@smalldave got the MultiNode TestKit up and running on my machine. Going to have it run the entire test suite overnight and see where it hangs. Do you think a visualizer for seeing which node failed which test and why would be helpful?
I don't have much free time right now, I've found some problems in specific areas eg. persistent actors with stashing. Akka.Persistence.TestKit is also fully operative, so it can be already used for custom Journal/SnapshotStore implementations.
I can set ignore flag on the few still failing tests (actually 10 out of 70-80 total) and push the persistence projects to upstream, so that anyone can start to experiment with them.
@Aaronontheweb I think a visualizer would be very helpful. Standard logging can be a bit overwhelming, there is so much going on. It would be great to be able to see the state of key actors in each remote / cluster node. Being able to watch the visualisation as multi-node tests were running would be a great feature.