We're running a MongoDB cluster up on EC2 and are experiencing the following error over and over again in our log files:
Assertion: 10429:setShardVersion failed! { "errmsg" : "exception: gotShardHost different than what i had before before
followed by info about all the existing shards and hosts. This problem happened after we tried connecting to the cluster from one of our staging machines using a newer version of the MongoDB client (1.8.2) while our existing server plus other clients are using 1.6.5. Call me crazy, but I would think that MongoDB should be able to recover from what appears to be a very simple mistake instead of crapping the bed like this. We are using the PHP drivers via Doctrine2.
Searching on the web, the only advice I see is "make sure you are running the same version of server and client" and we are indeed doing that. We've been trying to fix this going on 12 hours and nothing we have done is making a difference. Having parts of our web applications not working because of Mongo not responding without throwing this error is making some people anxious. ;))
Any suggestions on how recover from this would be greatly appreciated.