I have been tasked with implementing an 'on the wire' monitoring solution for a large Hadoop installation. The source of data will be a combination of taps and SPANs throughout the environment. My team's usual charter is one of packet analysis and network performance analysis. Given the architecture of this implementation (and volume of data) raw packet analysis through tools like Wireshark and others is just not feasable.
What are my options?
We are looking to monitor things like:
-How is Scoop/JDBC working
-How is connectivity performance between the control tier and the data tier
-DNS is key to this implementation. Are network services responding in an appropriate manner?
While we will be installing the standard suite of monitoring tools; Ganglia and Nagios, we would like to have that external hard network data for validation of performance. Some of the tools we have experience with are CompuWare DCRUM/Dynatrace, NetScout, Network Instruments, Extrahop, and Riverbed.
What are your experiences?