I have looked around, but there doesn't seem to be anyone with the same problem.
I am getting almost no connection from my console (laptop) to one of my servers (Raspberry Pi 2 B) . All other devices connect to it fine.
Here are the specs of interest:
Laptop: Asus i7 Ubuntu Connected by wifi, which has no problem streaming netflix, so it is unlikely the cause.
Raspberry Pi connected by ethernet directly to router.
Connection from all other devices on the network to the server over iperf shows around 95Mbit/s
Connection from laptop over iperf ranges from 1 - 20 Kbit/s
Connection from the same laptop, with ethernet instead of wifi, 95Mbit/s (Trust me, I have ruled out the wifi as the issue, I can get fast connection speeds to all other servers over the same wifi using iperf.