48 reputation
117
bio website sise.at
location Austria
age 27
visits member for 4 years, 6 months
seen Jun 3 at 6:52

Mar
20
comment How to duplicate TCP traffic to one or multiple remote servers for benchmarking purposes?
we did code our own logger and sender, but we could not reach the sending speed as the items are received. Therefore we could not compare the results. Afterwards we tried with two applications: one logging and then, separated from logging we did send it to benchmark the server. but this alternative did not deliver the desired results. we are working now with a combination of logger and using jemter to resend it afterwards. (one part of the jmeter requests are based on the recorded log files, additional scripts cover more complex requests and actions)
Mar
20
accepted How to duplicate TCP traffic to one or multiple remote servers for benchmarking purposes?
Feb
5
revised How to duplicate TCP traffic to one or multiple remote servers for benchmarking purposes?
added 623 characters in body
Feb
5
awarded  Editor
Feb
5
revised How to duplicate TCP traffic to one or multiple remote servers for benchmarking purposes?
added 2020 characters in body
Feb
5
comment How to duplicate TCP traffic to one or multiple remote servers for benchmarking purposes?
We have tried to get the twisted one going, but switched to regular python, because this was (in our opinion) more straight forward. i have attached the python script above. the only downside: because it is not transparent, it receives data and forwards it to 2 destinations (localhost:different port and remotehost:someport). if the script is malfunctioning, the traffic will be lost. so there needs to be some measures to switch ports, if script fails. that leaves the question: is there a way to make it transparent or do we have to go with a script which switches ports in case of malfunction?
Jan
31
comment How to duplicate TCP traffic to one or multiple remote servers for benchmarking purposes?
@Kazimieras Aliulis: that's definitely an alternative! i have never heard of it. but checking it out shows that it would fit perfectly to our purpose. We didn't consider python before, but currently we are looking at the Twisted framework and possibilities with general python as well. I will report back if we succeed!
Jan
30
awarded  Supporter
Jan
30
comment How to duplicate TCP traffic to one or multiple remote servers for benchmarking purposes?
yes, you are completely right, the agnoster duplicator tool would fit our requirements except of the multi port situation. Also the discarding of the responses of the test machine is fullfilled. To achieve our goal of simulating the real/live situation as accurately as possible we can't bundle all ports on the live server to one single port on the test machine. Different ports are used to divide client devices into different customers. Thereby, we have to open 60-70 sessions of this duplicator tool. This is not very practical as you can imagine.
Jan
30
comment How to duplicate TCP traffic to one or multiple remote servers for benchmarking purposes?
we have thought about that, I have read about the alternative of using SPAN. But, because the servers are located in a data center of a third party provider, we have limited possibilities when it comes to hardware changes. I have already requested to connect 2 servers on a second nic directly. This action combined with a local network for just these 2 servers would allow me to use IPTABLES with TEE. But to go for this alternative we would need to change the external IPs of the servers, which is a NoGo because client devices are configured to connect to the set IP.
Jan
30
comment How to duplicate TCP traffic to one or multiple remote servers for benchmarking purposes?
@Evan Anderson: duplication on HTTP level was our first idea as well, but e.g. apache proxy or similar tools or modules do not allow simultaneously process the requests locally and duplicating it to a remote host. if you have any other idea, please advice! :) we are preferring duplication over recording and replaying to get instant comparison results.
Jan
30
comment How to duplicate TCP traffic to one or multiple remote servers for benchmarking purposes?
@Kazimieras Aliulis: it is not required to communicate with two separate servers. the client is communicating with the primary server = the live server. the live server is processing the client requests and is answering the client. besides processing and answering to the client the primary server is duplicating the requests to the second server = testing server. the responses from the second server to the primary server will be discarded/ignored at the primary server and will not be forwarded to the client.
Jan
29
comment How to duplicate TCP traffic to one or multiple remote servers for benchmarking purposes?
yes, all of the traffic is HTTP.
Jan
29
asked How to duplicate TCP traffic to one or multiple remote servers for benchmarking purposes?
Apr
9
awarded  Popular Question
Feb
29
awarded  Famous Question
Sep
22
awarded  Notable Question
May
28
awarded  Popular Question
Mar
8
awarded  Student
Feb
17
awarded  Scholar