Hi I was looking forward to the CHR. Had budget to spend on the unlimited license. But I am bit let down by the initial numbers So ESX host. 3 vms Vm server A Vm server b Vm CHR Iperf -s -w 128M -I 10 Iperf -c <server ip> -w128M -I 10 A to B is [ 4] 0.0-10.0 sec 10.4 GBytes 8.96 Gbits/sec [ 4] 10.0-20.0 sec 11.7 GBytes 10.1 Gbits/sec [ 4] 20.0-30.0 sec 11.5 GBytes 9.89 Gbits/sec [ 4] 30.0-40.0 sec 11.6 GBytes 9.97 Gbits/sec [ 4] 40.0-50.0 sec 11.6 GBytes 9.99 Gbits/sec [ 4] 50.0-60.0 sec 11.7 GBytes 10.0 Gbits/sec [ 4] 60.0-70.0 sec 11.4 GBytes 9.79 Gbits/sec [ 4] 70.0-80.0 sec 11.7 GBytes 10.0 Gbits/sec [ 4] 80.0-90.0 sec 11.8 GBytes 10.1 Gbits/sec [ 4] 90.0-100.0 sec 11.6 GBytes 9.93 Gbits/sec [ 4] 100.0-110.0 sec 11.8 GBytes 10.1 Gbits/sec [ 4] 110.0-120.0 sec 11.7 GBytes 10.1 Gbits/sec [ 4] 120.0-130.0 sec 11.5 GBytes 9.90 Gbits/sec [ 4] 130.0-140.0 sec 11.5 GBytes 9.88 Gbits/sec [ 4] 140.0-150.0 sec 11.2 GBytes 9.63 Gbits/sec [ 4] 150.0-160.0 sec 11.7 GBytes 10.1 Gbits/sec [ 4] 160.0-170.0 sec 11.8 GBytes 10.1 Gbits/sec [ 4] 170.0-180.0 sec 10.2 GBytes 8.72 Gbits/sec [ 4] 180.0-190.0 sec 11.9 GBytes 10.2 Gbits/sec [ 4] 190.0-200.0 sec 11.7 GBytes 10.1 Gbits/sec Consistent 10Gb/s ... NO CHR A -> CHR -> B [SUM] 0.0-300.4 sec 70.5 GBytes 2.02 Gbits/sec Only 2Gb/s ... What am I missing and 100% cpu usage VM is 2 cpu 2G memory Vmxnet3 nics
Thanks for the detailed report Alex! :-) Did you provide that feedback to MikroTik yet? If not, I'm happy to forward on your behalf if you would like that? The limit is apparently CPU limit since routerOS /still/ allocates one CPU per data stream/connection. For CCR systems, the single stream limit is generally around 1.2 Gbps, so for a CPU that I assume is about double clock speed to CCR, 2gbps seems about right. Have you tried running with multiple data streams across that CHR instance? (as in '-P 2' with dual CPU, or '-P 4' for 4 CPUs, etc)? Cheers! Mike.
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Alex Samad - Yieldbroker Sent: Tuesday, 29 December 2015 11:14 AM To: public@talk.mikrotik.com.au Subject: [MT-AU Public] some quick tests on ESXi with CHR
Hi
I was looking forward to the CHR. Had budget to spend on the unlimited license. But I am bit let down by the initial numbers
So ESX host. 3 vms Vm server A Vm server b Vm CHR
Iperf -s -w 128M -I 10 Iperf -c <server ip> -w128M -I 10
A to B is [ 4] 0.0-10.0 sec 10.4 GBytes 8.96 Gbits/sec [ 4] 10.0-20.0 sec 11.7 GBytes 10.1 Gbits/sec [ 4] 20.0-30.0 sec 11.5 GBytes 9.89 Gbits/sec [ 4] 30.0-40.0 sec 11.6 GBytes 9.97 Gbits/sec [ 4] 40.0-50.0 sec 11.6 GBytes 9.99 Gbits/sec [ 4] 50.0-60.0 sec 11.7 GBytes 10.0 Gbits/sec [ 4] 60.0-70.0 sec 11.4 GBytes 9.79 Gbits/sec [ 4] 70.0-80.0 sec 11.7 GBytes 10.0 Gbits/sec [ 4] 80.0-90.0 sec 11.8 GBytes 10.1 Gbits/sec [ 4] 90.0-100.0 sec 11.6 GBytes 9.93 Gbits/sec [ 4] 100.0-110.0 sec 11.8 GBytes 10.1 Gbits/sec [ 4] 110.0-120.0 sec 11.7 GBytes 10.1 Gbits/sec [ 4] 120.0-130.0 sec 11.5 GBytes 9.90 Gbits/sec [ 4] 130.0-140.0 sec 11.5 GBytes 9.88 Gbits/sec [ 4] 140.0-150.0 sec 11.2 GBytes 9.63 Gbits/sec [ 4] 150.0-160.0 sec 11.7 GBytes 10.1 Gbits/sec [ 4] 160.0- 170.0 sec 11.8 GBytes 10.1 Gbits/sec [ 4] 170.0-180.0 sec 10.2 GBytes 8.72 Gbits/sec [ 4] 180.0-190.0 sec 11.9 GBytes 10.2 Gbits/sec [ 4] 190.0-200.0 sec 11.7 GBytes 10.1 Gbits/sec
Consistent 10Gb/s ... NO CHR
A -> CHR -> B
[SUM] 0.0-300.4 sec 70.5 GBytes 2.02 Gbits/sec
Only 2Gb/s ... What am I missing and 100% cpu usage VM is 2 cpu 2G memory Vmxnet3 nics
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
HI Yeah I have. But the thing is I have also tried this with a Centos VM in the middle instead of the CHR vm. Using vmxnet3 nics. And it doesn't chew through the CPU. I think Mikrotik/Ros still haven't applied the VMTools to the image.. Yep added it to the CHR thread on the forums page. A -----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Mike Everest Sent: Tuesday, 29 December 2015 11:52 AM To: 'MikroTik Australia Public List' <public@talk.mikrotik.com.au> Subject: Re: [MT-AU Public] some quick tests on ESXi with CHR Thanks for the detailed report Alex! :-) Did you provide that feedback to MikroTik yet? If not, I'm happy to forward on your behalf if you would like that? The limit is apparently CPU limit since routerOS /still/ allocates one CPU per data stream/connection. For CCR systems, the single stream limit is generally around 1.2 Gbps, so for a CPU that I assume is about double clock speed to CCR, 2gbps seems about right. Have you tried running with multiple data streams across that CHR instance? (as in '-P 2' with dual CPU, or '-P 4' for 4 CPUs, etc)? Cheers! Mike.
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Alex Samad - Yieldbroker Sent: Tuesday, 29 December 2015 11:14 AM To: public@talk.mikrotik.com.au Subject: [MT-AU Public] some quick tests on ESXi with CHR
Hi
I was looking forward to the CHR. Had budget to spend on the unlimited license. But I am bit let down by the initial numbers
So ESX host. 3 vms Vm server A Vm server b Vm CHR
Iperf -s -w 128M -I 10 Iperf -c <server ip> -w128M -I 10
A to B is [ 4] 0.0-10.0 sec 10.4 GBytes 8.96 Gbits/sec [ 4] 10.0-20.0 sec 11.7 GBytes 10.1 Gbits/sec [ 4] 20.0-30.0 sec 11.5 GBytes 9.89 Gbits/sec [ 4] 30.0-40.0 sec 11.6 GBytes 9.97 Gbits/sec [ 4] 40.0-50.0 sec 11.6 GBytes 9.99 Gbits/sec [ 4] 50.0-60.0 sec 11.7 GBytes 10.0 Gbits/sec [ 4] 60.0-70.0 sec 11.4 GBytes 9.79 Gbits/sec [ 4] 70.0-80.0 sec 11.7 GBytes 10.0 Gbits/sec [ 4] 80.0-90.0 sec 11.8 GBytes 10.1 Gbits/sec [ 4] 90.0-100.0 sec 11.6 GBytes 9.93 Gbits/sec [ 4] 100.0-110.0 sec 11.8 GBytes 10.1 Gbits/sec [ 4] 110.0-120.0 sec 11.7 GBytes 10.1 Gbits/sec [ 4] 120.0-130.0 sec 11.5 GBytes 9.90 Gbits/sec [ 4] 130.0-140.0 sec 11.5 GBytes 9.88 Gbits/sec [ 4] 140.0-150.0 sec 11.2 GBytes 9.63 Gbits/sec [ 4] 150.0-160.0 sec 11.7 GBytes 10.1 Gbits/sec [ 4] 160.0- 170.0 sec 11.8 GBytes 10.1 Gbits/sec [ 4] 170.0-180.0 sec 10.2 GBytes 8.72 Gbits/sec [ 4] 180.0-190.0 sec 11.9 GBytes 10.2 Gbits/sec [ 4] 190.0-200.0 sec 11.7 GBytes 10.1 Gbits/sec
Consistent 10Gb/s ... NO CHR
A -> CHR -> B
[SUM] 0.0-300.4 sec 70.5 GBytes 2.02 Gbits/sec
Only 2Gb/s ... What am I missing and 100% cpu usage VM is 2 cpu 2G memory Vmxnet3 nics
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com. au
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Alex Samad - Yieldbroker Sent: Tuesday, 29 December 2015 12:23 PM To: MikroTik Australia Public List <public@talk.mikrotik.com.au> Subject: Re: [MT-AU Public] some quick tests on ESXi with CHR
HI
Yeah I have. But the thing is I have also tried this with a Centos VM in
middle instead of the CHR vm. Using vmxnet3 nics. And it doesn't chew through the CPU.
I think Mikrotik/Ros still haven't applied the VMTools to the image..
Yep added it to the CHR thread on the forums page.
A
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Mike Everest Sent: Tuesday, 29 December 2015 11:52 AM To: 'MikroTik Australia Public List' <public@talk.mikrotik.com.au> Subject: Re: [MT-AU Public] some quick tests on ESXi with CHR
Thanks for the detailed report Alex! :-)
Did you provide that feedback to MikroTik yet? If not, I'm happy to forward on your behalf if you would like that?
The limit is apparently CPU limit since routerOS /still/ allocates one CPU
OK, thanks for the update! (watching with interest ;) Cheers! Mike. the per
data stream/connection. For CCR systems, the single stream limit is generally around 1.2 Gbps, so for a CPU that I assume is about double clock speed to CCR, 2gbps seems about right.
Have you tried running with multiple data streams across that CHR instance? (as in '-P 2' with dual CPU, or '-P 4' for 4 CPUs, etc)?
Cheers!
Mike.
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Alex Samad - Yieldbroker Sent: Tuesday, 29 December 2015 11:14 AM To: public@talk.mikrotik.com.au Subject: [MT-AU Public] some quick tests on ESXi with CHR
Hi
I was looking forward to the CHR. Had budget to spend on the unlimited license. But I am bit let down by the initial numbers
So ESX host. 3 vms Vm server A Vm server b Vm CHR
Iperf -s -w 128M -I 10 Iperf -c <server ip> -w128M -I 10
A to B is [ 4] 0.0-10.0 sec 10.4 GBytes 8.96 Gbits/sec [ 4] 10.0-20.0 sec 11.7 GBytes 10.1 Gbits/sec [ 4] 20.0-30.0 sec 11.5 GBytes 9.89 Gbits/sec [ 4] 30.0-40.0 sec 11.6 GBytes 9.97 Gbits/sec [ 4] 40.0-50.0 sec 11.6 GBytes 9.99 Gbits/sec [ 4] 50.0-60.0 sec 11.7 GBytes 10.0 Gbits/sec [ 4] 60.0-70.0 sec 11.4 GBytes 9.79 Gbits/sec [ 4] 70.0-80.0 sec 11.7 GBytes 10.0 Gbits/sec [ 4] 80.0-90.0 sec 11.8 GBytes 10.1 Gbits/sec [ 4] 90.0-100.0 sec 11.6 GBytes 9.93 Gbits/sec [ 4] 100.0-110.0 sec 11.8 GBytes 10.1 Gbits/sec [ 4] 110.0-120.0 sec 11.7 GBytes 10.1 Gbits/sec [ 4] 120.0-130.0 sec 11.5 GBytes 9.90 Gbits/sec [ 4] 130.0-140.0 sec 11.5 GBytes 9.88 Gbits/sec [ 4] 140.0-150.0 sec 11.2 GBytes 9.63 Gbits/sec [ 4] 150.0-160.0 sec 11.7 GBytes 10.1 Gbits/sec [ 4] 160.0- 170.0 sec 11.8 GBytes 10.1 Gbits/sec [ 4] 170.0-180.0 sec 10.2 GBytes 8.72 Gbits/sec [ 4] 180.0-190.0 sec 11.9 GBytes 10.2 Gbits/sec [ 4] 190.0-200.0 sec 11.7 GBytes 10.1 Gbits/sec
Consistent 10Gb/s ... NO CHR
A -> CHR -> B
[SUM] 0.0-300.4 sec 70.5 GBytes 2.02 Gbits/sec
Only 2Gb/s ... What am I missing and 100% cpu usage VM is 2 cpu 2G memory Vmxnet3 nics
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com. au
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
participants (2)
-
Alex Samad - Yieldbroker -
Mike Everest