Hi Mikrotikians, Have embarked upon a grand adventure to build a multiple 10Gbps machine on R/OS and hit a snag ... The 24 hours have expired on the R/OS test and I need to add the KEY to the USB image to get the machine up and running. How to do that? -- http://about.me/terry.sweetser
Hi Terry, As per direct email ;) For benefit of others (in case you are interested) the netinstall interface allows you to set a key to install as well as keep the original configuration. Since this list does not allow mime emails, refer to the doco here for more detail :) http://wiki.mikrotik.com/wiki/Manual:Netinstall Cheers! Mike. Ps: for those fellow Victorians, enjoy your 'day off', thanks to a whim of our fearless leader/premier! :-) For me, public holiday generally means I can come to the office in shorts and t shirt ;) -----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Terry Sweetser (SkyMesh) Sent: Friday, 2 October 2015 12:46 PM To: 'MikroTik Australia Public List' <public@talk.mikrotik.com.au> Subject: [MT-AU Public] X86 USB License Keys? Hi Mikrotikians, Have embarked upon a grand adventure to build a multiple 10Gbps machine on R/OS and hit a snag ... The 24 hours have expired on the R/OS test and I need to add the KEY to the USB image to get the machine up and running. How to do that? -- http://about.me/terry.sweetser _______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
Well ... I've overcome some odd problems over the last week with this ... I'm now running 6.33rc22 on a Dell R610 with the "newish" Intel 82599EB dual SFP+ card. Using traffic-generator, I can max out the I/O on that card at around 35 Gbps. (2 by 10Gbps ports, one of PCIe X8 bus.) The traffic generator partner is a CCR 36 core, both machines can happily generate 20Gbps of output, so 35Gbps full duplex succeeds. Nothing I tried under 6.31 would make above work, ever. Major bummer that I'm running RC software. BGP performance, which I'm testing now, is doing really well -- 650k routes updated is pushing one CPU up to max 50%. The X86 machine has 16 CPU 'threads' as it has 2 CPU packages, 4 cores each. RAM is cheap on this platform, max'ed to 96Gbytes. -- http://about.me/terry.sweetser On 02/10/15 12:46, Terry Sweetser (SkyMesh) wrote:
Hi Mikrotikians,
Have embarked upon a grand adventure to build a multiple 10Gbps machine on R/OS and hit a snag ...
The 24 hours have expired on the R/OS test and I need to add the KEY to the USB image to get the machine up and running.
How to do that?
Sounds like a beast !! -----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Terry Sweetser (SkyMesh) Sent: Friday, 16 October 2015 11:54 AM To: public@talk.mikrotik.com.au Subject: [MT-AU Public] X86 Well ... I've overcome some odd problems over the last week with this ... I'm now running 6.33rc22 on a Dell R610 with the "newish" Intel 82599EB dual SFP+ card. Using traffic-generator, I can max out the I/O on that card at around 35 Gbps. (2 by 10Gbps ports, one of PCIe X8 bus.) The traffic generator partner is a CCR 36 core, both machines can happily generate 20Gbps of output, so 35Gbps full duplex succeeds. Nothing I tried under 6.31 would make above work, ever. Major bummer that I'm running RC software. BGP performance, which I'm testing now, is doing really well -- 650k routes updated is pushing one CPU up to max 50%. The X86 machine has 16 CPU 'threads' as it has 2 CPU packages, 4 cores each. RAM is cheap on this platform, max'ed to 96Gbytes. -- http://about.me/terry.sweetser On 02/10/15 12:46, Terry Sweetser (SkyMesh) wrote:
Hi Mikrotikians,
Have embarked upon a grand adventure to build a multiple 10Gbps machine on R/OS and hit a snag ...
The 24 hours have expired on the R/OS test and I need to add the KEY to the USB image to get the machine up and running.
How to do that?
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
Question were you able to get above 1Gb single tcp stream on the CCR. When I was testing on my ccr36 I could never get a single tcp stream above 1Gb/s A -----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Paul Julian Sent: Friday, 16 October 2015 9:58 PM To: terry@skymesh.net.au; 'MikroTik Australia Public List' <public@talk.mikrotik.com.au> Subject: Re: [MT-AU Public] X86 Sounds like a beast !! -----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Terry Sweetser (SkyMesh) Sent: Friday, 16 October 2015 11:54 AM To: public@talk.mikrotik.com.au Subject: [MT-AU Public] X86 Well ... I've overcome some odd problems over the last week with this ... I'm now running 6.33rc22 on a Dell R610 with the "newish" Intel 82599EB dual SFP+ card. Using traffic-generator, I can max out the I/O on that card at around 35 Gbps. (2 by 10Gbps ports, one of PCIe X8 bus.) The traffic generator partner is a CCR 36 core, both machines can happily generate 20Gbps of output, so 35Gbps full duplex succeeds. Nothing I tried under 6.31 would make above work, ever. Major bummer that I'm running RC software. BGP performance, which I'm testing now, is doing really well -- 650k routes updated is pushing one CPU up to max 50%. The X86 machine has 16 CPU 'threads' as it has 2 CPU packages, 4 cores each. RAM is cheap on this platform, max'ed to 96Gbytes. -- http://about.me/terry.sweetser On 02/10/15 12:46, Terry Sweetser (SkyMesh) wrote:
Hi Mikrotikians,
Have embarked upon a grand adventure to build a multiple 10Gbps machine on R/OS and hit a snag ...
The 24 hours have expired on the R/OS test and I need to add the KEY to the USB image to get the machine up and running.
How to do that?
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au _______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
I'm going to run tests today on the CCR with R/OS v6.31.2 --- http://about.me/terry.sweetser On 17/10/15 06:45, Alex Samad - Yieldbroker wrote:
Question were you able to get above 1Gb single tcp stream on the CCR.
When I was testing on my ccr36 I could never get a single tcp stream above 1Gb/s
http://forum.mikrotik.com/viewtopic.php?t=62377 --- http://about.me/terry.sweetser On 17/10/15 06:45, Alex Samad - Yieldbroker wrote:
Question were you able to get above 1Gb single tcp stream on the CCR.
When I was testing on my ccr36 I could never get a single tcp stream above 1Gb/s
A
Hi So was that a yes or no http://forum.mikrotik.com/viewtopic.php?f=2&t=82359 << this is a thread I started, I have read other threads about it. Seems to be based around the fact the CCR code base it not multi threaded another example being the BGP as for http://forum.mikrotik.com/viewtopic.php?t=62377 not sure what I was supposed to get from that, those where not CCR's sorry maybe im missing something ? A -----Original Message----- From: Terry Sweetser (SkyMesh) [mailto:terry+mikrotik@skymesh.net.au] Sent: Tuesday, 20 October 2015 1:28 PM To: Alex Samad - Yieldbroker <Alex.Samad@yieldbroker.com>; MikroTik Australia Public List <public@talk.mikrotik.com.au> Subject: Re: [MT-AU Public] X86 http://forum.mikrotik.com/viewtopic.php?t=62377 --- http://about.me/terry.sweetser On 17/10/15 06:45, Alex Samad - Yieldbroker wrote:
Question were you able to get above 1Gb single tcp stream on the CCR.
When I was testing on my ccr36 I could never get a single tcp stream above 1Gb/s
A
What routerOS version shows that behaviour? I know that there has been a heap of work done on multi-core queue architecture since around 6.20 to 6.28 - they claim enormous performance boost (like up to 15 times faster!) in high traffic situation. Also, make sure that your testing methodology does not introduce some limitation. Btest, for example, is limited to 1 cpu, so if your btest client pegs a CPU, it is not necessarily indicative of a limitation with routing ;-) Cheers! Mike.
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Alex Samad - Yieldbroker Sent: Tuesday, 20 October 2015 2:36 PM To: terry@skymesh.net.au; MikroTik Australia Public List <public@talk.mikrotik.com.au> Subject: Re: [MT-AU Public] X86
Hi
So was that a yes or no
http://forum.mikrotik.com/viewtopic.php?f=2&t=82359 << this is a thread I started, I have read other threads about it. Seems to be based around the fact the CCR code base it not multi threaded another example being the BGP
as for http://forum.mikrotik.com/viewtopic.php?t=62377 not sure what I was supposed to get from that, those where not CCR's
sorry maybe im missing something ?
A
-----Original Message----- From: Terry Sweetser (SkyMesh) [mailto:terry+mikrotik@skymesh.net.au] Sent: Tuesday, 20 October 2015 1:28 PM To: Alex Samad - Yieldbroker <Alex.Samad@yieldbroker.com>; MikroTik Australia Public List <public@talk.mikrotik.com.au> Subject: Re: [MT-AU Public] X86
http://forum.mikrotik.com/viewtopic.php?t=62377
--- http://about.me/terry.sweetser
On 17/10/15 06:45, Alex Samad - Yieldbroker wrote:
Question were you able to get above 1Gb single tcp stream on the CCR.
When I was testing on my ccr36 I could never get a single tcp stream above 1Gb/s
A
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
Sorry didn't answer the question .. 6.29.1 A -----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Mike Everest Sent: Tuesday, 20 October 2015 2:46 PM To: 'MikroTik Australia Public List' <public@talk.mikrotik.com.au> Subject: Re: [MT-AU Public] X86 What routerOS version shows that behaviour? I know that there has been a heap of work done on multi-core queue architecture since around 6.20 to 6.28 - they claim enormous performance boost (like up to 15 times faster!) in high traffic situation. Also, make sure that your testing methodology does not introduce some limitation. Btest, for example, is limited to 1 cpu, so if your btest client pegs a CPU, it is not necessarily indicative of a limitation with routing ;-) Cheers! Mike.
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Alex Samad - Yieldbroker Sent: Tuesday, 20 October 2015 2:36 PM To: terry@skymesh.net.au; MikroTik Australia Public List <public@talk.mikrotik.com.au> Subject: Re: [MT-AU Public] X86
Hi
So was that a yes or no
http://forum.mikrotik.com/viewtopic.php?f=2&t=82359 << this is a thread I started, I have read other threads about it. Seems to be based around the fact the CCR code base it not multi threaded another example being the BGP
as for http://forum.mikrotik.com/viewtopic.php?t=62377 not sure what I was supposed to get from that, those where not CCR's
sorry maybe im missing something ?
A
-----Original Message----- From: Terry Sweetser (SkyMesh) [mailto:terry+mikrotik@skymesh.net.au] Sent: Tuesday, 20 October 2015 1:28 PM To: Alex Samad - Yieldbroker <Alex.Samad@yieldbroker.com>; MikroTik Australia Public List <public@talk.mikrotik.com.au> Subject: Re: [MT-AU Public] X86
http://forum.mikrotik.com/viewtopic.php?t=62377
--- http://about.me/terry.sweetser
On 17/10/15 06:45, Alex Samad - Yieldbroker wrote:
Question were you able to get above 1Gb single tcp stream on the CCR.
When I was testing on my ccr36 I could never get a single tcp stream above 1Gb/s
A
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com. au
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
Hi Guys, As far as the X86 BGP issue is concerned, the 1 core constraint appears to be in play even on 6.32rc but I did see the processing jump between cores, so it's not nailed to a core. On the CCR, I have _not_ been able to push the 36 core machine past 1Gbps on a single TCP connection. I'm trying "multi-queue-ethernet-default" on all of the ports now to see how that goes ... --- http://about.me/terry.sweetser On 20/10/15 13:46, Mike Everest wrote:
What routerOS version shows that behaviour? I know that there has been a heap of work done on multi-core queue architecture since around 6.20 to 6.28 - they claim enormous performance boost (like up to 15 times faster!) in high traffic situation.
Also, make sure that your testing methodology does not introduce some limitation. Btest, for example, is limited to 1 cpu, so if your btest client pegs a CPU, it is not necessarily indicative of a limitation with routing ;-)
Cheers!
Mike.
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Alex Samad - Yieldbroker Sent: Tuesday, 20 October 2015 2:36 PM To: terry@skymesh.net.au; MikroTik Australia Public List <public@talk.mikrotik.com.au> Subject: Re: [MT-AU Public] X86
Hi
So was that a yes or no
http://forum.mikrotik.com/viewtopic.php?f=2&t=82359 << this is a thread I started, I have read other threads about it. Seems to be based around the fact the CCR code base it not multi threaded another example being the BGP
as for http://forum.mikrotik.com/viewtopic.php?t=62377 not sure what I was supposed to get from that, those where not CCR's
sorry maybe im missing something ?
A
-----Original Message----- From: Terry Sweetser (SkyMesh) [mailto:terry+mikrotik@skymesh.net.au] Sent: Tuesday, 20 October 2015 1:28 PM To: Alex Samad - Yieldbroker <Alex.Samad@yieldbroker.com>; MikroTik Australia Public List <public@talk.mikrotik.com.au> Subject: Re: [MT-AU Public] X86
http://forum.mikrotik.com/viewtopic.php?t=62377
--- http://about.me/terry.sweetser
On 17/10/15 06:45, Alex Samad - Yieldbroker wrote:
Question were you able to get above 1Gb single tcp stream on the CCR.
When I was testing on my ccr36 I could never get a single tcp stream above 1Gb/s A
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
Hi Terry, 1. BGP updates - it is apparently routing table update that is the issue here. My understanding of the issue is that routing table can only be updated by one CPU because of some kind of locking problem (as in 'problem to be solved' rather than 'something is broken' ;) 2. Please send description of your testing methodology to support@duxtel.com so that we can try to reproduce the issue and potentially escalate to MT. Cheers! Mike.
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Terry Sweetser (SkyMesh) Sent: Tuesday, 20 October 2015 2:58 PM To: public@talk.mikrotik.com.au Subject: Re: [MT-AU Public] X86
Hi Guys,
As far as the X86 BGP issue is concerned, the 1 core constraint appears to be in play even on 6.32rc but I did see the processing jump between cores, so it's not nailed to a core.
On the CCR, I have _not_ been able to push the 36 core machine past 1Gbps on a single TCP connection.
I'm trying "multi-queue-ethernet-default" on all of the ports now to see how that goes ...
--- http://about.me/terry.sweetser
On 20/10/15 13:46, Mike Everest wrote:
What routerOS version shows that behaviour? I know that there has been a heap of work done on multi-core queue architecture since around 6.20 to 6.28 - they claim enormous performance boost (like up to 15 times faster!) in high traffic situation.
Also, make sure that your testing methodology does not introduce some limitation. Btest, for example, is limited to 1 cpu, so if your btest client pegs a CPU, it is not necessarily indicative of a limitation with routing ;-)
Cheers!
Mike.
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Alex Samad - Yieldbroker Sent: Tuesday, 20 October 2015 2:36 PM To: terry@skymesh.net.au; MikroTik Australia Public List <public@talk.mikrotik.com.au> Subject: Re: [MT-AU Public] X86
Hi
So was that a yes or no
http://forum.mikrotik.com/viewtopic.php?f=2&t=82359 << this is a thread I started, I have read other threads about it. Seems to be based around the fact the CCR code base it not multi threaded another example being the BGP
as for http://forum.mikrotik.com/viewtopic.php?t=62377 not sure what I was supposed to get from that, those where not CCR's
sorry maybe im missing something ?
A
-----Original Message----- From: Terry Sweetser (SkyMesh) [mailto:terry+mikrotik@skymesh.net.au] Sent: Tuesday, 20 October 2015 1:28 PM To: Alex Samad - Yieldbroker <Alex.Samad@yieldbroker.com>; MikroTik Australia Public List <public@talk.mikrotik.com.au> Subject: Re: [MT-AU Public] X86
http://forum.mikrotik.com/viewtopic.php?t=62377
--- http://about.me/terry.sweetser
On 17/10/15 06:45, Alex Samad - Yieldbroker wrote:
Question were you able to get above 1Gb single tcp stream on the CCR.
When I was testing on my ccr36 I could never get a single tcp stream above 1Gb/s A
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com .au
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com. au
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
participants (4)
-
Alex Samad - Yieldbroker -
Mike Everest -
Paul Julian -
Terry Sweetser (SkyMesh)