IP PROBLEM ON CCR1072-1G-8S+
Hi All, Got a strange one. I have two CCR 1072's back to back with a short is run (1km or so) of single mode with two 10G SFP+ single mode. The SFP's and run has been previously used and again tested with Cisco equipment without fault. I have also used the same type of SFP+ with CCR1072's without fault. But except for this one setup. The problem is after a random period of time (minutes to hours) one of the CCR's stop's responding to IP. You cant Ping the CCR or connect to it locally. Console works and says all is fine but no bidirectional traffic over the interface. The exception to this is that CDP still seems to be working as you can see the broadcasts from the CCR on a dump at the other end of the link. You can also clear the arp cache at the other end and ping and the mac is re-learning indicating that something is still happening. The only fix appears to be a reboot. When the unit starts behaving normally again for a time. If you set the watchdog it happy reboots the CCR fixing the problem also. Tried 6.33.3 and also the latest RC no luck. My next move is to replace the hardware. But it's a very odd hardware fault has anyone else seen anything like this. Matt. -- /* Matt Perkins Direct 1300 137 379 Spectrum Networks Ptd. Ltd. Office 1300 133 299 matt@spectrum.com.au Level 6, 350 George Street Sydney 2000 Spectrum Networks is a member of the Communications Alliance & TIO */
Hi Matt, Have you tried netinstalling them? Several times I have had odd behaviour resolved with a netinstall. On 12/12/2015 5:11 pm, "Matt Perkins" <matt@spectrum.com.au> wrote:
Hi All, Got a strange one. I have two CCR 1072's back to back with a short is run (1km or so) of single mode with two 10G SFP+ single mode. The SFP's and run has been previously used and again tested with Cisco equipment without fault. I have also used the same type of SFP+ with CCR1072's without fault. But except for this one setup.
The problem is after a random period of time (minutes to hours) one of the CCR's stop's responding to IP. You cant Ping the CCR or connect to it locally. Console works and says all is fine but no bidirectional traffic over the interface. The exception to this is that CDP still seems to be working as you can see the broadcasts from the CCR on a dump at the other end of the link. You can also clear the arp cache at the other end and ping and the mac is re-learning indicating that something is still happening. The only fix appears to be a reboot. When the unit starts behaving normally again for a time. If you set the watchdog it happy reboots the CCR fixing the problem also.
Tried 6.33.3 and also the latest RC no luck. My next move is to replace the hardware. But it's a very odd hardware fault has anyone else seen anything like this.
Matt.
-- /* Matt Perkins Direct 1300 137 379 Spectrum Networks Ptd. Ltd. Office 1300 133 299 matt@spectrum.com.au Level 6, 350 George Street Sydney 2000 Spectrum Networks is a member of the Communications Alliance & TIO */
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
No but I will give it a go when I get it back in the office on Monday. Matt On 12/12/2015 3:24 PM, Andrew Thrift wrote:
Hi Matt,
Have you tried netinstalling them? Several times I have had odd behaviour resolved with a netinstall. On 12/12/2015 5:11 pm, "Matt Perkins" <matt@spectrum.com.au> wrote:
Hi All, Got a strange one. I have two CCR 1072's back to back with a short is run (1km or so) of single mode with two 10G SFP+ single mode. The SFP's and run has been previously used and again tested with Cisco equipment without fault. I have also used the same type of SFP+ with CCR1072's without fault. But except for this one setup.
The problem is after a random period of time (minutes to hours) one of the CCR's stop's responding to IP. You cant Ping the CCR or connect to it locally. Console works and says all is fine but no bidirectional traffic over the interface. The exception to this is that CDP still seems to be working as you can see the broadcasts from the CCR on a dump at the other end of the link. You can also clear the arp cache at the other end and ping and the mac is re-learning indicating that something is still happening. The only fix appears to be a reboot. When the unit starts behaving normally again for a time. If you set the watchdog it happy reboots the CCR fixing the problem also.
Tried 6.33.3 and also the latest RC no luck. My next move is to replace the hardware. But it's a very odd hardware fault has anyone else seen anything like this.
Matt.
-- /* Matt Perkins Direct 1300 137 379 Spectrum Networks Ptd. Ltd. Office 1300 133 299 matt@spectrum.com.au Level 6, 350 George Street Sydney 2000 Spectrum Networks is a member of the Communications Alliance & TIO */
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
-- /* Matt Perkins Direct 1300 137 379 Spectrum Networks Ptd. Ltd. Office 1300 133 299 matt@spectrum.com.au Level 6, 350 George Street Sydney 2000 Spectrum Networks is a member of the Communications Alliance & TIO */
Hi Matt, What about interface down/up when it happens - would it restore the problem? Also, is it just one one port, or any/all? Please try to get a spout file when the problem happens (before reboot) then send to support@duztel.com for review. It might be one that needs to do to MT for attention! :-} Cheers, Mike. -----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Matt Perkins Sent: Saturday, 12 December 2015 3:09 PM To: MikroTik Australia Public List <public@talk.mikrotik.com.au> Subject: [MT-AU Public] IP PROBLEM ON CCR1072-1G-8S+ Hi All, Got a strange one. I have two CCR 1072's back to back with a short is run (1km or so) of single mode with two 10G SFP+ single mode. The SFP's and run has been previously used and again tested with Cisco equipment without fault. I have also used the same type of SFP+ with CCR1072's without fault. But except for this one setup. The problem is after a random period of time (minutes to hours) one of the CCR's stop's responding to IP. You cant Ping the CCR or connect to it locally. Console works and says all is fine but no bidirectional traffic over the interface. The exception to this is that CDP still seems to be working as you can see the broadcasts from the CCR on a dump at the other end of the link. You can also clear the arp cache at the other end and ping and the mac is re-learning indicating that something is still happening. The only fix appears to be a reboot. When the unit starts behaving normally again for a time. If you set the watchdog it happy reboots the CCR fixing the problem also. Tried 6.33.3 and also the latest RC no luck. My next move is to replace the hardware. But it's a very odd hardware fault has anyone else seen anything like this. Matt. -- /* Matt Perkins Direct 1300 137 379 Spectrum Networks Ptd. Ltd. Office 1300 133 299 matt@spectrum.com.au Level 6, 350 George Street Sydney 2000 Spectrum Networks is a member of the Communications Alliance & TIO */ _______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
Interface up/down doesn't restore. Nothing obvious in the supout. (i will send it over) I have not had a chance to try another port will do that when i get it in the office Monday. FYI config consists of default config ip address on SFP+ interface default route password set Nothing else changed from defaults. Matt On 12/12/2015 3:52 PM, Mike Everest wrote:
Hi Matt,
What about interface down/up when it happens - would it restore the problem? Also, is it just one one port, or any/all?
Please try to get a spout file when the problem happens (before reboot) then send to support@duztel.com for review. It might be one that needs to do to MT for attention! :-}
Cheers, Mike.
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Matt Perkins Sent: Saturday, 12 December 2015 3:09 PM To: MikroTik Australia Public List <public@talk.mikrotik.com.au> Subject: [MT-AU Public] IP PROBLEM ON CCR1072-1G-8S+
Hi All, Got a strange one. I have two CCR 1072's back to back with a short is run (1km or so) of single mode with two 10G SFP+ single mode. The SFP's and run has been previously used and again tested with Cisco equipment without fault. I have also used the same type of SFP+ with CCR1072's without fault. But except for this one setup.
The problem is after a random period of time (minutes to hours) one of the CCR's stop's responding to IP. You cant Ping the CCR or connect to it locally. Console works and says all is fine but no bidirectional traffic over the interface. The exception to this is that CDP still seems to be working as you can see the broadcasts from the CCR on a dump at the other end of the link. You can also clear the arp cache at the other end and ping and the mac is re-learning indicating that something is still happening. The only fix appears to be a reboot. When the unit starts behaving normally again for a time. If you set the watchdog it happy reboots the CCR fixing the problem also.
Tried 6.33.3 and also the latest RC no luck. My next move is to replace the hardware. But it's a very odd hardware fault has anyone else seen anything like this.
Matt.
-- /* Matt Perkins Direct 1300 137 379 Spectrum Networks Ptd. Ltd. Office 1300 133 299 matt@spectrum.com.au Level 6, 350 George Street Sydney 2000 Spectrum Networks is a member of the Communications Alliance & TIO */
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
-- /* Matt Perkins Direct 1300 137 379 Spectrum Networks Ptd. Ltd. Office 1300 133 299 matt@spectrum.com.au Level 6, 350 George Street Sydney 2000 Spectrum Networks is a member of the Communications Alliance & TIO */
Hi Matt,
What about interface down/up when it happens - would it restore the
Spout is more about checking other router state info, like interface packet stats and error countsthatscwhy we need a spout taken when the problem is active :) Cheers! Mike. -----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Matt Perkins Sent: Saturday, 12 December 2015 3:58 PM To: public@talk.mikrotik.com.au Subject: Re: [MT-AU Public] IP PROBLEM ON CCR1072-1G-8S+ Interface up/down doesn't restore. Nothing obvious in the supout. (i will send it over) I have not had a chance to try another port will do that when i get it in the office Monday. FYI config consists of default config ip address on SFP+ interface default route password set Nothing else changed from defaults. Matt On 12/12/2015 3:52 PM, Mike Everest wrote: problem?
Also, is it just one one port, or any/all?
Please try to get a spout file when the problem happens (before reboot) then send to support@duztel.com for review. It might be one that needs to do to MT for attention! :-}
Cheers, Mike.
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Matt Perkins Sent: Saturday, 12 December 2015 3:09 PM To: MikroTik Australia Public List <public@talk.mikrotik.com.au> Subject: [MT-AU Public] IP PROBLEM ON CCR1072-1G-8S+
Hi All, Got a strange one. I have two CCR 1072's back to back with a short is run (1km or so) of single mode with two 10G SFP+ single mode. The SFP's and run has been previously used and again tested with Cisco equipment without fault. I have also used the same type of SFP+ with CCR1072's without fault. But except for this one setup.
The problem is after a random period of time (minutes to hours) one of the CCR's stop's responding to IP. You cant Ping the CCR or connect to it locally. Console works and says all is fine but no bidirectional traffic over the interface. The exception to this is that CDP still seems to be working as you can see the broadcasts from the CCR on a dump at the other end of the link. You can also clear the arp cache at the other end and ping and the mac is re-learning indicating that something is still happening. The only fix appears to be a reboot. When the unit starts behaving normally again for a time. If you set the watchdog it happy reboots the CCR fixing the problem also.
Tried 6.33.3 and also the latest RC no luck. My next move is to replace the hardware. But it's a very odd hardware fault has anyone else seen anything like this.
Matt.
-- /* Matt Perkins Direct 1300 137 379 Spectrum Networks Ptd. Ltd. Office 1300 133 299 matt@spectrum.com.au Level 6, 350 George Street Sydney 2000 Spectrum Networks is a member of the Communications Alliance & TIO */
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com. au
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com. au
-- /* Matt Perkins Direct 1300 137 379 Spectrum Networks Ptd. Ltd. Office 1300 133 299 matt@spectrum.com.au Level 6, 350 George Street Sydney 2000 Spectrum Networks is a member of the Communications Alliance & TIO */ _______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
Supout is one generated while in the fault state. Might yield something. Here's hoping it's a by of strange one. Matt -- /* Matt Perkins Direct 1300 137 379 Spectrum Networks Ptd. Ltd. Office 1300 133 299 matt@spectrum.com.au Fax 1300 133 255 Level 6, 350 George Street Sydney 2000 SIP 1300137379@sip.spectrum.com.au Google Talk MattAPerkins@gmail.com PGP/GNUPG Public Key can be found at http://pgp.mit.edu */
On 12 Dec 2015, at 4:25 PM, Mike Everest <mike@duxtel.com> wrote:
Spout is more about checking other router state info, like interface packet stats and error countsthatscwhy we need a spout taken when the problem is active :)
Cheers! Mike.
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Matt Perkins Sent: Saturday, 12 December 2015 3:58 PM To: public@talk.mikrotik.com.au Subject: Re: [MT-AU Public] IP PROBLEM ON CCR1072-1G-8S+
Interface up/down doesn't restore. Nothing obvious in the supout. (i will send it over) I have not had a chance to try another port will do that when i get it in the office Monday.
FYI config consists of
default config ip address on SFP+ interface default route password set Nothing else changed from defaults.
Matt
On 12/12/2015 3:52 PM, Mike Everest wrote: Hi Matt,
What about interface down/up when it happens - would it restore the problem? Also, is it just one one port, or any/all?
Please try to get a spout file when the problem happens (before reboot) then send to support@duztel.com for review. It might be one that needs to do to MT for attention! :-}
Cheers, Mike.
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Matt Perkins Sent: Saturday, 12 December 2015 3:09 PM To: MikroTik Australia Public List <public@talk.mikrotik.com.au> Subject: [MT-AU Public] IP PROBLEM ON CCR1072-1G-8S+
Hi All, Got a strange one. I have two CCR 1072's back to back with a short is run (1km or so) of single mode with two 10G SFP+ single mode. The SFP's and run has been previously used and again tested with Cisco equipment without fault. I have also used the same type of SFP+ with CCR1072's without fault. But except for this one setup.
The problem is after a random period of time (minutes to hours) one of the CCR's stop's responding to IP. You cant Ping the CCR or connect to it locally. Console works and says all is fine but no bidirectional traffic over the interface. The exception to this is that CDP still seems to be working as you can see the broadcasts from the CCR on a dump at the other end of the link. You can also clear the arp cache at the other end and ping and the mac is re-learning indicating that something is still happening. The only fix appears to be a reboot. When the unit starts behaving normally again for a time. If you set the watchdog it happy reboots the CCR fixing the problem also.
Tried 6.33.3 and also the latest RC no luck. My next move is to replace the hardware. But it's a very odd hardware fault has anyone else seen anything like this.
Matt.
-- /* Matt Perkins Direct 1300 137 379 Spectrum Networks Ptd. Ltd. Office 1300 133 299 matt@spectrum.com.au Level 6, 350 George Street Sydney 2000 Spectrum Networks is a member of the Communications Alliance & TIO */
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com. au
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com. au
-- /* Matt Perkins Direct 1300 137 379 Spectrum Networks Ptd. Ltd. Office 1300 133 299 matt@spectrum.com.au Level 6, 350 George Street Sydney 2000 Spectrum Networks is a member of the Communications Alliance & TIO */
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
participants (3)
-
Andrew Thrift -
Matt Perkins -
Mike Everest