Hi all, Happy New Year BTW ! I am looking to put together a solution which we can provide as a diagnosis service for our customers to help them analyse what is happening on their Internet connection. There are a number of products which can give you information on such things like PfSense, Untangle, BandwidthD etc, but basically I am after something that can report things to the customer, or us actually so that we can then put together a report and recommendations. The sort of things we want to report on are: - Top talkers - Bandwidth used - Application usage We are not interested in tracking end user usage or anything, it's more just so that the customer knows what their Internet is getting used for and how much. I would really love to put this into a Mikrotik Routerboard but can't see how it's possible. I know we will need some type of proxy running like Squid or something, but it's the information gathering and reporting that are important. At this point my best solution seems to be a NUC running windows with Untangle on it and a mAP-2nD or something to redirect the traffic transparently to the NUC Proxy. Has anybody done a project like this before or does anybody have any better suggestions than what I am thinking of at the moment ? Thanks Paul
Perhaps you're better off using netflow to record the data, store it in a database, and query the database based on client IP to pull out the information you want... Mikrotk can send the data, at least, but not process it. Then you won't have issues with proxy servers. -----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Paul Julian Sent: Wednesday, 10 January 2018 10:51 AM To: public@talk.mikrotik.com.au Subject: [MT-AU Public] Internet Usage Reporting device Hi all, Happy New Year BTW ! I am looking to put together a solution which we can provide as a diagnosis service for our customers to help them analyse what is happening on their Internet connection. There are a number of products which can give you information on such things like PfSense, Untangle, BandwidthD etc, but basically I am after something that can report things to the customer, or us actually so that we can then put together a report and recommendations. The sort of things we want to report on are: - Top talkers - Bandwidth used - Application usage We are not interested in tracking end user usage or anything, it's more just so that the customer knows what their Internet is getting used for and how much. I would really love to put this into a Mikrotik Routerboard but can't see how it's possible. I know we will need some type of proxy running like Squid or something, but it's the information gathering and reporting that are important. At this point my best solution seems to be a NUC running windows with Untangle on it and a mAP-2nD or something to redirect the traffic transparently to the NUC Proxy. Has anybody done a project like this before or does anybody have any better suggestions than what I am thinking of at the moment ? Thanks Paul _______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
I would be willing to do that for sure, I suppose everything would probably be in Netflow data, it's just pulling it out and reporting on it. I did consider Netflow or Sflow but the reporting tools seemed a bit hard to find, whereas something that was more targeted at web filtering/proxy seemed to have more reporting options. Regards Paul -----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Philip Loenneker Sent: Wednesday, 10 January 2018 11:00 AM To: MikroTik Australia Public List Subject: Re: [MT-AU Public] Internet Usage Reporting device Perhaps you're better off using netflow to record the data, store it in a database, and query the database based on client IP to pull out the information you want... Mikrotk can send the data, at least, but not process it. Then you won't have issues with proxy servers. -----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Paul Julian Sent: Wednesday, 10 January 2018 10:51 AM To: public@talk.mikrotik.com.au Subject: [MT-AU Public] Internet Usage Reporting device Hi all, Happy New Year BTW ! I am looking to put together a solution which we can provide as a diagnosis service for our customers to help them analyse what is happening on their Internet connection. There are a number of products which can give you information on such things like PfSense, Untangle, BandwidthD etc, but basically I am after something that can report things to the customer, or us actually so that we can then put together a report and recommendations. The sort of things we want to report on are: - Top talkers - Bandwidth used - Application usage We are not interested in tracking end user usage or anything, it's more just so that the customer knows what their Internet is getting used for and how much. I would really love to put this into a Mikrotik Routerboard but can't see how it's possible. I know we will need some type of proxy running like Squid or something, but it's the information gathering and reporting that are important. At this point my best solution seems to be a NUC running windows with Untangle on it and a mAP-2nD or something to redirect the traffic transparently to the NUC Proxy. Has anybody done a project like this before or does anybody have any better suggestions than what I am thinking of at the moment ? Thanks Paul _______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au _______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
Manageengine have a free netflow analyser... I had a tinker with it a while back. But allowing users to only see their own data would be a challenge. -----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Paul Julian Sent: Wednesday, 10 January 2018 11:09 AM To: 'MikroTik Australia Public List' <public@talk.mikrotik.com.au> Subject: Re: [MT-AU Public] Internet Usage Reporting device I would be willing to do that for sure, I suppose everything would probably be in Netflow data, it's just pulling it out and reporting on it. I did consider Netflow or Sflow but the reporting tools seemed a bit hard to find, whereas something that was more targeted at web filtering/proxy seemed to have more reporting options. Regards Paul -----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Philip Loenneker Sent: Wednesday, 10 January 2018 11:00 AM To: MikroTik Australia Public List Subject: Re: [MT-AU Public] Internet Usage Reporting device Perhaps you're better off using netflow to record the data, store it in a database, and query the database based on client IP to pull out the information you want... Mikrotk can send the data, at least, but not process it. Then you won't have issues with proxy servers. -----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Paul Julian Sent: Wednesday, 10 January 2018 10:51 AM To: public@talk.mikrotik.com.au Subject: [MT-AU Public] Internet Usage Reporting device Hi all, Happy New Year BTW ! I am looking to put together a solution which we can provide as a diagnosis service for our customers to help them analyse what is happening on their Internet connection. There are a number of products which can give you information on such things like PfSense, Untangle, BandwidthD etc, but basically I am after something that can report things to the customer, or us actually so that we can then put together a report and recommendations. The sort of things we want to report on are: - Top talkers - Bandwidth used - Application usage We are not interested in tracking end user usage or anything, it's more just so that the customer knows what their Internet is getting used for and how much. I would really love to put this into a Mikrotik Routerboard but can't see how it's possible. I know we will need some type of proxy running like Squid or something, but it's the information gathering and reporting that are important. At this point my best solution seems to be a NUC running windows with Untangle on it and a mAP-2nD or something to redirect the traffic transparently to the NUC Proxy. Has anybody done a project like this before or does anybody have any better suggestions than what I am thinking of at the moment ? Thanks Paul _______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au _______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au _______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
Hi Philip, This isn't for users to access, we actually don't want to know individual usage, it's for a service for our customers so that when Telstra or somebody wants to sting them stupid money for excess usage or they just want to know where their Internet bandwidth is going we can provide them a report for a snapshot in time. It needs to just be summary information about usage, like top 10 IP's or websites, breakdown of types of usage like social media, email, general browsing etc Regards Paul -----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Philip Loenneker Sent: Wednesday, 10 January 2018 11:35 AM To: MikroTik Australia Public List Subject: Re: [MT-AU Public] Internet Usage Reporting device Manageengine have a free netflow analyser... I had a tinker with it a while back. But allowing users to only see their own data would be a challenge. -----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Paul Julian Sent: Wednesday, 10 January 2018 11:09 AM To: 'MikroTik Australia Public List' <public@talk.mikrotik.com.au> Subject: Re: [MT-AU Public] Internet Usage Reporting device I would be willing to do that for sure, I suppose everything would probably be in Netflow data, it's just pulling it out and reporting on it. I did consider Netflow or Sflow but the reporting tools seemed a bit hard to find, whereas something that was more targeted at web filtering/proxy seemed to have more reporting options. Regards Paul -----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Philip Loenneker Sent: Wednesday, 10 January 2018 11:00 AM To: MikroTik Australia Public List Subject: Re: [MT-AU Public] Internet Usage Reporting device Perhaps you're better off using netflow to record the data, store it in a database, and query the database based on client IP to pull out the information you want... Mikrotk can send the data, at least, but not process it. Then you won't have issues with proxy servers. -----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Paul Julian Sent: Wednesday, 10 January 2018 10:51 AM To: public@talk.mikrotik.com.au Subject: [MT-AU Public] Internet Usage Reporting device Hi all, Happy New Year BTW ! I am looking to put together a solution which we can provide as a diagnosis service for our customers to help them analyse what is happening on their Internet connection. There are a number of products which can give you information on such things like PfSense, Untangle, BandwidthD etc, but basically I am after something that can report things to the customer, or us actually so that we can then put together a report and recommendations. The sort of things we want to report on are: - Top talkers - Bandwidth used - Application usage We are not interested in tracking end user usage or anything, it's more just so that the customer knows what their Internet is getting used for and how much. I would really love to put this into a Mikrotik Routerboard but can't see how it's possible. I know we will need some type of proxy running like Squid or something, but it's the information gathering and reporting that are important. At this point my best solution seems to be a NUC running windows with Untangle on it and a mAP-2nD or something to redirect the traffic transparently to the NUC Proxy. Has anybody done a project like this before or does anybody have any better suggestions than what I am thinking of at the moment ? Thanks Paul _______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au _______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au _______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au _______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
You're looking for NTOP I think ? Works with Mikrotik Traffic Flow, we have it deployed at many locations. D On 10 January 2018 at 11:42, Paul Julian <paul@oxygennetworks.com.au> wrote:
Hi Philip,
This isn't for users to access, we actually don't want to know individual usage, it's for a service for our customers so that when Telstra or somebody wants to sting them stupid money for excess usage or they just want to know where their Internet bandwidth is going we can provide them a report for a snapshot in time.
It needs to just be summary information about usage, like top 10 IP's or websites, breakdown of types of usage like social media, email, general browsing etc
Regards Paul
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Philip Loenneker Sent: Wednesday, 10 January 2018 11:35 AM To: MikroTik Australia Public List Subject: Re: [MT-AU Public] Internet Usage Reporting device
Manageengine have a free netflow analyser... I had a tinker with it a while back. But allowing users to only see their own data would be a challenge.
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Paul Julian Sent: Wednesday, 10 January 2018 11:09 AM To: 'MikroTik Australia Public List' <public@talk.mikrotik.com.au> Subject: Re: [MT-AU Public] Internet Usage Reporting device
I would be willing to do that for sure, I suppose everything would probably be in Netflow data, it's just pulling it out and reporting on it.
I did consider Netflow or Sflow but the reporting tools seemed a bit hard to find, whereas something that was more targeted at web filtering/proxy seemed to have more reporting options.
Regards Paul
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Philip Loenneker Sent: Wednesday, 10 January 2018 11:00 AM To: MikroTik Australia Public List Subject: Re: [MT-AU Public] Internet Usage Reporting device
Perhaps you're better off using netflow to record the data, store it in a database, and query the database based on client IP to pull out the information you want... Mikrotk can send the data, at least, but not process it. Then you won't have issues with proxy servers.
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Paul Julian Sent: Wednesday, 10 January 2018 10:51 AM To: public@talk.mikrotik.com.au Subject: [MT-AU Public] Internet Usage Reporting device
Hi all,
Happy New Year BTW !
I am looking to put together a solution which we can provide as a diagnosis service for our customers to help them analyse what is happening on their Internet connection. There are a number of products which can give you information on such things like PfSense, Untangle, BandwidthD etc, but basically I am after something that can report things to the customer, or us actually so that we can then put together a report and recommendations.
The sort of things we want to report on are: - Top talkers - Bandwidth used - Application usage
We are not interested in tracking end user usage or anything, it's more just so that the customer knows what their Internet is getting used for and how much.
I would really love to put this into a Mikrotik Routerboard but can't see how it's possible. I know we will need some type of proxy running like Squid or something, but it's the information gathering and reporting that are important.
At this point my best solution seems to be a NUC running windows with Untangle on it and a mAP-2nD or something to redirect the traffic transparently to the NUC Proxy.
Has anybody done a project like this before or does anybody have any better suggestions than what I am thinking of at the moment ?
Thanks Paul _______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
-- *Denis Hancock* Chief Technical Officer / Director Helpdesk 1300 139 593 <1300139593> Mobile 0407 687 621 <0407687621> Member AISA OWASP VIC Unit 15, 5 Enterprise Drive, Rowville 3178 <https://goo.gl/maps/HGmhhNncEF12> QLD (Arcare) 14/8 Metroplex Ave, Murrarie 4172 <https://goo.gl/maps/dfeKUES6NbD2> <https://samurai.com.au> <https://www.facebook.com/samuraiconsulting.melbourne> <https://au.linkedin.com/in/denishancock> This email is intended only for the addresses(s) and is subject to copyright. If you have received this email in error, please notify the sender immediately, do not use or disclose the contents and delete the message and any attachments to this email. We cannot accept any liability for any loss or damage caused by software viruses.
+1 for NTOP - Works well. ________________________________ From: Denis Hancock [mailto:denis.hancock@samurai.com.au] Sent: January 10, 2018 at 10:56:55 AM GMT+10 To: MikroTik Australia Public List <public@talk.mikrotik.com.au<mailto:public@talk.mikrotik.com.au>> Subject: Re: [MT-AU Public] Internet Usage Reporting device You're looking for NTOP I think ? Works with Mikrotik Traffic Flow, we have it deployed at many locations. D On 10 January 2018 at 11:42, Paul Julian <paul@oxygennetworks.com.au<mailto:paul@oxygennetworks.com.au>> wrote: Hi Philip, This isn't for users to access, we actually don't want to know individual usage, it's for a service for our customers so that when Telstra or somebody wants to sting them stupid money for excess usage or they just want to know where their Internet bandwidth is going we can provide them a report for a snapshot in time. It needs to just be summary information about usage, like top 10 IP's or websites, breakdown of types of usage like social media, email, general browsing etc Regards Paul -----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Philip Loenneker Sent: Wednesday, 10 January 2018 11:35 AM To: MikroTik Australia Public List Subject: Re: [MT-AU Public] Internet Usage Reporting device Manageengine have a free netflow analyser... I had a tinker with it a while back. But allowing users to only see their own data would be a challenge. -----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Paul Julian Sent: Wednesday, 10 January 2018 11:09 AM To: 'MikroTik Australia Public List' <public@talk.mikrotik.com.au<mailto:public@talk.mikrotik.com.au>> Subject: Re: [MT-AU Public] Internet Usage Reporting device I would be willing to do that for sure, I suppose everything would probably be in Netflow data, it's just pulling it out and reporting on it. I did consider Netflow or Sflow but the reporting tools seemed a bit hard to find, whereas something that was more targeted at web filtering/proxy seemed to have more reporting options. Regards Paul -----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Philip Loenneker Sent: Wednesday, 10 January 2018 11:00 AM To: MikroTik Australia Public List Subject: Re: [MT-AU Public] Internet Usage Reporting device Perhaps you're better off using netflow to record the data, store it in a database, and query the database based on client IP to pull out the information you want... Mikrotk can send the data, at least, but not process it. Then you won't have issues with proxy servers. -----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Paul Julian Sent: Wednesday, 10 January 2018 10:51 AM To: public@talk.mikrotik.com.au<mailto:public@talk.mikrotik.com.au> Subject: [MT-AU Public] Internet Usage Reporting device Hi all, Happy New Year BTW ! I am looking to put together a solution which we can provide as a diagnosis service for our customers to help them analyse what is happening on their Internet connection. There are a number of products which can give you information on such things like PfSense, Untangle, BandwidthD etc, but basically I am after something that can report things to the customer, or us actually so that we can then put together a report and recommendations. The sort of things we want to report on are: - Top talkers - Bandwidth used - Application usage We are not interested in tracking end user usage or anything, it's more just so that the customer knows what their Internet is getting used for and how much. I would really love to put this into a Mikrotik Routerboard but can't see how it's possible. I know we will need some type of proxy running like Squid or something, but it's the information gathering and reporting that are important. At this point my best solution seems to be a NUC running windows with Untangle on it and a mAP-2nD or something to redirect the traffic transparently to the NUC Proxy. Has anybody done a project like this before or does anybody have any better suggestions than what I am thinking of at the moment ? Thanks Paul _______________________________________________ Public mailing list Public@talk.mikrotik.com.au<mailto:Public@talk.mikrotik.com.au> http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au _______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au _______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au _______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au _______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au -- *Denis Hancock* Chief Technical Officer / Director Helpdesk 1300 139 593 <1300139593> Mobile 0407 687 621 <0407687621> Member AISA OWASP VIC Unit 15, 5 Enterprise Drive, Rowville 3178 <https://goo.gl/maps/HGmhhNncEF12> QLD (Arcare) 14/8 Metroplex Ave, Murrarie 4172 <https://goo.gl/maps/dfeKUES6NbD2> <https://samurai.com.au> <https://www.facebook.com/samuraiconsulting.melbourne> <https://au.linkedin.com/in/denishancock> This email is intended only for the addresses(s) and is subject to copyright. If you have received this email in error, please notify the sender immediately, do not use or disclose the contents and delete the message and any attachments to this email. We cannot accept any liability for any loss or damage caused by software viruses. _______________________________________________ Public mailing list Public@talk.mikrotik.com.au<mailto:Public@talk.mikrotik.com.au> http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
Ntopng is the latest version of ntop, and yes I am considering that as an option as well, I am actually going to build a box to see what the new version looks like as the old version wasn't able to give me all that I wanted. Have you used the newer version ? any thoughts ? Thanks for the suggestion Regards Paul -----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Denis Hancock Sent: Wednesday, 10 January 2018 11:57 AM To: MikroTik Australia Public List Subject: Re: [MT-AU Public] Internet Usage Reporting device You're looking for NTOP I think ? Works with Mikrotik Traffic Flow, we have it deployed at many locations. D On 10 January 2018 at 11:42, Paul Julian <paul@oxygennetworks.com.au> wrote:
Hi Philip,
This isn't for users to access, we actually don't want to know individual usage, it's for a service for our customers so that when Telstra or somebody wants to sting them stupid money for excess usage or they just want to know where their Internet bandwidth is going we can provide them a report for a snapshot in time.
It needs to just be summary information about usage, like top 10 IP's or websites, breakdown of types of usage like social media, email, general browsing etc
Regards Paul
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Philip Loenneker Sent: Wednesday, 10 January 2018 11:35 AM To: MikroTik Australia Public List Subject: Re: [MT-AU Public] Internet Usage Reporting device
Manageengine have a free netflow analyser... I had a tinker with it a while back. But allowing users to only see their own data would be a challenge.
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Paul Julian Sent: Wednesday, 10 January 2018 11:09 AM To: 'MikroTik Australia Public List' <public@talk.mikrotik.com.au> Subject: Re: [MT-AU Public] Internet Usage Reporting device
I would be willing to do that for sure, I suppose everything would probably be in Netflow data, it's just pulling it out and reporting on it.
I did consider Netflow or Sflow but the reporting tools seemed a bit hard to find, whereas something that was more targeted at web filtering/proxy seemed to have more reporting options.
Regards Paul
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Philip Loenneker Sent: Wednesday, 10 January 2018 11:00 AM To: MikroTik Australia Public List Subject: Re: [MT-AU Public] Internet Usage Reporting device
Perhaps you're better off using netflow to record the data, store it in a database, and query the database based on client IP to pull out the information you want... Mikrotk can send the data, at least, but not process it. Then you won't have issues with proxy servers.
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Paul Julian Sent: Wednesday, 10 January 2018 10:51 AM To: public@talk.mikrotik.com.au Subject: [MT-AU Public] Internet Usage Reporting device
Hi all,
Happy New Year BTW !
I am looking to put together a solution which we can provide as a diagnosis service for our customers to help them analyse what is happening on their Internet connection. There are a number of products which can give you information on such things like PfSense, Untangle, BandwidthD etc, but basically I am after something that can report things to the customer, or us actually so that we can then put together a report and recommendations.
The sort of things we want to report on are: - Top talkers - Bandwidth used - Application usage
We are not interested in tracking end user usage or anything, it's more just so that the customer knows what their Internet is getting used for and how much.
I would really love to put this into a Mikrotik Routerboard but can't see how it's possible. I know we will need some type of proxy running like Squid or something, but it's the information gathering and reporting that are important.
At this point my best solution seems to be a NUC running windows with Untangle on it and a mAP-2nD or something to redirect the traffic transparently to the NUC Proxy.
Has anybody done a project like this before or does anybody have any better suggestions than what I am thinking of at the moment ?
Thanks Paul _______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com. au
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com. au
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com. au
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com. au
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com. au
-- *Denis Hancock* Chief Technical Officer / Director Helpdesk 1300 139 593 <1300139593> Mobile 0407 687 621 <0407687621> Member AISA OWASP VIC Unit 15, 5 Enterprise Drive, Rowville 3178 <https://goo.gl/maps/HGmhhNncEF12> QLD (Arcare) 14/8 Metroplex Ave, Murrarie 4172 <https://goo.gl/maps/dfeKUES6NbD2> <https://samurai.com.au> <https://www.facebook.com/samuraiconsulting.melbourne> <https://au.linkedin.com/in/denishancock> This email is intended only for the addresses(s) and is subject to copyright. If you have received this email in error, please notify the sender immediately, do not use or disclose the contents and delete the message and any attachments to this email. We cannot accept any liability for any loss or damage caused by software viruses. _______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
Sorry, only the original ... On 10 January 2018 at 12:04, Paul Julian <paul@oxygennetworks.com.au> wrote:
Ntopng is the latest version of ntop, and yes I am considering that as an option as well, I am actually going to build a box to see what the new version looks like as the old version wasn't able to give me all that I wanted.
Have you used the newer version ? any thoughts ?
Thanks for the suggestion
Regards Paul
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Denis Hancock Sent: Wednesday, 10 January 2018 11:57 AM To: MikroTik Australia Public List Subject: Re: [MT-AU Public] Internet Usage Reporting device
You're looking for NTOP I think ? Works with Mikrotik Traffic Flow, we have it deployed at many locations.
D
On 10 January 2018 at 11:42, Paul Julian <paul@oxygennetworks.com.au> wrote:
Hi Philip,
This isn't for users to access, we actually don't want to know individual usage, it's for a service for our customers so that when Telstra or somebody wants to sting them stupid money for excess usage or they just want to know where their Internet bandwidth is going we can provide them a report for a snapshot in time.
It needs to just be summary information about usage, like top 10 IP's or websites, breakdown of types of usage like social media, email, general browsing etc
Regards Paul
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Philip Loenneker Sent: Wednesday, 10 January 2018 11:35 AM To: MikroTik Australia Public List Subject: Re: [MT-AU Public] Internet Usage Reporting device
Manageengine have a free netflow analyser... I had a tinker with it a while back. But allowing users to only see their own data would be a challenge.
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Paul Julian Sent: Wednesday, 10 January 2018 11:09 AM To: 'MikroTik Australia Public List' <public@talk.mikrotik.com.au> Subject: Re: [MT-AU Public] Internet Usage Reporting device
I would be willing to do that for sure, I suppose everything would probably be in Netflow data, it's just pulling it out and reporting on it.
I did consider Netflow or Sflow but the reporting tools seemed a bit hard to find, whereas something that was more targeted at web filtering/proxy seemed to have more reporting options.
Regards Paul
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Philip Loenneker Sent: Wednesday, 10 January 2018 11:00 AM To: MikroTik Australia Public List Subject: Re: [MT-AU Public] Internet Usage Reporting device
Perhaps you're better off using netflow to record the data, store it in a database, and query the database based on client IP to pull out the information you want... Mikrotk can send the data, at least, but not process it. Then you won't have issues with proxy servers.
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Paul Julian Sent: Wednesday, 10 January 2018 10:51 AM To: public@talk.mikrotik.com.au Subject: [MT-AU Public] Internet Usage Reporting device
Hi all,
Happy New Year BTW !
I am looking to put together a solution which we can provide as a diagnosis service for our customers to help them analyse what is happening on their Internet connection. There are a number of products which can give you information on such things like PfSense, Untangle, BandwidthD etc, but basically I am after something that can report things to the customer, or us actually so that we can then put together a report and recommendations.
The sort of things we want to report on are: - Top talkers - Bandwidth used - Application usage
We are not interested in tracking end user usage or anything, it's more just so that the customer knows what their Internet is getting used for and how much.
I would really love to put this into a Mikrotik Routerboard but can't see how it's possible. I know we will need some type of proxy running like Squid or something, but it's the information gathering and reporting that are important.
At this point my best solution seems to be a NUC running windows with Untangle on it and a mAP-2nD or something to redirect the traffic transparently to the NUC Proxy.
Has anybody done a project like this before or does anybody have any better suggestions than what I am thinking of at the moment ?
Thanks Paul _______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com. au
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com. au
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com. au
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com. au
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com. au
--
*Denis Hancock* Chief Technical Officer / Director
Helpdesk 1300 139 593 <1300139593> Mobile 0407 687 621 <0407687621>
Member AISA OWASP
VIC Unit 15, 5 Enterprise Drive, Rowville 3178 <https://goo.gl/maps/HGmhhNncEF12> QLD (Arcare) 14/8 Metroplex Ave, Murrarie 4172 <https://goo.gl/maps/dfeKUES6NbD2>
<https://samurai.com.au> <https://www.facebook.com/samuraiconsulting.melbourne> <https://au.linkedin.com/in/denishancock>
This email is intended only for the addresses(s) and is subject to copyright. If you have received this email in error, please notify the sender immediately, do not use or disclose the contents and delete the message and any attachments to this email. We cannot accept any liability for any loss or damage caused by software viruses. _______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
-- *Denis Hancock* Chief Technical Officer / Director Helpdesk 1300 139 593 <1300139593> Mobile 0407 687 621 <0407687621> Member AISA OWASP VIC Unit 15, 5 Enterprise Drive, Rowville 3178 <https://goo.gl/maps/HGmhhNncEF12> QLD (Arcare) 14/8 Metroplex Ave, Murrarie 4172 <https://goo.gl/maps/dfeKUES6NbD2> <https://samurai.com.au> <https://www.facebook.com/samuraiconsulting.melbourne> <https://au.linkedin.com/in/denishancock> This email is intended only for the addresses(s) and is subject to copyright. If you have received this email in error, please notify the sender immediately, do not use or disclose the contents and delete the message and any attachments to this email. We cannot accept any liability for any loss or damage caused by software viruses.
Hi Paul, Have you considered traffic flow? (aka netflow) Alternatively, you can configure routerOS graphing of simple queues so that queue target address can be viewed from that named source IP - then you can use packet marking to make a different queue for different destination ports, dscp etc Cheers, Mike.
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Paul Julian Sent: Wednesday, 10 January 2018 10:51 AM To: public@talk.mikrotik.com.au Subject: [MT-AU Public] Internet Usage Reporting device
Hi all,
Happy New Year BTW !
I am looking to put together a solution which we can provide as a diagnosis service for our customers to help them analyse what is happening on their Internet connection. There are a number of products which can give you information on such things like PfSense, Untangle, BandwidthD etc, but basically I am after something that can report things to the customer, or us actually so that we can then put together a report and recommendations.
The sort of things we want to report on are: - Top talkers - Bandwidth used - Application usage
We are not interested in tracking end user usage or anything, it's more just so that the customer knows what their Internet is getting used for and how much.
I would really love to put this into a Mikrotik Routerboard but can't see how it's possible. I know we will need some type of proxy running like Squid or something, but it's the information gathering and reporting that are important.
At this point my best solution seems to be a NUC running windows with Untangle on it and a mAP-2nD or something to redirect the traffic transparently to the NUC Proxy.
Has anybody done a project like this before or does anybody have any better suggestions than what I am thinking of at the moment ?
Thanks Paul _______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
Thanks Mike, yes I have considered netflow, it's just finding a reasonable reporting tool that's a reasonable price too. I have considered the approach you suggest, in fact I did that for a client many years ago and it was pretty good actually, but I have been struggling to think of how I could work out top talkers and things like that. I thought I could put together address lists for such things and use various timeouts on the addresses to give me different timeframes, but then I would need to use some scripts or API to gather that info and work with it, so to do the basics would be pretty straightforward, but to get everything I need would be a bit messy in the end. Regards Paul -----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Mike Everest Sent: Wednesday, 10 January 2018 11:05 AM To: 'MikroTik Australia Public List' Subject: Re: [MT-AU Public] Internet Usage Reporting device Hi Paul, Have you considered traffic flow? (aka netflow) Alternatively, you can configure routerOS graphing of simple queues so that queue target address can be viewed from that named source IP - then you can use packet marking to make a different queue for different destination ports, dscp etc Cheers, Mike.
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Paul Julian Sent: Wednesday, 10 January 2018 10:51 AM To: public@talk.mikrotik.com.au Subject: [MT-AU Public] Internet Usage Reporting device
Hi all,
Happy New Year BTW !
I am looking to put together a solution which we can provide as a diagnosis service for our customers to help them analyse what is happening on their Internet connection. There are a number of products which can give you information on such things like PfSense, Untangle, BandwidthD etc, but basically I am after something that can report things to the customer, or us actually so that we can then put together a report and recommendations.
The sort of things we want to report on are: - Top talkers - Bandwidth used - Application usage
We are not interested in tracking end user usage or anything, it's more just so that the customer knows what their Internet is getting used for and how much.
I would really love to put this into a Mikrotik Routerboard but can't see how it's possible. I know we will need some type of proxy running like Squid or something, but it's the information gathering and reporting that are important.
At this point my best solution seems to be a NUC running windows with Untangle on it and a mAP-2nD or something to redirect the traffic transparently to the NUC Proxy.
Has anybody done a project like this before or does anybody have any better suggestions than what I am thinking of at the moment ?
Thanks Paul _______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com. au
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
I know you'd sooner drink battery acid but I suspect what you're after is something like the Deep Packet Analyser reporting in Ubiquity routers. I did see something about it on a web site the other day and I quickly moved to http://mikrotik.com to cleanse myself, I swear. On 10 January 2018 at 11:11, Paul Julian <paul@oxygennetworks.com.au> wrote:
Thanks Mike, yes I have considered netflow, it's just finding a reasonable reporting tool that's a reasonable price too.
I have considered the approach you suggest, in fact I did that for a client many years ago and it was pretty good actually, but I have been struggling to think of how I could work out top talkers and things like that. I thought I could put together address lists for such things and use various timeouts on the addresses to give me different timeframes, but then I would need to use some scripts or API to gather that info and work with it, so to do the basics would be pretty straightforward, but to get everything I need would be a bit messy in the end.
Regards Paul
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Mike Everest Sent: Wednesday, 10 January 2018 11:05 AM To: 'MikroTik Australia Public List' Subject: Re: [MT-AU Public] Internet Usage Reporting device
Hi Paul,
Have you considered traffic flow? (aka netflow)
Alternatively, you can configure routerOS graphing of simple queues so that queue target address can be viewed from that named source IP - then you can use packet marking to make a different queue for different destination ports, dscp etc
Cheers, Mike.
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Paul Julian Sent: Wednesday, 10 January 2018 10:51 AM To: public@talk.mikrotik.com.au Subject: [MT-AU Public] Internet Usage Reporting device
Hi all,
Happy New Year BTW !
I am looking to put together a solution which we can provide as a diagnosis service for our customers to help them analyse what is happening on their Internet connection. There are a number of products which can give you information on such things like PfSense, Untangle, BandwidthD etc, but basically I am after something that can report things to the customer, or us actually so that we can then put together a report and recommendations.
The sort of things we want to report on are: - Top talkers - Bandwidth used - Application usage
We are not interested in tracking end user usage or anything, it's more just so that the customer knows what their Internet is getting used for and how much.
I would really love to put this into a Mikrotik Routerboard but can't see how it's possible. I know we will need some type of proxy running like Squid or something, but it's the information gathering and reporting that are important.
At this point my best solution seems to be a NUC running windows with Untangle on it and a mAP-2nD or something to redirect the traffic transparently to the NUC Proxy.
Has anybody done a project like this before or does anybody have any better suggestions than what I am thinking of at the moment ?
Thanks Paul _______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com. au
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Paul Julian Sent: Wednesday, 10 January 2018 11:12 AM To: 'MikroTik Australia Public List' <public@talk.mikrotik.com.au> Subject: Re: [MT-AU Public] Internet Usage Reporting device
Thanks Mike, yes I have considered netflow, it's just finding a reasonable reporting tool that's a reasonable price too.
I have considered the approach you suggest, in fact I did that for a client many years ago and it was pretty good actually, but I have been struggling to think of how I could work out top talkers and things like that. I thought I could put together address lists for such things and use various timeouts on the addresses to give me different timeframes, but then I would need to use some scripts or API to gather that info and work with it, so to do the basics would be pretty straightforward, but to get everything I need would be a bit messy in the end.
Regards Paul
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Mike Everest Sent: Wednesday, 10 January 2018 11:05 AM To: 'MikroTik Australia Public List' Subject: Re: [MT-AU Public] Internet Usage Reporting device
Hi Paul,
Have you considered traffic flow? (aka netflow)
Alternatively, you can configure routerOS graphing of simple queues so
Did you consider the concept of using routerOS simple queues graphing? Cheers,.. that
queue target address can be viewed from that named source IP - then you can use packet marking to make a different queue for different destination ports, dscp etc
Cheers, Mike.
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Paul Julian Sent: Wednesday, 10 January 2018 10:51 AM To: public@talk.mikrotik.com.au Subject: [MT-AU Public] Internet Usage Reporting device
Hi all,
Happy New Year BTW !
I am looking to put together a solution which we can provide as a diagnosis service for our customers to help them analyse what is happening on their Internet connection. There are a number of products which can give you information on such things like PfSense, Untangle, BandwidthD etc, but basically I am after something that can report things to the customer, or us actually so that we can then put together a report and recommendations.
The sort of things we want to report on are: - Top talkers - Bandwidth used - Application usage
We are not interested in tracking end user usage or anything, it's more just so that the customer knows what their Internet is getting used for and how much.
I would really love to put this into a Mikrotik Routerboard but can't see how it's possible. I know we will need some type of proxy running like Squid or something, but it's the information gathering and reporting that are important.
At this point my best solution seems to be a NUC running windows with Untangle on it and a mAP-2nD or something to redirect the traffic transparently to the NUC Proxy.
Has anybody done a project like this before or does anybody have any better suggestions than what I am thinking of at the moment ?
Thanks Paul _______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com. au
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Paul Julian Sent: Wednesday, 10 January 2018 11:12 AM To: 'MikroTik Australia Public List' <public@talk.mikrotik.com.au> Subject: Re: [MT-AU Public] Internet Usage Reporting device
Thanks Mike, yes I have considered netflow, it's just finding a reasonable reporting tool that's a reasonable price too.
I have considered the approach you suggest, in fact I did that for a client many years ago and it was pretty good actually, but I have been struggling to think of how I could work out top talkers and things like that. I thought I could put together address lists for such things and use various timeouts on the addresses to give me different timeframes, but then I would need to use some scripts or API to gather that info and work with it, so to do the basics would be pretty straightforward, but to get everything I need would be a bit messy in the end.
Regards Paul
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Mike Everest Sent: Wednesday, 10 January 2018 11:05 AM To: 'MikroTik Australia Public List' Subject: Re: [MT-AU Public] Internet Usage Reporting device
Hi Paul,
Have you considered traffic flow? (aka netflow)
Alternatively, you can configure routerOS graphing of simple queues so
Yes, that's what I was referring to below, but the graphing is only one part really. Paul -----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Mike Everest Sent: Wednesday, 10 January 2018 4:53 PM To: 'MikroTik Australia Public List' Subject: Re: [MT-AU Public] Internet Usage Reporting device Did you consider the concept of using routerOS simple queues graphing? Cheers,.. that
queue target address can be viewed from that named source IP - then you can use packet marking to make a different queue for different destination ports, dscp etc
Cheers, Mike.
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Paul Julian Sent: Wednesday, 10 January 2018 10:51 AM To: public@talk.mikrotik.com.au Subject: [MT-AU Public] Internet Usage Reporting device
Hi all,
Happy New Year BTW !
I am looking to put together a solution which we can provide as a diagnosis service for our customers to help them analyse what is happening on their Internet connection. There are a number of products which can give you information on such things like PfSense, Untangle, BandwidthD etc, but basically I am after something that can report things to the customer, or us actually so that we can then put together a report and recommendations.
The sort of things we want to report on are: - Top talkers - Bandwidth used - Application usage
We are not interested in tracking end user usage or anything, it's more just so that the customer knows what their Internet is getting used for and how much.
I would really love to put this into a Mikrotik Routerboard but can't see how it's possible. I know we will need some type of proxy running like Squid or something, but it's the information gathering and reporting that are important.
At this point my best solution seems to be a NUC running windows with Untangle on it and a mAP-2nD or something to redirect the traffic transparently to the NUC Proxy.
Has anybody done a project like this before or does anybody have any better suggestions than what I am thinking of at the moment ?
Thanks Paul _______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com. au
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com. au
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com. au
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
participants (6)
-
Dave Browning -
Denis Hancock -
Jason Hecker (Up & Running Tech) -
Mike Everest -
Paul Julian -
Philip Loenneker