VIP Member

User Tag List

Page 2 of 2 FirstFirst 12
Results 26 to 44 of 44

Thread: Unplanned outage

  1. #26
    Nexus's Avatar
    Nexus is offline Administrator
    Join Date
    Nov 2008
    Location
    Geelong
    Age
    44
    Posts
    1,443
    Blog Entries
    1

    Default

    Quote Originally Posted by Nexus View Post
    Major internet outage in QLD presently. You may see some browsing errors, however I'd expect should be minimal or negligable effect on ozmps.
    Outage has continued all day. Amazingly, despite it affecting Toowoomba, Mackay, Gladstone, Bundaberg and Maroochydore, ISP doesn't have a status or ETA for an actual fix. Apparently if you don't record it it didn't happen. In the meantime I'll expect the problems to continue until such time as I can see the connections are stable. For now QLD is back online. Affect on ozmps is likely to be short lived periods during which you may see a squid error message reporting source server unreachable. This will happen if the connection has come online, your browser is attempting to talk to QLD gateway, but the QLD gateway has not yet established communications with VIC which happens very shortly after the connection comes online.
    "Blue Meanie" 2007 Aurora Blue MPS 3 - 18x8.5+44 SSR GTX01 - 235/40R18 Federal RS-RR - 3.5" ETS TMIC - CPE stg 2 mount - HKS/CPE BPV - 2XS inlet - 2XS short shift - 2XS turbo manifold - Hypertech tune - Leather/Aluminium handbrake - Momo shifty knob - 7" touchscreen - JDM Mazda Retractable dashtop screen assembly - PC based GPS and instrumentation - 36AH reserve battery and C-TEK isolator - TEIN Street Advanced coilovers 1" drop - Superpro bushings - 220Kw/410Nm.

    "Lipstick" 2013 Velocity Red MPS 3 - 18x7.5+48 Enkei RPF1 -225/40R18 Federal RS-RR - CPE TMIC - COBB inlet - CPE stg 2 mount - COBB Stage 1 98 octane tune - COBB shifty knob - 2XS short shift.

  2. #27
    Nexus's Avatar
    Nexus is offline Administrator
    Join Date
    Nov 2008
    Location
    Geelong
    Age
    44
    Posts
    1,443
    Blog Entries
    1

    Default

    Quote Originally Posted by Nexus View Post
    Outage has continued all day. Amazingly, despite it affecting Toowoomba, Mackay, Gladstone, Bundaberg and Maroochydore, ISP doesn't have a status or ETA for an actual fix. Apparently if you don't record it it didn't happen. In the meantime I'll expect the problems to continue until such time as I can see the connections are stable. For now QLD is back online. Affect on ozmps is likely to be short lived periods during which you may see a squid error message reporting source server unreachable. This will happen if the connection has come online, your browser is attempting to talk to QLD gateway, but the QLD gateway has not yet established communications with VIC which happens very shortly after the connection comes online.
    QLD outage has persisted on and off all day today as well. Again, minimal impact on users as long as you are persistent, however the extended outage has halved the sustained connection count as recorded by the server. Very poor form from the ISP, however unlikely to last too much longer.
    "Blue Meanie" 2007 Aurora Blue MPS 3 - 18x8.5+44 SSR GTX01 - 235/40R18 Federal RS-RR - 3.5" ETS TMIC - CPE stg 2 mount - HKS/CPE BPV - 2XS inlet - 2XS short shift - 2XS turbo manifold - Hypertech tune - Leather/Aluminium handbrake - Momo shifty knob - 7" touchscreen - JDM Mazda Retractable dashtop screen assembly - PC based GPS and instrumentation - 36AH reserve battery and C-TEK isolator - TEIN Street Advanced coilovers 1" drop - Superpro bushings - 220Kw/410Nm.

    "Lipstick" 2013 Velocity Red MPS 3 - 18x7.5+48 Enkei RPF1 -225/40R18 Federal RS-RR - CPE TMIC - COBB inlet - CPE stg 2 mount - COBB Stage 1 98 octane tune - COBB shifty knob - 2XS short shift.

  3. #28
    Nexus's Avatar
    Nexus is offline Administrator
    Join Date
    Nov 2008
    Location
    Geelong
    Age
    44
    Posts
    1,443
    Blog Entries
    1

    Default

    Site was down due to a power outage today from about 9:00AM to 3:45PM AEDT. From what I've heard someone left the road and collected a power pole, so hope they are OK.
    QLD site connections issues also persisted through to about 7:20PM tonight, it's back online and I'm hopeful it will remain that way.

    Quote Originally Posted by Nexus View Post
    QLD outage has persisted on and off all day today as well. Again, minimal impact on users as long as you are persistent, however the extended outage has halved the sustained connection count as recorded by the server. Very poor form from the ISP, however unlikely to last too much longer.
    "Blue Meanie" 2007 Aurora Blue MPS 3 - 18x8.5+44 SSR GTX01 - 235/40R18 Federal RS-RR - 3.5" ETS TMIC - CPE stg 2 mount - HKS/CPE BPV - 2XS inlet - 2XS short shift - 2XS turbo manifold - Hypertech tune - Leather/Aluminium handbrake - Momo shifty knob - 7" touchscreen - JDM Mazda Retractable dashtop screen assembly - PC based GPS and instrumentation - 36AH reserve battery and C-TEK isolator - TEIN Street Advanced coilovers 1" drop - Superpro bushings - 220Kw/410Nm.

    "Lipstick" 2013 Velocity Red MPS 3 - 18x7.5+48 Enkei RPF1 -225/40R18 Federal RS-RR - CPE TMIC - COBB inlet - CPE stg 2 mount - COBB Stage 1 98 octane tune - COBB shifty knob - 2XS short shift.

  4. #29
    Nexus's Avatar
    Nexus is offline Administrator
    Join Date
    Nov 2008
    Location
    Geelong
    Age
    44
    Posts
    1,443
    Blog Entries
    1

    Default

    Quote Originally Posted by Nexus View Post
    Site was down due to a power outage today from about 9:00AM to 3:45PM AEDT. From what I've heard someone left the road and collected a power pole, so hope they are OK.
    QLD site connections issues also persisted through to about 7:20PM tonight, it's back online and I'm hopeful it will remain that way.
    QLD site offline again....this looks set to persist for some time, so won't update again until I am confident the issue is resolved and performance returned to normal. It's currently spending more time offline than on.
    "Blue Meanie" 2007 Aurora Blue MPS 3 - 18x8.5+44 SSR GTX01 - 235/40R18 Federal RS-RR - 3.5" ETS TMIC - CPE stg 2 mount - HKS/CPE BPV - 2XS inlet - 2XS short shift - 2XS turbo manifold - Hypertech tune - Leather/Aluminium handbrake - Momo shifty knob - 7" touchscreen - JDM Mazda Retractable dashtop screen assembly - PC based GPS and instrumentation - 36AH reserve battery and C-TEK isolator - TEIN Street Advanced coilovers 1" drop - Superpro bushings - 220Kw/410Nm.

    "Lipstick" 2013 Velocity Red MPS 3 - 18x7.5+48 Enkei RPF1 -225/40R18 Federal RS-RR - CPE TMIC - COBB inlet - CPE stg 2 mount - COBB Stage 1 98 octane tune - COBB shifty knob - 2XS short shift.

  5. #30
    Nexus's Avatar
    Nexus is offline Administrator
    Join Date
    Nov 2008
    Location
    Geelong
    Age
    44
    Posts
    1,443
    Blog Entries
    1

    Default

    The fibre internet links in QLD continue to be unstable (yes the same fault since 13/12) - ISP is currently investigating. Generally impact on ozmps in negligable - this afternoon the QLD site came up but failed to communicate with VIC site - when this happens, some users will see a squid error - it's unusual for the sites not to establish a connection to each other when they are both online, so not common for you to see a fault but may have occurred this afternoon. QLD site continues to "flap" (connection up and down unpredictably)

  6. #31
    Nexus's Avatar
    Nexus is offline Administrator
    Join Date
    Nov 2008
    Location
    Geelong
    Age
    44
    Posts
    1,443
    Blog Entries
    1

    Default

    QLD site remains offline. Fix ETA early next week.
    VIC site experiencing intermittent power outages. Last one affected internet connection and caused a few minutes outage. I expect the >40deg temps has something to do with it.

  7. #32
    Nexus's Avatar
    Nexus is offline Administrator
    Join Date
    Nov 2008
    Location
    Geelong
    Age
    44
    Posts
    1,443
    Blog Entries
    1

    Default

    Internet outage in VIC from about 12:00 midnight through to 12:30 during which ozmps was offline
    Now resolved.

  8. #33
    Nexus's Avatar
    Nexus is offline Administrator
    Join Date
    Nov 2008
    Location
    Geelong
    Age
    44
    Posts
    1,443
    Blog Entries
    1

    Default

    Power outage took us down this evening approx 6:30PM to 10:15PM AEDT - widespread outage west of Melbourne, VIC.

  9. #34
    Nexus's Avatar
    Nexus is offline Administrator
    Join Date
    Nov 2008
    Location
    Geelong
    Age
    44
    Posts
    1,443
    Blog Entries
    1

    Default

    Down from approx 12:00AM through to 2:15PM AEDT today

    More power outages overnight caused filesystem errors when restarted this morning. We are currently online after repairing the filesystem. I'll be reassessing the current filesystem condition tonight - if I'm unhappy with the results, I may roll back to an earlier snapshot (possibly as far back as 28/12/17) or restore from backup. If I restore a snapshot or backup all posts made after the roll-back date will be permanently lost.

    ozmps was not the only damaged operating system - currently the VIC proxy gateway and studio workstation which run on the same hardware are down. All connections to the website are currently passing through the QLD proxy gateway.
    Last edited by Nexus; 29-01-2018 at 01:30 PM.
    "Blue Meanie" 2007 Aurora Blue MPS 3 - 18x8.5+44 SSR GTX01 - 235/40R18 Federal RS-RR - 3.5" ETS TMIC - CPE stg 2 mount - HKS/CPE BPV - 2XS inlet - 2XS short shift - 2XS turbo manifold - Hypertech tune - Leather/Aluminium handbrake - Momo shifty knob - 7" touchscreen - JDM Mazda Retractable dashtop screen assembly - PC based GPS and instrumentation - 36AH reserve battery and C-TEK isolator - TEIN Street Advanced coilovers 1" drop - Superpro bushings - 220Kw/410Nm.

    "Lipstick" 2013 Velocity Red MPS 3 - 18x7.5+48 Enkei RPF1 -225/40R18 Federal RS-RR - CPE TMIC - COBB inlet - CPE stg 2 mount - COBB Stage 1 98 octane tune - COBB shifty knob - 2XS short shift.

  10. #35
    Nexus's Avatar
    Nexus is offline Administrator
    Join Date
    Nov 2008
    Location
    Geelong
    Age
    44
    Posts
    1,443
    Blog Entries
    1

    Default

    Down for awhile this morning through to around 8:30AM AEDT - appears to have been due to some kind of clock disruption - haywire time servers - or something like that. A number of systems shut down inexplicably and clocks were all over the place this morning. Believed resolved now.

  11. #36
    Nexus's Avatar
    Nexus is offline Administrator
    Join Date
    Nov 2008
    Location
    Geelong
    Age
    44
    Posts
    1,443
    Blog Entries
    1

    Default

    Was down for about an hour or so this evening due to a hardware failure

  12. #37
    Nexus's Avatar
    Nexus is offline Administrator
    Join Date
    Nov 2008
    Location
    Geelong
    Age
    44
    Posts
    1,443
    Blog Entries
    1

    Default

    Restarted the server this afternoon around 2PM as was showing poor performance loading pages.

  13. #38
    Nexus's Avatar
    Nexus is offline Administrator
    Join Date
    Nov 2008
    Location
    Geelong
    Age
    44
    Posts
    1,443
    Blog Entries
    1

    Default

    Hi just discovered that recaptcha human verification services used during registration have recently been shutdown, causing problems for new users trying to register. Appears to have been a recent service shutdown and I'll need to upgrade the forum software and recaptcha components to v2 before I'll be able to turn it back on.

    For now it has been disabled so that registrations can proceed normally.

  14. #39
    Nexus's Avatar
    Nexus is offline Administrator
    Join Date
    Nov 2008
    Location
    Geelong
    Age
    44
    Posts
    1,443
    Blog Entries
    1

    Default

    Brief outage earlier this afternoon ~20minutes due to restarting host virtualisation server.

  15. #40
    Nexus's Avatar
    Nexus is offline Administrator
    Join Date
    Nov 2008
    Location
    Geelong
    Age
    44
    Posts
    1,443
    Blog Entries
    1

    Default

    Outage from 11:00 to 11:20PM AEST approx 6/6/18 : server restart required due to hardware fault.
    Last edited by Nexus; 06-06-2018 at 11:28 PM.

  16. #41
    Nexus's Avatar
    Nexus is offline Administrator
    Join Date
    Nov 2008
    Location
    Geelong
    Age
    44
    Posts
    1,443
    Blog Entries
    1

    Default

    Discovered this afternoon that one of the two gateways that your browser reaches the website through was playing up (VIC gateway), and doing so in such a way that your browsers were not falling back to the gateway that was working (QLD)
    As a result up to 50% of users trying to browse the website may have seen timeout or connection reset messages. Not sure how long this problem had been occurring - I suspect a day or two - as I hadn't seen the symptoms myself. Issue identified and reported through Facebook group. This is first time we've seen this issue that I can recall. Normally if one gateway is down, you should still be able to browse the website. In this case the gateway wasn't down in a way that caused browsers to fail over to the alternative gateway.Thanks Adrian for reporting the problem.

    VIC gateway has been restarted and is behaving normally again.
    "Blue Meanie" 2007 Aurora Blue MPS 3 - 18x8.5+44 SSR GTX01 - 235/40R18 Federal RS-RR - 3.5" ETS TMIC - CPE stg 2 mount - HKS/CPE BPV - 2XS inlet - 2XS short shift - 2XS turbo manifold - Hypertech tune - Leather/Aluminium handbrake - Momo shifty knob - 7" touchscreen - JDM Mazda Retractable dashtop screen assembly - PC based GPS and instrumentation - 36AH reserve battery and C-TEK isolator - TEIN Street Advanced coilovers 1" drop - Superpro bushings - 220Kw/410Nm.

    "Lipstick" 2013 Velocity Red MPS 3 - 18x7.5+48 Enkei RPF1 -225/40R18 Federal RS-RR - CPE TMIC - COBB inlet - CPE stg 2 mount - COBB Stage 1 98 octane tune - COBB shifty knob - 2XS short shift.

  17. #42
    Nexus's Avatar
    Nexus is offline Administrator
    Join Date
    Nov 2008
    Location
    Geelong
    Age
    44
    Posts
    1,443
    Blog Entries
    1

    Default

    internal network link failure between QLD and VIC caused similar faults to the gateway issue identified yesterday. Back online. Outage for 50% of users was from approx 9:20AM to 10:15AM AEDT today

  18. #43
    Nexus's Avatar
    Nexus is offline Administrator
    Join Date
    Nov 2008
    Location
    Geelong
    Age
    44
    Posts
    1,443
    Blog Entries
    1

    Default

    Repeat gateway issue this afternoon. Am suspecting that this may be due to an attack on the gateway, OR some of the small changes to the website in preparation of forum update. If it's related to website adjustments, it's only affecting one gateway (which are not actually part of the website, they just direct your incoming browser requests to the server from one of two public IP addresses), so this seems unlikely as the gateways are near identical.

    Outage affecting 50% of users from about 1:15PM to 2:35PM AEST.

    Will keep an eye on, I will probably attempt the forum update again tonight. After the update the forum config can be returned to prior to update. There are options that need to be turned on for the update to process successfully.
    "Blue Meanie" 2007 Aurora Blue MPS 3 - 18x8.5+44 SSR GTX01 - 235/40R18 Federal RS-RR - 3.5" ETS TMIC - CPE stg 2 mount - HKS/CPE BPV - 2XS inlet - 2XS short shift - 2XS turbo manifold - Hypertech tune - Leather/Aluminium handbrake - Momo shifty knob - 7" touchscreen - JDM Mazda Retractable dashtop screen assembly - PC based GPS and instrumentation - 36AH reserve battery and C-TEK isolator - TEIN Street Advanced coilovers 1" drop - Superpro bushings - 220Kw/410Nm.

    "Lipstick" 2013 Velocity Red MPS 3 - 18x7.5+48 Enkei RPF1 -225/40R18 Federal RS-RR - CPE TMIC - COBB inlet - CPE stg 2 mount - COBB Stage 1 98 octane tune - COBB shifty knob - 2XS short shift.

  19. #44
    Nexus's Avatar
    Nexus is offline Administrator
    Join Date
    Nov 2008
    Location
    Geelong
    Age
    44
    Posts
    1,443
    Blog Entries
    1

    Default

    Having some wet weather related issues with the copper internet line in VIC. Short lived outages - if you have difficulty accessing the site, please retry in a few minutes time.
    If you find the site appears down for longer than 15 minutes, please report issue to ozmpsclub facebook page

Page 2 of 2 FirstFirst 12

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •