Author Topic: May 28 2017 Forum crash, and recovery  (Read 1325 times)

James Patten

  • Global Moderator
  • Trainmaster
  • *****
  • Posts: 2,785
  • Loco for 6
    • View Profile
May 28 2017 Forum crash, and recovery
« on: May 29, 2017, 11:32:59 PM »
On May 28, Ed Lecuyer informed me that the forum was showing an error of some kind, looked like the forum database software had crashed.

I was unable to recover us from that state.  I tried installing a new version of the forum, but ran into bigger trouble (namely, a blank slate!).

I had our host restore the website to their full backup from Friday night/Saturday morning midnight.  The forum is back in operation, minus any posts from Saturday and Sunday.  I do not plan to try to recover them.

John McNamara

  • Operating Volunteers
  • Dispatcher
  • *****
  • Posts: 1,071
    • View Profile
Re: May 28 2017 Forum crash, and recovery
« Reply #1 on: May 29, 2017, 11:45:22 PM »
Many thanks for your efforts! ;)
-A Happy Reader

Bill Sample

  • Museum Member
  • Hostler
  • ***
  • Posts: 293
    • View Profile
Re: May 28 2017 Forum crash, and recovery
« Reply #2 on: May 29, 2017, 11:55:28 PM »
Let me second John's thanks.  I found there was a problem when I tried to get on over the weekend. 

Bob Holmes

  • Museum Member
  • Brakeman
  • ***
  • Posts: 164
    • View Profile
Re: May 28 2017 Forum crash, and recovery
« Reply #3 on: May 29, 2017, 11:57:58 PM »
So thankful for the recovery!!!  Bet it was pretty scary for you guys...

Another lesson in why it's so important to back up your own systems EVERY day.  Including your home computer.  If you don't have a backup plan, run -- don't walk -- to get either a backup drive and software (such as Acronis) or a backup cloud solution.

Bob

Wayne Laepple

  • Museum Member
  • Inspector
  • ******
  • Posts: 1,316
    • View Profile
Re: May 28 2017 Forum crash, and recovery
« Reply #4 on: May 30, 2017, 12:06:10 AM »
Thanks, Team. Not the most fun for a Memorial Day weekend. Well done.

Jeff Schumaker

  • Museum Member
  • Fireman
  • ****
  • Posts: 326
    • View Profile
Re: May 28 2017 Forum crash, and recovery
« Reply #5 on: May 30, 2017, 12:10:20 AM »
I thought something might be wrong when it wouldn't let me log in this morning. Glad to see things are up and running again.

Jeff S.
Hey Rocky, watch me pull a moose trout out of my hat.

Bill Reidy

  • Museum Member
  • Fireman
  • ****
  • Posts: 458
  • Life member. Ack.
    • View Profile
Re: May 28 2017 Forum crash, and recovery
« Reply #6 on: May 30, 2017, 12:18:55 AM »
Thanks James.  Working in IT, I understand all the work and angst this must have provided you and Ed the past 24+ hours.  Greatly appreciated!

Robert M. Ellsworth

  • Hobo
  • Posts: 3
    • View Profile
Re: May 28 2017 Forum crash, and recovery
« Reply #7 on: May 30, 2017, 01:34:20 AM »
I wonder if this is related to the RyPN crash. They are still down as of 8:30 pm Monday with no explanation I have been able to find.

Ed Lecuyer

  • Administrator
  • Supervisor
  • *****
  • Posts: 1,863
    • View Profile
    • wwfry.org
Re: May 28 2017 Forum crash, and recovery
« Reply #8 on: May 30, 2017, 02:36:10 AM »
First of a HUGE thank you to James for getting the forum restored. This issue quickly dwarfed my IT/web/database experience and James stepped up to the plate to get it fixed - on his day off! Also, I was away from my PC for most of this outage, so I could only be of limited help - so James is the real hero.

I wonder if this is related to the RyPN crash. They are still down as of 8:30 pm Monday with no explanation I have been able to find.
No. We are not connected to RYPN in any way and it appears that their forum is functional in some capacity (I did see it go live briefly, now it is dead again.) Although it is fun to speculate that some North Korean hacker really dislikes US heritage railroading...
Ed Lecuyer
Moderator, WW&F Forum

Eric Schade

  • Operating Volunteers
  • Flagman
  • *
  • Posts: 40
    • View Profile
Re: May 28 2017 Forum crash, and recovery
« Reply #9 on: May 30, 2017, 02:23:22 PM »
well done James!!!!  I tried it over the weekend and  ??? 
Eric Schade, Phippsburg, Maine

Ira Schreiber

  • Museum Member
  • Dispatcher
  • *****
  • Posts: 1,071
  • Life Member
    • View Profile
Re: May 28 2017 Forum crash, and recovery
« Reply #10 on: May 30, 2017, 03:14:22 PM »
He who named the little arrow thingy on the screen a  CURSOR knew what he was talking about

Steve Smith

  • Museum Member
  • Engineer
  • ****
  • Posts: 523
  • Life Member
    • View Profile
Re: May 28 2017 Forum crash, and recovery
« Reply #11 on: May 30, 2017, 06:45:49 PM »
James, you are a saint!

You took our ailing forum into Saint James Infirmary--IT Wing, and made it well again. Hurrah!

Thank you so much!

James Patten

  • Global Moderator
  • Trainmaster
  • *****
  • Posts: 2,785
  • Loco for 6
    • View Profile
Re: May 28 2017 Forum crash, and recovery
« Reply #12 on: May 30, 2017, 09:31:00 PM »
The real thanks go to the service personnel at our website host site, TotalChoice Hosting (http://totalchoicehosting.com/.  All I did was write a ticket, they did all the work.  Of course getting to that point took a while of messages back and forth between Ed and I.  It was Ed's idea to restore the website from back up.

John McNamara

  • Operating Volunteers
  • Dispatcher
  • *****
  • Posts: 1,071
    • View Profile
Re: May 28 2017 Forum crash, and recovery
« Reply #13 on: May 30, 2017, 10:30:01 PM »
There's still a bug of some sort. When I enter my name, a box pops up and reports that there is no such user. However, if I ignore the box and type in my password, everything is fine......
-John M

John Kokas

  • Museum Member
  • Engineer
  • ****
  • Posts: 706
    • View Profile
Re: May 28 2017 Forum crash, and recovery
« Reply #14 on: May 30, 2017, 11:22:19 PM »
Now I'm noticing that the main website will not load completely.  Most of the links still work, but all I have is a blue background and text.