Scary stuff

in the early morning on Wednesday, the 6th of July 2005 by Chad

So I worked before in a certain unnamed nuclear power plant in the early 90’s.
To give you an idea off the security around the place, to get to the secured area, you had to walk through the security building, which was split in two by steel bars. Two openings through the bars were full body turnstiles that you could only get halfway through before they locked. You were faced with a hand scanner. Not a cool looking one that uses light to check your fingerprints. This one had bars sticking up that you put your hand against, and it measured the resistance of your skin between the various points.
Well, that was for us normal people. The Wackenhut security guards were all so huge from donuts, they couldn’t fit through the turnstile, and had to walk through the vehicle gates to get back and forth. And that was just the women security guards!
My story starts one fine winter day. Myself and one other person were the network administrators for the plant. Our office was inside the server room. We had maybe 20-25 servers running OS/2 and LANManager. We even were running Lotus Notes on those servers. The backup software failed on a daily basis. All our data storage was on external full height 1 gig drives. Yes, thats right, full height (3 inches tall and about 10 lbs!) 1 gig drives. It was a long time ago…
Outside, we had almost a foot of snow on the ground. Inside the server room, in the center of the building, on the third floor, the temperature was currently over 100 degrees farenheit. At 9am. And climbing.
It seems that the building’s heater system was on the fritz. And stuck on full blast. Directly feeding the server room. Being the third floor center, there were no windows to open. The room had a small access door but that was it. Even a full size floor fan couldn’t get the heat out fast enough, because there was no place for it to go, the whole building was affected, although not quite as hot as in our room.
No one would make the call to just turn off the damn heater. Pull the breakers or something.
About once every half hour, you would hear the unmistakable whine of a drive somewhere in the room giving up and spinning down, data lost forever.
And no one would let us turn off the servers either.
Phone call with IBM server support:
“Whats the maximum ambient temperature your servers can handle?”
“We recommend a maximum of 85 degrees”
“How bad is 110 degrees?”
“What? Turn them off, quick!”
“We can’t, we’re a nuclear power plant…”
“Oh… well, just pray you don’t lose too many then!”
6 hours later. We’ve lost over a dozen drives. Someone on the roof finally got the heating unit fixed. Still, no one had made the call to shut down the servers. Now, these weren’t running the reactors or anything, they were on the administration side of the plant. And yet top managers were still unwilling to make a decision! Gives you real faith in the beaurocracy, don’t it?

[del.icio.us] [Digg] [Facebook] [MySpace] [Sphere] [StumbleUpon] [Technorati] [Windows Live] [Email]
1 Star2 Stars3 Stars4 Stars5 Stars
(No Ratings Yet)
Loading ... Loading ...

Related Posts

One Response to “Scary stuff”

  1. Anarchy Says:

    That reminds me of another power plant that I used to get summoned to for PC maintenance. Down in “Slower-Delaware”… about 10 or 12 years ago… I used to get called to one power plant (that is remaining nameless) to maintenance an ancient XT machine. It was monsterous. Supposedly, the PC had some software on it that maintenanced part of the cooling system. I was told that it HAD TO WORK because they couldn’t find the software anymore… so thier only copy was on this machine. Occassionally, the hard disk would lock up on them and they’d call me to fix it. I would show up… be escorted to the machine… and would wait until I was eventually left alone. Then, I would pick the XT up about 3 inches off the desk and drop it. The impact would usually dislodge the read/write arm in the drive, and it would start working again. I really hope they’ve replaced that machine by now.

Leave a Reply

Now my wife may think she's locked me out of the kitchen but MacGyver's not my patron saint for nothing.

-- Alton Brown, Good Eats: Where There's Smoke, There's Fish

Recent Posts

    Poll

    For the Holidays-
    View Results

Search

Captain's Logs

The Sites

Syndication

Stats

  • Comments: 3474
  • Pingbacks: 49
  • Trackbacks: 172
  • Comment Spam: 67448
View blog authority