cross-posted from: https://lemmy.bestiver.se/post/658762
You must log in or register to comment.
- DigitalDilemma@lemmy.mlEnglish5 months
As a sysadmin that’s pretty much my worst nightmare. I really feel for those trying to pick the pieces back up again after that.
- Krudler@lemmy.worldEnglish5 months
I feel your pain, but meanwhile I’m laughing. No backups, no fire suppression system, what the fuck are these clowns doing.
- 5 months
Suppressing evidence? Looks like this was a deliberate oversight to later erase data.
Probably data retention safety was overruled earlier by one person.
So, I think the designed erase worked as designed .
- 5 months
Pretty big conspiracy theory for a situation where incompetence doesn’t seem out of the ordinary.
SysAdmins saying “We need X, we need Y”, someone who signs the cheques saying “But it works fine! Why would there be a fire? We already spent so much on those UPSs”
- 5 months
I don’t know a lot at this time. The cool thing is this will be discussed for years , and any who follow this will know a lot more.
I’m just saying if it looks like a duck, quacks like a duck it may not be a squirrel
- 5 months
What you described isn’t “looks like a duck, quacks like a duck”.
This is a fire in a government (publicly-funded) location in an industry that’s often overlooked and underfunded… in a traditionally conservative country (with a Liberal leader for the last few months) that is part of a very top-down hierarchical structure. Which would suggest that the complaints of a systems administrator are likely to be ignored. And that’s assuming that the systems administrator is competent, which isn’t a guarantee in and of itself.
I’m seeing what looks like a duck, I’m hearing the quacks. The conspiracy theory is that it’s a squirrel in a duck costume that learned how to quack so people would toss it bread.
- 5 months
Here we have a glass of water, it’s half full.
Did someone forget to fill it up, or did someone drink it.
Is it institutional incompetence or criminal conspiracy?
- 5 months
Hanlon’s razor mate. I know it’s entirely possible that it’s a conspiracy, but it’d entirely possible (and more likely) that it’s just incompetence and lack of communication due to inefficient and lackluster processes as well as too many levels of leadership.
- 5 months
You know for a fact that the people doing the largest share of the recovery effort have nothing to do with the decision to have no backups.
…but with the way social/work hierarchies work in SK, it was probably never brought up.
- DigitalDilemma@lemmy.mlEnglish5 months
You know for a fact that the people doing the largest share of the recovery effort have nothing to do with the decision to have no backups.
Exactly. How they got there is no consolation to those dealing with it now.
- 5 months
Wow. this is one of the biggest instances of IT incompetence that I’ve heard of in recent years. Hosting a server farm without remote backups? Sound like the London Magnetic Tape Incident.
The LMTI: One employee was sent to the other end of London with the magnetic backup tapes every day. He got money to take a taxi, but saved it and took the tube. His favourite seat was right above one of the motors, where he sat the bag with the tapes on the floor for the journey. The tapes were just stored at the destination, and not checked in any way. Guess what they learned the first time they had to rely on those tapes?
- 5 months
That’s really funny. It’s such a specific situation too. Almost like a comedy sketch
- 5 months
Korean government’s
South.
(Just in case anybody else isn’t a clairvoyant either)
- 5 months
I’ll be honest, I assumed it was the South because I would be honestly shocked if the North ever reported anything bad happening to itself.
- 5 months
The north doesn’t need backups because errors do not happen there /s
- eleijeep@piefed.socialEnglish5 months
“Cloud storage” in the North is just a drawer full of usb sticks confiscated from people smuggling K-dramas in from the South.
- 5 months
The DPRK has their own intranet called kwangmyong, which needs its own storage and servers. Citizens use it regularly, access to the broader global internet however is more controlled and limited to specific jobs and positions as far as I know.
- morto@piefed.socialEnglish5 months
Hmm a system that stored government documents caught fire and they have no backups? Hmm, this carries the same energy of registry offices catching fire “spontaneously” in the past.
- 5 months
Always have two backups in different places than the original. If not, the least you can do is have one backup copy. How does the government don’t have such thing?
- 5 months
Government people get jobs by schmoozing and making deals, not by merit or skill.
Pournelle’s Law always seems relevant.
- Corridor8031@lemmy.mldeleted by creator5 months
sounds like you are suggesting that in private companys jobs are distributed by merit and skills lol
- 5 months
No.
But it does give more options to work around or not support those entities since they don’t have as much direct authority.
- 5 months
Ooh, ooh! I’m in that law! I’m in the (to paraphrase) “competent and devoted to the goal but unempowered” group!
- HubertManne@piefed.socialEnglish5 months
I have one backup but keep legacy things so that in a massive disaster I still have archives that have some of my important long term type documents. So figure one up to date backup and in a disaster I have stuff from last year.
5 monthsThis is a clear example where ‘the cloud’ really is a physical place.
For a long while, I had hoped it was at least 6 physical places, with various redundancies. A few billion small-ish servers at internet network hubs.
That or the magical floating bits that go over hackers heads in the movies. Those also look like the cloud. Not very secure, but quite convenient.
- 5 months
Well, a properly managed cloud storage service very much should be multiple locations with redundant copies of data lol yes. So you’re not wrong in that.
- 5 months
Perhaps contained evidence against the former PM who tried to do a military coup and this is the way of getting rid of it? Perhaps protecting co-conspirators if not the top guy.
- 5 months
At least they saved the Internet box. Otherwise, we’ll have to bother the elders of the Internet again.
- 5 months
Even though they historically used to have a great backup system for their historians and government records.
see link: https://en.wikipedia.org/wiki/Veritable_Records_of_the_Joseon_Dynasty
- 5 months
Disaster Recovery Concepts:
- Recovery time objective (RTO): maximum time to restore system function.
- Recovery point objective (RPO): maximum age of data needed to resume operations.
- Recovery consistency objective (RCO): how many inconsistent entries are allowed in recovered data.
- Sierra Madre objective (SMO): We don’t need no stinkin’ backups.
- 5 months
Get disaster insurance, wait for failure, collect a big c-suite payout and move to the next company.
Everyone else gets to find new exciting jobs.
- HubertManne@piefed.socialEnglish5 months
My favorite is places that don’t want to allocate time or resources to testing disaster recovery.
Too slow storage to back up? What a stupid, false reason. I assume nobody works at night. Do something else than full backups and you at least have something. A simple differential update replication would have saved them here.
- 5 months
Or do it by priority. Files that change often or are very important are copied fully often, maybe daily. A differential update of all files could follow daily or who knows weekly. Its the government, they should have money to add more storage, so that shouldn’t be the problem. At least some strategy to manage slow speed, instead not having ANY backup its the dumbest thing I’ve read from governments in a while.
- 5 months
Weird how there is a rising MAGA party in KR and an aligned former pm who attempted a coup. What a weird coincidence.
