Options

1st day on the job - don't be this guy

shochanshochan Member Posts: 1,004 ■■■■■■■■□□
in IT Jobs / Degrees
https://www.hackread.com/man-accidentally-destroyed-production-database-on-first-day-of-his-job/

HA! That's pretty crazy having access to production db - the ID10T error is definitely within their security team when giving access to their network. He should probably only have access to the test db until they can prove their skill set with working in db's.

Cheers & HI5!
CompTIA A+, Network+, i-Net+, MCP 70-210, CNA v5, Server+, Security+, Cloud+, CySA+, ISC² CC, ISC² SSCP
· Share on FacebookShare on Twitter

Comments

  • Options
    NetworkNewbNetworkNewb Member Posts: 3,298 ■■■■■■■■■□
    hahahaha nice. Yea, I don't even blame the guy who made the mistake. First real job, following instructions, accidentally put in the what the instructions had listed instead of switching his own info into a line.

    The idiot that made those instructions and kept that info on the instructions sheet should be the one who got fired.

    Funny story though!
    · Share on FacebookShare on Twitter
  • Options
    keenonkeenon Member Posts: 1,922 ■■■■□□□□□□
    wow, that is crazy. I do agree they both are at fault.

    Company Fault
    1. They left the guy by himself except with the guidance of a document.
    2. They left prod stuff in the test environment setup doc icon_scratch.gif
    3. They also gave him full unrestricted access on day 1 ( when i used to be the manager, new techs got basic but nothing until I was comfortable with them understanding the environment)

    His fault
    1. Not following directions
    2. Not asking for help
    Become the stainless steel sharp knife in a drawer full of rusty spoons
    · Share on FacebookShare on Twitter
  • Options
    greg9891greg9891 Member Posts: 1,189 ■■■■■■■□□□
    Wow that's a huge Gamble.....lol thats what you call a real cautionary tale......poor guy.
    :
    Upcoming Certs: VCA-DCV 7.0, VCP-DCV 7.0, Oracle Database 1Z0-071, PMP, Server +, CCNP

    Proverbs 6:6-11Go to the ant, you sluggard! Consider her ways and be wise, Which, having no captain, Overseer or ruler, Provides her supplies in the summer, And gathers her food in the harvest. How long will you slumber, O sluggard?
    When will you rise from your sleep? A little sleep, a little slumber, A little folding of the hands to sleep, So shall your poverty come on you like a prowler And your need like an armed man.
    · Share on FacebookShare on Twitter
  • Options
    NetworkingStudentNetworkingStudent Member Posts: 1,407 ■■■■■■■■□□
    Why didn't the company have a backup of the production DB?
    When one door closes, another opens; but we often look so long and so regretfully upon the closed door that we do not see the one which has opened."

    --Alexander Graham Bell,
    American inventor
    · Share on FacebookShare on Twitter
  • Options
    volfkhatvolfkhat Member Posts: 1,050 ■■■■■■■■□□
    Sounds like they DESERVE to be outta business...
    (almost :)
    · Share on FacebookShare on Twitter
  • Options
    stryder144stryder144 Member Posts: 1,684 ■■■■■■■■□□
    My favorite response: "What was their tech stack, Jenga?"
    The easiest thing to be in the world is you. The most difficult thing to be is what other people want you to be. Don't let them put you in that position. ~ Leo Buscaglia

    Connect With Me || My Blog Site || Follow Me
    · Share on FacebookShare on Twitter
  • Options
    blatiniblatini Member Posts: 285
    Great story. Everyone makes mistakes - definitely on the company to prevent that.
    · Share on FacebookShare on Twitter
  • Options
    TechGromitTechGromit Member Posts: 2,156 ■■■■■■■■■□
    shochan wrote: »
    HA! That's pretty crazy having access to production db - the ID10T error is definitely within their security team when giving access to their network. He should probably only have access to the test db until they can prove their skill set with working in db's.

    This is a documentation issue, no one should be issued documents first day on the job, experienced or not, detailing production configuration information. The company would have a difficult job winning a case in court for damages in my opinion, this was an accident waiting to happen, if not this new hire, then the next one. Also read only access might have been a good idea for someone starting on there first day.
    Still searching for the corner in a round room.
    · Share on FacebookShare on Twitter
  • Options
    greg9891greg9891 Member Posts: 1,189 ■■■■■■■□□□
    The company is 100% liable. Having backups that didn't work is a failure of all levels on their disaster recovery plan. That person should definitely not be the only person that should have been fired that day. All he did was expose the recovery and disaster recovery plans did not work. He exposed that their policies are not up to standard. the role of least responsibility wasn't in play at all. This company Looks like it got what it deserved.
    :
    Upcoming Certs: VCA-DCV 7.0, VCP-DCV 7.0, Oracle Database 1Z0-071, PMP, Server +, CCNP

    Proverbs 6:6-11Go to the ant, you sluggard! Consider her ways and be wise, Which, having no captain, Overseer or ruler, Provides her supplies in the summer, And gathers her food in the harvest. How long will you slumber, O sluggard?
    When will you rise from your sleep? A little sleep, a little slumber, A little folding of the hands to sleep, So shall your poverty come on you like a prowler And your need like an armed man.
    · Share on FacebookShare on Twitter
  • Options
    TechGromitTechGromit Member Posts: 2,156 ■■■■■■■■■□
    greg9891 wrote: »
    The company is 100% liable. Having backups that didn't work is a failure of all levels on their disaster recovery plan.

    Unfortunately deficiencies often are overlooked in most organizations until something blows up. Backups should be tested on a quarterly bases to verify they are functioning correctly. When I did backup / server administration, I had to restore one file from a backup each quarter to verify the backups were functioning as expected.
    Still searching for the corner in a round room.
    · Share on FacebookShare on Twitter
  • Options
    mzx380mzx380 Member Posts: 453 ■■■■□□□□□□
    Poor kid just got out of college and messed up on his first day. The sad thing is he could have been a star by exposing shoddy practices of an unprepared organization. In the long run, this will be to his benefit because he likely join a better organization that will polish him technically and professionally. The higher you start out the gate, the better your career will be.
    Certifications: ITIL, ACA, CCNA, Linux+, VCP-DCV, PMP, PMI-ACP, CSM
    Currently Working On: Microsoft 70-761 (SQL Server)
    · Share on FacebookShare on Twitter
  • Options
    yoba222yoba222 Member Posts: 1,237 ■■■■■■■■□□
    Dang the original Reddit post is locked now. Wanted to see a happy ending play out over the next few weeks where the guy is successful with a wrongful termination lawsuit and where the CTO gets fired.
    A+, Network+, CCNA, LFCS,
    Security+, eJPT, CySA+, PenTest+,
    Cisco CyberOps, GCIH, VHL,
    In progress: OSCP
    · Share on FacebookShare on Twitter
  • Options
    TheFORCETheFORCE Member Posts: 2,297 ■■■■■■■■□□
    That is hilarious. CTO is in for a rude awaking, he should start looking for a new job too. How can you not be backing up a prod database? Insane. How can you create documentation using prod as examples lol.
    · Share on FacebookShare on Twitter
  • Options
    SpetsRepairSpetsRepair Member Posts: 210 ■■■□□□□□□□
    Jesus, can't believe places like this still exist in this day and age with tech the way it is this company must be a failure from the top down. I had to beg to get access in my first 2-3 months and let alone someone has to walk you through accessing certain networks, systems, apps etc....
    · Share on FacebookShare on Twitter
  • Options
    UnixGuyUnixGuy Mod Posts: 4,564 Mod
    Company who doesn't have backup...had a document that includes prod details instead of Dev...gives prod DB access to a new hire on their first day...their CTO want to 'involve legal'...


    If I was the CEO, I'd let the CTO go, and bring that new hire guy and apologise to him for the all stress caused to him.
    Certs: GSTRT, GPEN, GCFA, CISM, CRISC, RHCE

    Learn GRC! GRC Mastery : https://grcmastery.com 

    · Share on FacebookShare on Twitter
  • Options
    DatabaseHeadDatabaseHead Member Posts: 2,753 ■■■■■■■■■■
    It will be interesting if they actually do come after the guy. I think that's a big fat no, but you never know.

    I work with data all the time and believe me too much access is a bad thing......

    Scary
    · Share on FacebookShare on Twitter
  • Options
    Danielh22185Danielh22185 Member Posts: 1,195 ■■■■□□□□□□
    Poor guy. He made an honest mistake and hopefully nothing comes of it.

    I put this ALL on the company. Why on Earth would someone be tasked with doing something that hold such a giant failure potential on day 1. Sounds like he was simply trying to follow instruction. Also it sounds like the company has no structure built into training up their employees. If the company doesn't have time / resources to train (disaster waiting to happen), then they should at a minimum have a strong structure built around their operational documentation.
    Currently Studying: IE Stuff...kinda...for now...
    My ultimate career goal: To climb to the top of the computer network industry food chain.
    "Winning means you're willing to go longer, work harder, and give more than anyone else." - Vince Lombardi
    · Share on FacebookShare on Twitter
  • Options
    wd40wd40 Member Posts: 1,017 ■■■■□□□□□□
    May be they didn't give him admin access on the first day, may be the admin user and password were in the documentation that they gave him .. icon_twisted.gif
    · Share on FacebookShare on Twitter
  • Options
    Mike7Mike7 Member Posts: 1,107 ■■■■□□□□□□
    In a similar vein

    British Airways says IT outage may have been caused by human error

    1st day on the job for the engineer?
    · Share on FacebookShare on Twitter
  • Options
    anhtran35anhtran35 Member Posts: 466
    CTO should be fired. NO BACKUP???
    · Share on FacebookShare on Twitter
  • Options
    skswitchskswitch Member Posts: 50 ■■■□□□□□□□
    Looks like that DID have backups but it wasn't restoring. So add not testing their DR plan to the pile.

    "So I left. I kept an eye on slack, and from what I can tell the backups were not restoring,"
    · Share on FacebookShare on Twitter
  • Options
    TechGromitTechGromit Member Posts: 2,156 ■■■■■■■■■□
    skswitch wrote: »
    Looks like that DID have backups but it wasn't restoring.

    An untested backup is not a real backup. You should restore at least one file every so often to verify things are working the way you assume they are.
    Still searching for the corner in a round room.
    · Share on FacebookShare on Twitter
  • Options
    TechGromitTechGromit Member Posts: 2,156 ■■■■■■■■■□
    Mike7 wrote: »
    British Airways says IT outage may have been caused by human error

    1st day on the job for the engineer?

    Need more details, not exactly sure how a single UPS is supplying power to the "data center". If it's really a UPS power supply issue, it more likely one rack of servers with only one functioning power supply each that was disconnected. To affect a "data center", you would have to trip the main breaker on a panel box and power it back on, maybe a power surge from a quick off / on on a main breaker panel? Maybe the term Data center is used loosely, one rack perhaps? Why doesn't the rack have redundant power sources and power supplies. The racks I manage, all the equipment except the KVM/monitor have one power supply connected to UPS and the other to house power.
    Still searching for the corner in a round room.
    · Share on FacebookShare on Twitter
  • Options
    ITSec14ITSec14 Member Posts: 398 ■■■□□□□□□□
    UnixGuy wrote: »
    Company who doesn't have backup...had a document that includes prod details instead of Dev...gives prod DB access to a new hire on their first day...their CTO want to 'involve legal'...


    If I was the CEO, I'd let the CTO go, and bring that new hire guy and apologise to him for the all stress caused to him.

    If they can't get the backups to work...they may just be out of business.
    · Share on FacebookShare on Twitter
  • Options
    wd40wd40 Member Posts: 1,017 ■■■■□□□□□□
    TechGromit wrote: »
    Need more details, not exactly sure how a single UPS is supplying power to the "data center". If it's really a UPS power supply issue, it more likely one rack of servers with only one functioning power supply each that was disconnected. To affect a "data center", you would have to trip the main breaker on a panel box and power it back on, maybe a power surge from a quick off / on on a main breaker panel? Maybe the term Data center is used loosely, one rack perhaps? Why doesn't the rack have redundant power sources and power supplies. The racks I manage, all the equipment except the KVM/monitor have one power supply connected to UPS and the other to house power.

    Unfortunately not all equipment have redundant power supplies, and it is possible that at that moment the main power was down and the UPS(s) did not take over (connecting equipment to "mains" directly is not a good idea and Doing a full data center UPS test is not an easy task so people skip it until a disaster happens.

    And it is possible because the engineer just switched the power back on in an uncontrolled way, the equipment did not start in the correct order which lead to a chain-reaction that brought the backup site down (and of course the main failed to start correctly) so now both sites are down.
    · Share on FacebookShare on Twitter
  • Options
    thomas_thomas_ Member Posts: 1,012 ■■■■■■■■□□
    TechGromit wrote: »
    Need more details, not exactly sure how a single UPS is supplying power to the "data center". If it's really a UPS power supply issue, it more likely one rack of servers with only one functioning power supply each that was disconnected. To affect a "data center", you would have to trip the main breaker on a panel box and power it back on, maybe a power surge from a quick off / on on a main breaker panel? Maybe the term Data center is used loosely, one rack perhaps? Why doesn't the rack have redundant power sources and power supplies. The racks I manage, all the equipment except the KVM/monitor have one power supply connected to UPS and the other to house power.


    You might have too narrow a view of UPS systems.
    · Share on FacebookShare on Twitter
Sign In or Register to comment.