Skip to main content

$400 million to Bankruptcy in 45 mins :(

While googling for devops case studies, i found this very interesting blog post by Doug Seven on how Knight Capital Group (an American Global Finance) failed code deployment on one of the eight production instances lead to the bankruptcy of KCG in August 2012.

At the first read I felt it may be a hypothetical case or something that is shown too aggravated. But with minimal digging I could correlate some of the facts even thought I am not totally sure about the the whole story. Anyways here the point is not about the story but about Dev & Ops nightmare.

Ignorance is not a bliss

Blog may be talking about 2012, but even today we just have a below 40% adoption of devops which seriously means lots of organization out there still doing manual heavy lifting of syncing of code between the dev/qa/prod environment. With manual intervention there is always a possibility of mistakes. If not today… tomorrow. Now the question to be asked is When or Why? Yes, with so much at stake organization cannot leave it to chance because things are fine at this point.

Human mistakes are inevitable. It may be in any form on the PDCA (Plan Do Check Act) cycle. So better to alway automate the processes which is repeatable. Definitely high risk processes like software deployments so that we have more reliability with each repetition.


Popular posts from this blog

Distinguished Engineer Award

Congrats! CSC Distinguished Engineers & Architects 2017

Yesterday CSC announced Distinguished Engineers & Architects, Batch 2017
Congrats to all the distinguished folks. Welcome on board...
Distinguished Architects  Randy Arthur (Americas) serves as product owner for CSC’s IaaS offerings and as a lead solutions architect for complex integration projects involving cloud computing technologies. During his 16-year career with CSC, Randy  has worked successfully in various roles including midrange service delivery, pre-sales solution development and product management. He was the first CTO of CSC’s Cloud  technology “incubator.” Bio on | LinkedIn| Twitter
Graham Chastney(UKI&N) is a global domain architect experienced in workplace technologies,  solution strategy and solution governance. He is a global collaborator who is relied upon to provide thought leadership to solution teams and to build and development teams. Graham is the founder  and lead author of the Technology Perspectives blog, which he regards as part of a broader ambition to …