Skip to main content

$400 million to Bankruptcy in 45 mins :(

While googling for devops case studies, i found this very interesting blog post by Doug Seven on how Knight Capital Group (an American Global Finance) failed code deployment on one of the eight production instances lead to the bankruptcy of KCG in August 2012.
At the first read I felt it may be a hypothetical case or something that is shown too aggravated. But with minimal digging I could correlate some of the facts even thought I am not totally sure about the the whole story. Anyways here the point is not about the story but about Dev & Ops nightmare.

Ignorance is not a bliss

Blog may be talking about 2012, but even today we just have a below 40% adoption of devops which seriously means lots of organization out there still doing manual heavy lifting of syncing of code between the dev/qa/prod environment. With manual intervention there is always a possibility of mistakes. If not today… tomorrow. Now the question to be asked is When or Why? Yes, with so much at stake organization cannot leave it to chance because things are fine at this point.

Human mistakes are inevitable. It may be in any form on the PDCA (Plan Do Check Act) cycle. So better to alway automate the processes which is repeatable. Definitely high risk processes like software deployments so that we have more reliability with each repetition.

Comments

Post a Comment

Popular posts from this blog

Just Buzz... Where is AI?

Speaking to Recode’s Kara Swisher and MSNBC’s Ari Melber, Pichai said AI is “one of the most important things that humanity is working on. It’s more profound than, I don’t know, electricity or fire,” adding that people learned to harness fire for the benefits of humanity, but also needed to overcome its downsides, too. Pichai also said that AI could be used to help solve climate change issues, or to cure cancer. We are seeing some exciting things in the industry, Samsung’s massive 8K TVs apparently use AI to upscale lower resolution images for the big screen. Sony has created a new version of the Aibo robot dog, which this time promises more artificial intelligence. Travelmate’s robot suitcase will use AI to drive around and follow its owner wherever they go.  Kohler has invented Numi, a toilet that has Amazon’s Alexa voice assistant built in etc., But despite all this, it does leave me wondering: is artificial intelligence really what we should be calling this revolution?...
1 comment
Read more

Building Hanlon Micro-Kernel (MK)

I am posting a quick cookbook on creating hanlon microkernel for easy reference. Detailed information on how the microkernel organized and build along with details on each of the command listed here can be found on git hanlon microkernel wiki   1. Install dependencies sudo apt-get install squashfs-tools -y sudo apt-get install -y fakeroot sudo apt-get install p7zip-full -y sudo apt-get install curl -y   2. Install Ruby (I prefer using rvm) \curl -sSL https://get.rvm.io | bash -s stable --ruby source /home/user/.rvm/scripts/rvm   3. Clone hanlon micro-kernel project into your working directory (my directory ~/wspace/hanlon/hanlon-mk) cd mkdir wspace mkdir hanlon git clone hanlon-mk cd hanlon-mk   4. Clone hanlon micro-kernel project into your working directory (my directory ~/wspace/hanlon/hanlon-mk) cd mkdir wspace mkdir hanlon git clone hanlon-mk   5. Create bundle file: This would create a temporary tar file containing all necessary ...
Post a Comment
Read more

AI - Intelligence is getting Hybrid

Cooperative learning among networks will lead to hybrid intelligence Neural networks will evolve from monolithic to distributed co-operative/competitive models. Coupled with evolving neural-fuzzy and generic fuzzy algorithms — reinforced learning models that are more adaptive to the environment and context (i.e., too noisy and time-varying systems) — these neural networks will evolve into hybrid intelligent systems that integrate different learning and adaptation techniques to overcome individual limitations
Post a Comment
Read more