EMA Blog: Business Intelligence and IT Management

Now that I’ve predicted that in 2018 machine learning will be available to ‘average Joe developer,’ let me share my experience from this weekend. Note that I’m not trying to be a ‘cool geek’ by doing some hands on work (I’m way too old to still be cool), but based on all the machine learning and artificial intelligence buzz in 2017, I thought my use case should be quick, simple, and most importantly solving a problem that could otherwise not be solved.

For readers who would like to see what happened to our 2017 predictions, please take a look. Jens Soeldner and the EMA Team sat down again this month to look into the crystal ball for 2018.

“We want everyday developers (...) to be able to use machine learning much more extensively.” This is Andy Jassy’s mantra targeted at making AWS the company that turns machine learning into a commodity, similar to what the company achieved for IaaS before. Within this context, the following two new offerings stood out of the glut of machine learning and IoT news at Re:Invent 2017.

First Came Autonomic Computing
‘Autonomic Computing’ was the original concept of providing systems and apps with the power autonomously responding to unpredictable challenges. ‘Autonomic Computing’ came with all the right ideas (IBM deserves a good share of credit for defining this concept), but failed due to the same cultural and technological barriers DevOps is struggling with today. There simply was not enough ‘pressure to innovate.' This allowed inertia to prevail, leading to 'business as usual,' instead of magical self-healing and self-optimizing datacenter infrastructure.

“Machine learning (ML) today is frustrating. There is so much potential and the algorithms are all there, but I just do not know how I can leverage it for my organization,” says the CTO of a major professional services firm. “My CEO wants me to ‘leverage ML to lower OPEX and differentiate our service offerings, but there is nothing out there in the market that would allow me to get this done in a manner that has a high probability of success.” Then of course he asks me what I would do and where I would start, because the guy with “Machine Learning and AI” in his job title must know for sure…

What should machine and artificial intelligence (ML/AI) do for IT operations, DevOps and container management? The following table represents my quick outline of the key challenges and specific problem ML/AI needs to address. The table is based on the believe that ML/AI needs to look over the shoulder of IT ops, DevOps, and business management teams to learn from their decision making. In other words, every virtualization administrator fulfills infrastructure provisioning or upgrade requests a little bit differently. Please regard the below table as a preliminary outline and basis for discussion. At this point, and probably at no future point either, I won't claim to know the 'ultimate truth.'

What should machine and artificial intelligence (ML/AI) do for IT operations, DevOps and container management? The following table represents my quick outline of the key challenges and specific problem ML/AI needs to address. The table is based on the believe that ML/AI needs to look over the shoulder of IT ops, DevOps, and business management teams to learn from their decision making. In other words, every virtualization administrator fulfills infrastructure provisioning or upgrade requests a little bit differently. Please regard the below table as a preliminary outline and basis for discussion. At this point, and probably at no future point either, I won't claim to know the 'ultimate truth.'

Why are there still so many repetitive tasks in data center and cloud management today? Why does application management still contain so many manual steps? Why do most organization still suffer from automation and monitoring silos that prevent them from avoiding preventable application outages and service degradations?

“Oh, I’m not coming to VMworld this year, we are at Jenkins instead.” This is a sentence I’ve heard quite a few times now from vendors that I’m used to seeing at VMworld and it makes me wonder what’s going on.

(You can read more about the content of the EMA Top 3 - Enterprise Decision Guide in my first Post)