Splunk Inc. has released research that shows organisations are ignoring potentially valuable data and don’t have the resources they need to take advantage of it. The research reveals that although business executives recognise the value of using all of their data, more than half (55%) of an organisation’s total data is ‘dark data,’ meaning they either don’t know it exists or don’t know how to find, prepare, analyse or use it.
The State of Dark Data Report, built using research conducted by TRUE Global Intelligence and directed by Splunk, surveyed more than 1,300 global business managers and IT leaders about how their organisations collect, manage and use data. In an era where data is connecting devices, systems, and people at unprecedented growth rates, the results show that while data is top of mind, action is often far behind.
· 76% respondents surveyed across the US, UK, France, Germany, China, Japan, and Australia agree “the organisation that has the most data is going to win.”
· 60% respondents said that more than half of their organisations’ data is dark, and one-third of respondents say more than 75% of their organisation’s data is dark
· Business leaders say their top three obstacles to recovering dark data is the volume of data, followed by the lack of necessary skill sets and resources.
· More than half (56%) admit that ‘data-driven’ is just a slogan in their organisation
· 82% say humans are and will always be at the heart of AI
Tim Tully, Chief Technology Officer, Splunk said, “data is hard to work with because it’s growing at an alarming rate and is hard to structure and organise. So, it’s easy for organisations to feel helpless in this chaotic landscape. I was pleased to see the opportunity people around the world attach to dark data, even though fewer than a third of those surveyed say they have the skills to turn data into action. This presents a tremendous opportunity for motivated leaders, professionals, and employers to learn new skills and reach a new level of results. Splunk can help those organizations feel empowered to take control of identifying and using dark data.”
While respondents understand the value of dark data, they admit they don’t have the tools, expertise or staff to take advantage of it. Plus, the majority of senior leaders say they are close enough to retirement that they aren’t motivated to become data-literate.
· 92% they are ‘willing’ to learn new data skills but only 57% are ‘extremely’ or ‘very’ enthusiastic to work more with data
· 69% said they were content to keep doing what they’re doing, regardless of the impact on the business or their career
· More than half of respondents (53%) said they are too old to learn new data skills when asked what they were doing to educate themselves and their teams
· 66% cite a lack of support from senior leaders as a challenge in gathering data and roughly one-in-five respondents (21%) cite a lack of interest from organisation leaders as a challenge.
Globally, respondents believe AI will generally augment opportunities, rather than replace people.
· A majority of respondents (71%) saw potential in employing AI to analyse data
· 73% think AI can make up for the skills gaps in IT
· 82% say humans are and will always be at the heart of AI and 72% say that AI is just a tool to solve business problems
· Only 12% are using AI to guide business strategy and 61% expect their organisation to increase its use of AI this way over the next five years
There are also some key differences in the UK specific results. For example, 39 per cent of people in the UK believe AI can make up for the skills gap versus only 27 per cent globally. UK employees are also the most likely in the world to say they need to learn more data skills in order to get promoted again, 83 per cent compared to the global figure of 76 per cent.