Research suggests many companies can't find the talent they need, as they struggle to deal with turning their vast supplies of data into usable information.

Generally this means a hunt for data scientists, which has sent demand for recruits who can fill this particular job title skyrocketing. But while hiring more people who call themselves data scientists is one way to fix the problem, companies are also coming up with alternatives that don't mean joining the race to hire a few of these elusive individuals.

Special Feature

The New Rules of Work

In the office, hybrid or remote, here's what is changing about where, when and how you do your job.

Tech analyst Forrester warned five years ago that while companies were busy directing huge resources to attracting data science talent, there was a risk that they were forgetting to invest in the engineering capability that would help scientists create value from data. Now, it looks as if some companies are starting to address that imbalance. 

SEE: Software skills will get you far, but you don't have to be a coder to make it big in tech

Lo?c Giraud, global head of digital platform and product delivery at life sciences giant Novartis, recognises that the battle for talent was a huge issue not so long ago. But today, it's less of a concern.

"I think there's hype," he says. "Two years ago, it was very difficult to get data scientists."

Novartis has about 2,000 data scientists and Giraud says his battle for talent is now focused on other areas, including snaring data engineering talent and honing business analyst capability -and he expects other companies to come to similar conclusions, too.

"I don't think the demand for data scientists is going to increase. I think you will find more technologies, which are easier to consume and for business analysts to do the science," he says. 

"In fact, even in our organisation, we're not trying to look for more data scientists. We are trying to build software solutions that can be used by more people and to democratise data science with business analysts." 

Novartis is focused on finding the full-stack engineering capability it needs to help business analysts around the organisation make the most of the data it holds.

While data scientists use their skills to create models and solve problems, data engineers build and manage the infrastructure that sits between data sources and data analytics. Both are important, yet there's increasing evidence to suggest that too much emphasis has been placed on data science at the expense of data engineering.

Another industry commentator has suggested "a course correction" is taking place. Data scientist Maruf Hossain wrote in a blog post last year that many organisations hire data scientists and then present them with work more commonly associated to data engineers. 

He suggests that this misalignment occurs because many data scientists join companies that don't have strong technological foundations in place to run analytics.

The task then falls to data scientists to help build those foundations. So, when they should be coding or creating algorithms, some scientists end up fulfilling technical roles that are unlikely to fit snugly with their existing capabilities.

It's worth nothing that, regardless of the role they end up fulfilling, companies are still on the lookout for data science talent: CodinGame and CoderPad's recent Tech Hiring Survey identified data science as a profession where demand greatly outstrips supply.

Of course, whether those companies require full-blow data scientists or something more akin to a full-stack engineer is something that many candidates might only discover once they start working in the role.

Special Feature

Tech skills: Upgrade your job

The new world of work needs a new set of skills. Here's what you need to know to get ahead.

To that end, the work that Giraud and his colleagues at Novartis have already undertaken presents some important pointers for managers looking to hire data scientists and for professionals looking to take on these roles.

SEE: How to get promoted: Five ways to climb the ladder and have a successful career

The company's approach to ensuring its data scientist skills gaps have been filled during the past few years has involved a journey of discovery that's now leading to a new focus on engineering and business analysis.

The company took a cloud-based approach and adopted Snowflake in 2017 as part of an all-encompassing effort