The State of AI and Machine Learning PDF
The State of AI and Machine Learning PDF
The State of AI
and Machine
Learning
01 Introduction
08 Conclusion
09 References
3
Introduction
The number of organizations of AI, they will need to both efficient, and it can augment
using artificial intelligence (AI) bridge the gaps and embrace human activity, assisting
has skyrocketed in recent years.
1
the commonality between their people in their tasks to improve
Today, more than one-third of efforts to adopt AI. efficiencies and responsiveness
organizations use AI in some to changing business needs.
capacity, and AI deployments Part of adopting and embracing
have grown by 270% during the AI requires obtaining the right This report illustrates the current
last four years. More and more data. Only high-quality training state of AI and machine learning,
companies are focused on data — those annotated for a detailing how organizations are
incorporating AI into their daily specific use case — can help implementing AI within their
business processes. Companies machine learning algorithms business. From the types of
that have already adopted AI to improve their accuracy to data that companies leverage to
report that2 it has allowed them make AI have an impactful the tools they use and budgets
to edge ahead of competitors. role in the real world. But not they have, this report shows the
every company has accessible, differences and commonalities
As companies determine how organized, and annotated data between line-of-business owners
to effectively use artificial that is ready for production. and technical practitioners. For
intelligence, two groups of Understanding how to take readers who might be in the
stakeholders have emerged. raw information and turn it into midst of their own AI projects,
Technical practitioners, who something useful is paramount understanding the dial turns for
are often data scientists or to getting an AI initiative moving. AI success will be invaluable.
machine learning (ML) engineers,
are responsible for writing the When organizations develop AI
code and creating the machine that can work in the real world,
learning models that enable it can have impressive impacts.
these futuristic capabilities. And, However, these impacts are
in many larger organizations, subtle and not the kind of sci-
there are line-of-business (LOB) fi movie scenarios we’re used
owners: managers, directors, to seeing. Today, AI can help
and C-level executives tasked businesses by automating
with overseeing AI initiatives. For tedious, repetitive tasks. It can
companies to enjoy the benefits make business processes more
4
Key Takeaways
Nearly one-third of respondents we
01
surveyed have a minimum AI budget
of $250,000 or more. With some
spending upwards of $5 million.
This report will shed light on why the two groups of people feel
differently about their company’s progress and hopefully help them
to find a common ground along which they can move forward.
We hope this report illuminates a path forward for you and your
organization. Thank you for taking the time to fully consider what
it means to develop AI for the real world.
5
About the Survey
We analyzed survey responses from over machine learning engineers, or software and
300 people across a variety of industries application developers. Our “line-of-business”
and company sizes. We grouped these 300 respondents represent over 50% of product
respondents into two groups: technical and managers or directors with the remainder
line-of-business. Our technical respondents representing job titles as business analyst, vice
represent 80% data scientists with the president and C-level executive.
remaining 20% representing data engineers,
TECHNICAL PRACTITIONERS
Data Scientist
79.7%
Machine Learning Engineer
10%
Data Engineer
5.6%
Software/App Developer
4.7%
6
We asked questions ranging from the budgets of AI projects to the tools and frameworks teams use to
develop their machine learning algorithms. Additional questions about the importance of AI for business
to AI’s societal impact were also asked to help broadly paint a picture of just how pervasive AI initiatives
are becoming the norm. Other questions related to the data types being used for AI, as well as business-
process bottlenecks related to AI adoption, help illuminate where AI business challenges still exist and how
both technical and line-of-business respondents can effectively progress their AI initiatives.
This is the fourth survey of its kind that Figure Eight has conducted, analyzed, and distributed. In previous
years, the survey was known as the “Data Scientist Report.” This year, we realized the survey and report
needed to evolve. The goal in issuing the survey is to better understand the challenges of getting an AI and
ML initiative off the ground from the perspective of the technical individuals working on the projects and the
managers who oversee larger teams and even entire companies. As such, it became clear the survey was
not simply about data scientists but about understanding the growing application of AI in the real world.
TL;DR: Though many organizations already support AI and ML initiatives or are excited to get their
particular AI efforts off the ground, there still remain key differences on how technical employees
and LOB owners approach AI.
LINE-OF-BUSINESS
Product Manager/Director
53.7%
Business Process/Dept Owner
14.5%
Program Manager/Director
12.7%
VP/C-Level Executive
12.7%
Business Process/Dept Owner
8
Nearly three-
quarters of technical
respondents 73.5%
spend 25% or
more of their time
managing, cleaning,
and/or labeling data
33.5%
29%
26.5%
AMOUNT OF TIME
0 - 24%
10.5%
25 - 49%
50 - 74%
<1% 75 - 99%
100%
(Figure 4: How technical practitioners spend their
time managing and cleaning their data)
9
How often are you maintaining/updating
your machine learning model?
Sometimes Constantly
56% 37%
(Figure 5: How often technical practitioners are managing their machine learning models)
10
Data management is not the
only thing making it difficult
for technical practitioners
to create their algorithms.
Executive/
Management 17%
“Buy-In”
Lack of technical
resources/ 24%
qualified people
Lack of
technical tools 3%
11
The Future is…
Human? Machine?
Cyborg?
Finally, technical practitioners may have a slightly different view of what AI in the real world
looks like. Nearly half (48%) of line-of-business owner respondents believe the future of AI will
resemble “bionics,” a sort of symbiotic “humans + machines” combination. Just 35.6% of technical
people believe the same, with slightly more technical people feeling AI will exist as “humans with
machines existing in work.” More than double the amount of technical practitioners than line-
of-business owners (13.6% vs. 6.3%) see AI producing a 100% machine future.
What does AI
mean to you?
35%
Humans + Machines
Combined (e.g., Bionics)
48%
TECHNICAL PRACTITIONERS
LINE OF BUSINESS
12
The solution?
It’s clear that people in line-of-business roles and
technical practitioners must do more to collaborate.
By getting in the same room, the two groups can
work to find common ground when it comes to
their AI initiatives.
13
LOB Budgets Suggest
Growing Importance
of AI Initiatives
Nearly one-third (29%) of line-of-business respondents report that their AI
budget is $250,000 or more. This investment makes it imperative that line-
of-business owners and technical practitioners form a united front when it
comes to AI decision making.
14
The belief in AI adoption, and the processes that support it, is
another place where technical and line-of-business AI owners
differ in their response. While 49% of technical practitioners feel
their company is behind when it comes to adopting AI, 59.5% of
line-of-business owners feel their companies are behind. Perhaps
collaborating more and finding common ground can help these
two groups better understand where companies are in their path
to AI success.
Do you feel
that your
company is
behind when
it comes to
adopting AI? TECHNICAL PRACTITIONERS
LINE OF BUSINESS
51%
NO
40%
15
When asked what type of data their organizations are: text, time-series, and still images. Product or
use most often for AI initiatives, line-of-business SKU data also appears to be growing as a chosen
and technical practitioner respondents replied data type. The rise of visual data types hints at
with an array of answers. However, across both more practical applications of AI in the real world,
the line-of-business respondents and technical from ML-driven agriculture machinery to self-
practitioners, the most common data types in use driving vehicles.
T E XT E -S E R I E S ILL I
M AGE
S
TI M ST
O
O
N
PR
AU DIO OTHER
20% 6%
(Figure 10: Types of data respondents work with for use with AI)
16
According to respondents, 81% of technical of technical practitioners say that more than 50%
practitioners and nearly 79% of line-of-business of their company’s focus is on AI. 44% of line-of-
owners say AI is core to their business: These business owners say their companies direct at
budgets aren’t going toward projects and one- least half of their focus toward AI initiatives. AI
off initiatives; they are powering the heart of is a core to many businesses, and takes up the
businesses themselves. More than one-third (38%) majority of the focus of many organizations.
0% (Not 18%
core to our
business) 22%
23%
10%
19%
21%
25%
15%
20%
50%
22%
10%
75%
19%
8%
100%
4%
TECHNICAL PRACTITIONERS
LINE OF BUSINESS
17
This AI focus is driven by leaders at the top level of many organizations. For line-of-business
owners, 22.8% report that the CTO is responsible, 12.7% report the CTO is responsible, and 19%
report they — manager level and above — are responsible.
For technical practitioners, 20% feel the CTO is responsible, 10.3% feel the CEO is responsible,
and 14.4% feel they — mostly data scientists and machine learning engineers — are responsible.
That around one in seven technical practitioners feel they must fight to make AI work in their
organization while also cleaning data and managing algorithms suggests a need for a different
organization hierarchy. For organizations with the resources, these findings may point to
demand for a CIO or chief data officer-type of role to accept responsibility for AI initiatives.
11%
Manager level
11%
Chief Executive
Officer (CEO)
5%
Chief Data Officer
(CDO)
11%
VP level
21%
<1% Chief Technology
Chief HR Officer Officer (CTO)/Head
(CHRO) of Technology
18
Who is ultimately responsible for all AI
initiatives within your organization?
2%
9% Other
No one/No initiative
14%
in place
I am
14%
Manager level
10%
Chief Executive
Officer (CEO)
1%
TECHNICAL
Chief Operating
PRACTITIONERS Officer (COO)
5%
Chief Data Officer
(CDO)
13%
Director level
20%
11% Chief Technology
Officer (CTO)/Head
VP level
of Technology
19
A full 67.3% of technical practitioners have consumed at least 11 pieces of ML-related content — articles,
blog posts, whitepapers, etc. — in the past six months. 55% of line-of-business owners also report having
reviewed at least 11 pieces of content. Reading is not the only way individuals are investing time and energy
learning about the latest in AI and ML.
2% 2%
13%
25%
LINE OF TECHNICAL
BUSINESS PRACTITIONERS
18%
55% 18%
67%
1 - 3
4 - 10
11 +
20
Nearly 90% of technical practitioners will attend at least one industry event in the next year versus 78%
of line-of-business owners who will be in attendance. 35% of technical respondents will even attend 3 or
more events, while 37.5% of line-of-business owners will attend multiple events, showcasing how creating
useful AI is an ongoing process for many.
12% 11%
13% 22%
LINE OF TECHNICAL
BUSINESS PRACTITIONERS
23%
1 OR 2
3 OR 4
5 OR MORE
(Figure 15: Number of AI events which will be attended within the next 12 months)
21
One reason organizations are
investing so much money and
time into AI initiatives is because
they truly believe those initiatives
will have an impact on the world
around them. 47% of technical
practitioners believe their AI
projects will have a large or
massive impact on the world,
though a majority (59.5%) of line-
of-business owners feel similarly.
This tells us that line-of-business
individuals feel their projects
are more impactful than their
technical peers do.
2% 4%
14% 12%
10%
14%
35%
LINE OF TECHNICAL
BUSINESS PRACTITIONERS
28%
46%
35%
NONE
S M A L L I M PACT
AV E RAGE I M PACT
L A R GE I M PACT
M AS S I V E I M PACT
A m a zo n S a g e M a k e r 20%
AW S D e e p L e a r n i n g A M I 12.5%
BigDL 1.8%
Boken 1.8%
C a f f e / C a f f e2 4.6%
Chainer 0.9%
CNTK 4.2%
Deeplearning4j 2.3%
DyNet 0.5%
Figure Eight 7.9%
Gluon 1.4%
Google Cloud ML Engine 13%
I B M Wa t s o n 5.6%
Ke r a s 40.9%
Licensing 0.5%
Matplotlib 51.2%
Microsof t A zure
Machine Learning 5.6%
Mxnet 7%
NumPy
74.9%
Paddle 0.5%
Pandas
77.2%
P y t o r c h & To r c h 32.6%
Salesforce Einstein 0.5%
S c i k i t- l e a r n
74.9%
Seaborn 38.6%
Te n s o r F l o w 54.4%
Theano 8.8%
Other 9.3%
43% of Technical
Practitioners said No
57% of Technical
Practitioners said Yes
24
Bridging the AI Gap
We have seen that there are some differences between technical practitioners and line-of-business
owners about how they view their organization’s AI progress. Bridging the gap between the two
practitioners will be an instrumental component in building a strong AI infrastructure.
One difference teams may encounter is where they expect AI to be deployed first within an
organization. A vast majority (62.5%) of line-of-business owners expect that AI will first be in
engineering or product deployment. Technical practitioners mostly feel similarly, except that 7%
feel that AI initiative efforts will first go toward helping the IT team perform tasks. The disconnect
could be due to a perception among engineers and data scientists that AI is a tool to assist with the
automation of tedious tasks. Line-of-business owners may be more likely to leverage AI to improve
decision making and support other business processes.
32%
32%
LINE OF TECHNICAL
BUSINESS PRACTITIONERS
1%
12%
7%
37%
6%
9%
3%
5% 4%
1%
25
Earning executive buy-in is the key to getting an AI
initiative off the ground. Line-of-business owners
felt someone like a CTO or the respondents
themselves — most of whom are manager-level
and above — are responsible for AI initiatives within
their organizations. Technical practitioners were The differences in data type usage start to
also most likely to report that a CTO is responsible appear as respondents work their way down
for AI initiatives. However, technical individuals also the list of data-type choices. 45.6% of line-of-
reported that the respondents themselves — who business individuals highlight still images as
are mostly data scientists — are the second-most a major data type, while just 34% of technical
likely group to be responsible for AI initiatives. practitioners say images are a major data source.
The widest gap exists with time-series data, the
It seems that both groups can align on the next most used form of data. While just 40.5% of
idea of an executive-level individual carrying line-of-business respondents say they use time-
the responsibility for initiatives. However, the series data, 60% of technical practitioners report
groups diverge after that decision, each feeling using time-series data.
they are responsible for the project at hand.
This divergence is where both line-of-business These differences suggest data scientists may
owners and technical practitioners must find lack the resources needed to annotate still images
common ground. Getting these teams and the and time-series data. It will be difficult to align on
authorizing executive in a room together to carve the resources necessary for AI initiatives if the two
out a common understanding of responsibility groups cannot first come together to determine
will be hugely helpful in building a successful and the types of data they will use.
sustainable AI initiative.
26
Crawl, Walk, Run with AI
Before your AI initiative can run,
it must first crawl and then walk.
Creating a successful AI initiative How would you
requires examining where your categorize the state
organization is in terms of adopting of your data?
AI. More line-of-business owners
(59.5%) than technical practitioners
(49%) feel their organization is behind
Completely
when it comes to adopting AI.
unusable data 2%
Bridging that gap and understanding
why the groups feel differently can
be a starting point in addressing Unorganized, inaccessible
and unannotated 9%
AI readiness. This also shows that
nearly half of all respondents,
regardless of role, feel like they are
Unorganized, inaccessible
behind. One reason respondents may BUT annotated 4%
feel they are behind may be due to
the state of their data.
Unorganized, BUT
accessible and annotated 13%
All AI initiatives must have organized,
usable data. Luckily, most (72.7%)
technical practitioners report Organized, accessible
that their data is organized and BUT unannotated 28%
accessible. However, just 22% of
those respondents report that their
Organized, accessible
data is “Organized, accessible and
and annotated 10%
annotated, being used for business
purposes and AI.”
Organized, accessible and
27
36% of data scientists say that 61% or more of their work informs or powers
AI initiatives or projects. While not all data scientists are tasked with AI, it
seems that the majority of respondents do not spend most of their time
working on AI projects. Determining if this is the correct time allotment or if
data scientists should be spending more time on AI projects will be helpful
in understanding why or why not an organization feels AI ready.
2%
15%
17%
TECHNICAL
PRACTITIONERS
21%
23%
22%
(Figure 21: The work of the AI technical practitioner informs AI initiatives and projects)
28
Nearly one-third of either group (31.7% for line-of-business owners and
34% of data scientists) reports that their company’s AI initiatives are
already launched. The timelines for both groups is a fairly even split.
Nearly one-third believes their AI initiatives are one month to one year
away from being launched, and about a final third of respondents in
either group feels their launches are one year or more away. The good
news is both groups seem to have formed a consensus about their
timelines. Now it’s up to both groups to determine how to best address
those timelines given their current resources.
34%
Already
launched
32%
12%
1 - 6 Months
10%
21%
6 - 12 Months
23%
15%
1 - 2 Years
18%
7%
3 - 5 Years
7%
3%
5 + Years
1%
Never, no 8%
AI initiatives
in place 9%
TECHNICAL PRACTITIONERS
LINE OF BUSINESS
29
Conclusion
AI is already making its mark on real-world organization’s end products. Some believe AI will
applications. Though the perfect autonomous help accelerate scientific discovery. For many, AI’s
vehicle algorithms, for example, have not yet best use case is to supplement and complement
emerged, every new attempt at creating AI for human intelligence.
public use helps us move one step closer. While we
wait for the more fantastic deployments to arrive, Whatever your use for AI, we hope this report
we can already begin to enjoy some of the ways in has helped you gain a better understanding
which AI is helping businesses compete and earn of the current landscape and appetite for AI
competitive edges. initiatives among business leaders and technical
practitioners. Please feel free to reach out should
Respondents see AI being used in the real world you have any questions about what you’ve read
to accomplish a number of tasks. Some believe here or about embarking upon your own AI journey.
it will help automate processes, workflows, and
simple tasks. Others feel it will enhance their
30
Reference
1 Gartner, “Gartner Survey Shows 37 Percent of Organizations Have
Implemented AI in Some Form”, https://www.gartner.com/en/newsroom/
press-releases/2019-01-21-gartner-survey-shows-37-percent-of-
organizations-have
3 LinkedIn Talent Blog, “These are the 15 Fastest-Growing Jobs in the U.S.”,
https://business.linkedin.com/talent-solutions/blog/trends-and-
research/2018/linkedin-emerging-jobs-report-2018
5 Figure Eight, “How to Build, Train, Test, and Deploy a Machine Learning Model”,
https://www.figure-eight.com/how-to-build-train-test-and-deploy-a-
machine-learning-model/
31
To learn how you can advance your AI and
machine learning initiatives, visit us at
www.figure-eight.com
S TAT E
E I G AP B E T W E E N DA O
HEA T
F CIENTISTS •
A
T
H
S
T
• BRIDGING
G
AI A
IN
AN
RS
E
D
D
N
I
N
A
L W
IN O
R
M E-
OF-
E
BUSIN
ES
S
A
AC
HINE L