CSR Driven
innovation
Inclusive innovations
Artificial Intelligence
Philippe TROTIN
Director of Inclusion & E-Accessibility
philippe.trotin@microsoft.com
Mobile ' 33 (6) 64 40 46 77
Question?
What is Artificial
Intelligence?
What is AI?
Machines with capabilities typically
associated with human intelligence
Wikipedia
Learning Perception Cognition
Learning over time without Interpret the meaning of data, Drawing conclusions
direct intervention including text, voice, and images and generate content
AI evolution
Artificial intelligence
A field of computer science that seeks to create
Artificial intelligence intelligent machines that can replicate or surpass
human intelligence.
Machine Learning Machine Learning
A subset of AI that allows machines to learn from
existing data and improve that data to make
decisions or predictions
Deep Learning Deep Learning
A machine learning technique in which layers of
neural networks are used to process data and make
decisions.
Gen AI
Create new written, visual, and auditory
Gen AI
content from guests or existing data.
Question?
Why AI arrive now?
Why now? Cloud
• A strong capacity to collect and store large volumes of data.
• Extremely high computing capacity.
Between 2018 and 2022 (4 years) in AI, the progression is equivalent to...
1997 2022
25 years of
Moore's Law(*)
(*) "Moore's Law" postulates the annual doubling of the performance of integrated circuits (memory and processors).
Question?
Why AI can be
a game changer
for inclusion?
AI | Serving inclusion
Employment
Everyday life
Communication and connection
Image recognition
AI technologies can
perceive, learn and
reason
to
Speech
expand the capabilities recognition
of people and
organizations.
Natural language interactions
Why AI can advance accessibility?
Capture an Play a
image
IA sound
Capture Render text
sound
IA
Capture a Render another
language IA language
Evolutions and an acceleration of innovations...
Speech Voice Language Generative
Vision Reading Translation
recognition synthesis comprehension AI
2016 2017 2018 2018 2018 2020 2023
Equivalent capacity between man and machine
with the aim of facilitating use for all
Microsoft 365 | Accessibility & AI already there
Search (Ctrl + E, /)
Immersive Reader
Auto captioning
Automatic translation
Design ideas
Voice dictation Subtitles
Translation
Reading aloud Transcription
Accessibility checker
Translation Keyboard shortcuts
Accessibility checker Blurred background
Voice dictation
Learning tools Dark theme / High contrast
Reading aloud
Voice dictation
Translation
Voice dictation Accessibility Checker
Accessibility checker
Learning tools Access priority
Mathematical Equation Accessibility checker Noise suppression
Translation Whiteboard
Handwritten entry TTY mobile calls
…
Microsoft Seeing AI
The phone's camera can help a visually
impaired person but also respond to
reading problems (illiterate).
Seeing AI
https://www.microsoft.com/en-us/ai/seeing-ai
Question?
What is
Generative AI?
What is Generative AI?
Generative artificial intelligence is a sub-branch of AI capable of generating new content
TEXT GENERATION MUSIC GENERATION
IMAGE GENERATION VIDEO GENERATION
COMPUTER CODE GENERATION FOLLOW A DISCUSSION (NEW)
Generative AI tools can produce fascinating and imaginative
creations, making them a powerful tool used by various professions.
How does Generative AI work?
The user start a conversation with the Gen AI application. The solution will evaluate the user request and
will try to provide the best possible answer. The model retains the context for its learning as long as the
conversation continues which allow the user to continue the interaction with AI.
Conversational Learning
Context / User Intent
Prompt(s)
Answers
A large language model (LLM) is a set of mathematical algorithms pre-trained on large amounts of data (think
billions!) of text, from books to articles to entire internet archives.
Applications of Prompt Engineering
Chatbots and Virtual Assistants Data Analysis
Designing prompts that enable Using prompts to instruct AI models to
these systems to understand and analyze and interpret large datasets,
respond to user queries extracting meaningful insights.
effectively.
Content Generation Educational Tools
Creating prompts that guide AI Developing prompts that help AI
to generate articles, provide personalized learning
summaries, or creative writing experiences and automated grading.
pieces.
Prompt engineering is essential for maximizing the potential of AI and NLP models, ensuring they
perform tasks accurately and efficiently while minimizing errors and biases. It combines creativity,
technical knowledge, and an understanding of human language to create effective AI interactions.
Question?
What is Microsoft
Copilot?
Copilot : Gen AI from Microsoft
AI conversational assistant to help you
Ambitious goals
Improve Stimulate Facilitate
Productivity Creativity Comprehension
Full integration with Microsoft 365
Microsoft 365
(Word, Excel, PowerPoint, Teams, …)
LLMs Models(*) Contents of
Including GPT-4 Microsoft Graph
(*) LLMs : Language Learning Models
Copilot is here to support you
It's a "Copilot" ... …not an "Autopilot"
Copilot for Microsoft 365 is your assistant. You're always in the driver's seat to review
proposals, use them, or redefine responses.
How can Copilot help you?
Summarize Create Ask
Synthesizing information can be It is always difficult to start from a blank Searching for information in the mass of
complex or time-consuming. sheet of paper to create a document on a content available can be a lot of time.
specific subject or to answer an email.
Copilot helps you easily and quickly Copilot makes your life easier: just ask it and
summarize information and identify Copilot helps you create your content very it can find the information you're looking for
relevant information. easily just with a simple request. faster.
Copilot is natively accessible
Here are some of Copilot's accessibility considerations
Intuitive interface A customizable environment
Using natural language to make it Users could customize their settings
easy for anyone to use the interface. for both the display and the volume of the sounds.
Prompt suggestions Visual and sound reproduction
Proposals should be suggested that are The interface should provide distinct, recognizable, and
simple, relevant and understandable by all consistent sounds for important information
(complex or specialized terms should be avoided). (availability, completion, or error of a task).
Keyboard and/or voice interaction
Limit cognitive overload
Users should be able to use the keyboard or voice
based on their abilities or preferences. A user-friendly, intuitive and simple interface
helps to limit cognitive overload:
• Limit information or options so as not to overwhelm the
user
Intuitive keyboard navigation
• Provide clear and concise instructions (visual cues,
Keyboard navigation should be simple and
icons), grouping and organizing related items
offer shortcuts and common keyboard commands.
• Allow users to control the sequence of the interaction.
Question?
How
Generative AI could
help inclusion?
Solutions to respond to many situations...
Physical disability/mobility Sensorial disability Handicap mental
Arnaud Lucas Anthony Sophie Léa Candice
Muscul. disorders Hand mobility Visually impaired Blind Hearing impaired Down syndrome
Cognitive disabilities
Thomas Sara Phillipe Adrien Damien
Autism Dyorthography Dyslexia ADD/ADHD Dyspraxia
Come and discover the adapted solutions available now
to respond to many situations of disability
Arnaud
have a Musculoskeletal Disorder (MSD) causes him problems working on his computer
in his job as an engineer from time to time.
Keyboard Mouse
He is unable to use intensively a keyboard and also encounter difficulties to use a mouse.
Outlook: Create a draft email
Lucas
have an atrophy of his left hand which sometimes make difficult to manipulate his computer.
He work a lot on data analyze for his company and need to create lots of tables in documents. Mouse
Word: Visualize as a Table a text
Anthony
have vision impairment that makes it difficult for him to work without accommodations.
He can read his screen using a magnifier included in Windows but when the content is Magnifier
complex, it’s not easy for him.
Outlook: Resume an email conversation
Sophie
is blind since her accident and it’s not always easy for her to navigate on internet.
She need to use a screen reader to use her computer and she it’s impossible for her to use Mouse Screen Reader
a mouse to navigate on her computer.
Microsoft Teams: Get a recap on a specific mail subjects
Lea
is a person with earing impairment which makes her having difficulties to follow a Microsoft
Team session easily.
Ear
Microsoft Teams: Resume a meeting or ask questions during a meeting
Damien
have dyspraxia which makes him have difficulties to coordinate his movements.
He can use his keyboard but it’s more complicated for him to use a mouse on a computer and Mouse
therefor it is really time consuming for him to create a beautiful PowerPoint presentation.
PowerPoint: Create a presentation
Thomas
have autism spectrum disorder causing him some difficulties to interact with others.
He can have some difficulties to understand complex document and to identify key elements Understand
in this document.
Word: Create a presentation
Philippe
suffers from dyslexia which makes sometimes complex to read a document.
He usually use the immersive reader to better read his document but helping him to do a Reading
synthesis on a document could makes him more efficient.
Word: Do a synthesis of a document
Sara
suffers from dysorthographia which makes many spelling mistakes when writing a document.
She is using the Editor in Words and other external tools, but she need to be help reformulating Spelling
sentences.
Word: Reformulate sentences
Adrien
have attention deficit disorders and it’s not always easy for him when he must invest a new topic.
He usually use the concentration tool embedded in Windows, but he needs tool to help him Understand
initiate new documents.
Whiteboard: Suggest ideas
Candice
is an allophone employee. she came from Germany and doesn't speak French at all.
She manage a project in France for a few months, she has started to learn the language, but she Language
still has difficulty expressing herself and understanding her collaborators.
Edge: Summarize a PDF file in another language
CSR Examples
Microsoft CSR
examples
AI for Accessibility Program
A 5-year, $25 million investment program to accelerate solutions that amplify
the capabilities of people with disabilities.
Technologies Knowledge Partnership
| AI for Accessibility
Azure credits Financial
AI for Accessibility
Areas of focus:
Employment
Using AI to help people develop additional skills at
work and evolve the culture of inclusive recruitment
Everyday life
Building modern inclusive solutions by making
software and devices smarter and more relevant in
everyday life
Communication and collaboration
Modernizing communication for people, no matter
how they listen, speak or write
aka.ms/AIforAccessibility
AI Business School
• Audience: Decision makers
• Format: Online courses, Free, On demand, Diverse content (articles, videos, use cases)
• Objectives: To give advice and share best practices to decision-makers (Microsoft, Customers, Partners) on how
to implement AI in the organization.
6 Pillars
Define an AI strategy How to promote an Identify the guiding Deploy AI widely Enable business Introduction to AI for
to create business AI-ready culture principles of in your users with AI Business Leaders
value responsible AI organization
For more information microsoft.com/ai-business-school In partnership with
Supporting social entrepreneurs
12 "AI for Good" projects Support from nearly 100
• AI for Earth Microsoft employees
• AI for Health
• AI for Accessibility
• AI for Humanitarian action Commitment of our Partners and our ecosystem
• AI for Cultural Heritage (AI Schools, Ashoka, ShareIT-Accenture, ...)
Microsoft in France
AI School
Atypical Intelligence
15 2 students
Students dropped out
1 day out of 5 of
Days
"soft skills" training
7 IA School Training
Month
1 Apprenticeship in
different companies
Year
42
Simulated job interviews
Training for interviews is already a step towards employment
Objective
Reduce the stress of candidates before their first
recruitment interviews (neurotypical profiles, ...).
Solution
Developing an immersive recruiting environment
with Hololens 2.
43
AI and ethics
Ultimately, it's not just about
what computers can do.
That's what computers
should do.
Brad Smith
President of Microsoft
Inclusive innovations
Make the world accessible to each of us
CSR Driven
innovation
