Hospital Digital Maturity Assessment: Electronic Medical Records Adoption
Hospital Digital Maturity Assessment: Electronic Medical Records Adoption
DMA Team
Outline
• Background
• Purpose of digital maturity assessment
• Method of assessment
• Assessment results
• Recommendation
• Conclusion
Background
Digital health transformation
ICT Infrastructure and Information Systems
Governance
Consideration of digital maturity assessment
• Supporting digital health
Digital health
transformation
transformation in Indonesia
(SatuSehat)
• Self-assessment and immediate
Electronic results and feedback
Stakeholders Medical
engagement Records
Adoption • Capability for continues improvement
of digital maturity and electronic
medical records implementation.
MoH Strategic Planning
and National Regulation
• Community engagement and support
(PERSI and PORMIKI)
Purpose of the digital maturity assessment
• Assess the current state of digital technology adoption in hospital level
to improve the quality and efficiency of medical services.
• Identify challenges of digital health implementation in hospital level and
develop recommendations on digital health adoption, strategy and
investment priorities.
• Provide tool for benchmarking the adoption of digital innovation in
hospital level
• Engage community and professional association for the assessment and
improvement of digital maturity at hospital level.
Method of maturity assessment
Assessment protocol
• DHIS2
• Expert MoH, Province
Internal Electronic platform
meeting Pilot Test and District
Team • Spreadsheet level Form • Technical
support
Socialization and • Hybrid meeting
distribution self- • Inviting all
assessment hospital
representatives in
collaboration with
PERSI
Recommendations to complete self-assessment
1. Unit IT/HIS as the person in charge
2. Study the hospital's digital maturity assessment instrument
3. Identification of stakeholders for further consultation
(clinicians, users, managers, other units)
4. Provide several relevant documents such as regulations,
reports, hospital profiles, technical guidelines, strategic plan
documents, SOPs and others.
5. Complete a self-assessment with other stakeholders (internal
meeting or joint workshop) by choosing the conditions most
suitable for the hospital.
Monitoring and supervision
• Coordination with Directorate General Healthcare Services (Yankes)
• Circular letter from the Secretary General of MoH to all hospitals and
health offices (Bidang Yankes)
• Site visit and coordination in several provinces in Indonesia
• Reminder that facilitate by the Hospital Association (PERSI) and
PORMIKI
Data Analysis Strategy
680; 40%
1029; 60%
Male Female
Hospital information systems (HIS) status
HIS Status* Level 1 Level 2 Level 3 Level 4 Level 5
Unknown 3 24 29 4
Le
vel
2;
36
1;
Le 37
vel %
3;
41
0;
42
%
DMI and hospital ownership (n=973)
Hospital Ownership* Level 1 Level 2 Level 3 Level 4 Level 5
BUMN 5 3
Kementerian Lain 5 4 2
Kemkes 4 16 8 1
Pemkab 31 97 47 14 2
Pemkot 3 20 18 5
Pemprop 7 44 31 8 1
POLRI 1 3 7 2
Swasta 17 120 203 66
Swasta Non Profit 7 51 72 19 1
TNI 2 12 9 5
Grand Total 68 361 410 129 5
2.6
Sulawesi
2.2 Sumatera
b. MALUKU-NTT-NTB
2 Kalimantan c. SULAWESI
d. KALIMANTAN
1.8 Papua e. SUMATERA
1.6 f. JAWA-BALI
1.4
1.2
1
1 1.2 1.4 1.6 1.8 2 2.2 2.4 2.6
DMI Sub-nasional*
Stage of RME Adoption
Response rate RME
Target self-assessment RME (n=3,052)
100% 100.0
90% 90.0
80% 80.0
70% 70.0
60% 60.0
50% 50.0
40% 40.0
30% 30.0
20% 20.0
10% 10.0
0% 0.0
B I A N L O A T T A T A N G A LI U R N G LU A T A T A U A U A N U R A H A T R A E N A H A T E H R A A N R A R A A H K U U R R A A T U A
M I I
J A AT TA AR AR AR TU - B IM PU KU AR AR R - R AT IM NG AR TA NT NG AR AC TA AT TA GA NG LU IM TA AR AP
I
- EL ON I B AK AK L 51 A M G B B AN 4 EL N T E B I U BA E B - U EL U G E A A T U B - P
T
5
1 S R ES I J Y B E N
W - LA BE WA RA AU
1 S A T N T A 1 A N T M A
N O W K OG A A A A T A TA ES 6 - N ER 1 KU SI S ER TE SI 1 - AR TAN PU 91
A W 3 T T A U
TA - G LA - D I Y GK - J 18 7 - - J GG UL N W
ER MA JA AN LA A AL WE AT ES AW
I E 8 G N A
G
N 5
A 7 SU 3 - D AN 1 3 5 1 2
3 EN KE
P T -
A LI 3 LIM SU
N
A UM M A M W L E N IMA - P
M
I S - L U T A L 92
L IM - 4 B T - U
M A 3 A -
K L - 8 2 U - S LA S U A
76 3 K S S -K
K A AN S A 21 - S 4-
1
- 71
- K A 13 3
- 12 SU 2 -
U
3
- A U N
U
1 6 6 6
62 7 4
- 7
- N 65
6 L - 7
P U 52 53
E
-K
1 9
100%
90% 6; 1% 5; 1%
80%
70%
137; 18% Stage 0
60% 171; 22% Stage 1
50% Stage 2
Stage 3
40% 139; 18% Stage 4
30% Stage 5
243; 31% Stage 6
20%
10% 7
0% 1;
Class A Class B Class C Class D D PRATAMA 9
%
Stage 0 Stage 1 Stage 2 Stage 3 Stage 4 Stage 5 Stage 6
DMI and RME Stage (n=772)
Hospital Digital Maturity
Index by Components
DMI Level by Components (n=973)
• In average DMI level
I. Hospital Information Systems and Infrastructure
was 2.63
4 • HIS infrastructure and
VII. EMR and Patient Center Care
3
II. Standards and Interoperability
human resource, skills
2
and HIS usage were
1
perceived higher
0
compare to other
VI. Information security, privacy and data confidentiality III. Management and governance
componenents
3.00
0.00
1. Sumatera 2. Jawa-Bali 3. Kalimantan 4. Sulawesi 5. NTB-NTT-Maluku 6. Papua
Component I. Information
systems and ICT Infrastructure
Information systems and ICT Infrastructure maturity by province
Average sub-component I
4
I.F. IS Resource Planning I.B. Back Office
3
5 5
5 4.774.87 4.874.93 4.924.92 4.92
4.79 4.74
4
4
3.44
3.01 3.07 3.07 3.1
3 2.72 2.74
2.62 2.69
2.45
2.33
2.17
2
0
1. Sumatera 2. Jawa-Bali 3. Kalimantan 4. Sulawesi 6. NTB-NTT-Maluku 7. Papua
5 4.77 4.62
3.95
4 3.64
3.38
2.91 3.09 3.03
3
2.16 2.31 2.21
2 1.79
0
n n k e s t e s n e e
io tio or ur ed ce or nc ce io ic ur
ct c tw ct u s
v i p p a vi
nc
t
er
v ct
fu
n
fu
n e tru s er ls
u en er fu tS tru
tn s m s nt s t s
fic
e
fi ce ne fra st
e gy c a ai lit
y en e n fra
f of er i n
Sy lo ni M i m ti
fI
n
t o
k In
t n o ch m rab ge o Pa
on ac . tio tio
n hn te te e i ty a nt
F r
.B
.1 i ca a te
c m ys rop i l an e
.1
.
.1 I.C un rm on ste
n
S te rab m re
m
.I A I.B m fo ti y
i o i ty in e u
m In a S at nd il ro
p c
co v e n ic
i o n m a erb te P ro
i u at r
a ta v at m m In fo tio
n
rop .I
n
.1
.
d o m r . a te .3 I.F
ic I nn co In fo
D
.3
e gr . In I.E
n . d . I. t 2
ctro C
.3 an D
.2 .I
n
I.E.
le I. n I. .1
.E a tio I.E
.2 rm
I.C n fo
.I
.1
I.D
Component II. Standards and
Interoperability
Standard and interoperability
Sub-components II by geographic region
3.5
3.24
3.1
3 2.91
2.81
2.71
2.5
2.5 2.38
2.23 2.25
2.01 2.01
2
1.75
1.5
0.5
0
1. Sumatera 2. Jawa-Bali 3. Kalimantan 4. Sulawesi 6. NTB-NTT-Maluku 7. Papua
3.06
3
2.53
2.25
1.98
2
0
II.A. Internal interoperability II.B. External interoperability II.B.1. External Data Exchange Average of II.B.2. Exchange of
Standard Individual Data
Komparasi kematangan standar dan interoperabilitas Mikro
dan Makro Level
3 Jawa-Bali
NTB-NTT-Maluku-Maluku Utara
2.8
2.6 Sulawesi
DMI Rumah Sakit
2.4
Kalimantan Sumatera
2.2
2 Papua
1.8
1.6
1.4
1.2
1
0 0.2 0.4 0.6 0.8 1 1.2 1.4 1.6 1.8 2 2.2 2.4
DMI Sub-nasional*
Component III. Management
and governance
Management and government maturity by province
Average sub-component III
III.A. IS/IT Strategic Plan
3
2.5
2
1.5
1
0.5
III.D. Information System Investment 0 III.B. IS/IT Governance
III.C. HR at IT Unit
Sub-components III by geographic region
3.50
3.17
3.00 2.86
2.79
2.722.72 2.66
2.51 2.52
2.50 2.45
2.37 2.36 2.33
2.30
2.19 2.222.22 2.20 2.23 2.17
2.12 2.16
1.99
2.00
1.50
1.00 1.00
1.00
0.50
0.00
1. Sumatera 2. Jawa-Bali 3. Kalimantan 4. Sulawesi 6. NTB-NTT-Maluku 7. Papua
III.A. IS/IT Strategic Plan III.B. IS/IT Governance III.C. HR at IT Unit III.D. Information System Investment
Average parameters of sub-component III
3.5 3.23
2.95 2.97
3
2.69
2.53 2.55
2.5 2.28 2.22
2 1.89
1.5
0.5
0
t t
an ev c e ce IS n g R en en
Pl on an an of
H ni H
pm m
i c M rn rn la
n
a nd o st
eg n ve ve tio
n P t el ve
t
Pl
a o o ni v In
S tra c G G ul
a H
R U d e m
i IT IT g T .I
T ty te
m teg 1. of e .I .3 ci s
s te tra .B
. n d
R .1
.C pa Sy
Sy III io an .C III ca n
S a t III io
i on .I
T
a lu i es H
R at
at 3 m
.A. Ev l ic .I
T for
fo
rm III d Po .4 .I
n
In an .4. .C .1
l ng .B III .D
i ta ri III III
sp ito of
o on e
.H M rag
.1 3 . e
III
.A
I.B. Av
II
Component IV. Data analysis
Data analysis maturity by province
Average sub-component IV and Parameters
3.00
2.50 2.39
1.98
2.00 1.83 1.83
1.67 1.68
1.56
1.50
1.12
1.00
0.50
0.00
s l
l ity m ic ls ls si
s ta ta
ua s te yt i ta ita ly pi da
sy al os
p sp a
ho
s g
Q
an ho An bi
nd i on a in
h
in a in ng
a ct at y at h gi
se l le . D us
e lit g
D ac na
U co .2 a i ro a
at
a A at
a qu .B p m
at
a
IV
.
D a .B ap r
. D
ld 3. at IV ta s
fo
V .A ti a .A
.
4 .D da rce
I sp
o IV .A. B ig ou
H IV .1
. es
.1. .B .R
.A IV .2
IV .B
IV
Sub-components IV by geographic region
3.50
3.00
3.00
2.50
2.28
2.04 2.05
2.00 1.90 1.96 1.86 1.88
1.80
1.72 1.72
1.64
1.50
1.00
0.50
0.00
1. Sumatera 2. Jawa-Bali 3. Kalimantan 4. Sulawesi 6. NTB-NTT-Maluku 7. Papua
4.00
3.00
2.00
1.00
V.D. Knowledge Management 0.00 V.B. Ease of use and usefulness
3.51
3.5 3.33
3.29
3.07 3.07 3.1
2.97
3 2.87 2.83
2.74 2.71 2.76
2.62 2.67
2.55 2.5
2.5 2.37
2.2
2.01 2
2 1.88 1.88 1.83
1.5
1.5
0.5
0
1. Sumatera 2. Jawa-Bali 3. Kalimantan 4. Sulawesi 6. NTB-NTT-Maluku 7. Papua
V.A. Digital Literacy V.B. Ease of use and usefulness V.C. Iinformation systems usage V.D. Knowledge Management
Average parameters of Component V
4.50
3.95 3.96
4.00 3.72
3.50 3.34
3.15 3.15
3.02
3.00 2.87
2.61
2.50 2.36 2.38
2.09
2.00
1.50
1.00
0.50
0.00
y r s t s s t t
ac se en se ce s on e rin
g
en en
r U tem m fu en ne pi tiv m
ite IS s e o er
i
fu
l m n ti o e em
ll sy g e p e ha ce on ag ag
ita fH n ga as ex s C in M an ng
ig ro tio e n
. E r .U IT ge ge M e
D be
a
se
r .1 se .3 . a a e i t
1. rm B U V.
B .1 us s g un
A . u m
nf
o U V. 2. V.
C .U ed ce
V. N li 4. .
te
m .3 l
vi
2. ti a .A. V.
B s C no
w
er
A . p V .S
y V. K .S
V. os .2 .1
.
.2
fh C D D
o V. V. V.
se
U
.3.
A
V.
Component VI. Information
security, privacy and data
confidentiality
Information security, privacy and data confidentiality maturity by province
Average sub-component VI and Parameters
4.00
3.00 2.86
2.46 2.60 2.56 2.39
2.15 2.08 2.13
2.00 1.79
1.00
0.00
Sub-components V by geographic region
3.00
2.68 2.67
2.46 2.47 2.49
2.50
2.34 2.33
2.25
2.11
2.04
2.00
1.74
1.50
1.00 0.88
0.50
0.00
1. Sumatera 2. Jawa-Bali 3. Kalimantan 4. Sulawesi 6. NTB-NTT-Maluku 7. Papua
VI.A. Security and access to patient data VI.B. Information system security procedures
Component VII. EMR and
Patient Center Care
EMR and Patient Center Care maturity by province
Average sub-component V
4.00
3.00
2.00
1.00
VII.D. Personalized Medicine 0.00 VII.B. Patient Center Care
2.47 2.54
2.5 2.4 2.45
2.37
2.21 2.15 2.21
2.07 2.02
2
1.79 1.75
1.62
1.46
1.5
1 1 1
1
0.5
0
1. Sumatera 2. Jawa-Bali 3. Kalimantan 4. Sulawesi 6. NTB-NTT-Maluku 7. Papua
VII.A. EMR function VII.B. Patient Center Care VII.C. EMR Adoption VII.D. Personalized Medicine
Average parameters of Component VII
5.00
4.50 4.36 4.36
4.05
4.00
3.50 3.16
3.00 2.75
2.55 2.42
2.50 2.31 2.29
1.97 2.04
2.00 1.88
1.52
1.50 1.33
1.00
0.50
0.00
gn d e s ta w ty n e n n s ty s
si cor car ord da flo b i li ctio a tiv tio tio i ce b ili i ce
a a v v
de lr
e
en
t
re
c
ge ic
e
er
a
i sf
a
is
tr
e nt is
tr er er
a er
rd a ti l a rv p t i n m i n t S p S
o ic pa ic
a m se o Sa or o d
rec ed n d a li l ter t d m
o cu d m p t er i ze
o e i t a i n n A d A p In l
al ic
m
R m ig ni
c
rd tie .1
.
al ug Su 5. na
dic n M i c
. D l i o P a C i c r l C
. s o
ro n c c II. D a er
m
e
ct fE tro A .5 of re .1. V lin d d ic V II. P
e o c . n l C n
ni
c el a ct e le VI
I
tio ic
a II.
B
.2
.
y
a M
e
e nt
tr o e p a d V C c . ti
ec n
th im e ss e gr M
e II. m
a
C
.4 Pa
l i e c t . V r I. .
1.
E
at
a
.Th Ac .I
n
A.
7
P ha VI D
.1
. 3 . .6 I. . I.
II.A 2 .D .A. .A.
4
II.A VI .3 VI
. II I .C
V
I.A V VI V
VI
I
VI
Recommendation
• Individual feedback for hospital to provide general recommendation for hospitals
• Supervision and capacity building post self-assessment survey to strengthening the
capacity of hospitals to adopt EMR
• Mentorship program, in collaboration with hospital association (hospital that has
better maturity level become mentor of other hospitals)
• Develop capacity building program for different level of users in hospitals and Health
Offices to improve knowledge, capacity and skills of HIS
Limitation
• It was perceived that the questionnaire too complex. Completion of self assessment
required staff from technical and health background to understand operational
definition of both narrative questions and the possible answers.
• There were technical problems with the electronic survey that probably impact the
low response rate of survey. In addition, area with geographical challenges probably
required direct supervision.
• The low involvement of the health office makes communication mechanisms and
technical support difficult in increasing the response rate and the completeness of
survey amongst the hospitals.
Conclusion
• A digital maturity self-assessment was developed to assess a hospital's digital
capacity.
• There are 2 components relatively better in the hospital, including: Information Systems and
Infrastructure and Human Resources, Skills and Use of information systems
• Standard components and interoperability, management and governance of hospital information
systems, security and confidentiality of data and electronic medical records vary relatively.
• Relative components require a lot of intervention on the data analysis aspect
• Electronic medical records (RME) have been adopted by hospitals, although adoption rates still vary.
Several important modules such as pharmacy, medical support, use of data standards and
interoperability between systems are available.
THANK YOU
This presentation is made possible by the support of the American people through the United States Agency for
International Development (USAID). The contents are the sole responsibility of the Country Health Information
System and Data Use program and do not necessarily reflect the views of USAID or the United States
Government.