Solution Evaluation
Agenda
• Overview of Solution Evaluation
• Core Concept Model in Solution Evaluation
• Measure Solution Performance
• Analyze Performance Measures
• Assess Solution Limitations
• Assess Enterprise Limitations
• Recommend Actions to Increase Solution Value
Classification: Restricted Page 2
Core Concept Model in Solution Evaluation
Classification: Restricted Page 3
Measure Solution Performance
Classification: Restricted Page 4
Measure Solution Performance
• Purpose : The purpose of Measure Solution Performance is to define
performance measures and use the data collected to evaluate the
effectiveness of a solution in relation to the value it brings.
• Description : Performance measures determine the value of a newly
deployed or existing solution. The measures used depend on the solution
itself, the context and how the organization defines value.
Classification: Restricted Page 5
Inputs
• Business Objective
• Implemented Solution ( external )
Classification: Restricted Page 6
Elements
• Define Solution Performance Measures
• Validate Performance Measures
• Collect Performance Measures
Classification: Restricted Page 7
Guidelines and Tools
• Change Strategy
• Future State Description
• Requirements(validated)
• Solution Scope
Classification: Restricted Page 8
Technique
1. Acceptance and Evaluation Criteria
2. Benchmarking and Market Analysis
3. Business Cases
4. Data Mining
5. Decision Analysis
6. Focus Groups
7. Metrics and Key Performance Indicators(KPI)
8. Non-Functional Requirements Analysis
9. Observation
10. Prototyping
11. Survey or Questionnaire
12. Use Cases and Scenarios
13. Vendor Assessment
Classification: Restricted Page 9
Acceptance & Evaluation Criteria
Classification: Restricted Page 10
Non-Functional Requirement Analysis
Classification: Restricted Page 11
Use Cases and Scenarios
Classification: Restricted Page 12
Stakeholder
• Customer
• Domain Subject Matter Expert
• End User
• Project Manager
• Regulator
• Sponsor
Classification: Restricted Page 13
Output
• Solution performance measures
Classification: Restricted Page 14
Analyze Performance Measures
Classification: Restricted Page 15
Analyze Performance Measures
• Purpose : The purpose of Analyze Performance Measures is to provide
insights into the performance of a solution in relation to the value it brings.
• Description : In order to meaningfully analyze performance measures,
business analysts require a thorough understanding of the potential value
that stakeholders hope to achieve with the solution.
Classification: Restricted Page 16
Inputs
• Potential Value
• Solution Performance Measures
Classification: Restricted Page 17
Elements
• Solution Performance versus Desired Value
• Risks
• Trends
• Accuracy
• Performance Variances
Classification: Restricted Page 18
Guidelines and Tools
• Change Strategy
• Future State Description
• Risk Analysis Results
• Solution Scope
Classification: Restricted Page 19
Technique
1. Acceptance and Evaluation Criteria
2. Benchmarking and Market Analysis
3. Data Mining
4. Interviews
5. Metrics and Key Performance Indicators(KPI)
6. Observation
7. Risk Analysis and Management
8. Root Cause Analysis
9. Survey or Questionnaire
Classification: Restricted Page 20
Stakeholders
• Domain Subject Matter Expert
• Project Manager
• Sponsor
Classification: Restricted Page 21
Output
• Solution Performance Analysis
Classification: Restricted Page 22
Assess Solution Limitations
Classification: Restricted Page 23
Assess Solution Limitations
• Purpose: The purpose of Assess Solution Limitations is to determine the
factors internal to the solution that restrict the full realization of value.
• Description: Assessing solution limitations identifies the root causes for
under-performing and ineffective solutions and solution components
Classification: Restricted Page 24
Inputs
• Implemented Solution (External)
• Solution Performance Analysis
Classification: Restricted Page 25
Elements
• Identify Internal Solution Component Dependencies
• Investigate Solution Problems
• Impact Assessment
Classification: Restricted Page 26
Guidelines and Tools
• Change Strategy
• Risks Analysis Results
• Solution Scope
Classification: Restricted Page 27
Technique
1. Acceptance and Evaluation Criteria
2. Benchmarking and Market Analysis
3. Business Rules Analysis
4. Data Mining
5. Decision Analysis
6. Interviews
7. Item Tracking
8. Lessons Learned
9. Risk Analysis and Management
10. Root Cause Analysis
11. Survey or Questionnaire
Classification: Restricted Page 28
(12) Item Tracking (p. 294)
HUB - MIS (2023) 29
Elements
• Item Record
• Item Management
• Metrics.
HUB - MIS (2023) 30
Stakeholders
• Customer
• Domain Subject Matter Expert
• End User
• Regulator
• Sponsor
• Tester
Classification: Restricted Page 31
Outputs
• Solution Limitation
Classification: Restricted Page 32
Assess Enterprise Limitations
Classification: Restricted Page 33
Assess Enterprise Limitations
• Purpose : The purpose of Assess Enterprise Limitations is to determine how
factors external to the solution are restricting value realization.
• Description : Solutions may operate across various organizations within an
enterprise, and therefore have many interactions and interdependencies.
Classification: Restricted Page 34
Inputs
• Current State Description
• Implemented (or Constructed) Solution(external)
• Solution Performance Analysis
Classification: Restricted Page 35
Elements
• Enterprise Culture Assessment
• Stakeholder Impact Analysis
• Organizational Structure Changes
• Operational Assessment
Classification: Restricted Page 36
Guidelines and Tools
• Business Objectives
• Change Strategy
• Future State Description
• Risk Analysis Results
• Solution Scope
Classification: Restricted Page 37
Technique
1. Benchmarking and Market Analysis 10. Organizational Modelling
2. Brainstorming 11. Process Analysis
3. Data Mining 12. Process Modelling
4. Decision Analysis 13. Risk Analysis and Management
5. Document Analysis 14. Roles and Permissions Matrix
6. Interviews 15. Root Cause Analysis
7. Item Tracking 16. Survey or Questionnaire
8. Lessons Learned 17. SWOT Analysis
9. Observation 18. Workshops
Classification: Restricted Page 38
Stakeholders
• Customer
• Domain Subject Matter Expert
• End User
• Regulator
• Sponsor
Classification: Restricted Page 39
Outputs
• Enterprise Limitation
Classification: Restricted Page 40
Recommend Actions to increase Solution Value
Classification: Restricted Page 41
Recommend Actions to increase Solution Value
• Purpose : The purpose of Recommend Actions to Increase Solution Value is
to understand the factors that create differences between potential value
and actual value, and recommend a course of action to align them.
• Description : This focuses on understanding the aggregate of the
performed assessments
Classification: Restricted Page 42
Inputs
• Enterprise Limitations
• Solution Limitation
Classification: Restricted Page 43
Elements
• Adjust Solution Performance Measures
• Recommendations
Classification: Restricted Page 44
Guidelines and Tools
• Business Objectives
• Current State Description
• Solution Scope
Classification: Restricted Page 45
Technique
1. Data Mining
2. Decision Analysis
3. Financial Analysis
4. Focus Groups
5. Organizational Modelling
6. Prioritization
7. Process Analysis
8. Risk Analysis and Management
9. Survey or Questionnaire
Classification: Restricted Page 46
Stakeholders
• Customer
• Domain Subject Matter Expert
• End User
• Regulator
• Sponsor
Classification: Restricted Page 47
Outputs
• Recommended Actions
Classification: Restricted Page 48
One Minute Drill
Classification: Restricted Page 49
KEY TAKEAWAYS
Classification: Restricted Page 50
Topics to be covered in next session
• Overview of Requirements Analysis and Design Definition
• Core Concept Model in Requirements Analysis and Design Definition
• Specify and Model Requirements
• Verify Requirements
• Validate Requirements
• Define Requirements Architecture
• Define Design Options
• Analyze Potential Value and Recommend Solution
Classification: Restricted Page 51
THANK YOU
Classification: Restricted Page 52
