Cost Analysis Guide
Cost Analysis Guide
Cost Analysis Guide
G T H EN I N G
PR
A
I CE
OL
CY
CT
CHILD WELFARE
RESEARCH&
ST
R EN
EVALUATION
COST WORKGROUP
COST ANALYSIS IN
PROGRAM EVALUATION
A GUIDE FOR CHILD WELFARE RESEARCHERS
AND SERVICE PROVIDERS
Create an estimate
of total costs
Estimate program
component costs
$$
Estimate costs
per participant
$$$
BU I L
D I NG E V I
DE
NC
Acknowledgments
Building on the momentum created during the 2011 National Child Welfare Evaluation Summit, the Childrens Bureau
convened three Child Welfare Research and Evaluation Workgroups. Each workgroup examined a particular evaluation
topic or issue with the goal of improving child welfare research and evaluation and strengthening the link between
research and practice. The Calculating the Costs of Child Welfare Services Workgroup created this guide. Workgroup
members included:
Melinda Baldwin
Federal Co-lead
Children's Bureau
George Gabel
National Resource Center for Child Welfare Data
and Technology
James Bell
James Bell Associates
Sylvia Kim
Children's Bureau
Christine McPherson
Formerly with Bay Mills Health Center
Crystal Collins-Camargo*
University of Louisville
Phaedra Corso*
University of Georgia
Michael Shaver*
Children's Home + Aid
Curtis Crouch
North Carolina Department of Health
and Human Services
Brian Deakins
Federal Lead
Children's Bureau
Emily Fisher (co-author)
JBS International, Inc.
John Fluke
American Humane Association
Douglas Swisher
Tennessee Department of Children's Services
Tammy White*
Children's Bureau
Fred Wulczyn
Chapin Hall at the University of Chicago
Brian Yates*
American University
*Denotes Steering Team member. The Steering Team was primarily responsible for providing guidance to the principal authors.
Suggested citation:
Calculating the Costs of Child Welfare Services Workgroup. (2013). Cost analysis in program
evaluation: A guide for child welfare researchers and service providers. Washington, DC: Childrens
Bureau, Administration for Children and Families, U.S. Department of Health and Human Services.
This product was created under JBS International, Inc., Contract No. HHSP23320095638WC funded
by the Childrens Bureau, Administration for Children and Families, U.S. Department of Health and
Human Services. The content of this product does not necessarily reflect the official views of the
Childrens Bureau.
I N FO R M I N G P
G T H EN I N G
PR
A
I CE
OL
CY
CT
CHILD WELFARE
RESEARCH&
ST
R EN
EVALUATION
COST WORKGROUP
BU I L
D I NG E V I
DE
NC
For example, the Washington State Institute for Public Policy (Lee et al., 2012) calculates return on investment for social programs using
cost estimates from various sources, including existing studies and budget information from program developers. The Cost Calculator
(Chamberlain et al., 2011), developed by Harriet Ward and other researchers at Loughborough University, employs an ingredients
approach to costing child welfare services. It identifies core child welfare practice processes, disaggregates them into discrete activities,
and estimates costs for these activities. The resulting information is combined with child-level placement data to estimate the total cost of
care for a child over a period of time. The economic analysis included in the ongoing Mother and Infant Home Visiting Program Evaluation
(MIHOPE) collects cost data at both the family level and the site level. The data gathered from each site are then summarized across sites
and home visiting models (J. Ingels, personal communication, April 11, 2013).
Child Welfare Research & Evaluation Workgroups are a Project of the Children's Bureau| 1
I N FO R M I N G P
G T H EN I N G
PR
A
I CE
OL
CY
CT
CHILD WELFARE
RESEARCH&
ST
R EN
EVALUATION
COST WORKGROUP
Process Evaluation
Program
Outputs
Program
Inputs
Context
Priorities
Mandates
Mission/Vision
Local Dynamics
Stakeholder Buy-in
Outcome/Impact Evaluation
Program Outcomes
& Impact
Activities
Personnel &
Non-personnel
Resources
Outcomes
Target
Participants
Effectiveness, Utility,
& Benefits
Cost Analysis
Cost Evaluation
2 | Child Welfare Research & Evaluation Workgroups are a Project of the Children's Bureau
BU I L
D I NG E V I
DE
NC
I N FO R M I N G P
OL
G T H EN I N G
PR
A
I CE
CY
CT
ST
R EN
EVALUATION
DE
NC
D I NG E V I
BU I L
CHILD WELFARE
RESEARCH&
COST WORKGROUP
Child Welfare Research & Evaluation Workgroups are a Project of the Children's Bureau| 3
I N FO R M I N G P
G T H EN I N G
PR
A
I CE
OL
CY
CT
CHILD WELFARE
RESEARCH&
ST
R EN
EVALUATION
COST WORKGROUP
4 | Child Welfare Research & Evaluation Workgroups are a Project of the Children's Bureau
BU I L
D I NG E V I
DE
NC
I N FO R M I N G P
OL
G T H EN I N G
PR
A
I CE
CY
CT
ST
R EN
EVALUATION
NC
DE
D I NG E V I
BU I L
CHILD WELFARE
RESEARCH&
COST WORKGROUP
To demonstrate the integration of cost analysis and program evaluation, we provide an illustration of how
cost data could be developed for an evaluation of the effectiveness of intact family services provided by a
public child welfare agency. This illustration (which uses fictitious data) is presented throughout this section
in box insets.
Illustration of a Cost Analysis of Intact Family Services (In-Home Services)
The purpose of this analysis is to provide the public child welfare agencys leadership with the cost of a
core child welfare service in conjunction with the evaluation of the intact family services program as a
whole. Given this purpose, the analysis focuses only on the implementing agency's perspective and does
not consider the larger costs to society. That is, the analysis only considers the specific costs incurred by the
child welfare agency to deliver the program as intended.
Intact family services include case management and referral services provided to families that have been
reported to the public child welfare agency for child maltreatment and for whom a determination is made
that the child(ren) can remain safely in the home. The purpose of these services is to address the underlying
causes of the issue that brought the family to the attention of the child welfare agency.
Child Welfare Research & Evaluation Workgroups are a Project of the Children's Bureau| 5
I N FO R M I N G P
G T H EN I N G
PR
A
I CE
OL
CY
CT
CHILD WELFARE
RESEARCH&
ST
R EN
EVALUATION
COST WORKGROUP
2
3
See the Appendix for the program components and resources identified for the illustration.
Copyright restrictions on the use of these instruments may apply. They are noted here as examples only.
6 | Child Welfare Research & Evaluation Workgroups are a Project of the Children's Bureau
BU I L
D I NG E V I
DE
NC
I N FO R M I N G P
OL
G T H EN I N G
PR
A
I CE
CY
CT
ST
R EN
EVALUATION
NC
DE
D I NG E V I
BU I L
CHILD WELFARE
RESEARCH&
COST WORKGROUP
Child Welfare Research & Evaluation Workgroups are a Project of the Children's Bureau| 7
I N FO R M I N G P
G T H EN I N G
PR
A
I CE
OL
CY
CT
CHILD WELFARE
RESEARCH&
ST
R EN
EVALUATION
COST WORKGROUP
In a cost-effectiveness or cost-benefit analysis, indirect costs may refer to the unintended or spillover costs a program creates, or to
productivity losses resulting from a persons participation in a treatment or intervention.
8 | Child Welfare Research & Evaluation Workgroups are a Project of the Children's Bureau
BU I L
D I NG E V I
DE
NC
I N FO R M I N G P
OL
G T H EN I N G
PR
A
I CE
CY
CT
ST
R EN
EVALUATION
NC
DE
D I NG E V I
BU I L
CHILD WELFARE
RESEARCH&
COST WORKGROUP
Child Welfare Research & Evaluation Workgroups are a Project of the Children's Bureau| 9
I N FO R M I N G P
G T H EN I N G
PR
A
I CE
OL
CY
CT
CHILD WELFARE
RESEARCH&
ST
R EN
EVALUATION
COST WORKGROUP
10 | Child Welfare Research & Evaluation Workgroups are a Project of the Children's Bureau
$$
BU I L
D I NG E V I
DE
NC
I N FO R M I N G P
G T H EN I N G
PR
A
I CE
R EN
ST
E
NC
DE
CHILD WELFARE
EVALUATION
D I NG E V I
RESEARCH&
BU I L
OL
CY
CT
COST WORKGROUP
> Conclusion
Cost analysis that employs the methods outlined in
this guide is doable. Cost analysis is important as part
of a comprehensive approach to evaluating programs,
and it can serve as a foundation for more rigorous cost
evaluation such as cost-effectiveness and cost-benefit
analyses.
Child Welfare Research & Evaluation Workgroups are a Project of the Children's Bureau| 11
I N FO R M I N G P
G T H EN I N G
PR
A
I CE
OL
CY
CT
CHILD WELFARE
RESEARCH&
ST
R EN
EVALUATION
COST WORKGROUP
> Glossary
Cost Analysis: A thorough description of the type and
amount of all resources used to produce services
(Yates, 1999).
Cost-Benefit Analysis: Analysis that attempt[s] to
calculate the actual costs of delivering services and
the monetary value of improving particular outcomes
for children and families, and to measure whether the
benefits exceed the costs (https://www.childwelfare.
gov/preventing/evaluating/cost_benefit.cfm).
Cost-Effectiveness Analysis: Analysis that attempt[s]
to determine which practices and policies protect the
greatest number of children for the lowest price, by
identifying key measures of program effectiveness
(outcomes) and comparing different strategies to
affect those outcomes (https://www.childwelfare.
gov/preventing/evaluating/cost_effect.cfm).
Costs: Value (typically monetary) of the amounts of
different types of resources consumed to implement the
program (Yates, 2009).
Direct Costs: Those costs that can be assigned to a
particular case or program, for example, the monetary
value of a case workers person-time used to counsel a
client (Bell, 2011).
Fixed Costs: Costs whose total remains constant (within
a relevant range) even though the volume of the activity
may vary (http://www.cdc.gov/dhdsp/programs/
nhdsp_program/economic_evaluation/index.htm).
Impact Evaluation: The purpose of an impact evaluation
is to determine the extent to which the objectives of the
program or policy are accomplished and whether any
unintended effects could be identified (often thought of
as distal outcomes) (Theodoulou and Kofinis, 2004).
Indirect Costs: Costs that are not identified specifically
with a particular case or program, for example, the cost
of facilities (Bell, 2011).1
Outcome Evaluation: The purpose of an outcome
evaluation is to characterize the extent to which the
knowledge, attitudes, behaviors, and practices have
12 | Child Welfare Research & Evaluation Workgroups are a Project of the Children's Bureau
BU I L
D I NG E V I
DE
NC
I N FO R M I N G P
OL
G T H EN I N G
PR
A
I CE
CY
CT
CHILD WELFARE
RESEARCH&
ST
R EN
EVALUATION
COST WORKGROUP
BU I L
D I NG E V I
DE
NC
Lee, S., Aos, S., Drake, E., Pennucci, A., Miller, M., &
Anderson, L. (2012). Return on investment: Evidencebased options to improve statewide outcomes: Technical
appendix methods and user manual, April 2012
(Document No. 11-07-1201B). Olympia: Washington
State Institute for Public Policy.
Corso, P., & Lutzker, J.R. (2006). The need for economic
analysis in research on child maltreatment. Child Abuse
and Neglect, 30(7), 727-738.
Child Welfare Research & Evaluation Workgroups are a Project of the Children's Bureau| 13
I N FO R M I N G P
OL
G T H EN I N G
PR
A
I CE
CY
CT
CHILD WELFARE
RESEARCH&
ST
R EN
EVALUATION
COST WORKGROUP
BU I L
D I NG E V I
DE
NC
> Appendices
In the following two appendices, we provide fictitious data for the cost analyses of two child welfare services. These
illustrations are completely fictitious and solely for the purpose of demonstrating how a cost analysis would be
conducted: first, by identifying the key program components and activities; second, by specifying all the resources; and
third, by adding value to all those resources before calculating the total cost of the program.
Activities
Direct services to
families
Direct services to
families
Direct services to
families
Case management:
Frontline supervision, case assignment, and case consultation
Time spent in court and/or interacting with attorneys, if applicable
Attendance at team meetings
Communication between the case manager and the original investigator
Direct services to
families
Direct services to
families
Direct services to
families
Case documentation:
Case notes
Case plan
Referral forms (for families to services)
Court reports, if applicable
Documentation or paperwork related to expenses and other internal agency requests
(e.g., paperwork related to case opening/closure/transfer to out-of-home placement)
Direct services to
families
Other activities depending on an agencys practice model and service delivery array
Child Welfare Research & Evaluation Workgroups are a Project of the Children's Bureau| 15
I N FO R M I N G P
G T H EN I N G
PR
A
I CE
OL
CY
CT
CHILD WELFARE
RESEARCH&
ST
R EN
EVALUATION
COST WORKGROUP
Category (continued)
Activities
Management and
administration1
Middle management planning, consultation, and supervision, including review and approval
of case documentation
Management and
administration
Management and
administration
Management and
administration
Management and
administration
Management and
administration
Training (e.g., training personnel who are providing new-hire training and ongoing staff
training and/or coaching, curriculum development, and implementation)
Management and
administration
Information Technology:
Staff to support the use of technology for case documentation, such as laptops,
tablets, and cell phones
Staff to manage case management/information systems
Staff to develop and release program output and outcomes reports
Management and
administration
Management and
administration
General program management, including accounting, contracting, policy and planning, and
quality assurance
In some financial models, this key component may be separated into two components management and administrative services and
infrastructure or indirect services.
Resources
Personnel (proportion
of salaries, benefits,
and taxes applicable to
intact family services)
Examples
Case managers
Case assistants, if applicable
Frontline supervisors
Program management
Family team meeting facilitators and coordinators
Quality assurance staff
Agency leadership
Agency legal counsel, if court involvement
Accounting staff
Information technology staff (to maintain and develop the case management system
or other reporting system)
Human resources staff
Training staff
Policy and planning staff
Contracts and procurement staff
Clerical staff
Value of any donated/volunteer labor
16 | Child Welfare Research & Evaluation Workgroups are a Project of the Children's Bureau
BU I L
D I NG E V I
DE
NC
I N FO R M I N G P
OL
G T H EN I N G
PR
A
I CE
CHILD WELFARE
RESEARCH&
ST
R EN
EVALUATION
BU I L
D I NG E V I
DE
NC
Resources (continued)
CY
CT
COST WORKGROUP
Examples
Contracted services
Proportion of these costs allocated to the intact family program (e.g., paper, pens, other
office supplies)
Depreciation costs of
durable equipment
Facilities/office space
Proportion of rent and other building costs allocated to the intact family program
Travel
Mileage:
For visits with families
To service providers on behalf of families
To training
For travel to court hearings, if applicable
Vouchers or reimbursements to families for travel
Utilities
The following data-collection instrument captures all costs for personnel (that is, the dedicated supervisor and five case
managers) and non-personnel resources of the program during the period of analysis.
Resources
$225,000
($45K x 5 case managers)
$56,250
($11,250 x 5)
$60,000
$15,000
Travel expenditures
$5,000
$1,500
$1,250
$3,000
$1,500
Salaries, benefits, and taxes for all other personnel (allocated based on
proportion of time spent on intact family services)
$168,750
Total
$537,250
Child Welfare Research & Evaluation Workgroups are a Project of the Children's Bureau| 17
I N FO R M I N G P
G T H EN I N G
PR
A
I CE
OL
CY
CT
CHILD WELFARE
RESEARCH&
ST
R EN
EVALUATION
COST WORKGROUP
Indirect Resources
Portion Assigned to
Intact Family Services
$12,500
$1,250
($12,500 x .10)
$30,000
$3,000
($30,000 x .10)
Utilities
$15,000
$1,500
($15,000 x .10)
$1,687,500
$168,750
($1,687,500 x .10)
18 | Child Welfare Research & Evaluation Workgroups are a Project of the Children's Bureau
BU I L
D I NG E V I
DE
NC
I N FO R M I N G P
OL
G T H EN I N G
PR
A
I CE
CY
CT
CHILD WELFARE
RESEARCH&
ST
R EN
EVALUATION
COST WORKGROUP
BU I L
D I NG E V I
DE
NC
Activities
Direct services to
enrolled families
Direct services to
enrolled families
Direct services to
enrolled families
Direct services to
enrolled families
Direct services to
enrolled families
Case documentation
Completing case notes and recording data to document services provided and client
status
Direct services to
enrolled families
Travel/transportation
Traveling to clients homes or other locations to provide services.
Transporting clients to locations outside their homes.
Child Welfare Research & Evaluation Workgroups are a Project of the Children's Bureau| 19
I N FO R M I N G P
G T H EN I N G
PR
A
I CE
OL
CY
CT
CHILD WELFARE
RESEARCH&
ST
R EN
EVALUATION
COST WORKGROUP
Category (continued)
Activities
Management and
Administration
Management and
Administration
Management and
Administration
Staff recruitment
Recruiting and hiring program staff
Management and
Administration
Staff training
Providing or attending in-house or outside trainings that support delivery of services or
program operations
Management and
Administration
Management and
Administration
Fundraising
Grant-writing, fundraising, and leveraging funding
Management and
Administration
Management and
Administration
External communication
Communicating with partners/stakeholders; building awareness or support for home
visiting programs among policymakers
Management and
Administration
Management and
Administration
20 | Child Welfare Research & Evaluation Workgroups are a Project of the Children's Bureau
BU I L
D I NG E V I
DE
NC
I N FO R M I N G P
G T H EN I N G
PR
A
I CE
ST
R EN
EVALUATION
NC
Office supplies
Computer software
Postage
Educational materials
Client support materials
Cars
Computers/laptops
Office furniture
DE
Home visitors
Supervisors
Program management
Administrative and support staff
Volunteers
Contracted services
D I NG E V I
Travel
CHILD WELFARE
COST WORKGROUP
Examples
Personnel
(proportion of salaries/fringe
benefits attributable to work on
the home visiting program and
value of any volunteer labor)
Facilities/office space
RESEARCH&
BU I L
Resources
OL
CY
CT
Cost for facilities (whether owned/leased/donated) used by the home visiting program
Travel/mileage to conduct home visits or visit other service providers on
families behalf, or provide transportation to families
Travel to attend professional trainings
Costs for professional or technical consultants to the home visiting program
Fees paid to home visiting model developers
Costs of staff training and professional development
Costs of shared administrative functions or other resources shared across programs
Child Welfare Research & Evaluation Workgroups are a Project of the Children's Bureau| 21
I N FO R M I N G P
G T H EN I N G
PR
A
I CE
OL
CY
CT
CHILD WELFARE
RESEARCH&
ST
R EN
EVALUATION
COST WORKGROUP
Example cost estimate for one year of home visiting program operation
Resources
Personnel
Materials and supplies
Annual Cost
$406,800
$35,500
$4,800
Facilities/office space
$8,500
Travel
$22,500
Contracted services
$11,500
$6,400
$80,750
22 | Child Welfare Research & Evaluation Workgroups are a Project of the Children's Bureau
BU I L
D I NG E V I
DE
NC