ESF Good Practice Note ThirdParty Monitoring June2018
ESF Good Practice Note ThirdParty Monitoring June2018
Afshan Khawaja (OPSES) and Anne-Katrin Arnold (OPSES) led the overall preparation of this Good Practice
Note with a team consisting of Leila Chennoufi (Sustainability and Environment Consultant), Elizabeth Smith
(OPSES), and Colin Scott (OPSES).
i
Abbreviations
ii
Glossary
iii
Good Practice Note – Third-party monitoring in the context of the ESF
Contents
1. Introduction ....................................................................................................................... 2
Environmental and Social Framework ...................................................................................................... 2
Third-party Monitoring (TPM) .................................................................................................................... 2
2. The TPM process for project implementation by the Borrower ........................................ 4
Step 1: Determine if TPM is advisable ...................................................................................................... 4
Initial decision ........................................................................................................................................ 4
Project characteristics ........................................................................................................................... 5
Key benefits and challenges ................................................................................................................. 6
The Bank’s role ..................................................................................................................................... 7
Step 2: Determine scope and develop TOR ............................................................................................. 8
Scope .................................................................................................................................................... 8
Terms of Reference............................................................................................................................... 9
Step 3: Select and contract third-party monitors ..................................................................................... 10
External experts .................................................................................................................................. 10
Individuals vs. firms ............................................................................................................................. 10
Independence from project preparation .............................................................................................. 12
Independence of third parties .............................................................................................................. 13
Procurement ........................................................................................................................................ 14
Confidentiality ...................................................................................................................................... 14
Step 4: Manage the TPM program .......................................................................................................... 15
Effective management......................................................................................................................... 15
Changing commitments....................................................................................................................... 15
Frequency of monitoring...................................................................................................................... 15
Step 5: Reporting and transparency ....................................................................................................... 16
Documenting findings and results ....................................................................................................... 16
Transparency and confidentiality ........................................................................................................ 16
3. When the Bank contracts TPM Directly for Smart Supervision .......................................17
Bank’s TPM activities .............................................................................................................................. 17
Capacity or specific skills required .......................................................................................................... 18
Coordination ............................................................................................................................................ 18
Funding when TPM is on behalf of the Bank .......................................................................................... 19
ANNEX 1: Resources ..............................................................................................................20
ANNEX 2: Template TORs for third-party monitoring...........................................................20
1
Good Practice Note – Third-party monitoring in the context of the ESF
1. Introduction
1
See Annex 1 for resources and examples: “External monitoring of the Chad-Cameroon pipeline projects,” International Finance
Corporation, September 2006; “Third Party Monitoring Programme for the Afghanistan Reconstruction Trust Fund: A Review,”
World Bank, 2014.
2
Good Practice Note – Third-party monitoring in the context of the ESF
role of stakeholders, including from civil society, to complement or verify the Borrower’s own monitoring
activities.
TPM may have a different focus if it is engaged directly by the Bank to complement the Bank’s own
ability to monitor projects in situations where the project may be difficult to access. In such cases, TPM
promotes “Smart Supervision” by enhancing the Bank’s presence in the field and getting “eyes and ears
on the ground” when World Bank staff are unable to do so directly 2 due to high levels of security concerns.
Furthermore, in such cases, TPM providers are contracted through Corporate Procurement. Through this
“Smart Implementation” approach 3, Borrowers can benefit from additional support and expertise from
experts in monitoring particular environmental and social issues or an overall program. Figure 1 illustrates
the relationship between Bank, Borrower, and TPM.
2
See FCV Group (forthcoming Operational Note) “Approaches to Smart Supervision in Insecure Areas: Third-Party
Monitoring and Beyond.”
3
See FCV Group (forthcoming Operations Note).
3
Good Practice Note – Third-party monitoring in the context of the ESF
ESS1. Assessment and Management of Environmental and Social Risks and Impacts
• Engage one or more internationally recognized independent experts for projects that
are High Risk or contentious, or that involve serious multidimensional environmental
or social risks or impacts (for example, in the form of an advisory panel), and identify
the third parties in the Environmental and Social Commitment Plan (ESCP).
• Engage stakeholders and third parties, such as independent experts, local
communities, or civil society organizations (CSOs), to complement or verify the
Borrower’s own monitoring activities and collaborate with such agencies and third-
party.
4
The ESF also includes references to third parties in other roles, including as independent specialist to carry out the environmental
and social assessment (ESS1), as employers of project workers (ESS2), as professionals engaged in the design of structural
elements (ESS4), as experts consulted with when assessing biodiversity baseline conditions or to assess whether an offset is
feasible (ESS6), as experts consulted with when assessing cultural heritage sites (ESS8), or as experts supporting the Borrower’s
stakeholder identification (ESS10). These roles of third parties are not addressed in this GPN, as they do not relate solely to
monitoring.
4
Good Practice Note – Third-party monitoring in the context of the ESF
• Engage separate independent experts with relevant and recognized experience when
structural elements or components of a project are situated in high-risk locations,
including those with risk of extreme weather or slow onset events, and their failure or
malfunction may threaten the safety of communities to conduct a review as early as
possible in project development and throughout the stages of project design,
construction, operation, and decommissioning.
• Contract experienced and competent professionals for the supervision of the design
and construction of dams, provide administrative support for its activities, and report
on the panel’s conclusions and recommendations.
Project characteristics
The decision to require TPM will take into account the specific requirements of the ESSs, the specific
nature and extent of the risks and impacts of the project, the complexity of the project, any stakeholder
concerns, and Borrower capacity to implement and monitor the project. Box 1 provides examples of other
project characteristics that may benefit from TPM.
5
Good Practice Note – Third-party monitoring in the context of the ESF
Benefits Challenges
6
Good Practice Note – Third-party monitoring in the context of the ESF
7
Good Practice Note – Third-party monitoring in the context of the ESF
ESP paragraph 58
“Where appropriate and as set out in the ESCP, the Bank will require the
Borrower to engage stakeholders and third parties, such as independent experts,
local communities or nongovernmental organizations (CSOs), to complement or
verify project monitoring information. Where other agencies or third parties are
responsible for managing specific risks and impacts and implementing mitigation
measures, the Bank will require the Borrower to collaborate with such agencies
and third parties to establish and monitor such mitigation measures.”
8
Good Practice Note – Third-party monitoring in the context of the ESF
Terms of Reference
The Borrower determines and agrees with the Bank the content
of the Terms of Reference (TORs), which reflects the scope of
the TPM. The Bank will provide input on the scope of the TORs TPM is not a substitute for the
to enable the assignment to meet the commitments established Borrower’s own internal
in the ESCP. Based on the scope of the monitoring to be monitoring program, but is
undertaken, the Bank assesses whether one expert or a firm is designed to complement
needed, or whether a number of individual experts are needed and/or verify what it has done,
on specific issues, in which case, there might be several smaller depending on the objectives
TORs. The TORs are prepared by the Borrower and agreed with and needs of the monitoring
the Bank. A TOR template is provided in Annex 2. activities.
9
Good Practice Note – Third-party monitoring in the context of the ESF
Table 3. Benefits and challenges for TPM conducted by individuals compared to firms
Individuals Individual experts or specialists can be Individuals may have other clients and
useful if the scope of work is limited or not be as available in the time needed,
focuses on a particular issue, such as and may be less likely to possess the
labor, health and safety, or a particular skills and resources available at a firm.
species of plant or animal that may be They may also not have liability
affected by a project. Individuals can be insurance if there are significant
less costly than consulting firms. quality problems in the work
undertaken.
Consulting firms Firms may have better quality control A consulting firm is likely to be more
than individual experts and can expensive than individual specialists or
increase staffing or support individual experts and may be more time
consultants with additional expertise or consuming to hire. Additionally, a
resources to meet the agreed scope of consulting firm that has been involved
work. It is important to agree in in the preparation of the project and
advance which individual employees of design of the action plans should not
the firm will undertake the work and monitor the project. Monitoring work
that these employees are not switched
out during the work, unless the
10
Good Practice Note – Third-party monitoring in the context of the ESF
Table 3. Benefits and challenges for TPM conducted by individuals compared to firms
Academics and If information and advice on a specific Academics and think tanks may act as
think tanks methodology or topic is needed, some individuals or consulting firms, but
academics or think tanks can be they may not have the breadth of
contracted to undertake a limited knowledge necessary for the entire
scope of work. An example would be scope of work to be undertaken. With
hiring an energy efficiency think tank to this type of contractor, it is very
monitor the implementation of a important to understand their
greenhouse gas accounting experience with the application of the
methodology and make issues in the TORs at the project level,
recommendations for improvement. and not just at the theoretical level.
Some academics or think tanks may
have staked out certain positions on
issues related to the project in
presentations or publications. These
views may need to be understood to
ensure there is no perceived bias on
project-relevant issues. It is also
important to determine whether they
may have an obligation or intent to
publish in relation to their work on the
project, and to take any appropriate
measures to protect confidentiality
and provide neutrality in the
monitoring, if that is the case.
CSOs Some CSOs may be well equipped for Some CSOs may not be able to agree to
TPM and may include experts on confidentiality agreements and, similar
specific issues. It is particularly to the point made above, may have an
important to review the CVs of the CSO obligation or intent to publish in
members that would undertake the relation to their work on the project.
work to make sure they have the skills Therefore, it is important to
and experience necessary. In some understand any limitations regarding
cases, CSOs are well placed to confidentiality if the scope of work
participate in monitoring activities and includes confidential information (for
have the education and expertise example, worker health and safety
11
Good Practice Note – Third-party monitoring in the context of the ESF
Table 3. Benefits and challenges for TPM conducted by individuals compared to firms
12
Good Practice Note – Third-party monitoring in the context of the ESF
implementing agency and its contractors) and should not have had a previous role in the project (with the
exception of a previous monitoring role). Their status should be reviewed to avoid conflicts of interest,
and they should maintain objectivity throughout the process, so that findings and conclusions are based
on evidence. Third-party monitors should also be ethical, reflecting integrity, confidentiality, trust, and
discretion. They should be fair, truthful, and accurate in reporting. Monitors should also be competent,
with the expertise and experience necessary to ensure due professional care in the conduct of work
undertaken. For high risk or contentious projects, the Bank may require the Borrower to engage one or
more internationally recognized independent experts to provide advice and oversight to the project.
5
“How to Note: Participatory and Third Party Monitoring in World Bank Financed Projects: What Can Non-State Actors Do?”
World Bank Social Development Department, 2013.
6
“Peru LNG: A focus on continuous improvement, Lessons of Experience.” International Finance Corporation, Washington,
DC, March 2013.
13
Good Practice Note – Third-party monitoring in the context of the ESF
Procurement
The World Bank’s Procurement Regulations 7 for IPF Borrowers clarify the various procurement options,
and cover topics such as governance, procurement provisions, and acceptable methods for selection of
services. The regulations vary according to the specific factors including procurement risk and contract
risk and other rules applicable to each specific project as outlined in the Project Procurement Strategy for
Development and the Project Procurement Plan.
The Bank’s task team will support the Borrower in selecting the appropriate procurement approach. The
Borrower will consider the availability of key knowledge, language and expertise locally and
internationally, as well as the complexity and magnitude of monitoring activities. The Borrower will make
staff available to manage the call for proposals, selection processes, interfaces and monitoring contracts,
following applicable World Bank procurement rules. It is good practice to link payments to outputs in the
contract, so that some leverage is retained, and that full payment is not made until reports are of
satisfactory quality.
Confidentiality
Contracting should include relevant requirements on personal data privacy and confidentiality, as
appropriate, and in accordance with procurement requirements. The Bank should bring the issue of
confidentiality to the Borrower’s attention if, in undertaking an assessment, the third party would have
access to proprietary information. In such cases, the third party may need to sign a confidentiality
agreement (for example, if they will have access to confidential information such as personnel records
regarding labor, accident reports, and so forth).
Some third parties, such as community-based organizations and CSOs, may have limitations on the type
of confidentiality to which they can agree. The Borrower will take confidentiality needs into account
when selecting a third party as well as the sensitivity of the assignment. If confidentiality is required, and
cannot be ensured by the potential TPM partner, the type of partner should be revisited. For example, a
specialist contracted to monitor allegations of gender-based violence may have access to sensitive
personal information that would be detrimental to the individual or group if it were not kept confidential.
Similarly, individual amounts received under resettlement agreements would not be public and
monitoring of labor issues may involve personnel information that is confidential. In certain
circumstances, when confidentiality is a concern, monitoring may be best managed under contracts with
individuals, firms, or institutions.
7
https://policies.worldbank.org/sites/ppf3/PPFDocuments/Forms/DispPage.aspx?docid=7398246c-6904-4546-9313-
4dd7a8f93faa&ver=current
14
Good Practice Note – Third-party monitoring in the context of the ESF
Changing commitments
When a third party makes a recommendation that would require changing existing commitments
between the Borrower and the Bank, these changes need to be agreed between the Borrower and the
Bank. For example, issues may be raised during monitoring or by events, such as accidents or incidents,
that require additional actions or monitoring. If changes need to be made, the World Bank environmental
or social specialists and legal counsel assigned to the project should be involved in the discussion.
Frequency of monitoring
If there are incidents during implementation that increase the risk of the project, the frequency of
monitoring may also be increased or additional capacity in expertise may need to be adjusted. For
example, a high rate of occupational safety accidents during project implementation may require a health
and safety expert to assess the accidents and develop an appropriate action plan and monitor its
implementation.
15
Good Practice Note – Third-party monitoring in the context of the ESF
16
Good Practice Note – Third-party monitoring in the context of the ESF
3. When the Bank contracts TPM Directly for Smart Supervision
17
Good Practice Note – Third-party monitoring in the context of the ESF
It is important to note that TPM contracted directly by the Bank is different from the requirement for a
Borrower to use TPM to complement or verify its monitoring activities under the ESF. When the Bank
choses to engage TPM directly, the purpose is to complement the Bank’s ability to monitor projects in
situations where the project may be difficult to access and enable it to carry out its supervision duties.
This may be useful in situations of FCV or where access to a project area is limited for other reasons (see
Box 4 for an example). In such situations, TPM enables Bank teams to have “eyes and ears on the ground,”
for example, during active conflict, and reengage quickly in post-conflict settings where access to Bank
staff remains highly constrained. 8 Box 5 describes TPM of a project where security challenges were
combined with limited Borrower capacity for fiduciary oversight.
Coordination
When the Bank engages TPM directly, the task team should clarify what other agencies and
organizations are doing in the project area to explore where partnerships may be an efficient way to
monitor specific issues. It is important to work with the Borrower to ensure the third-party monitor has
access to all relevant information and access to project-related sites and activities in order to undertake
a successful monitoring role.
8
Third-party monitoring in situations of fragility, violence, and conflict is discussed in detail in FCV Group (forthcoming).
18
Good Practice Note – Third-party monitoring in the context of the ESF
Lastly, it is important to note that TPM contracted for the purpose of enhancing the Borrower’s capacity
to monitor safeguards compliance or generate monitoring and evaluation data does not substitute for
Bank supervision.
19
Good Practice Note – Third-party monitoring in the context of the ESF
ANNEX 1: Resources
“CDD Toolkit, Governance and Accountability Dimensions, Monitoring and Feedback,” World Bank,
Washington, DC.
“CDD Toolkit, Governance and Accountability Dimensions, External level tools,” (including third-parties),
World Bank, Washington, DC.
“Combining Quantitative and Qualitative Methods for Program Monitoring and Evaluation,” PREM Notes,
Number 9, World Bank, Washington, DC, 2009.
“External monitoring of the Chad-Cameroon pipeline projects,” International Finance Corporation,
Washington, DC, September 2006.
FCV Group. Forthcoming. “Approaches to Smart Supervision in Insecure Environments: Third Party
Monitoring and Beyond.” Draft Operational Note. World Bank, Washington, DC.
Handbook on Planning, Monitoring and Evaluating for Development Results, United Nations Development
Programme, United Nations, 2011.
“How to Build M&E Systems to Support Better Government,” Report, Independent Evaluation Group,
World Bank, Washington, DC, 2007.
“How-to-Notes: Participatory and Third Party Monitoring in World Bank Financed Projects: What Can Non-
State Actors Do?” World Bank Social Development Department, World Bank, Washington, DC, 2013.
“Independent Evaluation: Principles, Guidelines And Good Practice,” World Bank, Washington, DC, 2003.
International Labour Organization. 2016. “Third-party monitoring of measures against child labour and
forced labour during the 2016 cotton harvest in Uzbekistan.” International Labour Organization,
Geneva. http://www.ilo.org/wcmsp5/groups/public/---ed_norm/---
ipec/documents/publication/wcms_543130.pdf.
“Peru LNG: A focus on continuous improvement, Lessons of Experience, International Finance
Corporation, Washington, DC, March 2013.
“Strategic framework for mainstreaming citizen engagement in World Bank Group operations: engaging
with citizens for improved results.” English. Working Paper, Number 92957. World Bank, Washington,
DC, 2014. http://documents.worldbank.org/curated/en/266371468124780089/Strategic-framework-
for-mainstreaming-citizen-engagement-in-World-Bank-Group-operations-engaging-with-citizens-for-
improved-results.
“Ten Steps to a Results-Based Monitoring and Evaluation System,” World Bank, Washington, DC, 2004.
“Terms of Reference for Third Party Monitoring of the Chad Cameroon Pipeline,” World Bank, 2000.
“The Baku-Tbilisi-Ceyhan (BTC) pipeline project, Lessons of Experience,” International Finance
Corporation, Washington, DC, 2006.
“Third party monitoring guidelines,” World Food Programme, Rome, 2014.
“Third Party Monitoring Programme for the Afghanistan Reconstruction Trust Fund: A Review,” World
Bank, 2014.
http://www.artf.af/images/uploads/ARTF_Supervisory_Agent_Review_FINAL_March_2014.pdf.
20
Good Practice Note – Third-party monitoring in the context of the ESF
9 There are many resources that may be useful in addressing the application of the ESF. The list of resources here is not exhaustive
and do not necessarily represent the views of the World Bank.
21
Good Practice Note – Third-party monitoring in the context of the ESF
ANNEX 2: Template TORs for third-party monitoring
A. Objectives
An introductory section should briefly present the Project, the monitoring goals and objectives and
how it fits in the overall scheme of project implementation.
C. Reporting/Outputs
Clarify the focus/purpose of the reports, how findings should be presented/rated, and how
conclusions and recommendations should be presented. Propose changes to ESCP, where
appropriate; updates to the Stakeholder Engagement Plan, and so forth. Reports should be sent to
the Borrower and the Bank at the same time for feedback on any factual inaccuracy. This allows the
Bank to see initial and independent recommendations. To ensure independence and credibility,
evidence-based conclusions and recommendations of the third-party-monitor should be maintained
unless there are factual inaccuracies on which the conclusions and recommendations are based. The
Borrower should provide the Bank with their comments to the monitor regarding the report. In
controversial or complex projects, the draft report may be shared publicly for maximum transparency
and to build trust. Clarify expected language of reporting and intended audience.
D. Qualifications
22
Good Practice Note – Third-party monitoring in the context of the ESF
E. Eligibility/independence requirements
For example (a) absence of existing contracts with Borrower contractors on the project, and (b) no
participation in earlier phases of the project or in the design of environmental or social programs
associated with the project. The more complex and controversial the project, the higher the eligibility
and independence needed.
G. Excluded costs
Logistical support, travel and accommodation that will be provided by Borrower that should not be
included in the cost estimate.
J. Format of proposal
The TORs should indicate how the cost estimate should be made for undertaking the monitoring
assignment: by task, sub-tasks, expected number of people, and daily rate and/or lump sum. If tasks
in the TORs are not fully defined, clarify how the budget should approach these tasks.
23