Quality Plan PDF
Quality Plan PDF
1 Quality Plan
ENRICH
Quality Plan
Status Draft
eContentplus
1 OJ L 79, 24.3.2005, p. 1.
1/37
DL 1.1 Quality Plan
Document Review
Reviewer Institution Date and result of the review
15/02/2008
Zdeněk Uhlíř NKP
Document approved for submission to EC.
03/03/2008, amendments according to the
Jakub Heller CCP
discussion held in Copenhagen
20/05/2008 Updated version approved by the
Tomáš Psohlavec AIP
Technical Coordinator
2/37
DL 1.1 Quality Plan
1 Executive Summary
ENRICH Quality Plan defines the project management structure, procedures, organisation
and the methodology that consortium partners will use during the project to support quality
management.
3/37
DL 1.1 Quality Plan
CONTENT
1 EXECUTIVE SUMMARY......................................................................................................................... 3
2 INTRODUCTION ....................................................................................................................................... 6
2.1 PURPOSE OF THE QUALITY PLAN .......................................................................................................... 6
2.2 CONTEXT DOMAIN ................................................................................................................................ 6
2.3 USE DOMAINS....................................................................................................................................... 6
2.4 APPLICABLE DOCUMENTS ..................................................................................................................... 7
2.5 ENRICH QUALITY PLAN EVOLUTION PROCEDURE ............................................................................... 7
2.6 LACK OF ADHERENCE TO THE QUALITY PLAN....................................................................................... 7
2.7 ABBREVIATIONS ................................................................................................................................... 7
3 QUALITY OBJECTIVES .......................................................................................................................... 8
3.1 PROJECT CHARACTERISTICS .................................................................................................................. 8
3.2 QUALITY SYSTEM ................................................................................................................................. 9
3.3 QUALITY ORGANISATION ...................................................................................................................... 9
4 ASSURANCE OF TECHNICAL QUALITY, ITS MONITORING AND EVALUATION............... 10
5 PROJECT PRESENTATION.................................................................................................................. 13
5.1 PROJECT OBJECTIVES, GOALS AND DESCRIPTION OF WORK ................................................................ 13
5.2 CONSORTIUM ORGANISATION ............................................................................................................. 13
5.3 PROJECT MANAGEMENT STRUCTURE................................................................................................... 14
6 PROJECT MILESTONES AND DELIVERABLES ............................................................................. 17
6.1 INTRODUCTION ................................................................................................................................... 17
6.2 PROJECT PLANNING AND MILESTONES ............................................................................................... 17
6.3 EC PROJECT DELIVERABLES ............................................................................................................... 17
7 PROJECT MONITORING AND REPORTING ................................................................................... 20
7.1 INTRODUCTION ................................................................................................................................... 20
7.2 REPORTING ......................................................................................................................................... 20
8 MAINTENANCE OF PROJECT RECORDS........................................................................................ 21
8.1 DATA, RESEARCH, AND OTHER NON-FINANCIAL RECORDS................................................................ 21
8.2 FINANCIAL RECORDS .......................................................................................................................... 21
8.3 WEBSITE ............................................................................................................................................. 21
9 HUMAN SUBJECTS AND DATA PROTECTION............................................................................... 22
9.1 HUMAN SUBJECTS .............................................................................................................................. 22
9.2 DATA PROTECTION ............................................................................................................................. 22
10 RISK MANAGEMENT ............................................................................................................................ 23
5/37
DL 1.1 Quality Plan
2 Introduction
6/37
DL 1.1 Quality Plan
2.7 Abbreviations
[Ax] Applicable Document
ENRICH European Networking Resources and Information concerning
Cultural Heritage
DoW Description of Work
EC European Commission
WP Work Package
WPL Work Package Leader
PM Project Manager
TGC Technological Group Committee
WPC Work Package Management Committee
MB ENRICH Management Board
7/37
DL 1.1 Quality Plan
3 Quality objectives
The ENRICH quality objectives are to set quality measures, to provide support to consortium
partners to achieve these and monitor adherence to the Quality Plan throughout the project’s
lifecycle. The Quality Plan is designed to provide for the assurance of quality, according to
the main ENRICH Project characteristics.
8/37
DL 1.1 Quality Plan
In assuring quality, the main role of the Project Manager and the Work package Leaders will
consist of regular monitoring of the application of the Quality Plan through actions such as:
verification of documents, participation in reviews and audits, follow-up of corrective actions
and analysis of quality indicators. These roles will be performed throughout the project
lifecycle.
9/37
DL 1.1 Quality Plan
In order to ensure the overall high quality of the technical work within the ENRICH project
the technical work is split into relatively small, discrete yet related Tasks grouped into
particular thematic Workpackages. Such an allocation of particular work tasks with defined
inputs, outputs, relations and interdependencies enables the Task Leaders to focus on their
part of technical work and to fully optimise their results to dedicated Task objectives without
their work being over affected by the approaches, tools, methodics and generally way of work
applied in the other Tasks and Workpackages by the other Leaders and participants.
Due to the significant diversity of various tasks that have to be fulfilled within the ENRICH
project such approach of independent Task solution and mutual „tolerance“ between the
Tasks is necessary in order to provide high quality results.
The Workpackage Leaders will have to ensure that the work will respect the common
requisities to any technical work: the analyses produced will respect the preceding user
demands and need surveys (where these will be performed), the subsequent realization will
correspond to the analysis and finally the feedback provided by evaluation of the outcomes
will reveal possible deviations or mistakes and will serve as a base for correcting the
outcomes of the project in order to fully adapt the outcomes to the most actual user needs.
In such a net of various different tasks the very important information for the Task and WP
Leaders will be created in frame of the WP7. Basically this whole workpackage is dedicated
to technical aspect of quality of ENRICH project outcomes. It will provide continuous
feedback by evaluating the Tasks (and even particular logical subtask - in order to provide as
much accurate information as possible) and their outcomes as described within the
Description of Work.
Correct usage and timed implementation of the provided feedback from WP7 by the all WP
and Task Leaders will ensure that the diverse Tasks will finally produce desired homogenous
outcomes as they are described in the DoW.
The Deliverable D7.1 (Methodology for Testing and Validation of e-Applications) will be the
first step of WP7 in order to ensure the above mentioned and will provide basic guidelines for
the evaluation of the technical works results that will be subsequently concretized as the
ENRICH project goes further.
The D7.1 and the designed evaluation principles and criteria will respect the preceding results
of European and worldwide projects and their outcomes published and verified during the last
years which also will ensure that the quality of technical work will be based and evaluated on
the most actual experiences and perspective approaches and methodologies. The combination
and diversity of Tasks that have to be resolved during the ENRICH project will require to
combine the available outcomes and knowledge into a brand new set of evaluation criteria
adapted to the Projects needs.
10/37
DL 1.1 Quality Plan
The D7.1 will be supplied by most concrete documentation on evaluation of each particular
evaluated (sub)Task later during the Project (including particular evaluation steps, metrics,
surveys, etc..). The concrete content/items for evaluation, related to the Tasks, formulated
inside the WPs, will be created within the WP7 will be updated as the ENRICH Project
advances. The particular contents will be based on the initial user surveys and analyses and
often of course can not be concretized without the knowledge of results of the preceding
Tasks.
From the technical point of view, the project will develop 5 main results or outputs in frame
of WP3, WP4, WP5 and WP6. Each of these results will be separately tested and evaluatd
using pre-defined set of standardized criteria. These 5 main results are:
The basic principles and evaluation criteria used within WP7 will be based on the study of
evaluation methodologies used worldwide for testing and evaluation of e-Applications. The
selected approach deals with the set of criteria assigned to each sub-task/sub-result to be
evaluated, organized in a form of the matrix. The methodology is more specifically described
in D 7.1, including the list of all sub-tasks/sub-results for evaluation and n respective
criteria/sub-criteria.
The set of quality criteria was proposed (but it can be later changed according to actual needs.
Most of the tools have not been developed yet and it is even not clear which technology will
they be based on, therefore it can not be fixed at the moment which sub-criteria should be
used for their evaluation.
The possible set of criteria at the moment was formulated as follows:
Interoperability -
Adaptability
Usability
Security
Multilinguality and localisation
Each one of those criteria was related to the concrete sub-tasks formulated in WP3, WP4,
WP5, WP6 and the sub-criteria (sub-tasks) will be rated using the range defined as:
The results of such evaluation will be then statistically processed, grouped and graphically
presented, together with the written recommendations to the Task/WP leaders. The results of
the evaluation will be also provided to all partners involved in the respective WP.
11/37
DL 1.1 Quality Plan
Only a very brief overview of the technical evaluation of the project results is presented here
in D 1:1 in order to avoid overlapping with D 7.1 because these two deliverables are very
closely related.
In case that the findings of the testing and evaluation of e-Applications will be below the
minimum acceptable rating/score or some other fatal insufficiencies will be found, the
respective Task/WP leaders will be given 2 weeks after receipt of such evaluation from WP7
leader for preparation of corrective actions and their presentation to the Technological Group
Committee (see the chapter 5.3.1 dealing with project management). This proposal of
correction actions shall include the time frame of its implementation, because the most of the
evaluation works are foreseen to be carried out in the final stage of the project and it is
assumed that there can be relatively short period for the implementation of correction actions.
The proposal of corrective actions shall also include the responsibilities of the partners
participating on the Task and proposed corrective actions. The Technological Group
Committee will decide within one week whether the proposed measures are sufficient and
confirm their agreement with the implementation of this corrective plan.
12/37
DL 1.1 Quality Plan
5 Project presentation
13/37
DL 1.1 Quality Plan
his/her WPMC one or more members to act as liaison with the other WPMCs, in order to
promote and coordinate integration between workpackages.For each workpackage, the WPSC
will monitor the activity of the different tasks according to the workplan, and will ensure that
the deadlines for milestones and deliverables are met. The Work Package Management
Committee is responsible for the allocation of funds among the members of the WP. All
recommendations for new or different activities that arise from the WPSC will be submitted
to the Management Board, of which the WP leaders are members. The specific tasks to be
carried out by each separate WP are defined in the workpackage description of ENRICH
project.
Day-to-day management
The National Library of the Czech Republic (NKP) will be responsible for overall project
coordination. NKP will closely cooperate with Cross Czech a.s. (CCP) within the overall
project management and mainly on the financial and administrative management issues. This
will include ensuring that reports are delivered on time to the Commission that the
workpackages are effectively interlinked, that cost statements and periodic reports are
collated and delivered on time and that processing and reimbursement of costs is done in a
timely fashion. The Coordinator will also be responsible for the negotiations with the
European Commission and for collecting and distributing deliverables. This will be in part by
the appointing a Project Manager from Cross Czech a.s. to manage ENRICH project on a day-
to-day basis. This Manager will be responsible to the Management Board for:
• developing a detailed project plan and briefing Contractors on their roles and
responsibilities (together with NKP)
• monitoring progress on workpackages and signalling pressure areas to the
Management Board;
• ensuring the quality and timeliness of all deliverables and project outputs
(together with NKP representatives and Technological Coordinator;
• fulfilling the reporting obligations to the European Commission and liaising with
Commission staff (together with NKP representatives)
• financial management and preparation of project records and cost statements;
• implementing membership registration and communication mechanisms
(including ensuring compliance with data protection legislation);
15/37
DL 1.1 Quality Plan
NKP will:
• provide the technical infrastructure for the Website (although the content will
be managed by another partner);
• ensure the reimbursement of the partners;
• supervise the Coordination Action Manager’s activities
• chairing the Management Board
16/37
DL 1.1 Quality Plan
6.1 Introduction
As the quality management plan will be applied to all milestones and deliverables we here
include the list of milestones, deliverables, and project outputs that will be governed by the
quality plan. The Quality Management Plan also governs all other activities carried out in
frame of ENRICH project.
1 R = Report
P = Service/Product
D = Demonstrator/Prototype
O = Other
2 PU = Public
PP = Restricted to other programme participants (including Commission services and project
reviewers).
CO = Confidential, only for members of the consortium (including Commission services
and project reviewers).
17/37
DL 1.1 Quality Plan
19/37
DL 1.1 Quality Plan
7.1 Introduction
Project monitoring and reporting will be performed by means of:
• Periodic progress meetings;
• Periodic progress reporting:
• Review of main project milestones;
• Reviews of all documents and deliverables by partners.
7.2 Reporting
Information necessary for reporting will be collected via the e-mail on a regular basis from all
partners.
7.2.1 Progress Report Document Templates
Project Reporting Documents are available in the internal part of the Project website.
20/37
DL 1.1 Quality Plan
8.3 Website
The ENRICH web site is a key output of the project. Its contents will be maintained for five
years after the close of the project.
21/37
DL 1.1 Quality Plan
22/37
DL 1.1 Quality Plan
10 Risk management
The management of risks in ENRICH project is detailed in the DoW. Two main aspects of
risks will be taken into account:
• Risks related to technical activities and validity of results
• Risks stemming from relatively large number of partners and their various
types
In order to contain those risks the Project is organised along the following principles:
The project management is structured to ensure smooth communication between technology
providers, content partners and end-users, to monitor the progress and to keep up to date with
the evolution. To ensure the successful completion of the activities and the validity of their
results, each work package is run as an autonomous project with defined relations and
dependencies with other WPs, i.e. contains of planning of work, validation and quality
assurance activities. This ensures that the project remains focus on its original objectives.
With respect to the analysis & management of risks related to the technical activities, the
project management structure & workplan have been set up along the following lines:
AIP as a technical coordinator will review technical aspects of the project and control
technical activities and directions. Certain risk is raised by heterogeneity of metadata for
machine translation. The metadata information available in the documents, by definition, can
be very general (for instance the fields describing content of a book), but also very specific
(fields covered by the ontology). For the first category, translation with SYSTRAN
technology allows a good stability of the translation quality which is - for the second
category, use of the multilingual ontology combined with structure-driven translation options
allows a high accuracy of the translation.
The technical risks are minimized by above mentioned management structure, including
Technological Group Committee. The technological coordinator will be assisted by the
leading experts in development of the technologies that will be used/adjusted during the
project implementation.
23/37
DL 1.1 Quality Plan
11.1 Authorship
Where it is not possible for documents to be issued with ‘Corporate Authorship’, that is with
ENRICH project listed as the author, the following guidelines apply. These guidelines also
apply to all articles that are published by the Consortium Members based on work funded by
the project.
11.1.1 Authorship Reserved For
Authorship is reserved for persons who receive primary credit and hold primary responsibility
for a published work. Authorship encompasses not only those that do the actual writing but
also those who have made a substantial contribution to an article or study (e.g. research
assistants). Substantial professional contributions may include, but are not limited to,
formulating the research problem or hypothesis, structuring the experimental design,
organizing and conducting statistical analysis, interpreting the results, having responsibility
for management and funding, or writing a major portion of the paper. Those who so
contribute should be listed in the byline for the piece of work.
11.1.2 Acknowledgement
Lesser contributions, which do not constitute authorship, may be acknowledged in a note.
These contributions may include such supportive functions as collecting or entering data,
modifying or structuring a computer program, recruiting participants and suggesting or
advising about statistical analysis. Substantial combinations of these with other tasks
however, may constitute authorship.
11.1.3 Main Author Obligations
The author who serves as main contact should always obtain a person’s consent before
including that person’s name in a byline or note. Each author listed in the byline of an article
should review the entire manuscript before it is submitted.
11.1.4 Byline Ordering
Authors are responsible for determining authorship and for specifying the order in which two
or more authors’ names appear in the byline. The general rule is that the name of the principal
author should appear first, with subsequent names in order of descending contribution or
alternatively the Principal Author’s name first with subsequent authors names appearing
alphabetically.
An author note should appear with each article to identify each author’s institutional
affiliation, provide acknowledgments, state any disclaimers or perceived conflicts of interest,
and provide a point of contact for any interested reader.
24/37
DL 1.1 Quality Plan
11.3.1 ACKNOWLEDGMENTS
All publications that relate to ENRICH project should include an acknowledgement not too
disimilar to this:
The background work was conducted within the context of the European Union
funded eContent+ project ENRICH (contract number: ECP 2006 DILI 510049,
http://enrich.manuscriptorium.com).
11.3.2 CONTRIBUTORS
Where articles have more than one author a statement about the Contributors should be
included. This statement might be something along the following lines:
All the authors participated in the definition of this work, analysis and
synthesis, and drafting of the manuscript. They agreed the final version of the
document.
Common authors of all public documents should establish as early as possible how the
attributions of authorship are to be divided between them. Attribution of Authorship: In the
absence of an agreement between the researchers, the following guidelines for attribution of
authorship apply. Authorship is attributed to all those persons who have made scholarly
contributions to the work and who share responsibility and accountability for the results, or
who were responsible for the activity. Unless alphabetic ordering is used the order of the
names in a publication is decided according to the quality of the contribution, the extent of the
responsibility and accountability for the results, and custom.
Duties of the Principal Author: In the absence of an agreement between the authors, where
there are co-authors, the following guidelines apply: The author who submits a manuscript for
publication accepts the responsibility of having included as co-authors all persons who are
entitled to co-authorship, and none who are inappropriate. The submitting author should send
each co-author a draft copy of the manuscript and should make a reasonable attempt to obtain
consent to co-authorship, including the order of names. Other contributions should be
indicated in a footnote or an "Acknowledgements" section, in accordance with the standards
of the discipline and the publisher.
25/37
DL 1.1 Quality Plan
12 DOCUMENTATION MANAGEMENT
12.1 Introduction
The aim of this chapter is to describe the documentation management procedure for the
ENRICH Project. It defines standard rules and procedures related to document production that
all the partners shall apply throughout the project.
The documentation management procedure is applicable:
• to all partners,
• for all documents both internal documents and those that are delivered to the European
Commission,
• and for documents exchanged between partners.
12.2 Definitions
Deliverable: A deliverable consists of one or more types of products (documents,
websites, registries, databases, events, training).
The lists of deliverables appear both in the Description of Work and in
Chapter 5.3 of this Quality Plan
Deliverable identifier: A deliverable identifier uniquely identifies each deliverable. It states the
WP to which this deliverably belongs and its order
English date format will be used for all documents, e.g. 24/07/2006 for 24 July 2006.
26/37
DL 1.1 Quality Plan
The following table gives an overview of the main attributes of a document (this does not
apply to financial statements, which will use the standardized format requested by the
European Commission).
Logos EU Flag X
Project Name ENRICH X
Document title Document title according to DoW X
Date Last update X
Partner(s) e.g.: CCP, NKP … X
Author(s) Document author(s) name(s) X
Document Status See 11.6 X
Dissemination level Public/Confidential X
Deliverable identifier (D) See 11.2 X
Contract reference ECP 2006 DILI 510049 X
Executive Summary
(D) for deliverable documents, only
12.3.2 Document identifier
Each document must be referenced by a unique document identifier to ensure effective
version control.
The nomenclature is defined as:
<Project name abbreviation>_<WP number>_<Document name or number of
deliverable>_<Document version_number>_<Version_Revision>_<initials of the author or
the last revisioner> e.g.: ENRICH_WP1_Qualityplan_01_00_JH
12.3.2.1 Version_Revision
For a document in a draft version, the version and the revision start at 0.0. When a document
is distributed internally or delivered, the Version.Revision number must always be updated.
When the delivery concerns just a part of the document only the revision number is
incremented. For delivery of a revision, the change control table and document change record
table of the document must be updated. For a new version, if the change control table and
document change record table become important, only history of Version number remains.
27/37
DL 1.1 Quality Plan
Document Review
Reviewer Institution Date and result of Review
28/37
DL 1.1 Quality Plan
e.g.: ENRICH_WP1_Qualityplan_01_00_JH.doc
29/37
DL 1.1 Quality Plan
• provide each partner, at any given time, with a consistent vision of the documentation
state.
30/37
DL 1.1 Quality Plan
The following formats will be used for delivering documents to the European Commission:
• Document distribution: Acrobat pdf (preference for PDF/A)
13.2 Website
The Web site has three core areas:
Category Description Access for
PUBLIC the interface between the project PUBLIC
and its constituency and will
include the basic information
about the project, its results and
consortium members, public
documents released by ENRICH,
news, Details of public events,
information about possibility to
join the project as associated
partner
INTERNAL The area for project data storage Consortium
and sharing, file exchange system. Partners with
username and
password
DATA/SYSTEM Core application service layer AIP and granted
LEVEL with publishing system individuals with
username and
password
31/37
DL 1.1 Quality Plan
14 Delivery Procedure
All deliverables will be produced and delivered in English.
32/37
DL 1.1 Quality Plan
15 Quality control
This chapter describes the techniques that are used to check the application of the quality plan
on the ENRICH project.
15.2 Approach
Different approaches can be employed by the person involved in quality control such as:
• participating into meetings;
• reviewing the documentation;
• engaging in discussions with those involved in preparing the deliverables; and,
• evaluating the strengths and weaknesses of the deliverable.
15.3 The Quality Control Stages
1. On completion of a piece of deliverable if it is a document, the Task Leader
responsible will send this for comment to two agreed reviewers. This second editor
will check and evaluate the work on several levels:
• Successful communication of author’s intention
• Quality of language
• Quality of expression
• Length
• Conciseness
• Communication of significant key points
• Synthesis and analysis
• Compliance to ENRICH Document Templates if appropriate
2. The reviewer returns the document within two weeks to the Task Leader with
comments and suggestions. The Task Leader makes certain that appropriate revisions
are made.
33/37
DL 1.1 Quality Plan
3. The document is then passed to the Workpackage Leader for approval. The
Workpackage Leader checks and evaluates the document based on the criteria above.
4. The document is passed back with further comments if needed. The Task Leader
makes certain that appropriate revisions are made
5. Once approved by the Workpackaged leader and two reviewers, the WP leader should
send the document to the Project Coordinator. By this stage the document should be in
its final form and ready to be mounted on the ENRICH website.
6. Final approval for publication of the document will come from the Project Manager.
Task Leaders must ensure that sufficient time is included in the programme of work to
ensure that quality assurance can be completed in a timely fashion.
34/37
DL 1.1 Quality Plan
16 External evaluation
External monitoring process, involving external experts will be applied to the most important
project deliverables. The external evaluators will be suggested by the respective WP leaders.
All consortium members can recommend their candidates for external evaluators in advance.
The final selection will be done usually during the project meeting preceding the planned
submission of the deliverable or later by e-mail confirmation. The final selection of external
experts has to be approved by project Management Board and Technical Coordinator.
The list of deliverables which will undergo the external evaluation:
Two external evaluators will evaluate each of above listed documents. The deliverables will
be internally reviewed according to Chapter 14.3 of this Quality Plan before they will be
passed to external evaluators. After successful internal review the document will be sent to
external evaluators. Further procedure will be similar to the internal review:
1) WP Leader responsible will send this document for comment to two agreed external
reviewers. They will check and evaluate the work on several levels:
• Successful communication of author’s intention
• Quality of language
• Quality of expression
• Length
• Conciseness
• Communication of significant key points
• Synthesis and analysis
• Compliance to ENRICH Document Templates if appropriate
2) The reviewer returns the document within two weeks to the WP Leader with comments and
suggestions. If recommended by the reviewer, he returns the document to Task leader for
appropriate revisions.
3) The document is then passed back to the Workpackage Leader and external reviewers for
approval of revision, if any.
35/37
DL 1.1 Quality Plan
4) Once approved by the Workpackaged leader and two external reviewers, the WP leader
should send the document to the Technical Coordinator and Project Manager. By this stage
the document should be in its final form and ready to be mounted on the ENRICH website.
5) Final approval for publication of the document will come from the Project Manager and
Technical Coordinator.
36/37
DL 1.1 Quality Plan
Project information
Mobile:
E-mail: Gudrun.Stock@ec.europa.eu
Fax:
Mobile: +420731612422
E-mail: zdenek.uhlir@nkp.cz
37/37