Disclosure of Invention
In view of the above problems, embodiments of the present invention provide an objective evaluation method and an evaluation apparatus for a work process, which solve the technical problems that the existing work process evaluation lacks an objective measurement means, and the evaluation process is susceptible to data deviation.
The objective evaluation method for the working process of the embodiment of the invention comprises the following steps:
establishing a quality evaluation model;
checking the reliability and the interpretation degree of the quality evaluation model in sequence, and adjusting the quality evaluation model according to the checking result;
performing dimensionality reduction analysis on the quality evaluation model which accords with the validity, extracting a commonality factor of the quality evaluation model and calculating evaluation index weight;
and correcting the quality evaluation model according to the weight of the evaluation index.
In an embodiment of the present invention, the establishing the quality evaluation model includes:
forming a data link between each dealer and the quality evaluation terminal;
the quality evaluation terminal acquires process elements of the working process of the dealer through a data link and forms an evaluation index library of the working quality according to the process elements;
the quality evaluation terminal determines the evaluation question type of the evaluation index according to the evaluation target, forms an evaluation data structure of the working process and distributes the evaluation data structure to the dealer, and the dealer quantifies the quality evaluation result of the working process;
and the quality evaluation end receives the quality evaluation result through the data link and establishes a quality evaluation model of the working process through the evaluation result and the evaluation index.
In an embodiment of the present invention, the sequentially checking the reliability and the interpretability of the quality evaluation model, and adjusting the quality evaluation model according to the checking result includes:
normalizing the existing evaluation result to form a percentile system data;
measuring, calculating and judging the significance of the reliability of the quality evaluation model according to the percentile system data;
checking the data reliability of the quality evaluation model according to a coefficient method, and adjusting the evaluation index of the quality evaluation model according to the data reliability;
and fitting the quality evaluation model according to the standard error to determine an interpretation proportion between the independent variable and the dependent variable, and adjusting the evaluation index of the quality evaluation model according to the interpretation proportion.
In an embodiment of the present invention, the performing a dimension reduction analysis on the quality evaluation model conforming to validity, extracting a commonality factor of the quality evaluation model, and calculating an evaluation index weight includes:
checking the validity of the quality evaluation model and judging whether factor analysis can be performed or not;
performing dimension reduction analysis on the quality evaluation model to extract evaluation indexes meeting the interpretation degree as common factors;
weights for the commonality factors and other evaluation indices are formed.
In an embodiment of the present invention, the modifying the quality evaluation model according to the weight of the evaluation index includes:
normalizing each evaluation index according to the weight to correct the quality evaluation model;
and combining qualitative quality evaluation of the working process, forming a quality evaluation result through the corrected quality evaluation model, and determining an improvement key point of the working process according to cross analysis among the quality evaluation results of different evaluation indexes.
The objective evaluation device for the working process of the embodiment of the invention is characterized by comprising the following steps:
the model initial module is used for establishing a quality evaluation model;
the index adjusting module is used for sequentially checking the reliability and the interpretation degree of the quality evaluation model and adjusting the quality evaluation model according to a checking result;
the factor analysis module is used for performing dimensionality reduction analysis on the quality evaluation model conforming to the validity, extracting a commonality factor of the quality evaluation model and calculating evaluation index weight;
and the model correction module is used for correcting the quality evaluation model according to the weight of the evaluation index.
In an embodiment of the present invention, the model initialization module includes:
the link forming unit is used for forming data links between each dealer and the quality evaluation terminal;
the index forming unit is used for acquiring the process elements of the working process of the dealer by the quality evaluation terminal through the data link and forming an evaluation index library of the working quality according to the process elements;
the evaluation forming unit is used for determining the evaluation question type of the evaluation index according to the evaluation target by the quality evaluation terminal, forming an evaluation data structure of the working process and distributing the evaluation data structure to the dealer, and the dealer quantificationally forms a quality evaluation result of the working process;
and the model forming unit is used for receiving the quality evaluation result through the data link by the quality evaluation terminal and establishing a quality evaluation model in the working process through the evaluation result and the evaluation index.
In an embodiment of the present invention, the index adjusting module includes:
the result normalization unit is used for normalizing the existing evaluation result to form percentile system data;
the significance judgment unit is used for measuring, calculating and judging the significance of the confidence level of the quality evaluation model according to the percentile system data;
the reliability judging unit is used for checking the data reliability of the quality evaluation model according to a coefficient method and adjusting the evaluation index of the quality evaluation model according to the data reliability;
and the proportion judging unit is used for fitting the quality evaluation model according to the standard error to determine an interpretation proportion between the independent variable and the dependent variable, and adjusting the evaluation index of the quality evaluation model according to the interpretation proportion.
In an embodiment of the present invention, the factor analyzing module includes:
the validity judging unit is used for checking the validity of the quality evaluation model and judging whether factor analysis can be performed or not;
the dimension reduction analysis unit is used for carrying out dimension reduction analysis on the quality evaluation model and extracting evaluation indexes which accord with the interpretation degree as common factors;
and the weight forming unit is used for forming the weights of the commonality factor and other evaluation indexes.
In an embodiment of the present invention, the model modification module includes:
the model correction unit is used for carrying out normalization processing on each evaluation index according to the weight to correct the quality evaluation model;
and the quality evaluation unit is used for forming a quality evaluation result through the corrected quality evaluation model in combination with qualitative quality evaluation of the working process, and determining the improvement focus of the working process according to cross analysis among the quality evaluation results of different evaluation indexes.
The objective evaluation method and the evaluation device for the working process of the embodiment of the invention objectively evaluate the quality of the daily working process of the dealer according to the interaction between the objective evaluation data and the objective evaluation model, visually embody the achievement quality of each working module and working content of each dealer, really realize the foundation and trace check of the evaluation result of the objective working process, and really realize the control and the on-control of the working process of the dealer. Weak indexes with poor common performance of dealers are locked according to the evaluation results of the indexes, so that improvement and promotion of working links are pointed. Meanwhile, by combining with the ranking of objective quality evaluation results in the working process, oriented supervision and guidance work is carried out on dealers needing to be promoted in a key mode, and the quality of the working process of the dealers is continuously promoted and improved.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention clearer and more obvious, the present invention is further described below with reference to the accompanying drawings and the detailed description. It is to be understood that the described embodiments are merely exemplary of the invention, and not restrictive of the full scope of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
An objective evaluation method of the working process according to an embodiment of the present invention is shown in fig. 1. In fig. 1, an embodiment of the present invention includes:
and step 100, establishing a quality evaluation model.
The quality evaluation model is formed according to key elements of the working process, and is the embodiment of links, contents and constraint conditions of the specific working process in reality. The quality evaluation model comprises an evaluation model and evaluation data, the evaluation model indexes key elements of the working process to form a dimension for quantifying the working process, the key elements comprise but are not limited to objective elements such as manpower, equipment, resources, places and the like, and the quality evaluation model also comprises process elements such as deployment rules, using methods, stage results and the like related to the objective elements. The evaluation data includes objective evaluation and subjective evaluation.
And 200, sequentially checking the reliability and the interpretation degree of the quality evaluation model, and adjusting the quality evaluation model according to the checking result.
The measurement of the quality evaluation model forming elements can be obtained through the judgment of the model reliability and the data reliability and the interpretation matching degree of the independent variable and the dependent variable of the model, and the quantitative adjustment of the model forming elements is determined.
Step 300: and performing dimensionality reduction analysis on the quality evaluation model conforming to the validity, extracting a commonality factor of the quality evaluation model and calculating evaluation index weight.
By determining the commonality factors in the model constituent elements, the criticality of the model constituent elements can be effectively determined, and the adjustment optimization basis of the model constituent elements is formed.
And 400, correcting the quality evaluation model according to the weight of the evaluation index.
And the quality evaluation model of the working process is integrally optimized to be fully adapted to the specific working process through the quantitative weight optimization of the model composition elements.
The objective evaluation method of the working process of the embodiment of the invention objectively evaluates the quality of the daily working process of the dealer according to the interaction of the objective evaluation data and the objective evaluation model, visually embodies the achievement quality of each working module and working content of each dealer, really realizes the foundation and trace check of the evaluation result of the objective working process, and really realizes the control and on-control of the working process of the dealer. Weak indexes with poor common performance of dealers are locked according to the evaluation results of the indexes, so that improvement and promotion of working links are pointed. Meanwhile, by combining with the ranking of objective quality evaluation results in the working process, oriented supervision and guidance work is carried out on dealers needing to be promoted in a key mode, and the quality of the working process of the dealers is continuously promoted and improved.
As shown in fig. 1, in an embodiment of the present invention, step 100 includes:
and step 110, forming a data link between each dealer and the quality evaluation terminal.
The data link is used for establishing a distributed data transmission architecture between each dealer and the quality evaluation terminal, so that the data independence and the data privacy of the dealer are ensured, and the synchronous continuous acquisition of the quality evaluation terminal on the working process elements and the working process data is met.
And 120, acquiring the process elements of the working process of the dealer by the quality evaluation terminal through the data link, and forming an evaluation index library of the working quality according to the process elements.
The process elements are element objectification of each working link, working content and working requirement in the working process, and the element objects influence normal working development, result output timeliness and result output quality. And mapping the element object into an evaluation index of the working quality, wherein the set of the evaluation indexes forms an evaluation index library at the quality evaluation end. The evaluation indexes can be dynamically changed and dynamically transmitted under the condition that the characteristic operation and operation strategies of all dealers are periodically and randomly changed.
And step 130, the quality evaluation terminal determines the evaluation question type of the evaluation index according to the evaluation target, forms an evaluation data structure of the working process and distributes the evaluation data structure to the dealer, and the dealer quantifies the quality evaluation result of the working process.
Setting corresponding question types by combining the evaluation indexes, and setting the following evaluation question types according to different evaluation targets:
a) the normative problem is as follows: evaluating according to five levels of non-standard, basic standard, common, non-standard and non-standard;
b) the satisfaction problem is that: according to the quality of the working process, carrying out satisfaction evaluation according to 1-10 minutes
c) "if" to judge the problem: judging whether the working process meets the requirements or not according to the working result achievement condition;
d) degree scoring problem: and (4) adopting a deduction system, directly evaluating according to the percentage system, and setting a deduction mechanism according to the problem type, wherein the deduction mechanism is different from 10, 20 and 30 points in violation of one-time deduction (considering emergency in the working process and combining with actual conditions, and setting a fault-tolerant mechanism for indexes).
The evaluation data structure is distributed to a dealer through a data link in a file data form, the dealer carries out formatted input, working process evaluation is carried out according to evaluation indexes, evaluation data corresponding to working process dimensions are fed back, and a working process quality evaluation result is formed.
And 140, the quality evaluation end receives the quality evaluation result through the data link and establishes a quality evaluation model of the working process through the evaluation result and the evaluation index.
The evaluation result of the satisfaction degree of the working quality is taken as a dependent variable Y, and other working process indexes are taken as independent variables X (X)1、X2、X3、X4…), establishing a quality evaluation model of the working process. The quality evaluation model comprises evaluation result data and evaluation index data of a working process, and the evaluation result data is used for optimizing the evaluation index.
As shown in fig. 1, in an embodiment of the present invention, step 200 includes:
and step 210, normalizing the existing evaluation result to form a percentile system data.
And (4) performing score conversion on the existing evaluation results, unifying the score conversion into a percentage system, so as to be beneficial to quantitatively testing the interpretation degree of the current evaluation index on the whole working process quality evaluation model, judging whether the working process quality evaluation requirement can be met, and measuring and calculating the reliability of the whole model. The principal numerical quantification includes:
a) the normative problem is as follows: the non-standard, basic standard, general, non-standard and non-standard are subjected to percentage conversion, and the corresponding scores are converted into 100, 80, 60, 40 and 20.
b) The satisfaction problem is that: and (4) performing percentage conversion on the evaluation result of the satisfaction degree of 1-10 points, wherein the percentage score is 10.
c) "if" to judge the problem: the "yes/no" evaluation of the operation achievement result is subjected to percentage conversion, and the result is 100, and the result is 0.
And step 220, calculating and judging the significance of the reliability of the quality evaluation model according to the percentile system data.
The measuring and calculating of the credibility of the model comprises the following steps:
and performing linear regression analysis on the converted percentile evaluation result, wherein when the sig value of the overall model result is less than 0.05 and meets a 95% confidence interval, the overall model has significance. The data listed in the following table example show that there is a positive correlation between the predictive power of a model independent variable on a dependent variable:
and step 230, checking the data reliability of the quality evaluation model according to a coefficient method, and adjusting the evaluation index of the quality evaluation model according to the data reliability.
Specifically, whether the data reliability reaches the standard is checked through a Cronbach's alpha (Kernebara) coefficient method. And measuring the model data, calculating the variance result of the data, and performing reliability test. The data listed in the following table examples can be seen:
the model has a good model reliability because the alpha value of the standardization item is 0.829. If the model is poor in reliability, the assessment indexes need to be adjusted, and the indexes are deleted or increased according to assessment requirements. The adjustment inevitably affects the regeneration of the evaluation result and the regeneration of the quality evaluation model.
And 240, fitting the quality evaluation model according to the standard error to determine an interpretation proportion between the independent variable and the dependent variable, and adjusting the evaluation index of the quality evaluation model according to the interpretation proportion.
Specifically, the rate of independent variable interpretation dependent variable variation is reflected by fitting the model with an Adjusted R Square (Adjusted R2). The adjusted R2 value of the model is 0.839. The data listed in the following table examples can be seen:
the independent variables in the model together explain 83.9% variation, with better results closer to 1. If the model interpretation proportion is low, the assessment indexes need to be adjusted, and the indexes are deleted or increased according to assessment requirements. The adjustment inevitably affects the regeneration of the evaluation result and the regeneration of the quality evaluation model.
As shown in fig. 1, in an embodiment of the present invention, step 300 includes:
step 310, checking the validity of the quality evaluation model to judge whether the factor analysis is possible.
Specifically, firstly, whether the quality evaluation model has structural validity or not and whether factor analysis can be performed or not is judged by using KMO (Kernel-based optimization) and Bartlett sphericity test. The data listed in the following table examples can be seen:
the Sig value of the model after inspection is less than 0.05, and factor analysis can be normally carried out.
And 320, performing dimension reduction analysis on the quality evaluation model to extract an evaluation index meeting the interpretation degree as a common factor.
Specifically, the maximum variance of the characteristic values is rotated by utilizing a determination analysis matrix, the number of the extraction common factors is determined, and the interpretation degree of the extracted common factors on the whole model is judged according to the output result. The data listed in the following table examples can be seen:
3 commonalities are extracted from the model, the total variance of the accumulated interpretation is 78.6%, and the extracted commonalities have better interpretation rate on all questions of the original questionnaire and meet the evaluation requirement.
At step 330, weights for the commonality factors and other evaluation indices are formed.
Specifically, a commonality factor weight W is calculated: the factor weight is determined by normalizing the variance interpretation ratio of the rotated commonality factors. Taking 3 common factors extracted from the above model as an example, W1=F1Variance interpretation ratio/cumulative variance interpretation ratio, W2=F2Variance interpretation ratio/cumulative variance interpretation ratio, W3=F3Variance interpretation rate/cumulative variance interpretation rate.
Specifically, each index weight is calculated: and dividing the rotated component matrix value of each index by sqrt (corresponding characteristic root) of the common factor corresponding to the index to calculate the coefficient of each index. Then, the coefficient of each index is multiplied by the corresponding weight of the common factor, and finally, the weight P of the index is obtained by adding the weights of the common factors.
As shown in FIG. 1, in one embodiment of the present invention, step 400 comprises:
and step 410, normalizing each evaluation index according to the weight to correct the quality evaluation model. Forming a correction quality evaluation model through normalization processing of each evaluation index:
S=P1*X1+P2*X2+P3*X3+…+Pn*Xn
and step 420, combining qualitative quality evaluation of the working process, forming a quality evaluation result by correcting the quality evaluation model, and determining an improvement focus of the working process according to cross analysis among the quality evaluation results of different evaluation indexes.
In practical application, the quality evaluation model of the innovative working process is as follows:
the method has the advantages that the working process data of an evaluation object are directly collected, the evaluation index of the daily working process is determined according to the key control point and the monitorability of the working link, the quality of the working process is quantitatively evaluated, the main nodes of the working process can be effectively controlled, the data can be checked, and fair, uniform, normative and scientific transparent evaluation is realized; common factors and index weights are determined through a factor analysis method, the management and control key points can be strengthened, the execution quality of key points in the working process is improved, and the overall delivery effect of a project is ensured.
The working process quality evaluation model is used for evaluating the working process submitted by the dealer data, and the evaluation is carried out according to a quantitative evaluation principle to generate evaluation results of all indexes of the dealer working process quality as follows:
and performing percentage conversion on the index evaluation result according to different question models, and finally performing result calculation according to an S-P1X 1+ P2X 2+ P3X 3+ … + P9X 9 model to generate a dealer working process quality evaluation result so as to monitor the dealer execution condition. Through the system evaluation, the execution condition and the execution problem of the dealer are fully reflected, and meanwhile, the later improvement focus is locked.
An objective evaluation device for the working process according to an embodiment of the present invention is shown in fig. 3. In fig. 3, the present embodiment includes:
the model initial module 10 is used for establishing a quality evaluation model;
the index adjusting module 20 is used for sequentially checking the reliability and the interpretation degree of the quality evaluation model and adjusting the quality evaluation model according to the checking result;
the factor analysis module 30 is used for performing dimensionality reduction analysis on the quality evaluation model conforming to the validity, extracting the commonality factor of the quality evaluation model and calculating the evaluation index weight;
and the model correction module 40 is used for correcting the quality evaluation model according to the weight of the evaluation index.
As shown in fig. 3, in an embodiment of the present invention, the model initialization module 10 includes:
a link forming unit 11, configured to form a data link between each dealer and the quality evaluation terminal;
the index forming unit 12 is used for acquiring the process elements of the working process of the dealer by the quality evaluation terminal through a data link and forming an evaluation index library of the working quality according to the process elements;
an evaluation forming unit 13, which is used for the quality evaluation terminal to determine the evaluation question type of the evaluation index according to the evaluation target, form the evaluation data structure of the working process and distribute the evaluation data structure to the dealer, and the dealer quantificationally forms the quality evaluation result of the working process;
and the model forming unit 14 is used for receiving the quality evaluation result through the data link by the quality evaluation terminal and establishing a quality evaluation model of the working process through the evaluation result and the evaluation index.
As shown in fig. 3, in an embodiment of the present invention, the index adjustment module 20 includes:
a result normalization unit 21, configured to normalize an existing evaluation result to form percentile system data;
the significance judging unit 22 is used for measuring, calculating and judging the significance according to the reliability of the percentile system data on the quality evaluation model;
a reliability judging unit 23, configured to check the data reliability of the quality evaluation model according to a coefficient method, and adjust an evaluation index of the quality evaluation model according to the data reliability;
and the proportion judging unit 24 is used for fitting the quality evaluation model according to the standard error to determine an interpretation proportion between the independent variable and the dependent variable, and adjusting the evaluation index of the quality evaluation model according to the interpretation proportion.
As shown in fig. 3, in an embodiment of the present invention, the factor analyzing module 30 includes:
a validity judgment unit 31 for checking validity judgment of the quality evaluation model whether factor analysis is possible;
the dimension reduction analysis unit 32 is used for carrying out dimension reduction analysis on the quality evaluation model and extracting evaluation indexes which accord with the interpretation degree as common factors;
a weight forming unit 33 for forming weights of the commonality factor and the other evaluation index.
As shown in fig. 3, in an embodiment of the present invention, the model modification module 40 includes:
a model modification unit 41, configured to perform normalization processing on each evaluation index according to a weight to modify the quality evaluation model;
and the quality evaluation unit 42 is used for forming a quality evaluation result through the corrected quality evaluation model in combination with qualitative quality evaluation of the working process, and determining the improvement focus of the working process according to cross analysis among the quality evaluation results of different evaluation indexes.
The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present invention are included in the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.