CN105791046A - Method, device, terminal and server for evaluating user QoE - Google Patents
Method, device, terminal and server for evaluating user QoE Download PDFInfo
- Publication number
- CN105791046A CN105791046A CN201410836361.XA CN201410836361A CN105791046A CN 105791046 A CN105791046 A CN 105791046A CN 201410836361 A CN201410836361 A CN 201410836361A CN 105791046 A CN105791046 A CN 105791046A
- Authority
- CN
- China
- Prior art keywords
- qoe
- application
- time delay
- assessment
- parameter
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W24/00—Supervisory, monitoring or testing arrangements
- H04W24/08—Testing, supervising or monitoring using real traffic
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Telephonic Communication Services (AREA)
- Mobile Radio Communication Systems (AREA)
Abstract
The invention provides a method, device, terminal and server for evaluating the user QoE, wherein the method comprises the following steps of: obtaining evaluation parameters for evaluating the QoE, wherein the evaluation parameters include at least one selected from a group including a network data packet generated by an application in the terminal in a use process, a network layer of the application, an index parameter in the application layer, the attribute information of the terminal, user related social attribute information and the opinion grade of the application; sending the obtained evaluation parameters to the server for establishing a QoE evaluation model; obtaining the QoE evaluation model established by the server according to the evaluation parameters; and performing QoE evaluation of the application according to the QoE evaluation model. By means of the invention, the problems that the QoE evaluation method in the related technology is complex to evaluate and low in accuracy degree and user experience can be solved; therefore, the QoE evaluation complexity can be reduced; and the QoE evaluation accuracy degree and the user experience are improved.
Description
Technical field
The present invention relates to the communications field, in particular to a kind of user experience quality QoE appraisal procedure, device, terminal and server.
Background technology
The technology of mobile Internet is fast-developing in recent years, and mobile terminal application emerges in an endless stream, and they are when bringing advantage to the user, and also bring a degree of pressure to mobile network so that terminal applies Quality Down.In order to support all kinds of terminal applies quickly increased, the exploitation of application developer puts into and operator invests on network foundation is disposed and increases to some extent.The experience of user can be improved again while how keeping the high efficiency of network investment obtain bigger customer group and become a critically important topic.
The fierce market competition makes developer, Virtual network operator and service provider it is realized that the satisfaction that improves terminal use is the scale that extends one's service realizes the key of profit.Therefore evaluate user's satisfaction to application program for mobile terminal, and the service that guarantees can obtain the accreditation of user and become a step of key.Standardization body of International Telecommunication Union defines the index weighing user's subjective feeling, i.e. user experience quality (QualityofExperience, referred to as QoE), it refers to " the overall acceptable degree by a kind of application of terminal use institute perception or business ".The QoE measurement of mobile Internet business is subject to the great attention of Virtual network operator and service provider.The QoE of accurate evaluation related application has directive significance for the optimization of network and the exploitation of terminal applies with adjustment, and final result is to bring better experience to user, carrys out bigger profit for operator and service provider simultaneously.
But, under mobile network environment, the user QoE of terminal applies is evaluated there is a lot of problem.In correlation technique and theory, the evaluation of QoE is both for the evaluation of certain business, have ignored the evaluation to Mobile solution.In its appraisement system, the evaluation index related to is all the parameter index of Internet.But the index of Internet for the evaluation of user QoE be have circumscribed, it is necessary to obtain the index of more application characteristic aspect, the evaluation of QoE just can be made to experience closer to user.
Meanwhile, in relevant technology and theory, the appraisal of main QoE is to carry out under fixed network environment, owing to mobile network environment and fixed network exist very big-difference in difference and the user data collection of QoE evaluation index so that existing a lot of QoE evaluation models all can not directly use.
It is primarily present following several evaluation scheme in the related, respectively 1) assessment algorithm [201410301467.X of QoE is proposed for certain business scenario, mobile video method for evaluating quality based on step analysis and multiple linear regression], 2) make relevant QoE for the different business of fixed network environment from network level and analyze [201310057840.7, network QoS and QoE measure and mapping relations analysis platform], 3) for some specific business, the QoE [201310045069.1 of experimental analysis specific transactions is carried out by artificial analog service environment, mobile video service-user Quality of experience appraisal procedure based on ordinal regression], but the such scheme in correlation technique respectively can there are the following problems:
1) proposing relevant assessment algorithm for some business scenario, only consider to promote QoE analytical performance by algorithm design, most important influence factor is QoE evaluation index in fact.But most of algorithms is excessively complicated simultaneously, and accuracy is low, and performance boost space is little, and flexibility ratio is poor, and expansibility is not strong.
2) fixed network environment is only considered, it does not have analyze mobile network environment.Only it is QoE from network level simultaneously and analyzes the network performance being only capable of reaction bottom, it is impossible to react the real experiences perception of user truly.
3) do experimental analysis for specific business and only rest on the aspect of emulation, it is impossible to be actually used in passive monitoring and the analysis of true application scenarios.
Can there is, for the QoE appraisal procedure existed in correlation technique, the problem that assessment is complicated, accuracy is low and Consumer's Experience is low, not yet propose effective solution at present.
Summary of the invention
The invention provides a kind of user experience quality QoE appraisal procedure, device, terminal and server, can there is, with the QoE appraisal procedure at least solving exist in correlation technique, the problem that assessment is complicated, accuracy is low and Consumer's Experience is low.
According to an aspect of the present invention, provide a kind of user experience quality QoE appraisal procedure, including: obtain the assessment parameter for QoE is estimated, wherein, described assessment parameter include following information at least one: the index parameter in network packet that the application in terminal in use produces, the network layer and application layer of described application, the attribute information of described terminal, the relevant social property information of user, opinion score to described application；The described assessment parameter obtained is sent to the server for setting up QoE assessment models；Obtain the described QoE assessment models set up according to described assessment parameter that described server sends；According to described QoE assessment models, described application is carried out QoE assessment.
Further, when described assessment parameter includes the index parameter in the network layer and application layer of described application, the described assessment parameter obtained is sent to and includes for the server setting up described QoE assessment models: the index parameter from the network layer and application layer of described application extracts the key index parameter affecting described QoE；The described key index parameter extracted is sent to described server.
Further, the index parameter in described Internet includes at least one of: domain name service dns resolution time delay, transmission control protocol TCP connect time delay, HTML (Hypertext Markup Language) http response time delay, network speed, flow；Index parameter in described application layer includes at least one of: the page is loaded into time delay, Rich Media loads time delay, webpage blank time delay, resource temperature, advertising resource take, battery consumption rate, the safety coefficient of application, transaction time delay.
According to a further aspect in the invention, additionally provide a kind of user experience quality QoE appraisal procedure, including: receive the assessment parameter for QoE is estimated that terminal sends, wherein, described assessment parameter include following information at least one: the index parameter in network packet that the application in terminal in use produces, the network layer and application layer of described application, the attribute information of described terminal, the relevant social property information of user, opinion score to described application；The QoE assessment models for described application being carried out QoE assessment is set up according to the described assessment parameter received；The described QoE assessment models set up is sent to described terminal.
Further, the index parameter in described Internet includes at least one of: domain name service dns resolution time delay, transmission control protocol TCP connect time delay, HTML (Hypertext Markup Language) http response time delay, network speed, flow；Index parameter in described application layer includes at least one of: the page is loaded into time delay, Rich Media loads time delay, webpage blank time delay, resource temperature, advertising resource take, battery consumption rate, the safety coefficient of application, transaction time delay.
Further, after receiving the assessment parameter being used for QoE is estimated that terminal sends, at least one of is also included: the described assessment parameter received is carried out classification storage；Back up described assessment parameter.
According to a further aspect in the invention, provide a kind of user experience quality QoE apparatus for evaluating, including: the first acquisition module, for obtaining the assessment parameter for QoE is estimated, wherein, described assessment parameter include following information at least one: the index parameter in network packet that the application in terminal in use produces, the network layer and application layer of described application, the attribute information of described terminal, the relevant social property information of user, opinion score to described application；First sending module, for being sent to the server for setting up QoE assessment models by the described assessment parameter obtained；Second acquisition module, for obtaining the described QoE assessment models set up according to described assessment parameter that described server sends；Evaluation module, for carrying out QoE assessment according to described QoE assessment models to described application.
Further, when described assessment parameter includes the index parameter in the network layer and application layer of described application, described first sending module includes: extraction unit, for extracting the key index parameter affecting described QoE in the index parameter from the network layer and application layer of described application；Transmitting element, for being sent to described server by the described key index parameter extracted.
Further, the index parameter in described Internet includes at least one of: domain name service dns resolution time delay, transmission control protocol TCP connect time delay, HTML (Hypertext Markup Language) http response time delay, network speed, flow；Index parameter in described application layer includes at least one of: the page is loaded into time delay, Rich Media loads time delay, webpage blank time delay, resource temperature, advertising resource take, battery consumption rate, the safety coefficient of application, transaction time delay.
According to a further aspect in the invention, it is provided that a kind of terminal, including the device described in any of the above-described item.
According to a further aspect in the invention, additionally provide a kind of user experience quality QoE apparatus for evaluating, including: receiver module, for receiving the assessment parameter for QoE is estimated that terminal sends, wherein, described assessment parameter include following information at least one: the index parameter in network packet that the application in terminal in use produces, the network layer and application layer of described application, the attribute information of described terminal, the relevant social property information of user, opinion score to described application；Set up module, for setting up the QoE assessment models for described application being carried out QoE assessment according to the described assessment parameter received；Second sending module, for being sent to described terminal by the described QoE assessment models set up.
Further, the index parameter in described Internet includes at least one of: domain name service dns resolution time delay, transmission control protocol TCP connect time delay, HTML (Hypertext Markup Language) http response time delay, network speed, flow；Index parameter in described application layer includes at least one of: the page is loaded into time delay, Rich Media loads time delay, webpage blank time delay, resource temperature, advertising resource take, battery consumption rate, the safety coefficient of application, transaction time delay.
Further, described user experience quality QoE apparatus for evaluating also includes at least one of: memory module, for the described assessment parameter received carries out classification storage；Backup module, is used for backing up described assessment parameter.
According to a further aspect in the invention, it is provided that a kind of server, including the device described in any of the above-described item.
Pass through the present invention, adopt the assessment parameter obtained for QoE is estimated, wherein, described assessment parameter include following information at least one: the index parameter in network packet that the application in terminal in use produces, the network layer and application layer of described application, the attribute information of described terminal, the relevant social property information of user, opinion score to described application；The described assessment parameter obtained is sent to the server for setting up QoE assessment models；Obtain the described QoE assessment models set up according to described assessment parameter that described server sends；According to described QoE assessment models, described application is carried out QoE assessment, solve the QoE appraisal procedure existed in correlation technique and can there is the problem that assessment is complicated, accuracy is low and Consumer's Experience is low, and then reached reduction QoE assessment complexity, promote QoE and assess the effect of accuracy and Consumer's Experience.
Accompanying drawing explanation
Accompanying drawing described herein is used for providing a further understanding of the present invention, constitutes the part of the application, and the schematic description and description of the present invention is used for explaining the present invention, is not intended that inappropriate limitation of the present invention.In the accompanying drawings:
Fig. 1 is the flow chart of the first user experience quality QoE appraisal procedure according to embodiments of the present invention；
Fig. 2 is the flow chart of the second user experience quality QoE appraisal procedure according to embodiments of the present invention；
Fig. 3 is the structured flowchart of the first user experience quality QoE apparatus for evaluating according to embodiments of the present invention；
Fig. 4 is the structured flowchart of the first sending module 34 in the first user experience quality QoE apparatus for evaluating according to embodiments of the present invention；
Fig. 5 is the structured flowchart of terminal according to embodiments of the present invention；
Fig. 6 is the second user experience quality QoE apparatus for evaluating according to embodiments of the present invention；
Fig. 7 is the preferred structure block diagram of the second user experience quality QoE apparatus for evaluating according to embodiments of the present invention；
Fig. 8 is the structured flowchart of server according to embodiments of the present invention；
Fig. 9 is the user's QoE appraisal procedure flow chart to application program for mobile terminal according to embodiments of the present invention；
Figure 10 is mobile terminal system structured flowchart according to embodiments of the present invention；
Figure 11 is server system structured flowchart according to embodiments of the present invention；
Figure 12 is the user's QoE appraisal procedure based on Mobile solution according to embodiments of the present invention.
Detailed description of the invention
Below with reference to accompanying drawing and describe the present invention in detail in conjunction with the embodiments.It should be noted that when not conflicting, the embodiment in the application and the feature in embodiment can be mutually combined.
Providing a kind of user experience quality QoE appraisal procedure in the present embodiment, Fig. 1 is the flow chart of the first user experience quality QoE appraisal procedure according to embodiments of the present invention, as it is shown in figure 1, this flow process comprises the steps:
Step S102, obtain the assessment parameter for QoE is estimated, wherein, this assessment parameter include following information at least one: the index parameter in network packet that the application in terminal in use produces, the network layer and application layer of application, the attribute information of terminal, the relevant social property information of user, opinion score to application；
Step S104, is sent to the server for setting up QoE assessment models by the assessment parameter obtained；
Step S106, obtains the QoE assessment models set up according to assessment parameter that above-mentioned server sends；
Step S108, carries out QoE assessment according to QoE assessment models to application.
Wherein, the relevant social property information of above-mentioned user at least includes the information such as the sex of user, age, occupation, hobby, pass through above-mentioned steps, above-mentioned assessment parameter has been taken into full account when QoE is estimated, and, above-mentioned appraisal procedure can apply under any network, thus efficiently solving the QoE appraisal procedure existed in correlation technique can there is the problem that assessment is complicated, accuracy is low and Consumer's Experience is low, and then reached reduction QoE assessment complexity, promote QoE and assess the effect of accuracy and Consumer's Experience.
When above-mentioned assessment parameter includes the index parameter in the network layer and application layer of application, the assessment parameter obtained is sent to and includes for the server setting up QoE assessment models: the index parameter from the network layer and application layer of application extracts the key index parameter affecting QoE；This key index parameter extracted is sent to server.That is, after index parameter in the network side obtaining application and application layer, can selectable transmitting portion index parameter, and non-sent all refers to mark parameter, when carrying out index parameter and selecting, the index parameter that QoE assessment impact is bigger can be selected, so can effectively alleviate the transmission pressure of network data.
Index parameter in above-mentioned Internet can include at least one of: domain name service dns resolution time delay, transmission control protocol TCP connect time delay, HTML (Hypertext Markup Language) http response time delay, network speed, flow；Index parameter in above-mentioned application layer includes at least one of: the page is loaded into time delay, Rich Media loads time delay, webpage blank time delay, resource temperature, advertising resource take, battery consumption rate, the safety coefficient of application, transaction time delay.
Fig. 2 is the flow chart of the second user experience quality QoE appraisal procedure according to embodiments of the present invention, as in figure 2 it is shown, the method comprises the steps:
Step S202, receive the assessment parameter for QoE is estimated that terminal sends, wherein, this assessment parameter include following information at least one: the index parameter in network packet that the application in terminal in use produces, the network layer and application layer of application, the attribute information of terminal, the relevant social property information of user, opinion score to application；
Step S204, sets up the QoE assessment models for application carries out QoE assessment according to the assessment parameter received；
Step S206, is sent to terminal by the QoE assessment models of foundation.
Pass through above-mentioned steps, it is possible to effectively the QoE appraisal procedure solved in correlation technique can exist the problem that assessment is complicated, accuracy is low and Consumer's Experience is low, and then has reached reduction QoE assessment complexity, promotes QoE and assesses the effect of accuracy and Consumer's Experience.
Index parameter in above-mentioned Internet can include at least one of: domain name service dns resolution time delay, transmission control protocol TCP connect time delay, HTML (Hypertext Markup Language) http response time delay, network speed, flow；Index parameter in above-mentioned application layer includes at least one of: the page is loaded into time delay, Rich Media loads time delay, webpage blank time delay, resource temperature, advertising resource take, battery consumption rate, the safety coefficient of application, transaction time delay.
In an optional embodiment, receive that terminal sends for after assessment parameter that QoE is estimated, it is also possible to carry out following operation at least one: the assessment parameter received is carried out classification storage；Backup assessment parameter.
Additionally providing a kind of user experience quality QoE apparatus for evaluating in the present embodiment, this device is used for realizing above-described embodiment and preferred implementation, has be carried out repeating no more of explanation.As used below, term " module " can realize the software of predetermined function and/or the combination of hardware.Although the device described by following example preferably realizes with software, but hardware, or the realization of the combination of software and hardware is also likely to and is contemplated.
Fig. 3 is the structured flowchart of the first user experience quality QoE apparatus for evaluating according to embodiments of the present invention, as shown in Figure 3, this device includes the first acquisition module the 32, first sending module the 34, second acquisition module 36 and evaluation module 38, below this device is illustrated.
First acquisition module 32, for obtaining the assessment parameter for QoE is estimated, wherein, this assessment parameter include following information at least one: the index parameter in network packet that the application in terminal in use produces, the network layer and application layer of application, the attribute information of terminal, the relevant social property information of user, opinion score to application；First sending module 34, is connected to above-mentioned first acquisition module 32, for the assessment parameter obtained is sent to the server for setting up QoE assessment models；Second acquisition module 36, is connected to above-mentioned first sending module 34, for obtaining the QoE assessment models set up according to assessment parameter that server sends；Evaluation module 38, is connected to above-mentioned second acquisition module 36, for application being carried out QoE assessment according to QoE assessment models.
Fig. 4 is the structured flowchart of the first sending module 34 in the first user experience quality QoE apparatus for evaluating according to embodiments of the present invention, as shown in Figure 4, when assessing the index parameter that parameter includes in the network layer and application layer applied, this first sending module 34 includes extraction unit 42 and transmitting element 44, below this first sending module 34 is illustrated.
Extraction unit 42, for extracting the key index parameter affecting QoE in the index parameter from the network layer and application layer of application；Transmitting element 44, is connected to said extracted unit 42, for the key index parameter of extraction is sent to above-mentioned server.
Wherein, the index parameter in above-mentioned Internet can include at least one of: domain name service dns resolution time delay, transmission control protocol TCP connect time delay, HTML (Hypertext Markup Language) http response time delay, network speed, flow；Index parameter in above-mentioned application layer can include at least one of: the page is loaded into time delay, Rich Media loads time delay, webpage blank time delay, resource temperature, advertising resource take, battery consumption rate, the safety coefficient of application, transaction time delay.
Fig. 5 is the structured flowchart of terminal according to embodiments of the present invention, as it is shown in figure 5, this terminal 52 includes the first QoE apparatus for evaluating 54 of any of the above-described.
Fig. 6 is the second user experience quality QoE apparatus for evaluating according to embodiments of the present invention, and as shown in Figure 6, this device includes receiver module 62, sets up module 64 and the second sending module 66, below this device is illustrated.
Receiver module 62, for receiving the assessment parameter for QoE is estimated that terminal sends, wherein, this assessment parameter include following information at least one: the index parameter in network packet that the application in terminal in use produces, the network layer and application layer of application, the attribute information of terminal, the relevant social property information of user, opinion score to application；Set up module 64, be connected to above-mentioned receiver module 62, for setting up the QoE assessment models for application being carried out QoE assessment according to the assessment parameter received；Second sending module 66, is connected to above-mentioned set up module 64, for the QoE assessment models of foundation is sent to terminal.
Wherein, the index parameter in above-mentioned Internet can include at least one of: domain name service dns resolution time delay, transmission control protocol TCP connect time delay, HTML (Hypertext Markup Language) http response time delay, network speed, flow；Index parameter in above-mentioned application layer can include at least one of: the page is loaded into time delay, Rich Media loads time delay, webpage blank time delay, resource temperature, advertising resource take, battery consumption rate, the safety coefficient of application, transaction time delay.
Fig. 7 is the preferred structure block diagram of the second user experience quality QoE apparatus for evaluating according to embodiments of the present invention, as it is shown in fig. 7, this device is except including all modules shown in Fig. 6, also includes memory module 72 and backup module 74, below this device is illustrated.
Memory module 72, is connected to above-mentioned receiver module 62, for the assessment parameter received carries out classification storage；Backup module 74, is connected to above-mentioned receiver module 62, is used for backing up above-mentioned assessment parameter.
Fig. 8 is the structured flowchart of server according to embodiments of the present invention, and as shown in Figure 8, this server 82 includes the second user experience quality QoE apparatus for evaluating 84 of any of the above-described.
From the system perspective including terminal and server, the present invention will be described below.
In one embodiment of the invention, it is based on mobile terminal application to realize user experience quality (QoE) is estimated, first of all for accurately weighing user in the experience using concrete terminal applies, need to find out the network factors of performance factor and the dependence thereof that can evaluate application, and then the real experiences perception according to user, these factors are used to carry out correlation analysis, find out the qualitative and quantitative relationship existed between them, finally utilize the relation excavated that the Quality of experience of each terminal applies of user is evaluated, implement step as shown in Figure 9, Fig. 9 is the user's QoE appraisal procedure flow chart to application program for mobile terminal according to embodiments of the present invention, this flow chart comprises the steps:
Step S902, proposes relative influence index from bottom-layer network, connects time delay, http response time delay, network speed, flow etc. including dns resolution time delay, TCP；
Step S904, proposes to affect the key index of user QoE from mobile terminal application characteristic aspect: proposes overall page for web page browsing application and is loaded into time delay, Rich Media's loading index such as time delay, webpage blank time delay；For indexs such as Video Applications proposition resource temperature, advertising resource takies, battery consumption rates；For social and transaction application, the index such as safety coefficient, transaction time delay is proposed；
Step S906, it is achieved the network data acquisition of mobile terminal application and analytic function: user is when experiencing concrete terminal applies, and this system obtains all-network packet on backstage, and is saved in system for post analysis；
Step S908, it is achieved the analysis of all kinds of terminal applies characteristic index is extracted: according to the use pattern of concrete end application and bottom-layer network data, calculate the parameter characterizing each index properties；
Step S910, data collection is realized at far-end server, mobile terminal software is responsible for obtaining and report of user data: data include analyzing the specific targets parameter of the types of applications extracted, and User Part information includes the basic social property of user, user completes subjective opinion score and the subscriber equipment relevant information that terminal applies is experienced；
Step S912, based on the index parameter extracted and get field feedback, carry out each index and user QoE is affected the analysis of relation and the foundation of mathematical model, the user QoE realizing different terminals application evaluates: first analyzes all kinds of index and includes terminal applies characterisitic parameter and network bottom layer parameter user QoE is affected relation, then set up assessment models and be trained with historical data generation training data set pair model, it is achieved the user QoE of application program for mobile terminal is assessed.
Figure 10 is mobile terminal system structured flowchart according to embodiments of the present invention, and the major function of the terminal shown in Figure 10 comprises following components:
Gather user and use the network packet produced in terminal applies process, collect the relevant social property information of application program, terminal unit and user；
Analyzing the network packet gathered, design related algorithm and program, extracting network layer and application significant level affects the key index parameter of user QoE；
The data such as the index of correlation value by the real experiences value (MOS, mean subjective opinion score) of user feedback, equipment, application program, user related information and proposition, are reported to server end；
The QoE regularly trained to server request assesses mathematical model, uses user and utilizes this model in the process of terminal applies, and the index of correlation according to extracting carries out QoE prediction.
Figure 11 is server system structured flowchart according to embodiments of the present invention, and wherein server can include unit's end server and home server, and the major function of the server shown in Figure 11 comprises following components:
Server is collected the data uploaded of mobile terminal and carries out classification storage；
Data are pulled down to home server be backed-up, complete the analysis of data and the training of dependent evaluation model at home server simultaneously；
The model trained is pushed to far-end server, and far-end server according to the request of client, can send the information of correlation model to client.
In order to clearly illustrate that concrete invention realizes flow process, in an optional embodiment, the concrete steps of the present invention are introduced with mobile terminal typical application Web browser application for example, Figure 12 is the user's QoE appraisal procedure based on Mobile solution according to embodiments of the present invention, comprises the steps:
Step S1202, proposes to affect the key index of user QoE from mobile terminal Web application characteristic aspect, and wherein Internet index includes: DNS time delay, TCP connect time delay, response delay, propagation delay time.Application layer index includes: overall page is loaded into time delay, Rich Media loads time delay, webpage blank time delay etc.；
Step S1204, it is achieved the network data acquisition function of mobile terminal application: user is when experiencing concrete Web application, and this system obtains all-network packet on backstage, and is saved in system for post analysis；And realize the analysis abstraction function of all kinds of terminal applies characteristic index: according to the use pattern of concrete end application and bottom-layer network data, calculate the parameter characterizing each index properties；
Step S1206, based on the index parameter extracted and get field feedback, carry out each index and user QoE is affected the analysis of relation and the foundation of mathematical model, the user QoE realizing different terminal applies evaluates: first analyzes all kinds of index and includes terminal applies characterisitic parameter and network bottom layer parameter user QoE is affected relation, then pass through the assessment models set up, it is achieved the user QoE of application program for mobile terminal is assessed.
Implementation and the extraction algorithm of application layer index parameter can be in the following way:
Battery consumption rate is divided by the electricity of consumption and the time of use when using browser according to user, draws the wear rate of battery electric quantity；
It is the mode being captured packet by backstage that the page loads time delay, is calculated by algorithm.This algorithm includes, destination Uniform Resource finger URL (UniformResourceLocator is sent at browser, referred to as URL) name server (DomainNameServer, referred to as DNS) request after start the clock, until target URL stops timing after all data being transmitted, the time delay obtained is designated as the page and loads time delay；
Rich Media loads time delay and is based on the data that backstage captures, and is calculated by algorithm.This algorithm includes: received data rich media data type is mated by the packet captured by backstage by each field of HTTP, obtains the port of all Rich Medias transmission；Calculate timestamp and the time delay of each port transmission Rich Media, and mate whether each time delay interval has coincidence；All time delays are added, and deduct the time delay of overlap, draw final Rich Media's overall transmission delay.
The advantage of the various embodiments described above of the present invention is in that, the assessment of user QoE is rethought from new angle end application, and the key index of user QoE is proposed to affect from terminal applies characteristic aspect, it is achieved the extraction of the performance indications parameter of types of applications characteristic index and network bottom layer.By integrating all kinds of parameter and collecting user's subjectivity opinion score, analyze different index parameter to the QoE relation affected, carry out founding mathematical models and realize the user QoE of terminal applies carries out accurately comprehensively assessment.In addition, the various embodiments described above of the present invention can also realize following effect: realizes the user experience quality assessment of mobile terminal application；Support the assessment of all kinds of terminal applies；The measurement of integrated QoS and QoE, is conducive to the optimization etc. of application developer and Virtual network operator and the application of service supplier, network, service；For types of applications, analyzing QoE index comprehensive, assessment accuracy is high, it is possible to as basic reference；Suitable in the assessment applying QoE under all kinds of terminal networks；Assessment models can carry out regular training according to the data volume collected and update, and improves the accuracy of assessment.
Obviously, those skilled in the art should be understood that, each module of the above-mentioned present invention or each step can realize with general calculation element, they can concentrate on single calculation element, or it is distributed on the network that multiple calculation element forms, alternatively, they can realize with the executable program code of calculation element, thus, can be stored in storage device is performed by calculation element, and in some cases, shown or described step can be performed with the order being different from herein, or they are fabricated to respectively each integrated circuit modules, or the multiple modules in them or step are fabricated to single integrated circuit module realize.So, the present invention is not restricted to the combination of any specific hardware and software.
The foregoing is only the preferred embodiments of the present invention, be not limited to the present invention, for a person skilled in the art, the present invention can have various modifications and variations.All within the spirit and principles in the present invention, any amendment of making, equivalent replacement, improvement etc., should be included within protection scope of the present invention.
Claims (14)
1. a user experience quality QoE appraisal procedure, it is characterised in that including:
Obtain the assessment parameter for QoE is estimated, wherein, described assessment parameter include following information at least one: the index parameter in network packet that the application in terminal in use produces, the network layer and application layer of described application, the attribute information of described terminal, the relevant social property information of user, opinion score to described application；
The described assessment parameter obtained is sent to the server for setting up QoE assessment models；
Obtain the described QoE assessment models set up according to described assessment parameter that described server sends；
According to described QoE assessment models, described application is carried out QoE assessment.
2. method according to claim 1, it is characterised in that when described assessment parameter includes the index parameter in the network layer and application layer of described application, is sent to the described assessment parameter obtained and includes for the server setting up described QoE assessment models:
Index parameter from the network layer and application layer of described application extracts the key index parameter affecting described QoE；
The described key index parameter extracted is sent to described server.
3. method according to claim 1, it is characterised in that
Index parameter in described Internet includes at least one of: domain name service dns resolution time delay, transmission control protocol TCP connect time delay, HTML (Hypertext Markup Language) http response time delay, network speed, flow；
Index parameter in described application layer includes at least one of: the page is loaded into time delay, Rich Media loads time delay, webpage blank time delay, resource temperature, advertising resource take, battery consumption rate, the safety coefficient of application, transaction time delay.
4. a user experience quality QoE appraisal procedure, it is characterised in that including:
Receive the assessment parameter for QoE is estimated that terminal sends, wherein, described assessment parameter include following information at least one: the index parameter in network packet that the application in terminal in use produces, the network layer and application layer of described application, the attribute information of described terminal, the relevant social property information of user, opinion score to described application；
The QoE assessment models for described application being carried out QoE assessment is set up according to the described assessment parameter received；
The described QoE assessment models set up is sent to described terminal.
5. method according to claim 4, it is characterised in that
Index parameter in described Internet includes at least one of: domain name service dns resolution time delay, transmission control protocol TCP connect time delay, HTML (Hypertext Markup Language) http response time delay, network speed, flow；
Index parameter in described application layer includes at least one of: the page is loaded into time delay, Rich Media loads time delay, webpage blank time delay, resource temperature, advertising resource take, battery consumption rate, the safety coefficient of application, transaction time delay.
6. method according to claim 4, it is characterised in that after receiving the assessment parameter being used for QoE is estimated that terminal sends, also include at least one of:
The described assessment parameter received is carried out classification storage；
Back up described assessment parameter.
7. a user experience quality QoE apparatus for evaluating, it is characterised in that including:
First acquisition module, for obtaining the assessment parameter for QoE is estimated, wherein, described assessment parameter include following information at least one: the index parameter in network packet that the application in terminal in use produces, the network layer and application layer of described application, the attribute information of described terminal, the relevant social property information of user, opinion score to described application；
First sending module, for being sent to the server for setting up QoE assessment models by the described assessment parameter obtained；
Second acquisition module, for obtaining the described QoE assessment models set up according to described assessment parameter that described server sends；
Evaluation module, for carrying out QoE assessment according to described QoE assessment models to described application.
8. device according to claim 7, it is characterised in that when described assessment parameter includes the index parameter in the network layer and application layer of described application, described first sending module includes:
Extraction unit, for extracting the key index parameter affecting described QoE in the index parameter from the network layer and application layer of described application；
Transmitting element, for being sent to described server by the described key index parameter extracted.
9. device according to claim 7, it is characterised in that
Index parameter in described Internet includes at least one of: domain name service dns resolution time delay, transmission control protocol TCP connect time delay, HTML (Hypertext Markup Language) http response time delay, network speed, flow；
Index parameter in described application layer includes at least one of: the page is loaded into time delay, Rich Media loads time delay, webpage blank time delay, resource temperature, advertising resource take, battery consumption rate, the safety coefficient of application, transaction time delay.
10. a terminal, it is characterised in that include the device according to any one of claim 7 to 9.
11. a user experience quality QoE apparatus for evaluating, it is characterised in that including:
Receiver module, for receiving the assessment parameter for QoE is estimated that terminal sends, wherein, described assessment parameter include following information at least one: the index parameter in network packet that the application in terminal in use produces, the network layer and application layer of described application, the attribute information of described terminal, the relevant social property information of user, opinion score to described application；
Set up module, for setting up the QoE assessment models for described application being carried out QoE assessment according to the described assessment parameter received；
Second sending module, for being sent to described terminal by the described QoE assessment models set up.
12. device according to claim 11, it is characterised in that
Index parameter in described Internet includes at least one of: domain name service dns resolution time delay, transmission control protocol TCP connect time delay, HTML (Hypertext Markup Language) http response time delay, network speed, flow；
Index parameter in described application layer includes at least one of: the page is loaded into time delay, Rich Media loads time delay, webpage blank time delay, resource temperature, advertising resource take, battery consumption rate, the safety coefficient of application, transaction time delay.
13. device according to claim 11, it is characterised in that also include at least one of:
Memory module, for carrying out classification storage to the described assessment parameter received；
Backup module, is used for backing up described assessment parameter.
14. a server, it is characterised in that include the device according to any one of claim 11 to 13.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410836361.XA CN105791046A (en) | 2014-12-26 | 2014-12-26 | Method, device, terminal and server for evaluating user QoE |
| PCT/CN2015/077428 WO2016101464A1 (en) | 2014-12-26 | 2015-04-24 | Quality of experience estimation method, device, terminal and server |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410836361.XA CN105791046A (en) | 2014-12-26 | 2014-12-26 | Method, device, terminal and server for evaluating user QoE |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105791046A true CN105791046A (en) | 2016-07-20 |
Family
ID=56149067
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410836361.XA Pending CN105791046A (en) | 2014-12-26 | 2014-12-26 | Method, device, terminal and server for evaluating user QoE |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN105791046A (en) |
| WO (1) | WO2016101464A1 (en) |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106899448A (en) * | 2017-01-22 | 2017-06-27 | 中国人民解放军信息工程大学 | Suitable for network state and the integrated dynamic weight index appraisal procedure of performance measurement |
| CN108271046A (en) * | 2017-12-25 | 2018-07-10 | 李文清 | A kind of intelligent network video service system |
| CN108365964A (en) * | 2017-12-25 | 2018-08-03 | 潘永森 | A kind of picture supply system of high quality |
| WO2018192414A1 (en) * | 2017-04-20 | 2018-10-25 | 中兴通讯股份有限公司 | Qoe determining method and apparatus, storage medium, and processor |
| CN109189465A (en) * | 2018-07-13 | 2019-01-11 | 北京奇艺世纪科技有限公司 | A kind of user perceptibility determines method, apparatus and electronic equipment |
| TWI682675B (en) * | 2018-12-12 | 2020-01-11 | 中華電信股份有限公司 | Network quality detecting device and network quality detecting method |
| CN110708592A (en) * | 2018-07-09 | 2020-01-17 | 上海交通大学 | Video content completion and cropping method and system based on user quality evaluation |
| CN111210505A (en) * | 2019-12-30 | 2020-05-29 | 南昌市小核桃科技有限公司 | 3D model loading method, server, storage medium and processor |
| TWI700939B (en) * | 2018-12-13 | 2020-08-01 | 中華電信股份有限公司 | Quality monitoring server and method thereof for network equipment |
| CN111770510A (en) * | 2020-06-01 | 2020-10-13 | Oppo广东移动通信有限公司 | Network experience state determination method, device, storage medium and electronic device |
| CN112151068A (en) * | 2019-06-26 | 2020-12-29 | 海德声科有限公司 | Method for determining the quality of speech transmitted via a telecommunication network |
| CN115277581A (en) * | 2022-07-21 | 2022-11-01 | 腾讯科技（深圳）有限公司 | Network transmission control method and device, computer equipment and storage medium |
| CN115550996A (en) * | 2022-10-12 | 2022-12-30 | 广州爱浦路网络技术有限公司 | QoE prediction method and QoS parameter updating method based on index data |
| CN116017092A (en) * | 2022-12-12 | 2023-04-25 | 中国科学院计算技术研究所 | A QoE quantification method and transmission system parameter adjustment method based on it |
| CN116368779A (en) * | 2020-10-05 | 2023-06-30 | 华为技术有限公司 | Detecting network-induced contributions to quality of experience degradation |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114466177B (en) * | 2021-07-30 | 2022-12-02 | 荣耀终端有限公司 | Quality evaluation method based on HTTP transmission video stream and electronic equipment |
| CN114721921A (en) * | 2022-04-25 | 2022-07-08 | Oppo广东移动通信有限公司 | User experience evaluation method and device, terminal equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1839597A (en) * | 2003-08-21 | 2006-09-27 | 维迪亚特企业公司 | Quality of experience (QOE) measurement for wireless communication networks |
| CN102625344A (en) * | 2012-03-13 | 2012-08-01 | 重庆信科设计有限公司 | Mobile terminal user quality of experience evaluation model and method |
| CN102932818A (en) * | 2012-11-02 | 2013-02-13 | 陈雪娇 | Wireless local area network (WLAN) based method for evaluating and analyzing customer service experience quality |
| CN103812671A (en) * | 2012-11-06 | 2014-05-21 | 中兴通讯股份有限公司 | Method and system for evaluating communication service customer quality of experience |
-
2014
- 2014-12-26 CN CN201410836361.XA patent/CN105791046A/en active Pending
-
2015
- 2015-04-24 WO PCT/CN2015/077428 patent/WO2016101464A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1839597A (en) * | 2003-08-21 | 2006-09-27 | 维迪亚特企业公司 | Quality of experience (QOE) measurement for wireless communication networks |
| CN102625344A (en) * | 2012-03-13 | 2012-08-01 | 重庆信科设计有限公司 | Mobile terminal user quality of experience evaluation model and method |
| CN102932818A (en) * | 2012-11-02 | 2013-02-13 | 陈雪娇 | Wireless local area network (WLAN) based method for evaluating and analyzing customer service experience quality |
| CN103812671A (en) * | 2012-11-06 | 2014-05-21 | 中兴通讯股份有限公司 | Method and system for evaluating communication service customer quality of experience |
Cited By (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106899448A (en) * | 2017-01-22 | 2017-06-27 | 中国人民解放军信息工程大学 | Suitable for network state and the integrated dynamic weight index appraisal procedure of performance measurement |
| CN106899448B (en) * | 2017-01-22 | 2019-06-28 | 中国人民解放军信息工程大学 | Suitable for network state and the integrated dynamic weight index appraisal procedure of performance measurement |
| WO2018192414A1 (en) * | 2017-04-20 | 2018-10-25 | 中兴通讯股份有限公司 | Qoe determining method and apparatus, storage medium, and processor |
| CN108271046A (en) * | 2017-12-25 | 2018-07-10 | 李文清 | A kind of intelligent network video service system |
| CN108365964A (en) * | 2017-12-25 | 2018-08-03 | 潘永森 | A kind of picture supply system of high quality |
| CN110708592B (en) * | 2018-07-09 | 2020-12-29 | 上海交通大学 | Video content completion and cropping method and system based on user quality evaluation |
| CN110708592A (en) * | 2018-07-09 | 2020-01-17 | 上海交通大学 | Video content completion and cropping method and system based on user quality evaluation |
| CN109189465A (en) * | 2018-07-13 | 2019-01-11 | 北京奇艺世纪科技有限公司 | A kind of user perceptibility determines method, apparatus and electronic equipment |
| TWI682675B (en) * | 2018-12-12 | 2020-01-11 | 中華電信股份有限公司 | Network quality detecting device and network quality detecting method |
| TWI700939B (en) * | 2018-12-13 | 2020-08-01 | 中華電信股份有限公司 | Quality monitoring server and method thereof for network equipment |
| CN112151068B (en) * | 2019-06-26 | 2024-04-05 | 海德声科有限公司 | Method for determining the quality of speech transmitted via a telecommunications network |
| CN112151068A (en) * | 2019-06-26 | 2020-12-29 | 海德声科有限公司 | Method for determining the quality of speech transmitted via a telecommunication network |
| CN111210505A (en) * | 2019-12-30 | 2020-05-29 | 南昌市小核桃科技有限公司 | 3D model loading method, server, storage medium and processor |
| CN111770510A (en) * | 2020-06-01 | 2020-10-13 | Oppo广东移动通信有限公司 | Network experience state determination method, device, storage medium and electronic device |
| CN111770510B (en) * | 2020-06-01 | 2024-01-16 | Oppo广东移动通信有限公司 | Network experience state determination method, device, storage medium and electronic device |
| CN116368779A (en) * | 2020-10-05 | 2023-06-30 | 华为技术有限公司 | Detecting network-induced contributions to quality of experience degradation |
| CN115277581A (en) * | 2022-07-21 | 2022-11-01 | 腾讯科技（深圳）有限公司 | Network transmission control method and device, computer equipment and storage medium |
| CN115277581B (en) * | 2022-07-21 | 2024-04-30 | 腾讯科技（深圳）有限公司 | Control method and device for network transmission, computer equipment and storage medium |
| CN115550996A (en) * | 2022-10-12 | 2022-12-30 | 广州爱浦路网络技术有限公司 | QoE prediction method and QoS parameter updating method based on index data |
| CN115550996B (en) * | 2022-10-12 | 2023-10-03 | 广州爱浦路网络技术有限公司 | QoE prediction method and QoS parameter updating method based on index data |
| CN116017092A (en) * | 2022-12-12 | 2023-04-25 | 中国科学院计算技术研究所 | A QoE quantification method and transmission system parameter adjustment method based on it |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2016101464A1 (en) | 2016-06-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105791046A (en) | Method, device, terminal and server for evaluating user QoE | |
| CN102685791B (en) | Method for evaluating user quality of experience (QoE) of WAP (Wireless Application Protocol) services by simulating user behavior | |
| Chen et al. | A lightweight end-side user experience data collection system for quality evaluation of multimedia communications | |
| US10114915B2 (en) | Consumer performance index scoring for websites and web-based applications | |
| CN104994133B (en) | A kind of mobile Web web page access user experience perception evaluating method based on network KPI | |
| KR20190055264A (en) | Providing per-application resource usage information | |
| CN110163654B (en) | Advertisement delivery data tracking method and system | |
| CN104378220A (en) | Method, device, user terminal and network server for evaluating user experience quality | |
| KR20140023225A (en) | Telecommunication behavior statistical analysis system | |
| CN114360222B (en) | Status early warning method, device, equipment and medium of leasing equipment | |
| CN104717670B (en) | A service quality testing method, device and system | |
| KR101616866B1 (en) | Apparatus and method for measuring advertisement metrics | |
| CN105681107A (en) | Wireless router management method and system | |
| De Masi et al. | Towards accurate models for predicting smartphone applications’ QoE with data from a living lab study | |
| WO2018015804A1 (en) | Identifying modifications to technical characteristics of a communication channel to alter user perception of communication channel performance | |
| Peng et al. | Usage-based insurance system based on carrier-cloud-client | |
| CN103139004A (en) | Method and system for simulating network bandwidth by using network rate-limiting tool | |
| WO2023041051A1 (en) | User perception evaluation method and device, storage medium, and electronic device | |
| CN109492890A (en) | Measurement method, device, the computer equipment of user experience quantitative evaluation value | |
| CN105007501A (en) | Data acquiring method and apparatus, and system capacity testing method and apparatus | |
| CN115017201A (en) | FLINK processing engine-based user behavior analysis method and system | |
| CN113570409B (en) | Determination method and device for conversion event weight value, storage medium and electronic device | |
| Li et al. | Mobile terminal quality of experience analysis based on big data | |
| CN107908558B (en) | Automatic evaluation method for mobile phone client software quality | |
| Torjesen et al. | CarbonTag: a browser-based method for approximating energy consumption of online Ads |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160720 |
|
| WD01 | Invention patent application deemed withdrawn after publication |