JP4610392B2 - Image evaluation apparatus, image evaluation method, and image evaluation program - Google Patents

Description

  The present invention relates to a video evaluation device, a video evaluation method, and a video processing program.

  Video processing including video acquisition, storage, transmission, display, encoding, decoding, and the like is generally performed at a fixed frame rate. Here, the frame rate refers to the number of frames processed per second, and the fixed frame rate refers to a frame rate where the number of frames processed per second is constant. A specific example of the fixed frame rate is defined as 29.97 fps (frame per second) in the National Television Standards Committee (NTSC) standard adopted in the United States and Japan, for example. In addition, it is defined as 25 fps in the Phase Alternating Line (PAL) standard by the National Television Standards Committee adopted in Europe. Furthermore, a fixed frame rate of 15 fps or 24 fps may be used. The “video” is composed of a series of “frames” which are single still images.

  When video processing is performed at a fixed frame rate, increasing the frame rate shortens the time interval between successive frames. This makes it possible to process a video with smoother motion. For example, an image processed at a frame rate of 30 fps is expressed with a smoother movement as a whole because the movement of the image per unit time is expressed more finely than an image processed at a frame rate of 15 fps. .

  In addition to the above-described video processing at a fixed frame rate, video processing at a variable frame rate is also performed. The video processing with the variable frame rate is to change the frame rate according to the video processing amount and data amount. For example, when encoding video, if it is determined that the amount of data to be encoded is large, the frame rate is decreased to reduce the number of frames to be encoded per unit time. This is because the time required for video processing increases as the amount of data increases.

A technique for changing such a frame rate is disclosed in Patent Document 1, for example.
Japanese Patent Laid-Open No. 11-112940

  By the way, when processing a video at a fixed frame rate, if the frame rate is increased in order to realize smooth motion, the processing amount, data amount and power consumption accompanying the video processing increase. More specifically, for example, when acquiring a video, the number of frames to be acquired per unit time increases, so that the processing amount and the power consumption accompanying the processing increase. In addition, when storing video, the amount of data increases due to an increase in the number of frames to be stored per unit time.

  On the other hand, if the frame rate is reduced to reduce the amount of processing, data, and power consumption associated with video processing, the smoothness of the video motion will be reduced, resulting in a jerky motion video. .

  Also, when processing video at a variable frame rate, if the frame rate is changed only according to the amount of video processing or the amount of data, the smoothness of the video motion will be reduced, resulting in a jerky motion video. End up.

  That is, until now, there has been no method for determining the lowest frame rate at which the motion is subjectively smooth according to the nature of the video.

  Therefore, an object of the present invention is to provide a video evaluation apparatus, a video evaluation method, and a video evaluation program that can determine an efficient frame rate according to the smoothness of actual motion of a video.

  In order to solve the above-described problem, a video evaluation apparatus according to the present invention includes a first input unit that inputs first motion information and first frame interval information related to a first moving image, and a second motion related to a second moving image. A first motion change amount for obtaining a first motion change amount for the first moving image based on the second input means for inputting the information and the second frame interval information; and the first motion information and the first frame interval information. Generating means; second motion change generating means for obtaining a second motion change amount for the second moving image based on the second motion information and the second frame interval information; the first motion change amount and the second motion; An evaluation value generating unit that calculates a relative evaluation value for evaluating the smoothness of the movement of the second moving image with respect to the first moving image based on the amount of change, and an output unit that outputs the relative evaluation value.

The video evaluation method of the present invention includes a first input unit, a second input unit, a first motion change amount generation unit, a second motion change amount generation unit, an evaluation value generation unit, and an output unit. A video evaluation method in a video evaluation apparatus comprising: a first input step in which first input means inputs first motion information and first frame interval information relating to a first moving image; and second input means; Based on the first motion information and the first frame interval information, the second input step of inputting the second motion information and the second frame interval information related to the second moving image, and the first motion change amount generation means, A first motion change amount generation step for obtaining a first motion change amount for the first moving image, and a second motion change amount generation means based on the second motion information and the second frame interval information, Second motion to determine the second motion change for the image And a relative evaluation value by which the evaluation value generating means evaluates the smoothness of the movement of the second moving image relative to the first moving image based on the first movement change amount and the second motion change amount. The evaluation value generating step for calculating the output value and the output means for outputting the relative evaluation value.

  According to the video evaluation program of the present invention, the computer inputs the first motion information related to the first moving image and the first frame interval information, the second input information related to the second moving image, and the second motion information. Second input means for inputting 2-frame interval information, first motion change amount generating means for obtaining a first motion change amount for the first moving image based on the first motion information and the first frame interval information, 2nd motion change amount generating means for obtaining a second motion change amount for the second moving image based on the 2 motion information and the second frame interval information, based on the first motion change amount and the second motion change amount. , Functioning as an evaluation value generating means for calculating a relative evaluation value for evaluating the smoothness of the movement of the second moving image with respect to the first moving image, and an output means for outputting the relative evaluation value.

  According to such a video evaluation device and video evaluation method, the motion of the second moving image relative to the first moving image is based on the motion information and the frame interval information of the first moving image and the second moving image. Since the smoothness is evaluated, it is possible to obtain an evaluation value of the smoothness of the video motion necessary for determining the frame rate according to the smoothness of the video motion.

  The same applies when the computer is operated using the video evaluation program.

  Further, it is preferable that the evaluation value generation unit calculates a relative evaluation value based on the relative motion change amount after calculating the relative motion change amount from the first motion change amount and the second motion change amount. By evaluating based on the relative motion change amount between the first moving image and the second moving image, the smoothness of the motion can be notified as an objective value.

The evaluation value generating means obtains a first evaluation value based on the first movement change amount, obtains a second evaluation value based on the second movement change amount, and calculates a relative value from the first evaluation value and the second evaluation value. Rukoto issuing calculate the evaluation value is also preferable. Also in this case, the smoothness of the motion can be notified as an objective value by evaluating the relative motion change between the first moving image and the second moving image.

Alternatively, the video evaluation apparatus of the present invention inputs the first motion change amount related to the first moving image calculated based on the first motion information related to the first moving image and the first frame interval information. Based on the second motion information and the second frame interval information, the second input means for inputting the second motion information and the second frame interval information relating to the second moving image, and the second motion information and the second frame interval information. Based on the second motion change amount generating means for obtaining the second motion change amount, and the first motion change amount and the second motion change amount, the smoothness of the motion of the second moving image with respect to the first moving image is evaluated. Evaluation value generating means for calculating the relative evaluation value and output means for outputting the relative evaluation value. According to such a video evaluation device, the smooth movement of the second moving image with respect to the first moving image is based on the amount of change in the movement of the first moving image and the movement information and frame interval information of the second moving image. Therefore, it is possible to obtain an evaluation value of the smoothness of the video motion necessary to determine the frame rate according to the smoothness of the video motion.

Alternatively, the video evaluation apparatus according to the present invention inputs a first evaluation value relating to the first moving image calculated based on the first motion information relating to the first moving image and the first frame interval information. And second input means for inputting second motion information and second frame interval information related to the second moving image, and second motion information and second frame interval information based on the second motion information and second frame interval information. (2) Relative for evaluating the smoothness of the motion of the second moving image with respect to the first moving image based on the second motion variation generating means for obtaining the motion variation, and the first evaluation value and the second motion variation. Evaluation value generation means for calculating an evaluation value and output means for outputting a relative evaluation value are provided. According to the video evaluation device, the evaluation value of the first moving picture, and the second based on the motion information and frame interval information of a moving image, the smoothness of the second moving image of motion to the first motion picture Therefore, it is possible to obtain an evaluation value of the smoothness of the video motion necessary for determining the frame rate according to the smoothness of the video motion.

  According to the present invention, the relative motion smoothness of the second moving image with respect to the first moving image can be evaluated according to the amount of change in the motion of the video and the frame interval. An evaluation value for determining the lowest frame rate at which the user feels smooth can be calculated.

  Hereinafter, preferred embodiments of a video evaluation apparatus according to the present invention will be described in detail with reference to the drawings. In the description of the drawings, the same elements are denoted by the same reference numerals, and redundant description is omitted.

[First Embodiment]
First, a first embodiment of the present invention will be described. FIG. 1 is a diagram illustrating a functional configuration of a video evaluation apparatus 10 according to the first embodiment.

  The video evaluation apparatus 10 is physically a computer including a CPU (Central Processing Unit), a storage device such as a memory, a communication device, and the like. Therefore, the video evaluation apparatus 10 may be a fixed communication terminal such as a PC terminal or a mobile communication terminal such as a mobile phone. That is, as the video evaluation device 10, devices capable of information processing can be widely applied.

  The functional configuration of the video evaluation apparatus 10 will be described with reference to FIG. As shown in FIG. 1, the video evaluation apparatus 10 includes a first input unit (first input unit) 101, a second input unit (second input unit) 102, and a first motion change amount generation unit (first motion). Change amount generation unit) 103, second motion change amount generation unit (second motion change amount generation unit) 104, evaluation value generation unit (evaluation value generation unit) 105, and output unit (output unit) 106.

  The first input unit 101 receives the first motion information 107 and the first frame interval information 108 input from the outside, and outputs them to the first motion change amount generation unit 103.

  The second input unit 102 receives the second motion information 109 and the second frame interval information 110 input from the outside, and outputs them to the second motion change amount generation unit 104.

  The first motion change amount generation unit 103 is based on the first motion information 107 and the first frame interval information 108 received from the first input unit 101, and represents the first motion change amount that represents the motion change amount of the first moving image. 111 is calculated and output to the evaluation value generation unit 105.

  Based on the second motion information 109 and the second frame interval information 110 received from the second input unit 102, the second motion change amount generation unit 104 is a second motion change amount that represents the motion change amount of the second moving image. 112 is calculated and output to the evaluation value generation unit 105.

  Based on the first motion change amount 111 received from the first motion change amount generation unit 103 and the second motion change amount 112 received from the second motion change amount generation unit 104, the evaluation value generation unit 105 A relative evaluation value 113 for evaluating the smoothness of the movement of the second moving image with respect to the moving image is calculated and output to the output unit 106.

  The output unit 106 outputs the relative evaluation value 113 received from the evaluation value generation unit 105 to the outside.

  Hereinafter, each piece of information processed in the video evaluation apparatus 10 will be described.

  The first motion information 107 is a value calculated based on the magnitude of the motion vector of the first moving image. Specifically, in two consecutive frame images included in the first moving image, an image signal pattern most similar to the image signal pattern in a block divided into a predetermined size is searched between frames, and For the motion vector calculated as the spatial displacement amount between the two image signal patterns, the size of the motion vector is calculated. The first motion information 107 is the maximum value of the motion vector in the frame image calculated as described above. In the first input unit 101, first motion information 107 for all or part of continuous frames in the first moving image is input. The first motion information 107 is not limited to the one calculated by the above method, and any information that represents the feature of the motion of the first moving image can be used.

  The first frame interval information 108 is a value calculated from the frame rate of the first moving image. When the frame rate of the first moving image is f1, the first frame interval information 108 is calculated as 1 / f1. Note that the first frame interval information 108 is not limited to the one calculated by the above method, and any information representing the motion characteristics of the first moving image can be used.

  The second motion information 109 and the second frame interval information 110 are values representing the same features as the first motion information 107 and the first frame interval information 108 for the second moving image. Also in the second input unit 101, the second motion information 109 for all or part of continuous frames in the second moving image is input.

  Next, referring to FIG. 2, the first motion change amount generation unit 103 determines the first moving image based on the first motion information 107 and the first frame interval information 108 received from the first input unit 101. Based on the method of calculating the first motion change amount 111 representing the motion change amount, and the second motion information 109 and the second frame interval information 110 received by the second motion change amount generation unit 104 from the second input unit 102, A method for calculating the second motion change amount 112 representing the motion change amount of the second moving image will be specifically described. 2A is a graph showing an example of the temporal change of the first motion information 107 in the first moving image, and FIG. 2B is an example of the temporal change of the second motion information 109 in the second moving image. It is a graph which shows.

  The first motion change amount generation unit 103 calculates the first motion change amount 111 by calculating the area of the shaded portion shown in FIG. 2A using the first motion information 107 and the first frame interval information 108. . For example, when the value of the first motion information 107 is m1 and the value of the first frame interval information 108 is d1 in a certain frame T1, the value S1 of the first motion change amount 111 representing the motion change amount of the first moving image is set. S1 = (1/2) × m1 × d1.

  Further, the second motion change amount generation unit 104 calculates the area of the shaded portion shown in FIG. 2B by using the second motion information 109 and the second frame interval information 110, and calculates the second motion change amount 112. calculate. For example, when the value of the second motion information 109 is m2 and the value of the second frame interval information 110 is d2 in a certain frame T2, the value S2 of the second motion change amount 112 indicating the motion change amount of the second moving image is set. S2 = (1/2) × m2 × d2.

  Further, the evaluation value generation unit 105 uses the first motion change amount 111 sent from the first motion change amount generation unit 103 and the second motion change amount 112 sent from the second motion change amount generation unit 104, A method for calculating the relative evaluation value 113 of the second moving image with respect to the first moving image will be specifically described.

  The evaluation value generation unit 105 calculates an average value S1a in all frames of the first moving image, targeting S1 which is the value of the first motion change amount 111 sent from the first motion change amount generation unit 103. To do. Further, the evaluation value generation unit 105 targets the S2 that is the value of the second motion change amount 112 sent from the second motion change amount generation unit 104, and the average value S2a in all frames of the second moving image. Is calculated. The evaluation value generation unit 105 calculates Sr, which is the relative motion change amount of the second motion change amount 112 with respect to the first motion change amount 111, using S1a and S2a. The calculation method of Sr is, for example, the difference between S2a and S1a (Sr = S2a-S1a) or the ratio between S2a and S1a (Sr = S2a / S1a). The calculation method of Sr is not limited to the above example, and any arbitrary function having S1 and S2 as variables can be used.

  Subsequently, the evaluation value generation unit 105 uses the value of the relative evaluation value 113 for evaluating the relative smoothness of the movement of the second moving image with respect to the first moving image based on the Sr calculated as described above. A certain Er is calculated. The calculation method of Er is Er = α / Sr (α is a constant) which is a function of the reciprocal of Sr. Alternatively, Er = a × Exp (−b × Sr) + C (a, b, and c are constants) may be used. Here, Exp (x) represents an exponential function of x. The calculation method of Er is not limited to the above example, and any arbitrary function having Sr as a variable can be used.

  With reference to FIG. 3, the flow of processing in the video evaluation device 10 of the first embodiment will be described, and the video evaluation method according to the first embodiment will be described.

  First, the first input unit 101 reads the first motion information 107 and the first frame interval information 108 input from the outside (step S301).

  Next, based on the first motion information 107 and the first frame interval information 108 received from the first input unit 101, the first motion change amount generation unit 103 represents the first motion change amount of the first moving image. The motion change amount 111 is calculated (step S302).

  Further, the second input unit 102 reads the second motion information 109 and the second frame interval information 110 input from the outside (step S303).

  Next, the second motion change amount generation unit 104 represents a second motion image motion change amount based on the second motion information 109 and the second frame interval information 110 received from the second input unit 102. The motion change amount 112 is calculated (step S304).

  Next, the evaluation value generation unit 105 based on the first motion change amount 111 received from the first motion change amount generation unit 103 and the second motion change amount 112 received from the second motion change amount generation unit 104, A relative evaluation value 113 for evaluating the smoothness of the movement of the second moving image with respect to the first moving image is calculated (step S305).

  Next, the output unit 106 outputs the relative evaluation value 113 received from the evaluation value generation unit 105 to the outside (step S306).

  Note that steps S301 to S304 may be performed in series, or may be performed in two steps, step S301 to step S302 and step S303 to step S304, as shown in FIG.

  Next, a video evaluation program 50 for causing a computer to function as the above-described video evaluation apparatus 10 will be described with reference to FIG. FIG. 5 is a configuration diagram of the video evaluation program 50.

  As shown in the figure, the video evaluation program 50 includes a main module 501, a first input module 502, a second input module 503, a first motion change generation module 504, and a second motion change. An amount generation module 505, an evaluation value generation module 506, and an output module 507 are provided. Here, by operating each of the first input module 502, the second input module 503, the first motion change generation module 504, the second motion change generation module 505, the evaluation value generation module 506, and the output module 507. The functions to be realized include the first input unit 101, the second input unit 102, the first motion change amount generation unit 103, the second motion change amount generation unit 104, the evaluation value generation unit 105, and the output of the video evaluation device 10 described above. The functions of the units 106 are the same.

  According to the video evaluation apparatus 10 described above, the smoothness of the movement of the second moving image with respect to the first moving image is based on the movement information and the frame interval information of the first moving image and the second moving image. Therefore, it is possible to obtain an evaluation value of the smoothness of the motion of the video necessary for determining the frame rate according to the smoothness of the motion of the video. As a result, an efficient frame rate can be determined according to the smoothness of the actual motion of the video.

[Second Embodiment]
A second embodiment of the present invention will be described. FIG. 6 is a diagram illustrating a functional configuration of the video evaluation device 60 according to the second embodiment.

  The video evaluation device 60 is a computer that physically includes a CPU (Central Processing Unit), a storage device such as a memory, a communication device, and the like, similar to the video evaluation device 10 in the first embodiment. Accordingly, the video evaluation device 60 may be a fixed communication terminal such as a PC terminal or a mobile communication terminal such as a mobile phone. That is, as the video evaluation device 60, devices capable of information processing can be widely applied.

  The functional configuration of the video evaluation apparatus 60 will be described with reference to FIG. As illustrated in FIG. 6, the video evaluation device 60 includes a first input unit 601, a second input unit 602, a second motion change amount generation unit 603, an evaluation value generation unit 604, and an output unit 605.

  The difference between the video evaluation device 60 and the video evaluation device 10 in the first embodiment is that the first input unit 101 and the first motion change amount generation unit 103 in the first embodiment are replaced with the first input unit 601. It is a point.

  That is, in the first embodiment, the first input unit 101 outputs the first motion information 107 and the first frame interval information 108 input from the outside to the first motion change amount generation unit 103, and the first motion change amount generation unit Based on the first motion information 107 and the first frame interval information 108 received from the first input unit 101, the first motion change amount 111 representing the motion change amount of the first moving image is calculated by the 103, and an evaluation value is generated. In contrast to the first embodiment, the first input unit 601 outputs the first motion change amount 606 directly input from the outside to the evaluation value generation unit 604. Different.

  Hereinafter, each component of the video evaluation apparatus 60 will be described focusing on differences from the first embodiment.

  The first input unit 601 receives the first movement change amount 606 input from the outside, and outputs it to the evaluation value generation unit 604.

  The second input unit 602 receives the second motion information 607 and the second frame interval information 608 input from the outside, and outputs them to the second motion change amount generation unit 603.

  Based on the second motion information 607 and the second frame interval information 608 received from the second input unit 602, the second motion change amount generation unit 603 is a second motion change amount that represents the motion change amount of the second moving image. 609 is calculated and output to the evaluation value generation unit 604.

  Based on the first motion change amount 606 received from the first input unit 601 and the second motion change amount 609 received from the second motion change amount generation unit 603, the evaluation value generation unit 604 applies the first moving image to the first moving image. A relative evaluation value 610 for evaluating the smoothness of the motion of the second moving image is calculated and output to the output unit 605.

  The output unit 605 outputs the relative evaluation value 610 received from the evaluation value generation unit 604 to the outside.

  Here, the second motion change amount generation unit 603 indicates the second motion image motion change amount based on the second motion information 607 and the second frame interval information 608 received from the second input unit 602. The method of calculating the motion change amount 609 is the same as the method in which the second motion change amount generation unit 104 calculates the second motion change amount 112 in the first embodiment.

  Further, the evaluation value generation unit 604 generates the first moving image based on the first motion change amount 606 received from the first input unit 601 and the second motion change amount 609 received from the second motion change amount generation unit 603. The method of calculating the relative evaluation value 610 for evaluating the smoothness of the movement of the second moving image with respect to the image is the same as the method of calculating the evaluation value 113 by the evaluation value generation unit 105 in the first embodiment.

  Next, the flow of processing in the video evaluation device 60 will be described with reference to FIG. 7, and the video evaluation method according to the second embodiment will be described.

  First, the first input unit 601 reads the first motion change amount 606 input from the outside (step S701).

  Also, the second input unit 602 reads the second motion information 607 and the second frame interval information 608 input from the outside (step S702).

  Next, the second motion change amount generation unit 603 represents a second motion image motion change amount based on the second motion information 607 and the second frame interval information 608 received from the second input unit 602. A motion change amount 609 is calculated (step S703).

  Next, based on the first motion change amount 606 received from the first input unit 601 and the second motion change amount 609 received from the second motion change amount generation unit 603, the evaluation value generation unit 604 generates a first motion change amount 606. A relative evaluation value 610 for evaluating the smoothness of the movement of the second moving image with respect to the moving image is calculated (step S704).

  Next, the output unit 605 outputs the relative evaluation value 610 received from the evaluation value generation unit 604 to the outside (step S705).

  Note that steps S701 to S703 may be performed in series, or may be performed in parallel in two steps, step S701 and steps S702 to S703, as shown in FIG.

  FIG. 9 is a configuration diagram of a video evaluation program 90 for causing a computer to function as the video evaluation device 60 described above. As shown in the figure, the difference between the video evaluation program 90 and the first embodiment (see FIG. 5) is that the first input module 502 and the first motion change generation module 504 of the first embodiment are different in the first embodiment. The point is that it is replaced with a one-input module 902.

  According to the video evaluation device 60 described above, the motion of the second moving image relative to the first moving image is based on the amount of change in motion of the first moving image and the motion information and frame interval information of the second moving image. Since the smoothness is evaluated, it is possible to obtain an evaluation value of the smoothness of the video motion necessary for determining the frame rate according to the smoothness of the video motion. As a result, an efficient frame rate can be determined according to the smoothness of the actual motion of the video.

[Third Embodiment]
A third embodiment of the present invention will be described. FIG. 10 is a diagram illustrating a functional configuration of the video evaluation apparatus 100 according to the third embodiment.

  The video evaluation apparatus 100 is a computer that physically includes a CPU (Central Processing Unit), a storage device such as a memory, a communication device, and the like, similar to the video evaluation device 10 in the first embodiment. Therefore, the video evaluation apparatus 100 may be a fixed communication terminal such as a PC terminal or a mobile communication terminal such as a mobile phone. That is, as the video evaluation apparatus 100, apparatuses capable of information processing can be widely applied.

  The functional configuration of the video evaluation apparatus 100 will be described with reference to FIG. As illustrated in FIG. 10, the video evaluation device 100 includes a first input unit 1001, a second input unit 1002, a second motion change amount generation unit 1003, an evaluation value generation unit 1004, and an output unit 1005.

  The difference between the video evaluation apparatus 100 and the video evaluation apparatus 10 in the first embodiment is that the first input unit 101 and the first motion change amount generation unit 103 in the first embodiment are replaced with the first input unit 1001. It is.

  That is, in the first embodiment, the first input unit 101 outputs the first motion information 107 and the first frame interval information 108 input from the outside to the first motion change amount generation unit 103, and the first motion change amount generation unit Based on the first motion information 107 and the first frame interval information 108 received from the first input unit 101, the first motion change amount 111 representing the motion change amount of the first moving image is calculated by the 103, and an evaluation value is generated. The second motion information 109 and the second frame interval information 110 input from the outside to the second motion change amount generation unit 104 are output to the second motion change amount generation unit 104. Calculates the second motion change amount 112 representing the motion change amount of the second moving image based on the second motion information 109 and the second frame interval information 110 received from the second input unit 102, and the evaluation value generating unit To 105 In the present embodiment, the evaluation value generation unit 105 calculates the relative evaluation value 113. In this embodiment, the first input unit 1001 uses the first evaluation value 1006 directly input from the outside as the evaluation value generation unit 1004. The second input unit 1002 outputs the second motion information 1007 and the second frame interval information 1008 input from the outside to the second motion change amount generation unit 1003, and the second motion change amount generation unit 1003 Based on the second motion information 1007 and the second frame interval information 1008 received from the two input unit 1002, a second motion change amount 1009 representing the motion change amount of the second moving image is calculated and sent to the evaluation value generating unit 1004. First, the evaluation value generation unit 1004 calculates the second evaluation value and calculates the relative evaluation value 1010 using the first evaluation value 1006 and the second evaluation value received from the first input unit 1001. Different from the facilities form.

  Hereinafter, each component of the video evaluation apparatus 100 will be described focusing on differences from the first embodiment.

  The first input unit 1001 receives the first evaluation value 1006 input from the outside, and outputs it to the evaluation value generation unit 1004.

  The second input unit 1002 receives the second motion information 1007 and the second frame interval information 1008 input from the outside, and outputs them to the second motion change amount generation unit 1003.

  The second motion change amount generation unit 1003 is a second motion change amount representing the motion change amount of the second moving image based on the second motion information 1007 and the second frame interval information 1008 received from the second input unit 1002. 1009 is calculated and output to the evaluation value generation unit 1004.

  Based on the first evaluation value 1006 received from the first input unit 1001 and the second motion change amount 1009 received from the second motion change amount generation unit 1003, the evaluation value generation unit 1004 performs the first evaluation on the first moving image. A relative evaluation value 1010 for evaluating the smoothness of the motion of the second moving image is calculated and output to the output unit 1005. More specifically, the evaluation value generation unit 1004 calculates the average value S2a of all the frames of the second moving image of S2, which is the value of the second motion change amount 1009, and the smoothness of the movement of the second moving image. A second evaluation value E2 is calculated. The second evaluation value E2 is calculated by E2 = α2 / S2a (α2 is a constant). Alternatively, E2 = a2 × Exp (−b2 × S2a) + c2 (a2, b2, and c2 are constants) may be calculated. Further, the calculation method of E2 is not limited to the above example, and any arbitrary function having S2a as a variable can be used. Furthermore, the evaluation value generation unit 1004 calculates a relative evaluation value 1010 based on the first evaluation value E1 and the second evaluation value E2. The value Er of the relative evaluation value 1010 is, for example, a difference between E1 and E2 (Er = E2-E1) or a ratio between E1 and E2 (Er = E2 / E1). Further, the calculation method of Er is not limited to the above example, and any arbitrary function having E1 and E2 as variables can be used.

  The output unit 1005 outputs the relative evaluation value 1010 received from the evaluation value generation unit 1004 to the outside.

  Here, the second motion change amount generating unit 1003 represents the second motion image motion change amount based on the second motion information 1007 and the second frame interval information 1008 received from the second input unit 1002. The method for calculating the motion change amount 1009 is the same as the method for the second motion change amount generation unit 104 to calculate the second motion change amount 112 in the first embodiment.

  With reference to FIG. 11, the flow of processing in the video evaluation apparatus 100 of the first embodiment will be described, and the video evaluation method according to the third embodiment will be described.

  First, the first input unit 1001 reads the first evaluation value 1006 input from the outside (step S1101).

  Further, the second input unit 1002 reads the second motion information 1007 and the second frame interval information 1008 input from the outside (step S1102).

  Next, the second motion change amount generating unit 1003 represents the second motion image motion change amount based on the second motion information 1007 and the second frame interval information 1008 received from the second input unit 1002. A movement change amount 1009 is calculated (step S1103).

  Next, based on the first evaluation value 1006 received from the first input unit 1001 and the second motion change amount 1009 received from the two motion change amount generation unit 1003, the evaluation value generation unit 1004 receives the first moving image. A relative evaluation value 1010 for evaluating the smoothness of the motion of the second moving image with respect to is calculated (step S1104).

  Next, the output unit 1005 outputs the relative evaluation value 1010 received from the evaluation value generation unit 1004 to the outside (step S1105).

  Note that steps S1101 to S1103 may be performed in series, or may be performed in parallel in two steps, step S1101 and steps S1102 to S1103, as shown in FIG.

  FIG. 13 is a configuration diagram of a video evaluation program 120 for causing a computer to function as the video evaluation apparatus 100 described above. As shown in the figure, the difference between the video evaluation program 120 and the first embodiment (see FIG. 5) is that the first input module 502 and the first motion change generation module 504 of the first embodiment are different in the first embodiment. This is a point that it is replaced with a one-input module 1202.

  According to the video evaluation apparatus 100 described above, smooth movement of the second moving image with respect to the first moving image is based on the evaluation value of the first moving image and the movement information and frame interval information of the second moving image. Therefore, it is possible to obtain an evaluation value of the smoothness of the video motion necessary for determining the frame rate according to the smoothness of the video motion. As a result, an efficient frame rate can be determined according to the smoothness of the actual motion of the video.

  The present invention is not limited to the above-described embodiments. For example, the first input units 101, 601, 1001 and the second input units 102, 602, 1002 may be a common input unit. Further, the first motion change amount generation unit 103 and the second change amount generation unit 104 may be a common change amount generation unit.

  In addition, the evaluation value generation units 105 and 604 are the frames of all the first moving images of S1 that are the values of the first motion change amounts 111 and 606 sent from the first motion change amount generation unit 103 or the first input unit 601. S1a may be calculated as a maximum value, a minimum value, or an intermediate value in all the frames of the first moving image of S1, instead of calculating S1a as an average value. Similarly, the evaluation value generation units 105, 604, and 1004 in all frames of the second moving image of S2 that is the value of the second movement change amount 112 sent from the second motion change amount generation units 104, 603, and 1003. Instead of calculating S2a as an average value, S2a may be calculated as a maximum value, a minimum value, or an intermediate value in all frames of the second moving image of S2.

  Further, the evaluation value of the smoothness of the motion of the second moving image with respect to the first moving image calculated by the evaluation value generating units 105, 604, and 1004 does not necessarily have to be one for the entire video. For example, it may be one evaluation value for some continuous frame units, frame units, block units, pixel units, object units, or an arbitrary region.

  In addition, the evaluation value generation units 105 and 604 are the frames of all the first moving images of S1 that are the values of the first motion change amounts 111 and 606 sent from the first motion change amount generation unit 103 or the first input unit 601. After calculating S1a as the average value at, the first evaluation value, which is the smoothness of the motion of the first moving image, is calculated, and the second motion change amount sent from the second motion change amount generating units 104 and 603 After calculating S2a as an average value in all frames of the second moving image of S2, which is 112, a second evaluation value that is the smoothness of the movement of the second moving image is calculated, and the first evaluation value and the first evaluation value are calculated. The relative evaluation values 113 and 610 may be calculated using the two evaluation values. At this time, the value E1 of the first evaluation value is E1 = α1 / S1a (α1 is a constant). Or it is good also as E1 = a1 * Exp (-b1 * S1a) + c1 (a1, b1, c1 is a constant). Further, the calculation method of E1 is not limited to the above example, and any arbitrary function having S1a as a variable can be used. The value E2 of the second evaluation value is E2 = α2 / S2a (α2 is a constant). Alternatively, E2 = a2 × Exp (−b2 × S2a) + c2 (a2, b2, and c2 are constants) may be used. Further, the calculation method of E2 is not limited to the above example, and any arbitrary function having S2a as a variable can be used. The value Er of the relative evaluation value 113 is, for example, a difference between E1 and E2 (Er = E2-E1) or a ratio between E1 and E2 (Er = E2 / E1). Further, the calculation method of Er is not limited to the above example, and any arbitrary function having E1 and E2 as variables can be used.

It is a schematic block diagram of the image | video evaluation apparatus concerning 1st Embodiment of this invention. (A) is a graph which shows an example of the time change of the 1st motion information in a 1st moving image, (b) is a graph which shows an example of the time change of the 2nd motion information in a 2nd moving image. It is a flowchart which shows the flow of a process of the image | video evaluation apparatus of FIG. It is a flowchart which shows the modification of the process of FIG. It is a schematic block diagram of the image | video evaluation program concerning 1st Embodiment of this invention. It is a schematic block diagram of the image | video evaluation apparatus concerning 2nd Embodiment of this invention. It is a flowchart which shows the flow of a process of the image | video evaluation apparatus of FIG. It is a flowchart which shows the modification of the process of FIG. It is a schematic block diagram of the image | video evaluation program concerning 2nd Embodiment of this invention. It is a schematic block diagram of the image | video evaluation apparatus concerning 3rd Embodiment of this invention. It is a flowchart which shows the flow of a process of the image | video evaluation apparatus of FIG. It is a flowchart which shows the modification of the process of FIG. It is a schematic block diagram of the image | video evaluation program concerning 2nd Embodiment of this invention.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 10,60,100 ... Image | video evaluation apparatus, 101,601,1001 ... 1st input part, 102,602 ... 2nd input part, 103 ... 1st motion change amount production | generation part, 104,603,1003 ... 2nd motion change Quantity generation unit, 105, 604, 1004 ... evaluation value generation unit, 106, 605, 1005 ... output unit, 50, 90, 120 ... video evaluation program, 501, 901, 1201 ... main module, 502, 902, 1202 ... first 1 input module, 503, 903, 1203... Second input module, 504... First motion change generation module, 505, 904, 1204... Second motion change generation module, 506, 905, 1205. 507, 906, 1206... Output module.

Claims (7)

First input means for inputting first motion information and first frame interval information relating to the first moving image;
Second input means for inputting second motion information and second frame interval information related to the second moving image;
First motion change amount generating means for obtaining a first motion change amount for the first moving image based on the first motion information and the first frame interval information;
Based on the second motion information and the second frame interval information, second motion change amount generating means for obtaining a second motion change amount for the second moving image;
Evaluation value generation means for calculating a relative evaluation value for evaluating the smoothness of the movement of the second moving image with respect to the first moving image based on the first movement change amount and the second movement change amount; ,
Output means for outputting the relative evaluation value;
A video evaluation apparatus comprising:   The evaluation value generating unit calculates a relative motion change amount from the first motion change amount and the second motion change amount, and calculates the relative evaluation value based on the relative motion change amount. The video evaluation apparatus according to 1. The evaluation value generation means obtains a first evaluation value based on the first movement change amount, obtains a second evaluation value based on the second movement change amount, and calculates the first evaluation value and the second evaluation value. video evaluation apparatus according to claim 1, wherein that issues calculate the relative evaluation value from the. First input means for inputting a first motion change amount relating to the first moving image calculated based on first motion information relating to the first moving image and first frame interval information ;
Second input means for inputting second motion information and second frame interval information related to the second moving image;
Based on the second motion information and the second frame interval information, second motion change amount generating means for obtaining a second motion change amount for the second moving image;
Evaluation value generation means for calculating a relative evaluation value for evaluating the smoothness of the movement of the second moving image with respect to the first moving image based on the first movement change amount and the second movement change amount; ,
An image evaluation apparatus comprising: output means for outputting the relative evaluation value. First input means for inputting a first evaluation value relating to the first moving image calculated based on the first motion information relating to the first moving image and the first frame interval information ;
Second input means for inputting second motion information and second frame interval information related to the second moving image;
Based on the second motion information and the second frame interval information, second motion change amount generating means for obtaining a second motion change amount for the second moving image;
Evaluation value generating means for calculating a relative evaluation value for evaluating the smoothness of the movement of the second moving image with respect to the first moving image, based on the first evaluation value and the second movement change amount;
An image evaluation apparatus comprising: output means for outputting the relative evaluation value. A video evaluation method in a video evaluation apparatus comprising a first input means, a second input means, a first motion change amount generation means, a second motion change amount generation means, an evaluation value generation means, and an output means. And
Wherein the first input means, a first input step of inputting the first motion information about the first moving picture and the first frame interval information,
It said second input means, a second input step of inputting second motion information about the second moving image and the second frame interval information,
It said first motion change amount generating means, based on the first movement information and the first frame interval information, and the first of the first change in motion of generation step of obtaining a first motion change amount for video images,
The second change in motion of generating means, based on said second motion information and the second frame interval information, and the second second motion change amount generating step of obtaining a second motion change amount for video images,
The evaluation value generation means calculates a relative evaluation value for evaluating the smoothness of the movement of the second moving image with respect to the first moving image, based on the first movement change amount and the second movement change amount. An evaluation value generation step to be calculated;
It said output means, and an output step of outputting the relative evaluation value,
A video evaluation method comprising: Computer
First input means for inputting first motion information and first frame interval information relating to the first moving image;
Second input means for inputting second motion information and second frame interval information related to the second moving image;
First motion change amount generating means for obtaining a first motion change amount for the first moving image based on the first motion information and the first frame interval information;
Second motion change amount generating means for obtaining a second motion change amount for the second moving image based on the second motion information and the second frame interval information;
Evaluation value generation means for calculating a relative evaluation value for evaluating the smoothness of the movement of the second moving image with respect to the first moving image, based on the first movement change amount and the second movement change amount; And an output means for outputting the relative evaluation value,
A video evaluation program characterized by functioning as

Images