JP4949912B2 - Subtitle display area determining apparatus and subtitle display program - Google Patents

Description

  The present invention relates to a caption display area determining device and a caption display program for arranging captions in a video.

Conventionally, there has been a video signal processing apparatus that synthesizes and outputs a video signal of a game video and a signal of a caption part (for example, Patent Document 1).
However, in the conventional video signal processing apparatus, when the luminance of the subtitle is close to the luminance of the background video, it may be difficult to see the subtitle.
On the other hand, subtitles can be made easier to see if game developers, etc. add subtitle edges or darken the background video and then process the subtitles or video. However, there is a problem that the work becomes complicated and takes time. It was.
JP 7-322159 A

  An object of the present invention is to provide a caption display area determination device and a caption display program that can make captions easier to see, can simplify the work for displaying captions, and can reduce man-hours.

  The present invention solves the above problems by the following means. In addition, in order to make an understanding easy, although the code | symbol corresponding to the Example of this invention is attached | subjected and demonstrated, it is not limited to this.

First invention reads subtitle information stored in the storage means (20), and subtitle luminance information is luminance information of subtitles, multiple subtitle display area for displaying the subtitle of the display means for displaying the subtitle The display area luminance information (L1 to L4) which is the luminance information of (i1 to i4) is compared, and the subtitle display area is selected from the plurality of subtitle display areas based on the luminance difference between the subtitle and the subtitle display area. Control means (30) for determining the subtitle display area for displaying the subtitles, the plurality of subtitle display areas have a priority order to be displayed in advance, the control means according to the priority order, When the luminance difference of a plurality of caption display areas is determined and it is determined that the luminance difference is equal to or greater than a predetermined value, the determined caption display area is determined as the caption display area, and the luminance difference is Above the specified value The Most When determining includes determining the brightness difference of the caption display area of the next priority, a subtitle display area determining apparatus according to claim.

According to a second aspect of the present invention, in the subtitle display area determining apparatus according to the first aspect, when the control means determines that the luminance differences of all the subtitle display areas are not equal to or greater than a specified value, the luminance difference is the largest. A subtitle display area determining apparatus characterized in that a large subtitle display area is determined as a subtitle display area.
According to a third aspect of the present invention, in the caption display area determining device according to the first or second aspect , the control means (30) includes at least one of brightness information of each color forming the caption brightness information, and the display area brightness. A subtitle display area determination device characterized in that at least one of luminance information of each color forming information (L1 to L4) is compared to obtain the luminance difference.
According to a fourth aspect of the present invention, in the caption display area determining device according to any one of the first to third aspects, the control means (30) includes transparency information forming the caption brightness information, and the display area brightness information. The subtitle display area determining apparatus is characterized in that the luminance difference is obtained by comparing with transparency information forming (L1 to L4).
According to a fifth invention, in the caption display area determining device according to any one of the first to fourth inventions, a caption display position storage means (24) for storing the caption display areas (i1 to i4) in association with the caption information. ), And the control means (30) stores the determined subtitle display area in association with the subtitle information in the subtitle display position storage means.
According to a sixth invention, in the caption display area determining device according to the fifth invention , the control means (30) reads the caption display areas (i1 to i4) stored in the caption display position storage means (24). And displaying the subtitles in the read subtitle display area.

In a seventh aspect of the invention, the computer (10) reads the caption information stored in the storage means (20), and displays the caption luminance information which is the luminance information of the caption and the caption of the display means for displaying the caption. The display area luminance information (L1 to L4) that is the luminance information of the plurality of subtitle display areas (i1 to i4) to be compared, and based on the luminance difference between the subtitle and the subtitle display area, the plurality of subtitles It functions as a control means (30) for determining the subtitle display area for displaying the subtitle from the display area, and the priority order for displaying the plurality of subtitle display areas is determined in advance, If the luminance difference of the plurality of subtitle display areas is determined according to the priority order and the luminance difference is determined to be greater than or equal to a predetermined value, the determined subtitle display area is determined as the subtitle display area. Is, if the luminance difference is determined not to be the prescribed value or more is a subtitle display program for causing a function to determine the brightness difference of the caption display area of the next priority.

According to an eighth aspect, in the caption display area determining device according to the seventh aspect, when the control means determines that the luminance differences in all the caption display areas are not equal to or greater than a specified value, the luminance difference is the largest. A caption display program characterized by causing a large caption display area to function as a caption display area.
According to a ninth invention, in the caption display program according to the seventh or eighth invention , the control means (30) controls the display area brightness information (at least one of brightness information of each color forming the caption brightness information) and the display area brightness information ( L1 to L4) are compared with at least one of the luminance information of the respective colors forming the subtitle display program and function to obtain the luminance difference.
According to a tenth aspect of the present invention, in the caption display program according to any one of the seventh to ninth aspects, the control means (30) forms the transparency information for forming the caption luminance information and the display area luminance information. It is a subtitle display program characterized in that it is made to function to obtain the luminance difference by comparing with transparency information.
In an eleventh aspect of the present invention, in the caption display area determination device according to any one of the seventh to tenth aspects, the computer (10) stores the caption display areas (i1 to i4) in association with the caption information. Functioning as subtitle display position storage means (24), and causing the control means (30) to function so that the determined subtitle display area is stored in the subtitle display position storage means in association with the subtitle information. This is a featured caption display program.
In a subtitle display program according to an eleventh aspect , the twelfth invention reads the subtitle display area (i1 to i4) stored in the subtitle display position storage means (24) from the control means (30), It is a subtitle display program characterized by functioning to display the subtitle in the read subtitle display area.

According to the present invention, the following effects can be obtained.
(1) In the present invention, the subtitle display area is determined based on the luminance difference between the subtitle and the plurality of subtitle display areas, so that the subtitle can be easily seen by displaying the subtitle in the subtitle display area having a large luminance difference. Can be displayed. In addition, since it is not necessary for a game developer or the like to process subtitles or background video, the work for displaying subtitles can be simplified and the number of man-hours can be reduced.

(2) Since the present invention obtains the luminance difference based on the luminance information of each color of the subtitle and the plurality of subtitle display regions, the subtitle display region can be determined from the luminance information of each color.

(3) In the present invention, the luminance difference is obtained based on the subtitle and the transparency information of the plurality of subtitle display areas, so that the subtitle display area can be determined from the transparency information.

(4) Since the present invention associates the determined subtitle display area with the subtitle display area and stores it in the subtitle display position storage means, once the process for obtaining the luminance difference between the subtitle luminance information and the display area luminance information is performed, the next time Can display subtitles without similar processing.

(5) Since the present invention reads the subtitle display area stored in the subtitle display position storage means and displays the subtitle in the read subtitle display area, the process of obtaining the luminance difference between the subtitle luminance information and the display area luminance information The burden on the CPU (central processing unit) and the like can be reduced.

  It is an object of the present invention to provide a caption display area determination device and a caption display program that can make captions easier to see, can simplify the work for displaying captions, and can reduce the man-hours. Realized by determining the subtitle display area to display subtitles from among the multiple subtitle display areas based on the luminance difference between the subtitle luminance information and the display area luminance information that is the luminance information of the multiple subtitle display areas did.

Hereinafter, the present invention will be described in more detail with reference to the drawings and the like.
FIG. 1 is a block diagram of a game system 1 according to the present embodiment.
As shown in FIG. 1, the game system 1 includes a game machine 10 (caption display area determination device), a monitor 50 (display means) that outputs game video and game sound in accordance with an output from the game machine 10, and a speaker 60. And.
The game machine 10 includes a storage unit 20 (storage unit), a control unit 30 (control unit), and an operation unit 40.
Note that the computer in the present invention refers to an information processing apparatus including a storage device, a control unit, and the like, and the game machine 10 includes a storage unit 20, a control unit 30, and the like. included. The game machine 10 may be a portable information terminal including a mobile phone.

The storage unit 20 is a storage device such as a hard disk or a semiconductor memory element for storing programs, data, and the like necessary for the operation of the game machine 10. The storage unit 20 includes a game program storage unit 21, a video information storage unit 22, a caption information storage unit 23, and a caption display position storage unit 24 (caption display position storage unit).
The game program storage unit 21 is a storage area for storing a game program that is a main program necessary for the progress of the game.

The video information storage unit 22 is a storage area for storing information of game video to be displayed on the monitor 50.
The subtitle information storage unit 23 is a storage area for storing subtitle information (subtitle information) to be displayed on the monitor 50. The subtitles displayed in the present embodiment are subtitles for explaining the game method before play, and subtitles indicating instructions to the player as the play progresses, such as role playing games.
The caption display position storage unit 24 is a storage area that stores the caption display areas i1 to i4 in association with the caption information, as will be described later.

The control unit 30 is a control unit that controls the game machine 10 in an integrated manner, and includes, for example, a CPU (Central Processing Unit). The control unit 30 reads and executes various programs stored in the storage unit 20 as appropriate, thereby realizing various functions according to the present embodiment in cooperation with the hardware described above. The control unit 30 includes a game progress control unit 31, a caption display control unit 32, and a bus line that transmits information between the control units.
The game progress control unit 31 is a control unit that is operated by a game program and comprehensively controls the progress of the game.

  The caption display control unit 32 is a control unit that reads the caption information stored in the caption information storage unit 23 and displays the caption on the monitor 50. The caption display control unit 32 determines the position for displaying the caption from the four caption display areas i1 to i4 (see FIG. 3) of the monitor 50. The subtitle display areas i1 to i4 are prioritized in advance in the order of the subtitle display areas i1 to i4 with reference to the visibility during play and the difficulty of obstructing during play. The display control unit 32 displays the caption in the caption display area i1 that is easy for the player to see. Therefore, the player can read the subtitles by moving his eyes to the subtitle display area i1.

However, for example, when the brightness of the game video and the subtitles is close, the subtitles are observed to be melted into the game video and are difficult to see. Therefore, as will be described later, the caption display control unit 32 performs image processing on the caption information and the game video information, and displays caption luminance information that is the luminance information of the caption and the caption display area when the game video is output. Display area luminance information L1 to L4 (see FIG. 4) which is luminance information of i1 to i4 is extracted. Then, the subtitle display control unit 32 determines a subtitle display area for displaying the subtitles from the subtitle display areas i1 to i4 based on the luminance difference between the luminance of the displayed subtitles and the luminance of the subtitle display areas i1 to i4. To do.
The operation unit 40 is an operation button for the player to start play or to advance play. The operation unit 40 outputs a signal to the control unit 30 when operated.

FIG. 2 is a flowchart showing the operation of the game system 1 of the present embodiment.
FIG. 3 is a diagram showing a game image during play according to the present embodiment.
FIG. 4 is a table showing subtitle luminance information and subtitle display area luminance information of this embodiment.
First, in step S (hereinafter referred to as “S”) 1, when the operation unit 40 is operated by the player, a signal is output to the control unit 30, and the game progress control unit 31 starts playing.
In S2, the game progress control unit 31 reads the video information of the game from the video information storage unit 22 and the subtitle display control unit 32 reads the subtitle information from the subtitle information storage unit 23 in accordance with the progress of the play, and proceeds to S3. .

In S3, the caption display control unit 32 extracts the display area luminance information L1 (see FIG. 4) of the caption display area i1 from the read video information. Here, the caption display control unit 32 extracts luminance information of each color forming the display area luminance information L1, that is, luminance information of R (red), G (green), and B (blue). The brightness of each color is defined by a numerical value from 0 (dark) to 100 (bright) in the present embodiment. For example, if R = 0, G = 0, and B = 0, the displayed color is black. If R = 100, G = 100, and B = 100, the displayed color is white. is there. In addition, since the luminance varies depending on the location in the caption display area i1, the caption display control unit 32 averages the luminance in the caption display area i1 (the same applies to the following processing).
Similarly, the caption display control unit 32 extracts luminance information of each color forming a caption from the read caption information.

  The caption display control unit 32 compares the luminance information of each color of the extracted display area luminance information L1 with the luminance information of each color of the caption, and determines whether or not the luminance difference is equal to or greater than a threshold value. In the present embodiment, the caption display control unit 32 compares the sum of the brightness of each color of the caption with the sum of the brightness of each color of the display area brightness information L1. When the subtitle display control unit 32 determines that the luminance difference between the subtitle and the subtitle display area i1 is within the threshold (S3: NO), the subtitle display control unit 32 proceeds to S4 and determines that the luminance difference is equal to or greater than the threshold (S3: YES), the process proceeds to S31, selects the caption display area i1, and then proceeds to S8.

  For example, as shown in FIG. 4, if the luminance of each color of the caption is R = 100, G = 100, B = 100, that is, if the caption is white, the sum of the luminance of each color of the caption is 300. If the luminance of the color information of the display area luminance information L1 is R = 90, G = 80, and B = 70, the sum of the luminances of the respective colors of the display area luminance information L1 is 240. In this case, the luminance difference between the caption and the caption display area i1 is 60. If the threshold is 150, the caption display control unit 32 determines that the luminance difference is within the threshold (S3: NO), and proceeds to S4.

Returning to FIG. 2, in S4, the caption display control unit 32 performs the same processing as S3, extracts the display area luminance information L2 of the caption display area i2 from the read video information, and displays the display area luminance information L2 The sum of the brightness of each color is calculated. In the present embodiment, in the processing after S4, the caption display control unit 32 does not extract the luminance information of each color of the caption after S4. This is because the subtitle colors after S4 are the same. However, in the specification in which the color of the subtitle is changed, the subtitle display control unit 32 may extract the luminance information of each color of the subtitle when the color of the subtitle is changed.
When the subtitle display control unit 32 determines that the luminance difference between the subtitle and the subtitle display area i2 is within the threshold (S4: NO), the process proceeds to S5, and when it is determined that the luminance difference is equal to or greater than the threshold ( (S4: YES), the process proceeds to S41, selects the caption display area i2, and then proceeds to S8.

  For example, as shown in FIG. 4, if the luminance of each color of the display area luminance information L2 is R = 70, G = 70, and B = 60, the sum of the luminances of the respective colors of the display area luminance information L2 is 200. . In this case, the luminance difference between the caption and the caption display area i2 is 100. Since the threshold value is 150, the caption display control unit 32 determines that the luminance difference is within the threshold value (S4: NO), and proceeds to S5.

Returning to FIG. 2, in S5, the caption display control unit 32 performs the same processing as S3, extracts the display area luminance information L3 of the caption display area i3 from the read video information, and displays the display area luminance information L3. The sum of the brightness of each color is calculated. When the subtitle display control unit 32 determines that the luminance difference between the subtitle and the subtitle display area i3 is within the threshold (S5: NO), the process proceeds to S6, and when the luminance difference is determined to be equal to or greater than the threshold ( (S5: YES), the process proceeds to S51, selects the caption display area i3, and then proceeds to S8.
For example, as shown in FIG. 4, if the luminance of each color of the display area luminance information L3 is R = 30, G = 30, and B = 30, the sum of the luminances of the respective colors of the display area luminance information L3 is 90. . In this case, the luminance difference between the caption and the caption display area i3 is 210. Since the threshold is 150, the subtitle display control unit 32 determines that the luminance difference is equal to or greater than the threshold (S5: YES), proceeds to S33, selects the subtitle display area i3, and then proceeds to S8.

Returning to FIG. 2, in S6, the caption display control unit 32 performs the same processing as S3, extracts the display area luminance information L4 of the caption display area i4 from the read video information, and displays the display area luminance information L4. The sum of the brightness of each color is calculated. If the subtitle display control unit 32 determines that the luminance difference between the subtitle and the subtitle display area i4 is within the threshold (S6: NO), the process proceeds to S7, and determines that the luminance difference is equal to or greater than the threshold ( (S6: YES), the process proceeds to S61, selects the caption display area i4, and then proceeds to S8.
In the example shown in FIG. 4, this S6 is not executed, but if the luminance of each color of the display area luminance information L4 is R = 50, G = 50, B = 60, for example, each color of the display area luminance information L4 The sum of luminance is 160. In this case, the luminance difference between the caption and the caption display area i4 is 140. Since the threshold is 150, the caption display control unit 32 determines that the luminance difference between the two is within the threshold (S6: NO), and proceeds to S7.

  Returning to FIG. 2, the process proceeds to S <b> 7 is a case where the luminance difference does not exceed the threshold in the processes of S <b> 3 to S <b> 6 (S <b> 3 to S <b> 6: NO). Therefore, the subtitle display control unit 32 selects subtitle display areas i1 to i4 having a large luminance difference from the display area luminance information L1 to L4 in order to display the subtitles as easily as possible, and proceeds to S8.

  In S <b> 8, the caption display control unit 32 combines the video information and the caption information and outputs the synthesized information to the monitor 50. The subtitle display control unit 32 displays subtitles in the subtitle display areas i1 to i4 that are determined to be equal to or greater than the threshold by processing the video information in S3 to S6 or the subtitle display areas i1 to i4 selected in the process of S7. The subtitle display area is determined and the subtitle is arranged.

Through the above processing, the game system 1 can display subtitles in the subtitle display areas i1 to i4 having a large luminance difference from the game video, and can display the subtitles so that they can be easily seen. In addition, the game system 1 does not require work such as subtitle framing and background image processing, which has been performed by game developers and the like, so that it is possible to reduce development man-hours in game development.
After arranging the caption, the caption display control unit 32 proceeds to S9.

  In S9, the caption display control unit 32 stores the information of the caption display areas i1 to i4 determined by the above processing in the caption display position storage unit 24 in association with the caption information. Then, when the play is repeatedly performed, the subtitle display control unit 32 reads the information of the subtitle display areas i1 to i4 stored in the subtitle display position storage unit 24 and displays the subtitles in the read subtitle display areas i1 to i4. To do. As a result, the subtitle display control unit 32 does not need to perform the luminance comparison process described above, and thus can reduce the burden on the CPU and the like.

In S10, the game progress control unit 31 determines whether or not the play has ended. When it is determined that the play is continued (S10: NO), the game progress control unit 31 repeats the processes from S2, and when it is determined that the play is completed (S10: YES), the game progress control unit 31 proceeds to S11 and ends the series of processes. To do.

As described above, the game system 1 of the present embodiment can display subtitles so that they can be easily seen, and can reduce the development man-hours at the time of game developers.
Furthermore, the game system 1 can reduce the load on the CPU and the like when the play is repeated and the subtitles are displayed next time.

(Modification)
Without being limited to the embodiments described above, various modifications and changes are possible, and these are also within the technical scope of the present invention.
(1) In the present embodiment, an example in which subtitles are arranged in a game video is shown, but the present invention is not limited to this. For example, the subtitles may be arranged in movie images.

(2) In this embodiment, the subtitle display control unit obtains the luminance difference from the sum of the luminance information of each color (R, G, B). However, the present invention is not limited to this. For example, the caption display control unit may compare luminance information of one color among the colors. Further, the caption display control unit may obtain a luminance difference by performing other arithmetic processing (for example, weighting one color) on the luminance information of each color.

(3) In the present embodiment, the caption display control unit has obtained an example in which the luminance difference is obtained based on the luminance information of each color (R, G, B), but the present invention is not limited to this. For example, the luminance difference may be obtained by comparing the transparency information (so-called α value or the like) forming the caption luminance information with the transparency information forming the display area luminance information. In this case, it is possible to prevent the subtitles from being melted into the background video. Further, the luminance difference may be obtained based on both the information on the luminance of the color and the information on the transparency.

(4) In the present embodiment, the subtitle display control unit has shown an example in which the subtitle display area having the largest luminance difference is selected when all the display area luminance information is equal to or smaller than the threshold, but the present invention is not limited to this. . For example, the caption display control unit may make the caption easier to see by changing the color of the caption so that the luminance difference is equal to or greater than a threshold value.

(5) In the present embodiment, the storage unit is an example of a storage device such as a hard disk or a semiconductor memory element, but the present invention is not limited to this. For example, the storage unit may be a storage medium such as a CD (Compact Disc) and a DVD (Digital Versatile Disc) that can be read by a computer on which a game program, a program for arranging subtitles, and the like are recorded. In this case, a distributor of game software or the like can store and deliver a game having an effect that subtitles are easily visible on these storage media.
Further, when the display position of the caption has already been determined by performing the above-described processing in the development process, a caption display position storage unit in which the caption display position is recorded may be provided in the storage medium. Thereby, when a player plays, since the game machine does not need to perform the above-mentioned process, the burden on the CPU or the like can be reduced.

It is a block diagram of game system 1 of this example. It is a flowchart which shows operation | movement of the game system 1 of a present Example. It is a figure which shows the game image | video in play of a present Example. It is a table | surface which shows the luminance information of a subtitle of a present Example, and the luminance information of a subtitle display area.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Game system 10 Game machine 20 Memory | storage part 21 Game program memory | storage part 22 Image | video information memory | storage part 23 Subtitle information memory | storage part 24 Subtitle display position memory | storage part 30 Control part 31 Game progress control part 32 Subtitle display control part 50 Monitor i1-i4 Subtitle display Area L1-L4 Display area luminance information

Claims (12)

Reading subtitle information stored in the storage means, subtitle luminance information that is subtitle luminance information, and display area luminance information that is luminance information of a plurality of subtitle display areas for displaying the subtitles of the display means for displaying the subtitles And a control means for determining the subtitle display area for displaying the subtitle from a plurality of the subtitle display areas based on a luminance difference between the subtitle and the subtitle display area ,
In the plurality of subtitle display areas, the priority order to display is determined in advance,
The control means includes
According to the priority order, determine the luminance difference of the plurality of caption display areas,
If it is determined that the luminance difference is greater than or equal to a predetermined value, the determined caption display area is determined as the caption display area;
If it is determined that the luminance difference is not greater than or equal to a predetermined value, determining the luminance difference of the caption display area of the next priority;
A subtitle display area determination device characterized by the above . In the caption display area determination device according to claim 1,
When the control means determines that the luminance difference of all the subtitle display areas is not equal to or greater than the specified value, the subtitle display area having the largest luminance difference is determined as the subtitle display area;
A subtitle display area determination device characterized by In the caption display area determination device according to claim 1 or 2 ,
The control means obtains the luminance difference by comparing at least one of the luminance information of each color forming the caption luminance information with at least one of the luminance information of each color forming the display area luminance information. ,
A subtitle display area determination device characterized by the above. In the caption display region determination device according to any one of claims 1 to 3 ,
The control means compares the transparency information forming the caption luminance information with the transparency information forming the display area luminance information to obtain the luminance difference;
A subtitle display area determination device characterized by the above. In the caption display region determination device according to any one of claims 1 to 4 ,
Subtitle display position storage means for storing the subtitle display area in association with the subtitle information,
The control means stores the determined caption display area in the caption display position storage means in association with the caption information;
A subtitle display area determination device characterized by the above. In the caption display area determination device according to claim 5 ,
The control means reads the caption display area stored in the caption display position storage means, and displays the caption in the read caption display area;
A subtitle display area determination device characterized by the above. Computer
Reading subtitle information stored in the storage means, subtitle luminance information that is subtitle luminance information, and display area luminance information that is luminance information of a plurality of subtitle display areas for displaying the subtitles of the display means for displaying the subtitles And based on the luminance difference between the subtitle and the subtitle display area, function as control means for determining the subtitle display area for displaying the subtitle from the plurality of subtitle display areas ,
In the plurality of subtitle display areas, the priority order to display is determined in advance,
The control means;
In accordance with the priority order, the luminance difference of the plurality of caption display areas is determined,
If it is determined that the luminance difference is equal to or greater than a specified value, the determined caption display area is determined as the caption display area;
If it is determined that the luminance difference is not equal to or greater than a specified value, the luminance difference of the subtitle display area of the next priority order is determined to function;
A subtitle display program characterized by In the caption display area determination device according to claim 7,
If the control means determines that the luminance difference of all subtitle display areas is not equal to or greater than the specified value, the control means functions to determine the subtitle display area having the largest luminance difference as the subtitle display area;
A subtitle display program characterized by In the caption display program according to claim 7 or claim 8 ,
The control means compares at least one of the luminance information of each color forming the caption luminance information with at least one of the luminance information of each color forming the display area luminance information so as to obtain the luminance difference. To make it work,
A subtitle display program characterized by In the caption display program according to any one of claims 7 to 9 ,
The control means is configured to compare the transparency information forming the caption luminance information with the transparency information forming the display area luminance information to function to obtain the luminance difference;
A subtitle display program characterized by In the subtitle display area determination device according to any one of claims 7 to 10 ,
Causing the computer to function as caption display position storage means for storing the caption display area in association with the caption information;
Causing the control means to function to store the determined caption display area in the caption display position storage means in association with the caption information;
A subtitle display program characterized by In the caption display program according to claim 11 ,
Allowing the control means to read the caption display area stored in the caption display position storage means and to function to display the caption in the read caption display area;
A subtitle display program characterized by

Images