JP5539006B2 - Display control apparatus and display control method - Google Patents

Description

  The present invention relates to a technique for outputting audio as well as displaying an image.

  In recent years, in mobile phones and notebook computers, a panel that displays content is a rotating panel. According to the contents to be displayed, usability is improved by using a rectangular display panel as a vertically long panel or a horizontally long panel.

  2. Description of the Related Art Conventionally, a technique is known that uses a dedicated built-in speaker for each of the case where the rotating panel is used as a vertically long panel and the case where it is used as a horizontally long panel.

  In recent years, multi-window systems have been widely used in general with the spread of PCs (personal computers). The multi-window system is a system that defines a plurality of virtual areas on a display device and allocates different applications to the virtual areas. The operator uses a plurality of applications at the same time while switching the virtual area with an input device such as a mouse. In addition, with the recent increase in display panel size and definition, and the development of graphic cards that support high resolution, many applications can be handled using the multi-window system described above. It is. There are also situations where a large table-type display device is shared by a plurality of people.

JP2003-244786

  Conventionally, for example, when a plurality of operators are seated facing a table-type display device and a speaker is placed on the display device, the correct sound image is obtained when the operator changes the orientation or position of the speaker. I can't audition the position. For example, when reproducing stereo sound using two speakers, if the direction of these speakers is changed from the direction facing one operator to the direction facing the operator, the stereo sound to be output is The left and right are reversed.

  The present invention has been made in view of the above problems, and it is an object of the present invention to appropriately output sound output from a plurality of sound generating devices such as speakers even when the direction and position of the sound generating device are changed. To do.

  In order to solve the above-described problems, according to the display control device of the present invention, the display control unit that displays the content on the display unit, the position detection unit that detects the position of the audio output device approaching the display unit, Selection means for selecting content being displayed on the display means, approaching the sound output device, direction detecting means for detecting the direction in which the sound output device outputs sound, and the position and direction of the sound output device On the basis of this, it is characterized by comprising output voice control means for determining voice data to be output from the voice output apparatus, and data transmission control means for transmitting the determined voice data to the voice output apparatus.

  According to the above configuration, even if the direction and position of a plurality of sound generating devices such as speakers are changed, sound output from them can be appropriately output.

Processing configuration diagram of a system applied to the embodiment External view of a system applied to the embodiment The figure which shows the process sequence of the system applied to embodiment. The figure explaining the situation of each part regarding this system The figure explaining the situation of each part regarding this system The figure which shows the information of each contents regarding this system

  Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings. In the present embodiment, a description will be given assuming a horizontally installed table-type display as an example of the display device, but any display device that can be used for a speaker described later is applicable to the present invention.

  1 and 2 are views showing a basic system according to the present embodiment. FIG. 1 shows a configuration of a processing unit in the system according to the present embodiment, and FIG. 2 corresponds to an external view of the system. The display means 110 in FIG. 1 is a display represented by a liquid crystal display or a plasma display. The display unit 110 corresponds to the display unit 210 in FIG. The display unit 110 is installed horizontally and can display contents 240 to 242 such as photographs, moving images, sentences, and music files. The audio output device 120 in FIG. 1 is a device having a function of outputting audio such as a speaker. The audio output device 120 corresponds to the audio output device 220 and the audio output device 221 shown in FIG. The audio output device 120 is preferably a small and portable speaker. In this embodiment, each audio output device 120 is placed on the display unit 110. The approach detection means 130 in FIG. 1 is a means for detecting that the sound output device 120 has approached the display means 110. When the approach is detected, the approach detection unit 130 establishes communication with the audio output device 120 via the data transmission control unit 160. Here, a known communication technique such as Bluetooth is used, and detailed description thereof is omitted. The position detection unit 140 in FIG. 1 is a unit that specifies the approach position of the audio output device 120 detected by the approach detection unit 130. The content selection unit 150 determines whether content exists in the vicinity of the approach position. If the content exists within a specified range, the audio data of the content is output via the data transmission unit 160 as audio output. Wirelessly transmit to the device 120. The display control unit 170 performs display control of the contents 240 to 242. In addition, the display control unit 170 creates an area (circle) in which the content selection unit 150 determines that “content exists” around the position of the audio output device 120 (220, 221) specified by the position detection unit 140. Display. The direction detection unit 180 is a unit that specifies the direction of the audio output device 120 detected by the approach detection unit 130. The output sound control unit 190 determines the sound output from the sound output device according to the position and direction of the sound output device 120 obtained by the position detection unit 140 and the direction detection unit 180. In FIG. 2, the approach detection unit 130, the position detection unit 140, the content selection unit 150, the data transmission unit 160, the display control unit 170, the direction detection unit 180, and the output audio control unit 190 are the main body 200 (display control device). It shall be built in. Further, the main body 200 and the display unit 210 may be integrated, or may be removable.

  FIG. 3 is a flowchart showing a processing procedure of the main body 200 (display control apparatus) of the present embodiment. Details of FIG. 3 will be described later.

  4 and 5 are diagrams for visually explaining the processing procedure. Here, the main body 400 and the main body 500 in FIG. 4 correspond to the main body 200 in FIG. 2. The display devices 410 and 510 correspond to the display device 210 in FIG. The audio output devices 420 and 421, the audio output devices 460 and 461, or the audio output devices 520 and 521 correspond to the audio output devices 220 and 221 in FIG. The contents 440 to 442 or 540 to 542 correspond to the contents 240 to 242 in FIG. Here, the operator 450 and the operator 451 face each other with the main body 400 interposed therebetween, and the operator 550 and the operator 551 face each other with the main body 500 interposed therebetween. . 4 shows two states, and FIG. 5 shows one state. For example, in the state I shown on the left side of FIG. 4, the direction of the sound output devices 420 and 421 (the direction in which sound is output) is generally facing the operator 450. Further, in the state II shown on the right side of FIG. 4, the direction of the audio output devices 460 and 461 (the direction in which audio is output) is generally directed to the operator 451. In the state III shown in FIG. 5, the direction of the audio output device 520 is generally directed to the operator 551, and the direction of the audio output device 521 is generally directed to the operator 550. In the lower part of FIG. 4, the coordinates and directions where the audio output devices 420 and 421 are installed are indicated by 480, and the coordinates and directions where the audio output devices 460 and 461 are installed are indicated by 490. Here, it is assumed that the upper left corner of the display device 410 is the coordinates (X = 0, Y = 0), and the X axis and the Y axis are set in the directions of the arrows. In the lower part of FIG. 5, 580 and 590 indicate coordinates and directions where the audio output devices 520 and 521 are installed. Here, as in FIG. 4, the upper left corner of the display device 510 is set as coordinates (X = 0, Y = 0), and the X axis and the Y axis are set in the directions of the arrows.

  FIG. 6 shows an example of the coordinates of the contents 440 to 442 being displayed on the display means 410, the presence / absence of audio data, and the number of channels.

  Hereinafter, the flowchart of FIG. 3 will be described with reference to FIGS. First, in step 300, when the main body 200 (display control device) is activated, the display control device performs the following processing.

  In step 310, the distance between the audio output device 120 and the display unit 110 is measured by the approach detection unit 130. For example, since the audio output devices 420 and 421 are installed on the display unit 410, the distance measured by the approach detection unit 130 is 0 cm.

  In step 320, the approach detection unit 130 determines whether there is an audio output device 120 approaching within the distance N. And when it determines with the audio | voice output apparatus 120 existing within the distance Ncm, it changes to step 330. In the present embodiment, the following description will be given assuming that the distance N is set to 3 cm. For example, in the state I in FIG. 4, the distance between the audio output devices 420 and 421 and the display unit 410 is 0 cm, which is within 3 cm of the distance N, so that the audio output units 420 and 421 are detected. If there is no audio output means within a distance of 3 cm in step 320, the process proceeds to step 310, and the distance to the audio output device approaching again is measured. Then, step 310 and step 320 are repeated at regular intervals to remeasure the distance. In this embodiment, the time interval until the distance remeasurement is 0.5 seconds.

  In step 330, the position detection unit 140 identifies the coordinates of the sound output device that is currently approaching (in the example of state I, the sound output devices 420 and 421). For example, in the state I, as shown by 480 in FIG. 4, the audio output device 420 is installed at the coordinates (x, y) = (600, 550), and the audio output device 421 has the coordinates (x, y ) = (1080, 550).

  In step 340, the coordinates of the contents 440 to 442 being displayed are specified by the contents selection means 150. It is assumed that the contents 440 to 442 are displayed at coordinates 610 to 612 shown in FIG. The coordinates are based on the coordinates (x, y) described above, and the four coordinates shown in each content in FIG. 6 correspond to four vertices when the content is recognized as a rectangle.

  In step 350, the content selection unit 150 determines whether content exists in the vicinity of the audio output device (the audio output devices 420 and 421 in the state I example). Here, it is determined that the content included in the region centered on the coordinates approaching the audio output device (the circle with a predetermined radius in FIGS. 4 and 5) is “the content exists in the vicinity of the audio output device”. . If the content is in the vicinity of the audio output device, the process proceeds to step 360. If there is no content in the vicinity, the process proceeds to step 330, and step 330, step 340, and step 350 are repeated at regular intervals. For example, the vicinity range of the audio output device 420 is a circle 430, and the vicinity range of the audio output device 421 is a circle 431. These circles 430 and 431 are displayed as images on the display means 410 so that the operator can recognize them. Here, it is calculated whether or not the circle 430 and the circle 431 and the contents 440 to 442 overlap on the coordinates. Here, since the displayed content 440 overlaps the neighboring circles 430 and 431 of the audio output device, the process proceeds to step 360.

  In step 360, the content selection unit 150 determines the content for outputting sound. Here, the content selection unit 150 first checks whether each content in the vicinity of the audio output device has audio data. If the content being confirmed has audio data such as a moving image or music file, the audio data is acquired. Then, this content is determined as an audio output target. If there is content that does not have audio data, it is excluded from the subsequent processing targets. An example of whether or not the contents 440 to 442 have audio data is shown in 620 to 622 in FIG. For example, since the content 440 in the state I has audio data, the content 440 is determined as an audio output target. Then, audio data included in the content 440 is acquired.

  In step 370, the direction of the audio output device is specified by the direction detection unit 180. For example, in 480 of FIG. 4, the audio output device 420 is arranged to form an angle of 60 ° with the X axis, and the audio output device 421 is arranged to form an angle of 90 ° with the X axis. . The direction detection unit 180 acquires these directions as information.

  In step 380, the audio data to be output from each audio output device is determined by the output audio control unit 190 based on the coordinates and direction (angle) of the audio output device specified by the position detection unit 140 and the direction detection unit 180. .

  The internal flow of step 380 will be described as steps 381 to 389. When the start of the flow in step 380 is detected in step 381, the following is performed.

  In step 382, the angle formed by each other's audio output device is calculated. For example, in the case of state I in FIG. 4, the angle formed by the audio output devices 420 and 421 is calculated as “90 ° −60 ° = 30 °”.

  In step 383, it is determined whether the calculated angle is 90 ° or less. This determination process determines whether the audio output device is directed to one operator or a plurality of operators depending on the angle formed by each other's audio output device. Judgment. For example, in the state I in FIG. 4, the angle formed by the mutual sound output devices is within 90 °, so it is determined that the two sound output devices are directed to one operator. Further, for example, in the state III of FIG. 5, the angle formed by the sound output devices is 90 ° or more, so that each sound output device is directed to another operator, that is, the two sound output devices are Judged to be used by multiple people. Here, in the case of state III in FIG. 5, in step 383, it is determined that the angle is 90 ° or more. Therefore, in this case, the process proceeds to step 388. In step 388, settings are made so that a plurality of channels corresponding to the sound of one content are synthesized and output (monaural output) from one audio output device. Therefore, in the state III in FIG. 5, for example, even when a plurality of operators (operators 550 and 551) listen to the sound of the same content, the sound that is monaurally output from each sound output device is used. I will listen.

In step 384, the rotation direction of the line segment connecting the coordinates of the audio output device (420 and 421 in state I) and the line segment representing the direction of the audio output device is calculated. The line segments representing the direction of the audio output device are the above-described angles of 60 ° and 90 °, and the length of the line segment is 10. Coordinates where the audio output devices (420 and 421 in state I in FIG. 4) are installed are respectively A and B, and line segments indicating the directions of these audio output devices are AA ′ and BB ′. For example, in the state I, the coordinates of A, A ′, B, B ′ are (Ax, Ay) = (600, 550), (A′x, A′y) = (606, 558), respectively. ), (Bx, By) = (1080, 550), (B′x, B′y) = (1080, 560). Using the above coordinates and formulas described later, the rotation direction is obtained for the line segment AB (line segment BA) of the line segments AA ′ and BB ′. In the formula (1), if the direction that becomes the Y axis when the X axis rotates 90 ° is the positive direction, if the value obtained in the formula (1) is positive, the rotation in the positive direction becomes the direction of the line segment AB. If it is negative, it will be in the direction of line segment AB when rotated in the negative direction.
(A′x−Ax) × (By−Ay) − (A′y−Ay) × (Bx−Ax). . . Formula (1)
(606-600) * (550-550)-(558-550) * (1080-600) <0. . . Formula (2)
In step 384, the audio output device 420 performs calculation using equation (1). Since the rotation direction of the line segment AA ′ with respect to the line segment AB is negative as shown in the expression (2) using the expression (1), it is determined that the rotation direction is the negative direction. The Therefore, the process proceeds to step 387 based on the determination in step 385.

  In step 387, the sound output device 420 is determined to be “installed on the left side with respect to the operator” because the rotation direction is a negative direction from the above formula. The audio data for the channel is set.

Further, similarly to the above, calculation is also performed on the audio output device 421. That is, in step 384, for the audio output device 421, the rotation direction of the line segment BB ′ with respect to the line segment BA is calculated.
(B′x−Bx) × (Ay−By) − (B′y−By) × (Ax−Bx). . . Formula (3)
(1080-1080) * (550-550)-(560-550) * (600-1080)> 0. . . Formula (4)
Since the calculation result is positive as shown in the above equation (4), the rotation direction is determined to be the positive direction. Therefore, the process proceeds to step 386 based on the determination in step 385.

  In step 386, the sound output device 421 is determined to be “installed on the right side with respect to the operator” because the rotation direction is the positive direction from the above formula, and the sound output device 421 has the right side The audio data for the channel is set.

  In step 390, the data transmission control means 160 transmits the audio data of the audio channels set as described above to the corresponding audio output device.

  In step 391, the audio data transmitted from the data transmission control means 160 is output by the audio output device. Note that this step 391 alone is not performed by the main body 200 (or the main bodies 400 and 500) described above, but is performed by a separate audio output device.

  According to the above, by obtaining the rotation direction with the line segment AB connecting the audio output devices, it can be determined whether the audio output devices are positioned on the left or right side with respect to the operator. The sound output device 420 is determined to be installed on the left side with respect to the operator because the rotation direction is negative from the above equation, and the sound output device 421 is determined to be in the operator because the rotation direction is positive from the above equation. On the other hand, it is judged that it is installed on the right side. As described above, audio data can be output to the operator at the correct sound image position.

The state II in FIG. 4 will be described below. In this state II, the direction of the sound output devices 420 and 421 in the state I is changed as the sound output devices 460 and 461, and each sound output device is directed toward the operator 451. It is. Here, the directions of the audio output devices 420 and 421 are 120 ° and 60 ° in angle with the X axis. Also, the coordinates where the audio output device is installed are A and B, respectively, and the line segments indicating the direction of the audio output device are AA ′ and BB ′. The coordinates of A, A ′, B and B ′ are respectively
(Ax, Ay) = (600, 550), (A′x, A′y) = (594, 542), (Bx, By) = x (1080, 550), (B′x, B′y) = (1088, 542). In the case of state II, the angle formed by the audio output devices 460 and 461 is calculated as 60 ° in step 383. In the case of state II, in step 384, the rotation direction of the audio output device 460 with respect to the line segment AB is calculated as follows based on the equation (1).
(594-600) * (550-550)-(542-550) * (1080-600)> 0. . . Formula (5)
As shown in the above formula (5), the rotation direction is determined to be the positive direction. Then, it is determined that the audio output device 460 is “installed on the right side with respect to the operator”. This is the reverse of the result of determination that the audio output device 420 is “installed on the left side with respect to the operator” in the state I. Similarly, the sound output device 461 determines that the rotation direction is the negative direction from the result of the equation (6) based on the equation (3). Then, it is determined that the audio output device 461 is “installed on the left side with respect to the operator”. This is the reverse of the determination result that the audio output device 421 is “installed on the right side with respect to the operator” in the state I.
(1088-1080) * (550-550)-(542-550) * (600-1080) <0. . . Formula (6)
From the above results, the data transmission control means 160 transmits the right channel audio data to the audio output device 460 and the left channel audio data to the audio output device 461.

  As described above, the audio output device 220 outputs the left channel in the state I (audio output device 420), and outputs the right channel in the state II (audio output device 460). The audio output device 221 outputs the right channel in state I (audio output device 421), and outputs the left channel in state II (audio output device 461). Therefore, according to this embodiment, even when the operator changes the direction of the speaker from the state I to the state II, stereo sound at an appropriate sound image position can be output.

[Modification]
Each embodiment described above is also realized by executing the following processing. That is, a process of supplying software (computer program) that realizes each process and function of the above-described embodiment to the system via a network or a storage medium, and the computer (or CPU or the like) of the system reads and executes the program. It is. The computer program and a computer-readable storage medium storing the computer program are also included in the scope of the present invention.

Claims (6)

Display control means for displaying content on the display means;
Position detecting means for detecting the position of the audio output device approaching the display means;
Selection means for selecting the content being displayed on the display means, approaching the audio output device;
Direction detecting means for detecting a direction in which the sound output device outputs sound;
Output sound control means for determining sound data to be output from the sound output device based on the position and direction of the sound output device;
A display control device comprising: data transmission control means for transmitting the determined audio data to the audio output device.   The display control apparatus according to claim 1, wherein an area determined to approach the audio output apparatus is displayed as an image on the display unit.   The display control apparatus according to claim 1, wherein the display unit is a table-type display.   A computer program that causes a computer to function as the display control apparatus according to claim 1 by being read and executed by a computer.   A computer-readable storage medium storing the computer program according to claim 4. A display control method for controlling a display device, comprising:
A display control step of displaying content on the display means by the display control means;
A position detecting step of detecting a position of the audio output device approaching the display means by a position detecting means;
A selection step of selecting the content being displayed on the display means, the selection means approaching the audio output device;
A direction detecting step of detecting a direction in which the sound output device outputs sound by a direction detecting means;
An output sound control step of determining sound data to be output from the sound output device based on the position and direction of the sound output device by the sound control means;
A display control method comprising: a data transmission control step of transmitting the determined audio data to the audio output device by data transmission control means.

Images