JP2013239767A - Head-mounted type information input/output device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a head-mounted type information input/output device capable of improving convenience.SOLUTION: A head-mounted type information input/output device includes: a display body 20 having a display unit for displaying an image, a signal processing unit for outputting a sound signal, and a transmission unit for transmitting a sound signal that has been output from the signal processing unit; and a head band 40 having a reception unit for receiving a sound signal transmitted from the transmission unit, a holder 42 for removably supporting the display body 20, and first bone conduction speakers 50, 51 arranged close to the head of a user and outputting sound on the basis of a sound signal received by the reception unit in a case where the display body 20 is supported by the holder 42.

Description

  The present invention relates to a head-mounted information input / output device.

  A head-mounted display (HMD) that displays video is disclosed in Patent Document 1.

JP 2008-60825 A

  However, the head-mounted information input / output device (head mounted display) is large in size because the headband and the device main body are integrated, and has a problem that it is inconvenient to carry and is not convenient. .

  The present invention has been made in view of the above points, and an object thereof is to provide a head-mounted information input / output device capable of improving convenience.

  The present invention has been made to solve the above problems, and transmits a display unit that displays an image, a signal processing unit that outputs an audio signal, and the audio signal output from the signal processing unit. An apparatus main body having a transmission section; a reception section that receives the audio signal transmitted from the transmission section; a support section that detachably supports the apparatus main body; and the support section supports the apparatus main body. A headband having a first speaker that is disposed in the vicinity of the user's head and that outputs a sound based on the sound signal received by the receiving unit. This is a part-mounted information input / output device.

  According to the present invention, the head-mounted information input / output device can improve convenience.

It is a perspective view of a head mount display in a 1st embodiment of the present invention. It is the perspective view which looked at the head mounted display in 1st Embodiment of this invention from the back side. It is a figure which shows the mounting form of the head mounted display in 1st Embodiment of this invention. It is a horizontal sectional view of a display main part in a 1st embodiment of the present invention. It is a perspective view of a headband in a 1st embodiment of the present invention. FIG. 3 is a vertical sectional view of the headband and the apparatus main body when the display main body is mounted on the right side of the user in the first embodiment of the present invention. It is a perspective view which shows the stereo earphone in 1st Embodiment of this invention. It is a functional block diagram which shows the structure of the head mounted display in 1st Embodiment of this invention. It is a functional block diagram which shows the structure of the headband in 1st Embodiment of this invention. It is a flowchart which shows the audio output destination switching process in 1st Embodiment of this invention. It is a functional block diagram which shows the structure of the headband in 2nd Embodiment of this invention. It is a flowchart which shows the communication process of a display main body and a headband in 2nd Embodiment of this invention.

[First Embodiment]
A first embodiment of the present invention will be described in detail with reference to the drawings. In the following description, an XYZ rectangular coordinate system is set as necessary, and the positional relationship of each part will be described with reference to the set XYZ rectangular coordinate system.

  Hereinafter, a predetermined direction in the horizontal plane is referred to as an X-axis direction, a direction orthogonal to the X-axis direction in the horizontal plane is referred to as a Y-axis direction, and a vertical direction orthogonal to the X-axis direction and the Y-axis direction is referred to as a Z-axis direction. . In addition, the rotation (inclination) directions around the X axis, Y axis, and Z axis are referred to as θX, θY, and θZ directions, respectively.

  FIG. 1 is a perspective view of a head-mounted display (head-mounted information input / output device, display device). In FIG. 1, the longitudinal direction of the display main body 20 is referred to as a Y-axis direction, and the direction in which the headband 40 holds the user's head is referred to as an X-axis direction.

First, the configuration of each part of the head mounted display 1 will be described.
The head mounted display 1 is a monocular head mounted display and is mounted on the user's head. The head mounted display 1 includes a display main body 20 and a headband 40 (mounting unit).

The headband 40 has a holder 42. The holder 42 detachably supports the display body 20.
The display main body 20 includes an apparatus main body portion 21 and a display portion 60. The apparatus main body 21 incorporates main circuits and has an operation unit and various interfaces.

  Hereinafter, the end portion (+ Y side end portion) supported by the holder 42 in the apparatus main body portion 21 is referred to as a base end portion, and the end portion opposite to the base end portion (end on the −Y side). Part) is referred to as the tip. In the state where the apparatus main body 21 is supported by the headband 40, the headband 40 side (+ X side) of the apparatus main body 21 is referred to as the inner side, and the opposite side (−X side) with respect to the headband 40 is referred to. Called the outside.

The display unit 60 is connected to the distal end portion of the apparatus main body unit 21.
The apparatus main body 21 has a substantially plate-shaped housing. A main switch 28, a touch switch 34, and a sound collecting microphone 24 are arranged along the longitudinal direction of the apparatus main body 21 on the outer surface of the casing of the apparatus main body 21.

  The main switch 28 is a switch for performing an on / off operation of the display main body 20. The touch switch 34 is a touch panel that can perform various operations of the head mounted display 1 when the user touches with a finger or the like. The sound collection microphone 24 is an external microphone that collects and collects environmental sounds.

  FIG. 2 is a perspective view of the head mounted display as viewed from the back side. In FIG. 2, the longitudinal direction of the display body 20 is referred to as a Y-axis direction, and the direction in which the headband 40 clamps the user's head is referred to as an X-axis direction.

The ear speaker 23 outputs sound. The ear speaker 23 is provided inside the base end portion of the apparatus main body 21. The ear speaker 23 is disposed in the vicinity of the user's ear when the display body 20 is supported by the holder 42.
The call microphone 37 is provided on the inner side of the distal end portion of the apparatus main body 21. The call microphone 37 collects the user's voice.

  The heart rate sensor 137 includes a light emitting unit and a light receiving unit. The light emitting unit of the heart rate sensor 137 is, for example, a light emitting diode. The light receiving unit of the heart rate sensor 137 detects light reflected inside the user's skin. The heart rate sensor 137 is provided at the center of the inner surface of the apparatus main body 21 and measures the user's heart rate by contacting the surface of the user's face. More specifically, the heart rate sensor 137 measures the user's heart rate by detecting a change in the amount of reflected light due to a change in the blood flow of the user's face.

  The heart rate sensor 137 may be disposed in the vicinity of the user's eye when the display body 20 is supported by the holder 42. Even in this case, the heart rate sensor 137 can count the user's heart rate without causing the user to feel glare by emitting light in the infrared region from the light emitting unit.

The USB connector 25 is provided on the side end surface of the base end portion of the apparatus main body 21. The USB connector 25 is a connection terminal of a USB (Universal Serial Bus) device.
The video connector 27 is a video input / output terminal. The video connector 27 is provided on the side end surface of the base end portion of the apparatus main body 21.

  The operation switch 30 (operation unit) is, for example, a pointing device such as a trackball and a stick. The operation switch 30 is provided at a position facing the side end surface of the base end portion of the apparatus main body 21, that is, the screen of the display unit 60. As a result, the left-right direction of the operation via the operation switch 30 matches the left-right direction of the screen of the display unit 60, so that the user can intuitively operate the operation switch 30 while looking at the screen.

  A first light emitting unit for performing optical communication is provided in the vicinity of the light guide plate 304. The light guide plate 304 relays optical communication between the first light emitting unit and the light receiving unit on the headband 40 side. The light guide plate 304 is provided on the base end side of the inner surface of the apparatus main body 21. A first light receiving unit may be further provided in the vicinity of the light guide plate 304. In this case, the headband 40 may include a light emitting unit that performs optical communication with the first light receiving unit.

  A second light emitting unit for performing optical communication is provided in the vicinity of the light guide plate 305. The light guide plate 305 relays optical communication between the second light emitting unit and the light receiving unit on the headband 40 side. The light guide plate 305 is provided on the base end side of the inner surface of the apparatus main body 21. A second light receiving unit may be further provided in the vicinity of the light guide plate 305. In this case, the headband 40 may include a light emitting unit that performs optical communication with the second light receiving unit.

  The headband 40 can attach the display main body 20 supported by the holder 42 to the user's head. In addition, the user can use the display main body 20 that is not supported by the holder 42 even when the display main body 20 is held in the hand. That is, the user can carry the display body 20 in a small and light state by removing the display body 20 from the headband 40 as necessary.

  The headband 40 includes a head pad (mounting member) 46, a head pad (mounting member) 47, a first headband 43, a second headband 44, a rotation mechanism 56, and a rotation mechanism 57. .

  The headband 40 can hold the user's head. Accordingly, the first bone conduction speaker 50 and the second bone conduction speaker 51 are in contact with and pressed against the “left and right temple portions” of the user, respectively. This contact position is a preferable position for the user in transmitting sound by bone conduction.

  The first headband 43 is an elastic member having an arc shape as a whole. A joint portion 43 a for bending the first headband 43 is provided on the top of the first headband 43. Further, a bearing portion 43 b constituting the rotation mechanism 56 is provided at one end of the first headband 43. The other end of the first headband 43 is provided with a bearing portion 43 c that constitutes a rotation mechanism 57.

  A bearing portion 43d to which the head pad 46 is connected is provided further on the front end side of the band than the bearing portion 43b. Further, a bearing portion 43e to which the head pad 47 is connected is provided further on the band tip side than the bearing portion 43c.

  The second headband 44 is an elastic member having an arc shape as a whole. A joint portion 44 a for bending the second headband 44 is provided on the top of the second headband 44. In addition, a shaft member 44 b constituting the rotation mechanism 56 is provided at one end of the second headband 44. A shaft member 44 c that constitutes a rotation mechanism 57 is provided at the other end of the second headband 44.

  The second headband 44 has a configuration in which the surface of a spring member 48 made of a metal such as stainless steel is covered with a flexible material such as a resin. The spring force for clamping the user's head is generated by the spring member 48 of the second headband 44. Further, the second headband 44 is formed with a wider width than the first headband 43. Thereby, the formation part of the joint part 44a has the mark display part 49 formed wider than other band parts. A mark or a printed product tag is attached to the mark display section 49. The entire second headband 44 may be made of metal.

  The head pad 46 includes a plate-like support plate 46a and an elastic member 46b. The elastic member 46b is provided on one surface side of the support plate 46a, and is formed of an elastic member having an arcuate cross section and relatively high hardness. A head pad 46 is provided at one end of the headband 40. The head pad 46 incorporates the first bone conduction speaker 50. On the other hand, a head pad 47 is provided at the other end of the headband 40. The head pad 47 incorporates the second bone conduction speaker 51.

  FIG. 3 is a diagram illustrating a mounting form of the head mounted display. The display main body 20 is attached to the user's head by the headband 40. Since the holder 42 can support the display body 20 even if the orientation of the display body 20 is reversed, the head mounted display 1 can be used regardless of whether the display body 20 is mounted on the left or right side of the user's head. is there. Here, the display main body 20 can adjust the wearing state according to the condition of the user's eyes, the shape of the face, and the like.

  FIG. 3A shows a state where the user is viewing the display unit 60 with the right eye (right eye). On the other hand, FIG. 3B shows a state where the user is viewing the display unit 60 with the left eye (left eye). The orientation of the device main body 21 supported by the holder 42 is reversed between the state where the user is viewing the display unit 60 with the right eye and the state where the user is viewing the display unit 60 with the left eye.

  In addition, in comparison with the state shown in FIG. 3A, in FIG. 3B, the support position of the holder 42 is located closer to the base end side of the display body 20. That is, in FIG. 3B, the display main body 20 is displaced forward of the user's face as compared to the state shown in FIG.

  FIG. 4 is a horizontal sectional view of the display body 20. In FIG. 4, the headband 40 side of the display unit 60 is referred to as an inner side, and the side opposite to the headband 40 is referred to as an outer side. The apparatus body 21 incorporates a plate-like circuit board 29 extending along the longitudinal direction of the housing 21 </ b> A and a battery 33. In addition, a control circuit (not shown), a power supply circuit and the like (not shown) are mounted on the circuit board 29. Moreover, each part of the display main body 20 is electrically connected via wiring (not shown).

  The touch switch 34 is disposed so as to be exposed on the outer surface of the apparatus main body 21. Further, a display panel 36 and a backlight 35 are disposed inside the touch switch 34. In the present embodiment, the image displayed on the display panel 36 is displayed through the touch switch 34. The display panel 36 and the backlight 35 are, for example, a liquid crystal panel, an organic EL (Electro Luminescence) panel, or an electrophoresis panel.

  The heart rate sensor 137 is provided so as to protrude from the inner surface of the apparatus main body 21. Thereby, the heart rate sensor 137 can contact the surface of the user's face when the head mounted display 1 is worn. The battery 33 may be either a primary battery or a secondary battery.

  The display unit 60 is connected to the distal end portion of the apparatus main body unit 21. The display unit 60 is an arm member having a curved shape in a top view (Z-axis view), and has a shape that curves inward as it goes from the connecting portion with the apparatus main body 21 toward the distal end side. A finder opening 67 is provided on the inner surface of the display unit 60. A camera 64 is provided on the outer surface of the display unit 60.

  The display unit 60 is connected to the apparatus main body unit 21 via a display hinge 61. The display hinge 61 is a ball joint composed of a concave curved housing 61a formed in the housing 60A of the display 60 and a spherical portion 61b formed in the apparatus main body 21 and fitted in the housing 61a. .

  The spherical portion 61 b of the display hinge 61 is provided on an inclined surface formed at the distal end portion of the outer surface of the apparatus main body portion 21. Here, the spherical portion 61b of the display hinge 61 is provided so as to protrude in the normal direction (Y′-axis direction) of the inclined surface extending obliquely with respect to the longitudinal direction of the housing 21A. Accordingly, the display unit 60 can freely rotate around the Y ′ axis with respect to the spherical portion 61 b of the display hinge 61.

  The spherical portion 61b of the display hinge 61 is formed with a through hole 61c that penetrates the spherical portion 61b in the height direction (Y′-axis direction). The inside of the display part 60 and the inside of the apparatus main body part 21 are connected via the through-hole 61c. A cable (not shown) is inserted through the through hole 61c. The circuit board 29 and each part of the display unit 60 are electrically connected via the inserted cable.

  With this configuration, each part of the display unit 60 is disposed in the vicinity of the circuit board 29. This eliminates the need to provide the display unit 60 with a mechanism that allows the position of the display unit to be adjusted in the Y direction (see FIG. 2). Further, in the display unit 60, the video signal cable is not routed for a long time. Therefore, the display unit 60 can suppress the possibility that noise is mixed in the video signal and the possibility that unnecessary radiation is emitted.

  The display unit 60 includes a backlight 62, a display panel 63, a camera 64, a prism 65, a reflection mirror 66, a front light 68, a front speaker 70, an imaging lens 71, and an image sensor 72. .

  The prism 65 has a configuration in which a first prism 65a having a substantially triangular shape in a top view (Z-axis view) and a second prism 65b having a substantially triangular shape in a top view (Z-axis view) are bonded to each other. Have. The display panel 63 is provided at a position facing one of the two surfaces not bonded to each other in the first prism 65a. The display panel 63 is, for example, a liquid crystal panel. In addition, a backlight 62 for transmitting and illuminating the display panel 63 is disposed on the back surface of the display panel 63. A reflection mirror 66 is disposed at a position facing the other surface of the first prism 65a that is not bonded. Here, the reflection mirror 66 is arranged at a position substantially in front of the finder opening 67.

  Of the two surfaces that are not bonded to each other in the second prism 65 b, one surface is a finder eyepiece surface of the finder opening 67. In addition, the imaging lens 71 and the imaging element 72 are arranged to face each other at a position facing the other surface not bonded to the second prism 65b.

  In the display unit 60, the optical image displayed on the display panel 63 is emitted from the viewfinder opening 67 through the first prism 65a, the reflection mirror 66, and the second prism 65b, so that the user Observed.

  The image sensor 72 images the eye of the user who is looking at the display panel 63 through the finder opening 67 through the second prism 65 b and the imaging lens 71. The captured image of the eye is used when analyzing the user's line-of-sight direction, eye blink, and facial expression. That is, the imaging element 72 functions as an imaging unit that images the user's eyes. Here, the backlight 62 is also used as an illuminating device for illuminating the eyes of the user when the image sensor 72 images the eyes of the user.

  The camera 64 (imaging unit) has, for example, an image sensor with 5 to 10 million pixels and can perform an autofocus operation. The imaging direction of the camera 64 is set so as to coincide with the user's line-of-sight direction. Thereby, the camera 64 can capture an image in the line of sight of the user wearing the head mounted display 1.

  Here, the matching adjustment between the imaging direction of the camera 64 and the user's line-of-sight direction may be performed mechanically or may be performed by image processing. For example, the image of the user's line-of-sight direction may be extracted from the image captured by the camera 64 by acquiring information on the user's line-of-sight direction from an image obtained by wide-angle imaging of the user's eyes. Thereby, the display panel 63 can display the extracted video. That is, the image in the user's line-of-sight direction can be captured and displayed without providing the camera 64 with an adjustment mechanism.

  The front light 68 is, for example, an LED (Light Emitting Diode) light. The front light 68 has light emitting elements of red, green, and blue, and can emit any color at any timing. For example, the front light 68 is used as a device that displays information to the outside based on the emission color and the emission timing. For example, the front light 68 may be used as a lighting device when the camera 64 captures an image.

FIG. 5 is a perspective view of the headband. The arc height r1 of the first headband 43 is lower than the arc height r2 of the second headband 44. As a result, even if the first headband 43 and the second headband 44 are moved so as to cross each other, the first headband 43 and the second headband 44 do not interfere with each other, and the position of the front and back is related. Will be replaced.
The holder 42 includes a detection switch 405, an upper light receiving unit 401, and a lower light receiving unit 402.

Hereinafter, the right side for the user is referred to as “the right side of the user”. The left side for the user is referred to as “the left side of the user”.
FIG. 6 is a vertical sectional view of the headband and the apparatus main body when the display main body is mounted on the right side of the user.

  The right audio LED 301 is an LED for outputting a right channel audio signal from the apparatus main body 21 by optical communication. A light guide plate 304 is provided outside the right audio LED 301. The left audio LED 302 is an LED for outputting a left channel audio signal from the apparatus main body 21 by optical communication. A light guide plate 305 is provided outside the left audio LED 302.

  The light guide plate 304 and the light guide plate 305 are configured along the longitudinal direction of the apparatus main body 21. The light guide plates 304 and 305 are arranged vertically symmetrically with respect to the center line O of the apparatus main body 21.

  With this configuration, even when the position at which the holder 42 supports the apparatus main body 21 is adjusted in the Y-axis direction (see FIG. 1) so that the relative distance between the user's eyes and the display unit 60 is optimal. The first bone conduction speaker 50 and the second bone conduction speaker 51 abut on a position preferable for the user (for example, the position of the temple). Even if the LED 301 and the upper light receiving unit 401 are not facing each other, one audio signal of the left and right channels is transmitted from the LED 301 to the upper light receiving unit 401 via the light guide plate 304. Even if the LED 302 and the upper light receiving unit 402 are not facing each other, the other audio signal of the left and right channels is transmitted from the LED 302 to the upper light receiving unit 402 via the light guide plate 305. In this way, the head mounted display 1 can clearly transmit images and sounds to the user. Details of the transmission of the audio signal will be described later with reference to FIG.

  A pin 41 is erected on the surface of the support plate 46a opposite to the elastic member 46b in a posture perpendicular to the surface. The pin 41 is fitted to one end of the first headband 43. The support plate 46 a and the elastic member 46 b of the head pad 46 are disposed at one end of the first head band 43.

  The accommodating portion 42a provided in the holder 42 and the spherical portion 41a provided at one end of the pin 41 are fitted to each other to constitute a so-called ball joint. Thereby, the holder 42 is rotatable with respect to the headband 40 around the spherical portion 41a.

  Here, the holder 42 is 45 degrees upward and downward by a rotation limiting mechanism (not shown) from the state in which the apparatus main body 21 is disposed substantially horizontally and the first headband 43 is disposed in a substantially vertical direction. It can be rotated in the A direction (see FIG. 1).

  The holder 42 supports the apparatus main body 21 so that the distance between the user's eyes and the display unit 60 (see FIG. 3) is optimal. Here, the height and width of the apparatus main body 21 are uniform in the vicinity of the light guide plate 304. Thereby, the holder 42 can support the apparatus main body 21 reliably by slightly deforming the claw 42b.

  Inside the holder 42, an upper light receiving portion 401 and a lower light receiving portion 402 are provided vertically symmetrically with respect to the center line O of the holder 42. A detection switch 405 is also provided inside the holder 42. The detection switch 405 detects whether or not the device main body 21 is supported by the holder 42, that is, whether the display main body 20 (device main body 21) is attached or detached.

  The upper light receiving unit 401, the lower light receiving unit 402, and the detection switch 405 are disposed on the substrate 406. The signal output from the detection switch 405 is output to the substrate 412 in the head pad 46 via the cable 415 passing through the through hole 41 b provided in the pin 41. The same applies to the signals output from the upper light receiving unit 401 and the lower light receiving unit 402, respectively.

  Inside the head pad 46, a control circuit (not shown), a battery 414, and an audio connector 413 are provided. This control circuit is provided on the substrate 412. The support plate 46a is provided with a permanent magnet 411 such as neodymium. A coil 410 is loosely fitted around the permanent magnet 411. The coil 410 is provided with a diaphragm 416.

The battery 414 may be a primary battery or a secondary battery. Further, the battery 414 may be replaceable.
A stereo earphone can be connected to the audio connector 413.

  The first bone conduction speaker 50 includes a permanent magnet 411, a coil 410, and a diaphragm 416. The first bone conduction speaker 50 contacts the user's head and transmits sound to the eardrum through the skin and bone.

  The first bone conduction speaker 50 and the substrate 412 are electrically connected via a cable (not shown). For example, the first bone conduction speaker 50 vibrates when an audio signal received by optical communication by the upper light receiving unit 401 is transmitted to the first bone conduction speaker 50 via the substrate 412. Further, the second bone conduction speaker 51 (see FIG. 2) provided on the opposite side to the first bone conduction speaker 50 is configured such that the audio signal received by the lower light receiving unit 402 by optical communication is the second bone. It vibrates by being transmitted through a substrate (not shown) in the conductive speaker 51.

  FIG. 7 is a perspective view showing a stereo earphone. The stereo earphone 100 includes a connector 101, a cable 102, a first speaker 103, a second speaker 104, and a plurality of clips 106.

  The connector 101 is provided at one end of the cable 102. The connector 101 is, for example, a three-pole φ3.5 mm mini plug. Here, the breakdown of the three poles is the first speaker 103, the second speaker 104, and the ground (GND). The cable 102 is bifurcated in the vicinity of the connector 101. A first speaker 103 is provided at one end of the cable 102. A second speaker 104 is provided at the other end of the cable 102. Further, the plurality of clips 106 are arranged on the cable 102 at a predetermined interval.

  The first speaker 103 is attached to the ear of the user on the side where the display body 20 is disposed. On the other hand, the second speaker 104 is attached to the ear on the opposite side to the first speaker 103. Here, the cable 102 may be fixed to the second headband 44 by the clip 106.

  FIG. 8 is a functional block diagram of the head mounted display. The head mounted display 1 includes a backlight 62, a display panel 63, a camera 64, an image sensor 72, a decoder 121, a flash memory 122, a processing unit 123, an LCD driver 125, a BL driver 126, and a memory. 127, encoder 129, main switch 28, operation switch 30, headband sensor 151, vibrator 164, touch switch 34, right audio LED 301, left audio LED 302, backlight 35, and battery 33. The power circuit 120, the display panel 36, the ear speaker 23, the speaker amplifier 162, the front speaker 70, the video connector 27, the sound collecting microphone 24, the call microphone 37, the laser oscillator 73, and the angular velocity sensor 134. And GP Sensor 135, temperature / humidity sensor 136, heart rate sensor 137, 3G / LTE communication circuit 138, front light 68, geomagnetic sensor 133, acceleration sensor 132, WiFi communication circuit 131, and BT communication circuit 130 Is provided.

The battery 33 supplies power to each part of the head mounted display 1 via the power supply circuit 120.
The power supply circuit 120 executes control of power supplied from the battery 33 (for example, voltage conversion, supply on / off) based on a control signal supplied from the processing unit 123.

The memory 127 stores a control program executed by the processing unit 123 in advance.
The main switch 28 is a switch for turning on and off the power supply of the entire apparatus, and supplies a control signal based on the operation to the processing unit 123 when operated by a user.
The operation switch 30 is a switch for performing a pointing operation on the screen, and supplies a control signal based on the operation to the processing unit 123 when operated by a user.
The touch switch 34 is a switch for performing various operation inputs by a touch operation, and supplies a control signal based on the operation input to the processing unit 123.

  The display body 20 can be operated by an operation input via the main switch 28, the operation switch 30, and the touch switch 34 regardless of whether the display body 20 is mounted on the right side or the left side of the user.

  The acceleration sensor 132 (G sensor) detects acceleration (for example, the direction of gravity), and supplies the detected acceleration information (hereinafter referred to as “acceleration information”) to the processing unit 123. The supplied acceleration information is used to detect the posture (tilt) of the head mounted display 1.

  The geomagnetic sensor 133 detects azimuth information based on geomagnetism, and supplies the detected azimuth information to the processing unit 123. The detected orientation information is used to detect the orientation in which the head mounted display 1 is facing.

The angular velocity sensor 134 (gyro sensor) detects the angular velocity and supplies the detected angular velocity to the processing unit 123. The detected angular velocity is used for detecting the rotation of the head mounted display 1.
The GPS sensor 135 measures the latitude, longitude, and altitude of the head mounted display 1 by positioning using GPS, and supplies the measured latitude, longitude, and altitude to the processing unit 123.

The temperature / humidity sensor 136 detects the temperature and humidity of the environment. The temperature / humidity sensor 136 supplies the detected temperature and humidity of the environment to the processing unit 123.
The laser oscillator 73 irradiates a target (object) corresponding to a predetermined position in the image displayed on the display panel 63 with laser light (spot light).

  The heart rate sensor 137 contacts the user's cheek to detect the heart rate, and supplies the detected user's heart rate to the processing unit 123. Thereby, the heart rate sensor 137 can detect whether or not the head mounted display 1 is worn by the user, that is, whether or not the display main body 20 is disposed in the vicinity of the user's head.

  The headband sensor 151 detects that the display body 20 is supported by the holder 42, and outputs a signal indicating whether or not the display body 20 is supported by the holder 42 to the processing unit 123.

  The camera 64 (imaging unit) executes an autofocus operation and an imaging process. The camera 64 includes an optical system and an image sensor. The optical system of the camera 64 includes a lens group. The lens group of the optical system forms a subject image (optical image) on the light receiving surface of the image sensor of the camera 64. The lens of the optical system of the camera 64 is driven based on a control signal supplied from the processing unit 123 during the autofocus operation.

  The imaging device of the camera 64 is an imaging device such as a CCD image sensor (Charge Coupled Device Image Sensor). The imaging element of the camera 64 converts the subject image (optical image) formed on the light receiving surface into an electrical signal by imaging processing, further converts it into image data, and outputs it to the encoder 129.

  The camera 64 has a relatively deep depth of field, and can capture a range from close to infinity by so-called pan focus. Thereby, even when the camera 64 is focused on the subject image of a subject located at infinity, the camera 64 can focus on the image of the user's hand that is in the vicinity and detect the user's hand. .

  The image sensor 72 converts a subject image (optical image) formed on the light receiving surface thereof into an electrical signal by an imaging process, further converts it into image data, and outputs the image data to the encoder 129.

  Connected to the encoder 129 are a camera 64, an image sensor 72, a sound collection microphone 24, a call microphone 37, and a video connector 27. The encoder 129 encodes each audio signal input from the sound collection microphone 24 and the call microphone 37 into audio data of a predetermined audio system. That is, the encoder 129 encodes the audio signals input from the sound collection microphone 24 and the call microphone 37 and supplies the encoded audio signals to the processing unit 123.

  The encoder 129 encodes each video signal input from the camera 64, the image sensor 72, and the video connector 27 into video data of a predetermined video format. That is, the encoder 129 encodes video (image) signals input from the camera 64, the image sensor 72 that captures the user's eyes, and the video connector 27, and supplies the encoded video (image) signals to the processing unit 123. To do.

  The processing unit 123 is, for example, a CPU (Central Processing Unit). The processing unit 123 is connected to various circuits (functional blocks) of the head mounted display 1 and comprehensively controls the head mounted display 1. The processing unit 123 can operate based on the operation input received by the operation switch 30.

  The processing unit 123 stores the audio data supplied from the sound collection microphone 24 and the call microphone 37 via the encoder 129 in the flash memory 122. Further, the processing unit 123 converts the audio data supplied from the sound collection microphone 24 and the call microphone 37 via the encoder 129 into at least one of the BT communication circuit 130, the WiFi communication circuit 131, and the 3G / LTE communication circuit 138. To other devices (not shown). Further, the processing unit 123 converts the audio data stored in the flash memory 122 into another device (not shown) via at least one of the BT communication circuit 130, the WiFi communication circuit 131, and the 3G / LTE communication circuit 138. May be sent to.

  In addition, the processing unit 123 stores video (image) data supplied from at least one of the camera 64, the image sensor 72, and the video connector 27 via the encoder 129 in the flash memory 122. The processing unit 123 also displays video (image) data supplied from at least one of the camera 64, the imaging device 72, and the video connector 27 via the encoder 129 via the decoder 121 and the LCD driver 125. It is displayed on the panel 36 and the display panel 63. In addition, the processing unit 123 displays the video (image) data stored in the flash memory 122 on the display panel 36 and the display panel 63 via the decoder 121 and the LCD driver 125.

  In addition, the processing unit 123 supplies the video signal output from the decoder 121 to at least one of the display panel 36 and the display panel 63 via the LCD driver 125. Thereby, the video data is reproduced. That is, the video based on the input video signal is displayed on the display panel 36 and the display panel 63. In addition, the processing unit 123 causes the video signal output from the decoder 121 to be output to an external device (not shown) via the video connector 27.

  In addition, the processing unit 123 converts video (image) data supplied from at least one of the camera 64, the image sensor 72, and the video connector 27 via the encoder 129 into a BT communication circuit 130, a WiFi communication circuit 131, and The data is transmitted to another device (not shown) via at least one of the 3G / LTE communication circuit 138.

  In addition, the processing unit 123 causes the display panel 36 to display an image by turning on the backlight 35 for the display panel 36 as necessary. Here, the processing unit 123 supplies the control signal to the BL driver 126 to cause the BL driver 126 to turn on the backlight 35.

  The processing unit 123 causes the display panel 63 to display an image by turning on the backlight 62 for the display panel 63 as necessary. Here, the processing unit 123 supplies a control signal to the BL driver 126 to cause the BL driver 126 to turn on the backlight 62.

  In addition, a signal indicating whether or not the display main body 20 is supported by the holder 42 is input from the headband sensor 151 to the processing unit 123. When the display body 20 is supported by the holder 42, the processing unit 123 stops the sound output from the ear speaker 23 and causes the right sound LED 301 and the left sound LED 302 to perform optical communication.

  Vibrator 164 vibrates based on a control signal supplied from processing unit 123 when an incoming call is received in a state set to a so-called manner mode. Thereby, even when the manner mode is set, the user is notified of an incoming call.

  Connected to the decoder 121 are an LCD driver 125, a speaker amplifier 162, a right audio LED 301, a left audio LED 302, and a video connector 27. The decoder 121 decodes the audio data into an audio signal, and supplies the decoded audio signal to the speaker amplifier 162 or the right audio LED 301 and the left audio LED 302. The decoder 121 decodes video (image) data into a video (image) signal, and supplies the decoded video signal to the LCD driver 125 or the video connector 27.

The right audio LED 301 performs optical communication based on the right channel audio signal supplied from the decoder 121.
The left audio LED 302 performs optical communication based on the left channel audio signal supplied from the decoder 121.

  The LCD driver 125 is a circuit that generates a driving signal for a liquid crystal panel, for example, and is connected to the display panel 36 and the display panel 63. The LCD driver 125 generates a drive signal for the liquid crystal panel based on the video (image) signal supplied from the processing unit 123 via the decoder 121, and displays the generated drive signal for the liquid crystal panel on the display panel 36 or This is supplied to the display panel 63.

  The display panel 63 (display unit) is, for example, a liquid crystal display panel, and displays a video (image) based on a drive signal supplied from the LCD driver 125. The display panel 63 displays, for example, an image captured by the camera 64 and a menu screen.

  The BL driver 126 is a circuit that generates a drive signal for backlight, for example, and is connected to the backlight 35 and the backlight 62. The BL driver 126 generates a backlight drive signal based on the control signal supplied from the processing unit 123, and supplies the generated backlight drive signal to the backlight 35 and the backlight 62.

  The speaker amplifier 162 amplifies the audio signal supplied via the decoder 121 and supplies the amplified audio signal to the ear speaker 23 and the front speaker 70. Here, the speaker amplifier 162 synthesizes the left and right audio signals supplied via the decoder 121, and supplies a monaural audio signal as a result of the synthesis to the ear speaker 23 and the front speaker 70.

The ear speaker 23 outputs monaural sound in which left and right sound signals are synthesized.
The front speaker 70 outputs monaural sound in which left and right audio signals are synthesized.

The BT communication circuit 130 is a communication circuit for performing Bluetooth (registered trademark) communication with other devices.
The WiFi communication circuit 131 is a communication circuit for performing wireless LAN communication (IEEE 802.11) with other devices.
The 3G / LTE communication circuit 138 is a communication circuit for performing mobile communication with other devices.
The BT communication circuit 130, the WiFi communication circuit 131, and the 3G / LTE communication circuit 138 execute transmission / reception of information such as audio data and video (image) data with other devices.

  FIG. 9 is a functional block diagram showing the configuration of the headband. The headband 40 includes a processing unit 418a, an upper light receiving unit 401, a lower light receiving unit 402, a detection switch 405, a power control unit 419, an audio connector 413, a first bone conduction speaker 50, and a second bone conduction. A speaker 51 and a battery 414 are provided.

  The detection switch 405 detects whether or not the apparatus main body 21 (see FIG. 6) is supported by the holder 42 (see FIG. 6). The detection switch 405 outputs a signal indicating whether or not the apparatus main body 21 is supported by the holder 42 to the power control unit 419.

The battery 414 supplies power to the power supply control unit 419.
A signal indicating whether or not the apparatus main body 21 is supported by the holder 42 is input from the detection switch 405 to the power control unit 419. When the apparatus main body 21 is supported by the holder 42, the power control unit 419 supplies power from the battery 414 to each unit such as the processing unit 418a.

  The upper light receiving unit 401 outputs an audio signal received by optical communication to the processing unit 418a. Further, the lower light receiving unit 402 outputs an audio signal received by optical communication to the processing unit 418a.

  When the display main body 20 is mounted on the right side of the user, the upper light receiving unit 401 receives light emitted from the right audio LED 301 through the light guide plate 304 (see FIG. 6). On the other hand, the lower light receiving unit 402 receives light emitted from the left audio LED 302 through the light guide plate 305 (see FIG. 6).

  When the display main body 20 is mounted on the left side of the user, the display main body 20 is supported by the holder 42 in a state in which the orientation is reversed with respect to the case where the display main body 20 is mounted on the user right side. Therefore, the lower light receiving unit 402 receives light emitted from the right audio LED 301 through the light guide plate 304. On the other hand, the upper light receiving unit 401 receives light emitted from the left audio LED 302 through the light guide plate 305.

  Since the light guide plate 304 and the light guide plate 305 are arranged along the longitudinal direction of the device main body 21 (see FIG. 2), the position where the holder 42 supports the device main body 21 is Even when the main body 21 is displaced in the longitudinal direction, the optical communication is reliably performed. In optical communication, there is no worry about unnecessary radiation. In addition, since it is sufficient that the audio signal can be transmitted and received at a frequency of about 4 [kHz] at the maximum, the load on the circuit is small.

  The processing unit 418a operates with power supplied from the power supply control unit 419. The processing unit 418a may be any of a processor that executes software processing, a digital circuit (hardware) that executes digital processing, or an analog circuit (hardware) that executes analog processing. In the present embodiment, the processing unit 418a is described as an analog circuit as an example.

  When the display main body 20 is mounted on the right side of the user, the right channel audio signal is received by the upper light receiving unit 401. The processing unit 418a outputs the right channel audio signal input from the upper light receiving unit 401 to the first bone conduction speaker 50 (see FIG. 2). The audio signal of the left channel is received by the lower light receiving unit 402. The processing unit 418a outputs the audio signal of the left channel input from the lower light receiving unit 402 to the second bone conduction speaker 51 (see FIG. 2).

  In this way, the right channel sound is output from the first bone conduction speaker 50 mounted on the right side of the user. In addition, the left channel sound is output from the second bone conduction speaker 51 mounted on the left side of the user.

  On the other hand, when the display body 20 is mounted on the left side of the user, the left channel audio signal is received by the upper light receiving unit 401. The processing unit 418 a outputs the left channel audio signal input from the upper light receiving unit 401 to the first bone conduction speaker 50. The right channel audio signal is received by the lower light receiving unit 402. The processing unit 418 a outputs the right channel audio signal input from the lower light receiving unit 402 to the second bone conduction speaker 51.

  In this way, the left channel sound is output from the first bone conduction speaker 50 mounted on the left side of the user. Also, the right channel sound is output from the second bone conduction speaker 51 mounted on the right side of the user.

Next, the operation of the headband when the stereo earphone 100 is connected to the audio connector 413 (see FIGS. 6 and 9) will be described.
The processing unit 418a detects whether or not the stereo earphone 100 is connected to the audio connector 413 by detecting the electrical resistance value of the audio connector 413. When the stereo earphone 100 is connected to the audio connector 413, the processing unit 418a switches the audio output destination.

  Specifically, when the stereo earphone 100 is connected to the audio connector 413, the processing unit 418a stops the sound output from the first bone conduction speaker 50 and the sound output from the second bone conduction speaker 51, Audio output from the stereo earphone 100 is started.

  Here, when the stereo earphone 100 is connected to the audio connector 413, the sound whose output from the first bone conduction speaker 50 is stopped is attached to the ear of the user on the side where the display body 20 is disposed. Output from the speaker 103 (see FIG. 7). On the other hand, when the stereo earphone 100 is connected to the audio connector 413, the sound whose output from the second bone conduction speaker 51 is stopped is attached to the user's ear on the side where the display body 20 is not disposed. Output from the speaker 104 (see FIG. 7). Therefore, the left-right relationship between the right channel sound and the left channel sound that can be heard by the user does not collapse before and after the stereo earphone 100 is connected.

  The display main body 20 (device main body portion 21) can be used without being supported by the headband 40. For example, the user can use the display main body 20 while holding it by hand. In this case, monaural sound is output from the ear speaker 23.

  The audio output destination switching processing is performed, for example, when the display main body 20 is carried in a user's pocket or the like and when the display main body 20 is not supported by the headband 40 but the head. This is executed depending on whether the display body 20 is used in a state where the display main body 20 is supported by the headband 40.

FIG. 10 is a flowchart showing the audio output destination switching process. In FIG. 10, the case where the head mounted display 1 performs a telephone call process as a telephone is demonstrated.
(Step S1) The processing unit 418a (see FIG. 9) determines whether there is an incoming call to the head mounted display 1. When there is no incoming call (step S1: No), the processing unit 418a returns the process to step S1. On the other hand, when there is an incoming call (step S1: Yes), the processing unit 418a advances the process to step S2.

  (Step S2) The processing unit 123 (see FIG. 8) determines whether or not the display main body 20 is supported by the headband 40 (holder 42). Here, the processing unit 123 receives a signal indicating whether or not the display main body 20 is supported by the holder 42 from the headband sensor 151 (see FIG. 8), so that the display main body 20 is supported by the holder 42. It is determined whether or not it has been done.

  In addition, the communication part for the process part 123 of the display main body 20 and the process part 418a (refer FIG. 9) of the headband 40 to communicate may be provided separately. The processing unit 418a receives a signal output from the detection switch 405 (see FIG. 6), that is, information indicating whether or not the apparatus body 21 is supported by the holder 42 via the communication unit. You may communicate with.

  When the display body 20 is supported by the headband 40 (step S2: Yes), the processing unit 418a advances the process to step S3. On the other hand, when the display body 20 is not supported by the headband 40 (step S2: No), the processing unit 123 advances the process to step S4.

  (Step S3) The processing unit 418a outputs ringtones from the first bone conduction speaker 50 and the second bone conduction speaker 51, and proceeds to step S9.

  (Step S4) The processing unit 123 determines whether or not the display main body 20 is arranged in the vicinity of the user's head. Here, the processing unit 123 determines that the display main body 20 is disposed in the vicinity of the user's head when the heart rate sensor 137 (see FIG. 2) counts the user's heart rate. Further, for example, when the imaging device 72 (see FIG. 4) is photographing the user's eyes, the processing unit 123 may determine that the display main body 20 is disposed in the vicinity of the user's head. .

  In addition, as a case where the display main body 20 is not supported by the holder 42 and the display main body 20 is disposed in the vicinity of the user's head, for example, a head protector (helmet) without a speaker For example, it is assumed that the display main body 20 is attached.

  When the display main body 20 is disposed in the vicinity of the user's head (step S4: Yes), the processing unit 123 advances the processing to step S5. On the other hand, when the display main body 20 is not disposed in the vicinity of the user's head (step S4: No), the processing unit 123 proceeds with the process to step S6.

  (Step S5) The processing unit 123 outputs a ringtone from the ear speaker 23 at a low sound pressure, and proceeds to step S9.

  (Step S6) The processing unit 123 determines whether or not the display main body 20 is set to the manner mode. When the display main body 20 is set to the manner mode (step S6: Yes), the processing unit 123 proceeds with the process to step S7. On the other hand, when the display main body 20 is not set to the manner mode (step S6: No), the processing unit 123 advances the process to step S8.

  (Step S7) The processing unit 123 vibrates the vibrator 164 by the control signal, and advances the process to step S9.

  (Step S8) The processing unit 123 outputs a ringtone from the front speaker 70 (see FIG. 4) at a high sound pressure.

  (Step S9) The processing unit 123 determines whether or not an instruction to start a call process has been received, that is, whether or not a call has been started by the user. Here, for example, an instruction to start the call processing is input from the touch switch 34 (see FIG. 1). When the call has not started (step S9: No), the processing unit 123 returns the process to step S2. On the other hand, when the telephone call is started (step S9: Yes), the processing unit 123 advances the process to step S10.

  (Step S10) The processing unit 123 (see FIG. 8) determines whether or not the display main body 20 is supported by the headband 40 (holder 42). Here, the processing unit 123 receives a signal indicating whether or not the display main body 20 is supported by the holder 42 from the headband sensor 151 (see FIG. 8), so that the display main body 20 is supported by the holder 42. It is determined whether or not it has been done.

  When the display body 20 is supported by the headband 40 (step S10: Yes), the processing unit 418a advances the process to step S11. On the other hand, when the display body 20 is not supported by the headband 40 (step S10: No), the processing unit 123 advances the processing to step S12.

  (Step S11) The processing unit 418a causes the first bone conduction speaker 50 and the second bone conduction speaker 51 to output voice from the other party, and proceeds to step S13.

  (Step S12) The processing unit 123 causes the voice from the other party to be output from the ear speaker 23 at a low sound pressure, and the process proceeds to step S13.

  (Step S13) The processing unit 123 determines whether or not an instruction to end the call process has been received, that is, whether or not the user has ended the call. Here, for example, an instruction to end the call processing is input from the touch switch 34 (see FIG. 1). If the call has not ended (step S13: No), the processing unit 123 returns the process to step S10. On the other hand, when the call is ended (step S13: Yes), the processing unit 123 ends the process.

As described above, the head-mounted information input / output device (head-mounted display 1) transmits the display panel 63 that displays an image, the decoder 121 that outputs an audio signal, and the audio signal output from the decoder 121. The display main body 20 having the right audio LED 301 and the left audio LED 302, the upper light receiving unit 401 and the lower light receiving unit 402 for receiving the audio signals transmitted from the right audio LED 301 and the left audio LED 302, and the display main body 20 are attached and detached. When the display main body 20 is supported by the holder 42 supported by the holder 42 and the holder 42, it is arranged in the vicinity of the user's head and based on the audio signal received by the upper light receiving unit 401 and the lower light receiving unit 402. A first bone conduction speaker 50 and a second bone conduction speaker 51 for outputting sound; Includes a headband 40 that, a.
With this configuration, the holder 42 detachably supports the display body 20. Thereby, the head-mounted information input / output device (head mounted display 1) can improve the convenience.

  Further, with this configuration, the upper light receiving unit 401 and the lower light receiving unit 402 of the holder 42 receive (receive light) the audio signals transmitted from the right audio LED 301 and the left audio LED 302 according to the mounting form of the head mounted display. (See FIG. 6). As a result, the right / left relationship between the sound of the right channel and the sound of the left channel that can be heard by the user does not depend on the mounting mode of the head mounted display (the direction in which the apparatus main body 21 is supported) (see FIG. 3). It will not collapse.

  Further, the display main body 20 (device main body portion 21) can be used even when the display main body 20 is held by hand, for example, without being supported by the headband 40. Thereby, the user can carry the display body 20 very compactly without carrying the headband 40.

  Further, each part of the display unit 60 is disposed in the vicinity of the circuit board 29. This eliminates the need to provide the display unit 60 with a mechanism that allows the position of the display unit to be adjusted in the Y direction (see FIG. 2). Therefore, in the display unit 60, the cable of the video signal is routed long. There is no. Therefore, the display unit 60 can suppress the possibility that noise is mixed in the video signal and the possibility that unnecessary radiation is emitted. Further, the display main body 20 has high drip-proof properties and dust-proof properties. Further, the head-mounted information input / output device (head mounted display 1) is low in manufacturing cost.

The right audio LED 301 and the left audio LED 302 transmit the audio signal by light.
The display main body 20 includes an ear speaker 23, and the ear speaker 23 outputs sound based on the audio signal output from the decoder 121 when the display main body 20 is not supported by the holder 42.

  The headband 40 includes a battery 414, and the battery 414 supplies power to the headband 40 depending on whether or not the display main body 20 is supported by the holder 42.

  The holder 42 supports the display body 20 so as to be movable in a predetermined direction. Thereby, the display main body 20 can adjust a mounting state to the said predetermined direction according to a user's eye condition, the shape of a face, etc.

The first bone conduction speaker 50 and the second bone conduction speaker 51 are bone conduction speakers that abut on the user's head.
Further, the holder 42 supports the display main body 20 whose direction is reversed.
The first bone conduction speaker 50 and the second bone conduction speaker 51 switch the audio output channel according to the orientation of the display body 20 supported by the holder 42.

  The display main body 20 has a heart rate sensor 137 that detects whether or not the display main body 20 is disposed in the vicinity of the user's head, and the ear speaker 23 is supported by the holder 42 on the display main body 20. If the heart rate sensor 137 detects that the display main body 20 is disposed in the vicinity of the user's head, a sound is output.

  The display main body 20 includes a vibrator 164. The vibrator 164 vibrates when no sound is output from any of the first bone conduction speaker 50, the second bone conduction speaker 51, and the ear speaker 23.

[Second Embodiment]
The second embodiment is different from the first embodiment in that the display body 20 and the headband 40 communicate audio signals by radio waves. Only the differences from the first embodiment will be described below.

  Based on the acceleration information supplied from the acceleration sensor 132, the processing unit 123 (see FIG. 8) of the display main body 20 determines the posture of the display main body 20 (the supported direction and the direction of gravity applied to the display main body 20). Then, the left and right audio signal channels are set according to the determination result.

  Specifically, when the display body 20 is mounted on the right side of the user, the processing unit 123 outputs a right channel audio signal from the first bone conduction speaker 50 and a left channel audio signal as the second bone conduction. The channel setting is executed so that it is output from the speaker 51. On the other hand, when the display body 20 is attached to the left side of the user, the processing unit 123 outputs the left channel audio signal from the first bone conduction speaker 50 and the right channel audio signal from the second bone conduction speaker 51. Execute channel setting to output.

  The processing unit 123 transmits information indicating the channel setting to the headband 40 by radio waves via the BT communication circuit 130. Here, the information indicating the channel setting is information indicating whether or not the right channel audio signal corresponds to the first bone conduction speaker 50, for example.

  FIG. 11 is a functional block diagram showing the configuration of the headband. The headband 40 includes a processing unit 418b, a communication unit 421, a detection switch 405, a power control unit 419, an audio connector 413, a first bone conduction speaker 50, a second bone conduction speaker 51, and a battery 414. Is provided. Here, the processing unit 418b corresponds to the processing unit 418a in the first embodiment.

  The communication unit 421 outputs an audio signal received by radio waves to the processing unit 418b. Here, the communication unit 421 performs Bluetooth (registered trademark) communication with the BT communication circuit 130 (see FIG. 8) of the display main body 20. Further, the communication unit 421 may perform wireless LAN communication (IEEE 802.11) for the WiFi communication circuit 131 (see FIG. 8) of the display body 20.

  The processing unit 418b may be either a processor that executes software processing or a digital circuit (hardware) that executes digital processing. In the present embodiment, the processing unit 418b is described as an example of a processor that executes software processing.

  The processing unit 418b receives a right channel audio signal, a left channel audio signal, and information indicating the channel setting from the communication unit 421. When the information indicating the channel setting indicates that the audio signal of the right channel corresponds to the first bone conduction speaker 50, the processing unit 418a causes the first bone conduction speaker 50 to output the audio of the right channel. The left channel sound is output from the second bone conduction speaker 51. On the other hand, when the information indicating the channel setting does not indicate that the audio signal of the right channel corresponds to the first bone conduction speaker 50, the processing unit 418a transmits the audio of the left channel from the first bone conduction speaker 50. The right channel sound is output from the second bone conduction speaker 51.

FIG. 12 is a flowchart showing communication processing between the display main body and the headband.
(Step Sa1) The processing unit 123 of the display body 20 determines whether or not the display body 20 is supported by the headband 40 based on the detection result by the headband sensor 151 (see FIG. 8). When the display main body 20 is not supported by the headband 40 (step Sa1: No), the processing unit 123 ends the process. On the other hand, when the display main body 20 is supported by the headband 40 (step Sa1: Yes), the processing unit 123 advances the processing to step Sa2.

(Step Sa2) The detection switch 405 (see FIGS. 6 and 9) of the headband 40 sends a signal indicating whether or not the device main body 21 is supported by the holder 42 to the power supply control unit 419 (see FIG. 9). ). When the apparatus main body 21 is supported by the holder 42, the power control unit 419 supplies power from the battery 414 (see FIG. 9) to each unit such as the processing unit 418b.
The processing unit 123 of the display main body 20 starts predetermined communication processing (for example, negotiation processing) using radio waves with the headband 40.

(Step Sa3) The processing unit 123 sets the ear speaker 23 to the mute mode.
(Step Sa4) The processing unit 123 determines the orientation of the display body 20 supported by the holder 42, that is, whether or not the display body 20 is mounted on the right side of the user based on the acceleration information. In addition, the processing unit 123 switches the output channels of the first bone conduction speaker 50 and the second bone conduction speaker 51 according to the orientation of the display body 20 supported by the holder 42.

  (Step Sa5) The processing unit 123 converts the right channel audio signal and the left channel audio signal supplied via the encoder 129 and information indicating the channel setting into the BT communication circuit 130, the WiFi communication circuit 131, and the 3G. The data is transmitted to the headband 40 via at least one of the / LTE communication circuits 138. The communication unit 421 outputs an audio signal received by radio waves to the processing unit 418b. The processing unit 418a outputs audio from the first bone conduction speaker 50 and the second bone conduction speaker 51 based on the information indicating the channel setting.

As described above, the head-mounted information input / output device (head mounted display 1) includes the display panel 63 that displays an image and the transmission unit that transmits an audio signal (for example, the BT communication circuit 130, the WiFi communication circuit 131, And a 3G / LTE communication circuit 138), a communication unit 421 for receiving the audio signal transmitted from the transmission unit, a holder 42 for detachably supporting the display main unit 20, and a holder 42 When the display body 20 is supported on the first bone conduction speaker 50, which is arranged near the user's head and outputs sound based on the sound signals received by the upper light receiving unit 401 and the lower light receiving unit 402. And a headband 40 having a second bone conduction speaker 51.
With this configuration, the holder 42 detachably supports the display body 20. Thereby, the head-mounted information input / output device (head mounted display 1) can improve the convenience.

  Further, the BT communication circuit 130, the WiFi communication circuit 131, and the 3G / LTE communication circuit 138 transmit the audio signal by radio waves. Since the amount of information of the audio signal is smaller than the amount of information of the video signal, these communication circuits can sufficiently transmit the audio signal even with a smaller processing capacity compared to the case of transmitting the video signal.

  The embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to this embodiment, and includes designs and the like that do not depart from the gist of the present invention.

For example, the speakers included in the headband 40 are not limited to bone conduction speakers, and may be a wide variety of speakers.
Further, for example, the head mounted display 1 may execute a process of transmitting / receiving and displaying an electronic mail and notify the user of an incoming mail or the like.

  Also, a program for realizing the head-mounted information input / output device described above is recorded on a computer-readable recording medium, and the program recorded on the recording medium is read into a computer system and executed. Thus, the execution process may be performed. Here, the “computer system” may include an OS and hardware such as peripheral devices.

  Further, the “computer system” includes a homepage providing environment (or display environment) if a WWW system is used. The “computer-readable recording medium” means a flexible disk, a magneto-optical disk, a ROM, a writable nonvolatile memory such as a flash memory, a portable medium such as a CD-ROM, a hard disk built in a computer system, etc. This is a storage device.

Further, the “computer-readable recording medium” means a volatile memory (for example, DRAM (Dynamic) in a computer system that becomes a server or a client when a program is transmitted via a network such as the Internet or a communication line such as a telephone line. Random Access Memory)) that holds a program for a certain period of time is also included.
The program may be transmitted from a computer system storing the program in a storage device or the like to another computer system via a transmission medium or by a transmission wave in the transmission medium. Here, the “transmission medium” for transmitting the program refers to a medium having a function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line.
The program may be for realizing a part of the functions described above.
Furthermore, what can implement | achieve the function mentioned above in combination with the program already recorded on the computer system, and what is called a difference file (difference program) may be sufficient.

DESCRIPTION OF SYMBOLS 1 ... Head mounted display, 20 ... Display main body, 21 ... Apparatus main body part, 21A ... Case (apparatus main body part), 23 ... Ear speaker, 24 ... Sound collecting microphone, 25 ... USB connector, 27 ... Video connector, 28 ... Main switch, 29 ... Circuit board, 30 ... Operation switch, 31 ... Connection hole, 33 ... Battery, 34 ... Touch switch, 35 ... Backlight (main body), 36 ... Display panel (main body), 37 ... Call microphone, 40 ... Headband (mounting part), 41 ... pin, 41b ... spherical part, 41c ... through hole, 42 ... holder (supporting part), 42a ... accommodating part, 42b ... nail, 43 ... first headband, 43a ... joint part, 43b ... Bearing portion, 43c ... Bearing portion, 43d ... Bearing portion, 43e ... Bearing portion, 44 ... Second headband, 46 ... Head pad, 46a ... Support Plate 46b ... Elastic member 47 ... Head pad 48 ... Spring member 49 ... Mark display part 50 ... First bone conduction speaker 51 ... Second bone conduction speaker 56 ... Turning mechanism 57 ... Turning Mechanism 60... Display unit 61. Display hinge 62. Backlight (display unit) 63. Display panel (display unit) 64. Camera 65 65 Prism 66 Reflector mirror 67. Viewfinder opening 68 DESCRIPTION OF SYMBOLS ... Front light, 70 ... Front speaker, 71 ... Imaging lens, 72 ... Imaging device (imaging part), 73 ... Laser oscillator, 100 ... Stereo earphone, 101 ... Audio connector, 102 ... Cable, 103 ... First speaker, 104 ... second speaker 106 ... clip 120 ... power supply circuit 121 ... decoder 122 ... flash memory 123 ... processing unit 25 ... LCD driver, 126 ... BL driver, 127 ... memory, 128 ... main switch, 129 ... encoder, 130 ... BT communication circuit, 131 ... WiFi communication circuit, 132 ... acceleration sensor, 133 ... geomagnetic sensor, 134 ... angular velocity sensor, 135 ... GPS sensor, 136 ... temperature / humidity sensor, 137 ... heart rate sensor, 138 ... 3G / LTE communication circuit, 151 ... headband sensor, 162 ... speaker amplifier, 164 ... vibrator (vibration unit), 301 ... right audio LED, 302 ... Left audio LED, 304 ... Light guide plate, 305 ... Light guide plate, 401 ... Upper light receiving portion, 402 ... Lower light receiving portion, 405 ... Detection switch, 406 ... Circuit board, 410 ... Coil, 411 ... Permanent magnet, 412 ... Circuit Board, 413 ... Audio connector, 414 ... Bag Terry (power supply unit), 415 ... cable, 416 ... diaphragm, 418a and 418b ... processing unit, 419 ... power supply control unit, 421 ... communication unit (reception unit)

Claims (10)

A display for displaying an image;
A signal processing unit for outputting an audio signal;
A transmission unit for transmitting the audio signal output from the signal processing unit;
An apparatus body having
A receiver for receiving the audio signal transmitted from the transmitter;
A support part for detachably supporting the apparatus main body;
When the apparatus main body is supported by the support unit, a first speaker that is arranged near the user's head and outputs sound based on the audio signal received by the reception unit;
A headband having
A head-mounted information input / output device comprising:   The head-mounted information input / output device according to claim 1, wherein the transmission unit transmits the audio signal by light or radio waves. The apparatus main body has a second speaker,
The said 2nd speaker outputs an audio | voice based on the said audio | voice signal output from the said signal processing part, when the said apparatus main body is not supported by the said support part. Head-mounted information input / output device as described in 1. The headband has a power supply unit,
4. The power supply unit according to claim 1, wherein the power supply unit supplies power to the headband according to whether the apparatus main body is supported by the support unit. 5. Head-mounted information input / output device.   The head-mounted information input / output device according to any one of claims 1 to 4, wherein the support unit supports the device main body so as to be movable in a predetermined direction.   The head-mounted information input / output device according to any one of claims 1 to 5, wherein the first speaker is a bone conduction speaker that contacts the head of the user.   The head-mounted information input / output device according to any one of claims 1 to 6, wherein the support portion supports the device body whose direction is reversed.   The head-mounted information input / output device according to claim 7, wherein the first speaker switches an output channel of the sound in accordance with an orientation of the device main body supported by the support portion. The apparatus main body has a detection unit that detects whether or not the apparatus main body is disposed in the vicinity of the user's head,
The second speaker, when the detection unit detects that the apparatus main body is not supported by the support part and the apparatus main body is disposed in the vicinity of the user's head, The head-mounted information input / output device according to any one of claims 3 to 8, wherein the head-mounted information input / output device is output. The apparatus main body has a vibration part,
The head-mounted information input / output device according to claim 9, wherein the vibration unit vibrates when no sound is output from any of the first speaker and the second speaker.

Images