JP6975097B2 - Eyewear system - Google Patents

Description

The present invention relates to a biometric information detector, eyewear, and an eyewear system.

Conventionally, a technique has been known in which a biometric information detection function is provided for eyewear such as eyeglasses and sunglasses so that biometric information (for example, acceleration, angular velocity, electrooculogram, etc.) of the wearer of the eyewear can be detected. ing.

For example, in Patent Document 1 below, an electro-oculography electrode is provided at a position in contact with the nose pad and the eyebrows in the frame of the eyewear so that the electro-oculography of the wearer of the eyewear can be detected. The technology was disclosed.

Japanese Unexamined Patent Publication No. 2015-202198

However, the technique of Patent Document 1 employs a configuration in which a battery is provided in one temple of the frame and a circuit board is provided in the other temple. That is, in the technique of Patent Document 1, a plurality of components for detecting the electrooculogram are provided dispersedly over the entire frame. Therefore, in the technique of Patent Document 1, it is not possible to easily provide the eyewear with a plurality of components necessary for realizing the biological information detection function.

The biological information detection device of one embodiment includes an electrooculogram sensor that detects an electrooculogram, an acceleration sensor that detects an acceleration, a gyro sensor that detects an angular velocity, and a process using the electrooculogram, the acceleration, and the angular velocity. The processing means for performing the above, the communication means for communicating with the outside, the battery for supplying power, the electro-oculography sensor, the acceleration sensor, the gyro sensor, the processing means, the communication means, and the battery are integrated. It is provided with a housing that can be attached to the bridge of the frame provided by the eyewear.

According to one embodiment, the eyewear can be easily provided with a plurality of components necessary for realizing the biometric information detection function.

It is a figure which shows the structure of the eyewear system which concerns on one Embodiment. It is a figure which shows the wearing state of the biological information detection apparatus which concerns on one Embodiment. It is a figure which shows the mounting state of the cradle which concerns on one Embodiment. It is an enlarged view of the eyewear and the biological information detection apparatus which concerns on one Embodiment. It is a figure which shows the hardware composition of the biological information detection apparatus which concerns on one Embodiment. It is a figure which shows the hardware composition of the cradle which concerns on one Embodiment. It is an external perspective view from the bottom surface side of the biological information detection device and the cradle which concerns on one Embodiment. It is an external perspective view from the upper surface side of the biological information detection device and the cradle which concerns on one Embodiment. It is a figure which shows the functional structure of the processing circuit which concerns on one Embodiment.

[Embodiment]
Hereinafter, one embodiment will be described with reference to the drawings.

(Configuration of eyewear system 10)
FIG. 1 is a diagram showing a configuration of an eyewear system 10 according to an embodiment. FIG. 2 is a diagram showing a wearing state of the biological information detection device 100 according to the embodiment. FIG. 3 is a diagram showing a mounted state of the cradle 300 according to the embodiment. FIG. 4 is an enlarged view of the eyewear 200 and the biological information detection device 100 according to the embodiment.

As shown in FIG. 1, the eyewear system 10 includes an eyewear 200, a biometric information detection device 100, and a cradle 300.

The eyewear 200 is eyeglasses, sunglasses, or the like worn on the wearer's face. The eyewear 200 includes a frame 201, a left lens 202, and a right lens 203. The frame 201 has a left rim 201A, a right rim 202B, and a bridge 201C. The left rim 201A supports the outer peripheral edge of the left lens 202. The right rim 202B supports the outer peripheral edge of the right lens 203.

The bridge 201C connects the left rim 201A and the right rim 202B between the left rim 201A and the right rim 202B. A notch 201D is formed on the face side of the wearer in the bridge 201C. The cutout portion 201D is a portion cut out having substantially the same shape as the outer shape of the housing 101 included in the biological information detection device 100. The notch 201D can be fitted with the housing 101. Although the frame 201 actually has temples on the left and right sides, the illustration is omitted in the present embodiment.

The biological information detection device 100 is a device that can be attached to the eyewear 200. As shown in FIG. 2, the biological information detection device 100 is attached to the bridge 201C of the eyewear 200 by fitting the housing 101 into the notch 201D of the eyewear 200. The housing 101 is formed by using a relatively hard material (for example, a hard resin or the like). The housing 101 has a substantially rectangular parallelepiped shape.

As shown in FIG. 4, ribs 101A and 101B projecting outward are provided on both left and right sides of the housing 101. On the other hand, engaging grooves 201E and 201F extending in the front-rear direction are formed on both the left and right inner wall surfaces of the notch 201D of the eyewear 200. When the housing 101 is fitted into the notch 201D, the ribs 101A and 101B are inserted into the engaging grooves 201E and 201F and engage with the engaging grooves 201E and 201F. As a result, the housing 101 is positioned with high accuracy in the notch 201D and is stably held.

An acceleration sensor 111 and a gyro sensor 112 are provided inside the housing 101. Thereby, the biological information detection device 100 can detect the acceleration and the angular velocity in the wearer's head. Further, a left nose pad 102 and a right nose pad 103 are attached to the lower side of the housing 101. The left nose pad 102 and the right nose pad 103 support the eyewear 200 by abutting on the surface of the wearer's nose. Electrodes 104 and electrodes 105 are provided on the surfaces of the left nose pad 102 and the right nose pad 103 (contact surfaces with the wearer's nose). Further, an electrode 106 is provided on the contact surface of the housing 101 with the wearer's eyebrows. The electrodes 104, 105, 106 function as the electrooculogram sensor 113 and can detect the electrooculogram of the wearer.

The cradle 300 is a device that can be attached to and detached from the biological information detection device 100. As shown in FIG. 3, the cradle 300 is attached to the housing 101 of the biometric information detection device 100 and is electrically connected to the biometric information detection device 100 to charge and reset the biometric information detection device 100. be able to. In particular, the cradle 300 can be attached to the rear part of the housing 101 so that the biometric information detection device 100 can be attached to the biometric information detection device 100 while being attached to the bridge 201C of the eyewear 200.

(Hardware configuration of biometric information detection device 100)
FIG. 5 is a diagram showing a hardware configuration of the biological information detection device 100 according to the embodiment. As shown in FIG. 5, the biometric information detection device 100 includes an acceleration sensor 111, a gyro sensor 112, an electro-oculography sensor 113, a processing circuit 114, a memory 115, a communication module 116, a battery 117, and a connection terminal 118.

Each of these hardware is integrally provided in the housing 101 and is modularized. For example, the acceleration sensor 111, the gyro sensor 112, the processing circuit 114, the memory 115, the communication module 116, and the battery 117 are provided on a substrate provided inside the housing 101. Further, the electro-oculography sensor 113 (electrodes 104, 105, 106) is provided on the surface of the housing 101 and the surface of the nose pad attached to the housing 101, as shown in FIG. Further, the connection terminal 118 is provided on a substrate provided inside the housing 101, and a part (connection portion) thereof is exposed from the bottom surface of the housing 101.

The acceleration sensor 111 detects the acceleration generated in the biological information detection device 100 (that is, the head of the wearer of the eyewear 200) for each of the three predefined axes (X-axis, Y-axis, Z-axis). , Outputs acceleration data indicating the acceleration. The acceleration data output from the acceleration sensor 111 is supplied to the processing circuit 114. As the acceleration sensor 111, for example, a strain gauge type acceleration sensor, a piezo resistance type acceleration sensor, a piezoelectric type acceleration sensor, or the like can be used.

The gyro sensor 112 detects the angular velocity generated in the biological information detection device 100 (that is, the head of the wearer of the eyewear 200) for each of the three predefined axes (X-axis, Y-axis, Z-axis). , Outputs the angular velocity data indicating the angular velocity. The angular velocity data output from the gyro sensor 112 is supplied to the processing circuit 114. As the gyro sensor 112, for example, a vibration type gyro sensor, a capacitance type gyro sensor, or the like can be used.

The electrooculogram sensor 113 detects the voltage value due to the potential difference between the potential on the corneal side and the potential on the retinal side in the wearer's eyeball as "ocular potential" by the three electrodes 104, 105, 106 attached to the housing 101. Then, the electrooculogram data indicating the electrooculogram is output. The electro-oculography data output from the electro-oculography sensor 113 is supplied to the processing circuit 114.

The processing circuit 114 is an example of "processing means". The processing circuit 114 performs processing for realizing various functions of the biological information detection device 100. For example, the processing circuit 114 may store each measurement data (acceleration data, angular velocity data, and electrooculogram data) acquired from each sensor (accelerometer 111, gyro sensor 112, and electrooculogram sensor 113) in the memory 115. , Output to an external information processing device (for example, a smartphone, a personal computer, a server, etc.) via the communication module 116. Further, for example, the processing circuit 114 determines the movement of the eyes of the wearer of the eyewear 200 based on each measurement data acquired from each sensor. As the processing circuit 114, for example, an IC (Integrated Circuit) or the like can be used.

The memory 115 stores various data used for processing of the processing circuit 114. For example, the memory 115 stores each measurement data (acceleration data, angular velocity data, and electrooculogram data) acquired from each sensor by the processing circuit 114. As the memory 115, for example, a RAM (Random Access Memory) or the like can be used.

The communication module 116 performs wireless communication with an external information processing device. For example, the communication module 116 controls communication connection with an external information processing device, data transmission to an external information processing device, and the like. In this embodiment, Bluetooth (registered trademark) is used as the wireless communication method by the communication module 116. However, the present invention is not limited to this, and other wireless communication methods (for example, Wi-Fi (registered trademark), NFC (Near Field Communication), etc.) may be used as the communication method by the communication module 116.

The battery 117 stores electric power by being charged by the electric power supplied from the cradle 300. Then, the battery 117 supplies electric power to each part of the biological information detection device 100. In the present embodiment, a rechargeable secondary battery (for example, a lithium ion secondary battery, a lithium ion polymer secondary battery, a nickel hydrogen secondary battery, etc.) is used as the battery 117.

The connection terminal 118 is electrically connected to the connection terminal 305 of the cradle 300 when the cradle 300 is attached to the biological information detection device 100. As a result, the connection terminal 118 can receive the electric power supplied from the cradle 300.

The biological information detection device 100 configured in this way is attached to the bridge 201C of the eyewear 200 to continuously measure the acceleration, the angular velocity, and the electrooculogram in the head of the wearer of the eyewear 200. Can be done. Then, the biological information detection device 100 stores each measurement data (acceleration data, angular velocity data, and electrooculogram data) in the memory 115, or wirelessly communicates with an external information processing device to the external information processing device. It can be output. Further, the biological information detection device 100 can determine the movement of the eyes of the wearer of the eyewear 200 based on each measurement data, and output the determination result to an external information processing device.

The output unit 126 outputs each measurement data (acceleration data, angular velocity data, and electrooculogram data) and the determination result of the eye movement of the wearer of the eyewear 200 to an external information processing device in real time. Alternatively, each measurement data and determination result stored in the memory 115 may be collectively output to an external information processing device at a predetermined timing (for example, a timing connected to an external information processing device). good.

(Hardware configuration of cradle 300)
FIG. 6 is a diagram showing a hardware configuration of the cradle 300 according to the embodiment. As shown in FIG. 6, the cradle 300 includes a USB connector 301, a charging circuit 302, a battery 303, a power feeding circuit 304, a connection terminal 305, a reset switch 306, and a reset signal output circuit 307.

By connecting the USB cable, the USB connector 301 is electrically connected to an external power supply device via the USB cable. As a result, the USB connector 301 can receive the electric power supplied from the external power supply device.

The charging circuit 302 charges the battery 303 using the electric power supplied from the external power supply device via the USB connector 301.

The battery 303 stores electric power by being charged by the charging circuit 302. Then, the battery 303 supplies electric power to the power feeding circuit 304. In the present embodiment, a rechargeable secondary battery (for example, a lithium ion secondary battery, a lithium ion polymer secondary battery, a nickel hydrogen secondary battery, etc.) is used as the battery 303.

The power supply circuit 304 supplies the electric power supplied from the battery 303 to the biometric information detection device 100 via the connection terminal 305 to charge the battery 117 included in the biometric information detection device 100.

The connection terminal 305 is electrically connected to the connection terminal 118 of the biometric information detection device 100 when the cradle 300 is attached to the biometric information detection device 100. As a result, the connection terminal 305 can send the electric power from the power feeding circuit 304 to the biometric information detection device 100.

The reset switch 306 is a switch that is partially exposed from the housing 310 of the cradle 300 and can be pressed and operated by the user. When the reset switch 306 is pressed, the reset signal output circuit 307 transmits a reset signal for resetting the biometric information detection device 100 to the biometric information detection device 100 via the connection terminal 305.

(Electrical connection configuration of biometric information detection device 100 and cradle 300)
FIG. 7 is an external perspective view of the biological information detection device 100 and the cradle 300 according to the embodiment from the bottom surface side. FIG. 8 is an external perspective view of the biological information detection device 100 and the cradle 300 according to the embodiment from the upper surface side.

As shown in FIG. 7, two connection terminals 118 are exposed and provided on the bottom surface of the housing 101 of the biological information detection device 100.

On the other hand, as shown in FIGS. 7 and 8, the housing 310 of the cradle 300 has a tip portion 310A protruding forward on the lower side and a clip 311 protruding forward on the upper side, and the tip portion 310A. And the clip 311 allow the rear portion of the housing 101 included in the biological information detection device 100 to be clipped from above and below.

As shown in FIG. 8, two connection terminals 305 are provided on the upper surface of the tip portion 310A so as to project upward. As shown in FIG. 3, when the cradle 300 is attached to the biometric information detection device 100, each of the two connection terminals 118 provided in the biometric information detection device 100 has two connection terminals 305 provided in the cradle 300. Contact with each of the and electrically connected. As a result, electric power is supplied from the cradle 300 to the biometric information detection device 100, and the battery 117 of the biometric information detection device 100 is charged. Further, a reset signal can be transmitted from the cradle 300 to the biometric information detection device 100, and the biometric information detection device 100 can be reset by pressing the reset switch 306 of the cradle 300.

The housing 101 of the biological information detection device 100 has a waterproof structure. In particular, the housing 101 has relatively high waterproof performance because only the connection terminal 118 is exposed and other parts such as switches and connectors are not exposed.

(Functional configuration of processing circuit 114)
FIG. 9 is a diagram showing a functional configuration of the processing circuit 114 according to the embodiment. As shown in FIG. 9, the processing circuit 114 includes an acceleration acquisition unit 121, an angular velocity acquisition unit 122, an electro-oculography acquisition unit 123, a storage unit 124, a motion determination unit 125, an output unit 126, a reset signal reception unit 127, and a reset unit. It is equipped with 128.

The acceleration acquisition unit 121 acquires the acceleration data output from the acceleration sensor 111. Specifically, the acceleration acquisition unit 121 acquires acceleration data for each of the three axes (X-axis, Y-axis, and Z-axis) output from the acceleration sensor 111.

The angular velocity acquisition unit 122 acquires the angular velocity data output from the gyro sensor 112. Specifically, the angular velocity acquisition unit 122 acquires the angular velocity data of each of the three axes (X-axis, Y-axis, Z-axis) output from the gyro sensor 112.

The electro-oculography acquisition unit 123 acquires the electro-oculography data output from the electro-oculography sensor 113. Specifically, the electro-oculography acquisition unit 123 uses the voltage value indicating the electro-oculography of the wearer of the eyewear 200, which is output from the three electrodes 104, 105, 106 of the electro-oculography sensor 113, as the electro-oculography data. get.

The storage unit 124 stores the acceleration data acquired by the acceleration acquisition unit 121, the angular velocity data acquired by the angular velocity acquisition unit 122, and the electro-oculography data acquired by the electro-oculography acquisition unit 123 in the memory 115.

The motion determination unit 125 determines the eye movement of the wearer of the eyewear 200 based on each measurement data (acceleration data, angular velocity data, and electrooculogram data) stored in the storage unit 124. For example, the motion determination unit 125 uses a known technique (for example, EOG (Electro-Oculography) method) based on the electro-oculography data accumulated in the storage unit 124 to blink and gaze the wearer of the eyewear 200. Determine the direction. The voltage value in the electro-oculography data changes depending on the direction of the line of sight and also by blinking. Therefore, for example, the determination pattern for each line-of-sight direction based on the voltage value and the blink determination pattern based on the voltage value are stored in the memory 115 in advance. Thereby, the motion determination unit 125 can determine the blink and the line-of-sight direction of the wearer of the eyewear 200 based on each determination pattern and the voltage value indicated by the measured electro-oculography data. In addition, there is a possibility that the accuracy of the determination result by the motion determination unit 125 may decrease due to the superimposition of noise on the electro-oculography data. Therefore, the motion determination unit 125 further uses at least one of the acceleration data and the angular velocity data stored in the storage unit 124 to determine the movement of the wearer's eyes, thereby improving the accuracy of the determination result. You may try to increase it.

The output unit 126 outputs each measurement data (acceleration data, angular velocity data, and electrooculogram data) stored in the memory 115 to an external information processing device via the communication module 116. Further, the output unit 126 outputs the determination result of the eye movement of the wearer of the eyewear 200 by the motion determination unit 125 to the external information processing device via the communication module 116.

The reset signal receiving unit 127 receives the reset signal transmitted from the cradle 300. When the reset signal receiving unit 127 receives the reset signal, the reset unit 128 resets (restarts) the biometric information detection device 100.

Each function of the processing circuit 114 described above is realized, for example, by the processor executing the program stored in the memory in the processing circuit 114. This program may be provided together with the biometric information detection device 100 in a state of being introduced into the biometric information detection device 100 in advance, or may be provided from the outside and introduced into the biometric information detection device 100. In the latter case, the program may be provided by an external storage medium (eg, USB memory, memory card, CD-ROM, etc.) or by downloading from a server on the network (eg, the Internet, etc.). You may do so.

As described above, in the biometric information detection device 100 of the present embodiment, a plurality of components (each sensor, processing circuit 114, memory 115, communication module 116, battery 117, etc.) are integrally provided in the housing 101. The housing 101 can be attached to the bridge 201C of the eyewear 200. As a result, in the biological information detection device 100 of the present embodiment, a plurality of components can be collectively provided in the eyewear 200 by simply attaching the housing 101 to the bridge 201C of the eyewear 200. Therefore, according to the biometric information detection device 100 of the present embodiment, the eyewear 200 can be easily provided with a plurality of components necessary for realizing the biometric information detection function.

Further, the biometric information detection device 100 of the present embodiment can be easily attached to the eyewear 200 by simply fitting the housing 101 into the notch 201D formed in the bridge 201C of the eyewear 200. Therefore, according to the biometric information detection device 100 of the present embodiment, it can be easily attached to each of a plurality of eyewear having a similar notch. Also, when replacing eyewear, it can be easily attached to new eyewear.

Further, since the biometric information detection device 100 of the present embodiment is provided with a plurality of sensors (electromagnetic potential sensor, acceleration sensor, and gyro sensor) integrally in the housing 101, each measurement data (electromagnetic potential, acceleration, angular velocity) is provided. ) Can be measured at the same position (near the eyebrows of the wearer's head). As a result, the biological information detection device 100 of the present embodiment can suppress variations in measurement accuracy due to the measurement position among the measurement data. Therefore, according to the biological information detection device 100 of the present embodiment, it is possible to obtain each measurement data capable of determining the movement of the wearer's eyes, head, etc. with high accuracy.

Further, since the biometric information detection device 100 of the present embodiment is provided with a plurality of components integrally in the housing 101, it is not necessary to pull out wiring members such as FPCs (Flexible Printed Circuits) from the housing 101. The waterproofness of the housing 101 can be enhanced. Further, since the biometric information detection device 100 of the present embodiment does not need to separately provide a wiring member such as an FPC in the frame 201 of the eyewear 200, the manufacturing costs of the eyewear 200 and the biometric information detection device 100 are suppressed. In addition, there is no possibility that the wiring member will be disconnected in the frame 201, and thus the reliability of each product of the eyewear 200 and the biometric information detection device 100 can be enhanced.

Although one embodiment of the present invention has been described in detail above, the present invention is not limited to these embodiments, and various modifications or modifications are made within the scope of the gist of the present invention described in the claims. It can be changed.

For example, in the above embodiment, the motion determination unit 125 of the biological information detection device 100 determines the movement of the eye of the wearer of the eyewear 200, but the present invention is not limited to this, and the motion determination unit 125 may be used for other purposes. (For example, the movement of the head, etc.) may be determined. Further, instead of the motion determination unit 125, an external information processing device may be used to determine the movement of the eyes of the wearer of the eyewear 200.

Further, in the above embodiment, as an example of the detection means for detecting the biological information, the acceleration sensor 111, the gyro sensor 112, and the electrooculogram sensor 113 are integrally provided in the housing 101, but the present invention is not limited to this. .. For example, the configuration may be such that the acceleration sensor 111 or the gyro sensor 112 is not provided. Further, for example, another sensor capable of detecting biological information (for example, an infrared sensor or the like) may be integrally provided in the housing 101.

Further, in the above embodiment, as an example of the attachment structure for attaching the biometric information detection device 100 to the bridge 201C of the eyewear 200, a configuration in which the housing 101 is fitted into the notch 201D is used, but the present invention is limited to this. No. For example, a configuration may be used in which the housing 101 is attached to the bridge 201C by a fixing means such as a screw, double-sided tape, or a magnet.

10 Eyewear system 100 Biometric information detection device 101 Housing 111 Accelerometer 112 Gyro sensor 113 Ocular potential sensor 114 Processing circuit (processing means)
115 Memory 116 Communication module (communication means)
117 Battery 118 Connection terminal 121 Acceleration acquisition unit 122 Angle speed acquisition unit 123 Optical potential acquisition unit 124 Accumulation unit 125 Motion determination unit 126 Output unit 127 Reset signal receiver unit 128 Reset unit 200 Eyewear 201 Frame 201C Bridge 201D Notch 300 Cradle 306 Reset switch 307 Reset signal output circuit (reset signal output means)

Claims (8)

An electro-oculography sensor that detects the electro-oculography and an electro-oculography sensor
An accelerometer that detects acceleration and
With a gyro sensor that detects the angular velocity,
A processing means for performing processing using the electro-oculography, the acceleration, and the angular velocity, and
Communication means to communicate with the outside and
A battery that supplies power and
Biological information detection including the electro-oculography sensor, the acceleration sensor, the gyro sensor, the processing means, the communication means, and the housing provided with the battery integrally and which can be attached to the bridge of the frame of the eyewear. and equipment,
With a cradle that is removable from the biometric information detection device and that is attached to the biometric information detection device to charge the battery.
Equipped with
The cradle is
An eyewear system characterized in that the biometric information detection device is sandwiched from above and below while the biometric information detection device is mounted on the bridge . The cradle is
It has a tip portion protruding forward on the lower side and a clip protruding forward on the upper side, and the tip portion and the clip sandwich the upper and lower parts of the biometric information detection device from the rear.
The eyewear system according to claim 1. The biometric information detection device is
Further provided with a nose pad integrally provided with the housing,
The electro-oculography sensor is
The eyewear system according to claim 1 or 2 , wherein the eyewear system has an electrode provided on the nose pad and an electrode provided on a contact surface between the eyeglasses of the wearer of the eyewear in the housing. .. Any of claims 1 to 3, wherein the processing means has a motion determination unit that determines the movement of the eye of the wearer of the eyewear based on the electrooculogram detected by the electrooculogram sensor. Or the eyewear system described in item 1 . The eyewear system according to claim 4 , wherein the motion determination unit determines the blink of the wearer. The motion determination unit, eyewear system of claim 4 or 5, wherein the determining the gaze direction of the wearer. The eyewear having the biometric information detection device is provided.
The eyewear system according to any one of claims 1 to 6, wherein the eyewear system is characterized in that. The cradle is
With a reset switch,
The eyewear system according to any one of claims 1 to 7, further comprising a reset signal output means for outputting a reset signal to the biometric information detection device when the reset switch is pressed.

Images