KR20150074757A - Electronic device and control method thereof - Google Patents

Abstract

An electronic device and its control method are disclosed. An electronic device and a control method thereof according to the present invention include: a frame coupled to at least one point of the face so that the device can be worn on the face of the user; And at least one of the first information acquired from the direct sensing device directly sensing the wearing state of the user and the second information acquired from the indirect sensing device indirectly sensing the wearing state of the user, And a controller for determining whether the device is worn based on the information. According to the present invention, it is possible to effectively detect the current state of the electronic device.

Description

ELECTRONIC DEVICE AND CONTROL METHOD THEREOF FIELD OF THE INVENTION [0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention [0002] The present invention relates to an electronic device and a control method thereof, and more particularly, to an electronic device and its control method capable of effectively sensing a current state of an electronic device.

In recent years, research, interest, and commercialization of a wearable computing system (wearable computing system), which can be directly mounted on the body, has been actively conducted. Particularly, there is a great interest in an electronic device that can provide various data through a glass in a state in which the user wears it as glasses, and provides a cellular phone function, a camera function, and the like.

The present invention relates to an electronic device capable of effectively sensing the current state of an electronic device and a control method thereof.

According to an aspect of the present invention, there is provided an electronic device including: a frame coupled to at least one point of a face of a user so that the device can be worn on a user's face; And at least one of the first information acquired from the direct sensing device directly sensing the wearing state of the user and the second information acquired from the indirect sensing device indirectly sensing the wearing state of the user, And a controller for determining whether the device is worn based on the information.

The controller may determine whether the device is worn by combining at least one of the first information and the second information.

Wherein the first information comprises at least one sensor installed at least at one point of the device and contacting at least one point of the user's body, a frame sensor sensing the state of the frame, And status information including information acquired through at least one of the motion sensors.

The second information may be status information including at least one of a time range of wearing or not wearing the device, and a charging progress for the device.

Further comprising at least one glass equipped with a display function, wherein the control unit can display the content using the at least one glass when the device is in a non-use state.

The system of claim 1, further comprising at least one projector, wherein the controller can project the content toward a projection surface using the at least one projector when the device is in a non-use state.

The controller may determine that the device is in a wear state regardless of the first and second information when it detects a user's gripping operation with respect to at least one point of the devices.

According to another aspect of the present invention, there is provided a method of controlling an electronic device, including: sensing a state of a device; And

Based on at least one of the first information obtained from the direct sensing device directly sensing the wearing state of the user and the second information acquired from the indirect sensing device indirectly sensing the wearing state of the user, And a step of judging whether or not it is possible.

The determining may include determining whether the device is worn by combining at least one of the first information and the second information.

Wherein the first information comprises at least one of a sensor, a sensor, installed at at least one point of the device and contacting at least one point of the user's body, a frame sensor for sensing a state of the frame, And status information including information obtained through at least one of the sensors.

The second information may be status information including at least one of a time range of wearing or not wearing the device, and a charging progress for the device.

And displaying the content using at least one glass when the device is not in use.

And projecting the content toward the projection surface using at least one projector when the device is not in use.

The electronic device and its control method according to the present invention have the effect of effectively detecting the current state of the electronic device.

1 is a block diagram of an electronic device according to an embodiment of the present invention.
Figure 2 is a perspective view of the electronic device of Figure 1;
Figure 3 is a perspective view in accordance with another embodiment of the electronic device of Figure 1;
FIG. 4 is a flow chart showing an operation process of the electronic device of FIG.
Fig. 5 is a view showing a state in which the electronic device of Fig. 1 is worn.
6 is a flow chart specifically showing the step of displaying in the second scheme of the flowchart of Fig.
FIG. 7 is a diagram showing an embodiment of the electronic device display state of FIG. 1;
Figs. 8 to 10 are views showing another embodiment of the electronic device display state of Fig.
Fig. 11 is a view showing another embodiment of the electronic device of Fig. 1; Fig.
Figs. 12 and 13 are diagrams showing an operation method according to an embodiment of the electronic device of Fig. 1;
Figs. 14 to 18 are diagrams showing an operation method according to another embodiment of the electronic device of Fig. 1;
FIG. 19 is a flow chart specifically illustrating a process of detecting the current state of the electronic device of FIG. 4;
Figure 20 is a diagram listing methods for sensing the current state of the electronic device of Figure 1;
FIGS. 21 and 22 are diagrams illustrating a sensing method using a sensor of the electronic device of FIG.
Fig. 23 is a diagram showing a detection method using the camera of Fig. 1 electronic device. Fig.
Fig. 24 is a diagram showing a sensing method according to the state of the spectacle frame of the electronic device of Fig. 1;
FIG. 25 is a diagram illustrating a time-based sensing method of the electronic device of FIG. 1;
FIG. 26 is a view showing a sensing method according to charging of the electronic device of FIG. 1;

The above objects, features and advantages of the present invention will become more apparent from the following detailed description taken in conjunction with the accompanying drawings. It is to be understood, however, that the invention is not limited to the disclosed embodiments, but, on the contrary, is intended to cover various modifications and similarities. Like reference numerals designate like elements throughout the specification. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail. Further, numerals (e.g., first, second, etc.) used in the description process of this specification are only an identifier for distinguishing one component from another component

Hereinafter, a mobile terminal related to the present invention will be described in detail with reference to the drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The mobile terminal described in this specification may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), and navigation. However, it will be understood by those skilled in the art that the configuration according to the embodiments described herein may be applied to a fixed terminal such as a digital TV, a desktop computer, and the like, unless the configuration is applicable only to a mobile terminal.

FIG. 1 is a block diagram of an electronic device according to an embodiment of the present invention, and FIG. 2 is a perspective view of the electronic device of FIG. 1.

As shown in these drawings, an electronic device 100 according to an embodiment of the present invention includes a first camera 110, a second camera 120, a glass 130, a microphone 150, A display unit 160, a touch sensor 170, a memory 180, a wireless communication unit 190, a power source unit 200, and a projector 210.

The electronic device 100 may be a device of a type that can be worn by the user. For example, the device may be a wearable device such as a pair of glasses.

The first camera 110 may be used to photograph an external image. The first camera 110 can be rotated up and down, left and right by a predetermined angle when necessary. The second camera 120 may be used to photograph an image of a user's eye wearing the electronic device 100. [ The second camera 120 can be rotated up and down and right and left by a predetermined angle when necessary.

The first camera 110 can take an external image in a range exceeding the time of the user. That is, when the range of the user's time is A, the range that can be photographed through the first camera 110 means A + a. For example, the first camera 110 can capture an image of a 360-degree range around the user.

The first camera 110 may be plural. For example, it means that a suitable number of first cameras 110 for photographing the front, the side, and the rear can be located at each position of the electronic device 100.

The first camera 110 may be a wide angle camera. That is, it means that the camera can photograph an image of a larger angle than a normal camera. When a wide-angle camera is applied, an external image around the user can be widely obtained even with a small number of first cameras 110.

The glass 130 may be substantially transparent, such as ordinary glasses. The user can observe the surroundings through the glass 130. Two glasses 130 may be provided so as to correspond to the left and right eyes, respectively, or one glass 130 may be provided to correspond to one eye of the left and right eyes.

The glass 130 may be provided with a transparent display area 131 for providing information. The control unit 140 may display information necessary for the user through the transparent display area 131. [ The transparent display area 141 may be provided with two or one such that it corresponds to the left eye and / or the right eye.

The control unit 140 can control the operation of the electronic device 100 as a whole. That is, the control unit 140 means that the components of the electronic device 100 can be controlled as a whole. The control unit 140 may analyze the images photographed through the first camera 110 and / or the second camera 120. The control unit 140 may perform an information acquisition operation for a forward object to which a user gives a gaze and provide the obtained information through the transparent display area 131 provided in the glass 130. [ The control unit 140 may analyze the image of the user's eye photographed by the second camera 120 and may perform a specific function corresponding to the eye gesture of the user recognized as an analysis result.

The microphone 150 may receive an external sound signal by a microphone in a communication mode, a recording mode, and / or a voice recognition mode, and may process it as electrical voice data. Meanwhile, various noise reduction algorithms for eliminating noise generated in the process of receiving an external sound signal by the microphone 150 may be implemented.

The audio output unit 160 may output audio data. The sound output unit 160 may include a receiver, a speaker, a buzzer, and the like. The sound output unit 160 can output sound through an earphone jack (not shown). The user can connect the earphone to the earphone jack and hear the sound output.

The touch sensor 170 may be configured to convert a change in pressure or capacitance applied by a touch on a specific portion into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch. The touch sensor 170 may be implemented as a proximity sensor. Input data via the touch sensor 170 may be used to perform certain functions of the electronic device 100.

The memory 180 may store a program for the operation of the control unit 140 and may temporarily and / or permanently store input / output data (e.g., phonebook, message, still image, moving picture, etc.).

The storage unit 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory) (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM A disk, and / or an optical disk. The electronic device 100 may operate in association with a web storage that performs storage functions of the memory 180 on the Internet.

The wireless communication unit 190 may include one or more modules that enable wireless communication between the electronic device 100 and the wireless communication system. For example, the wireless communication unit 190 may include a broadcast receiving module, a mobile communication module, a wireless Internet module, a short distance communication module, and a location information module. However, the range of the wireless communication-related module that can be included in the wireless communication unit 190 is not limited thereto.

The sensing unit 195 may sense the state of the electronic device 100. [ For example, it means that the user wearing the electronic device 100 can sense the orientation, the height, the rotation, the forward movement, the backward movement, and the like. The sensing unit 195 may include at least one of a position sensor, a geomagnetic sensor, and an acceleration sensor. The control unit 140 may sense the state of the electronic device 100 and / or the current state of the user wearing the electronic device 100 through the resultant value sensed by the at least one sensor.

The power supply unit 200 receives external power and internal power under the control of the control unit 140 and supplies power necessary for operation of the respective components.

The projector 210 can project an image. For example, it means that in certain situations the content can be projected onto an external projection surface. The control unit 140 may selectively output an image to at least one of the projector 210 and the transparent display area 131. [ For example, it means that an image is output through the transparent display area 131 when the electronic device 100 is worn, and an image can be output through the projector 210 when the electronic device 100 is not in use .

The projector 210 may include a first projector 212 and a second projector (214 in FIG. 7). The first projector 212 and the second projector (214 in Fig. 7) can project images in different directions. For example, the first projector 212 projects an image toward the front surface of the electronic device 100, and the second projector (214 of FIG. 7) projects an image toward the rear surface of the electronic device 100 It means that the image can be projected. Whether or not to project an image using the projector 210 among the first and second projectors 212 and 214 can be determined by the control signal of the control unit 140 of the electronic device 100. [ For example, depending on the state of the electronic device 100. The operation of the projector 210 will be specifically described in the corresponding portions.

The electronic device 100 may be divided into a body 141 and a frame 161.

The body 141 may be a part constituting the front surface of the electronic device 100. [ The body 141 may include cameras 110 and 120, a glass 130, a transparent display area 131, and a controller 140.

The transparent display area 131 may be located on each or one side of the glass 130. For example, the first and second transparent display areas 131a and 131b may be provided in the glass 130.

The spectacle frame 161 may be coupled to the body 141. The spectacle frame 161 can be rotated about the hinge 171. [ That is, the eyeglass frame 161 can be rotated clockwise or counterclockwise around the hinge 171. Therefore, at least one of the first and second eyeglass frames 161a and 161b may be rotated counterclockwise to be folded inward of the body 141 or clockwise to fold outwardly of the body 141.

Figure 3 is a perspective view in accordance with another embodiment of the electronic device of Figure 1;

As shown therein, the electronic device 100 according to another embodiment of the present invention may be configured in another form.

The electronic device 100 may not include the glass (130 in Fig. 2). For example, the body 141 may include a body 141 and an eyeglass frame 161, but may be in the form of an eyeglass but not a body of the glass 141 (FIG. 2).

The electronic device 100 can project an image through the projector 210 so that the image can be recognized by a user. For example, when the electronic device 100 is worn, it means that the projector 210 can project an image directly to the user's eye. Therefore, the glass (130 in FIG. 2) to the transparent display area (131 in FIG. 2) may not be necessary. Since the glass (130 in FIG. 2) is not present, the electronic device 100 can be worn more naturally.

FIG. 4 is a flow chart showing an operation process of the electronic device of FIG.

As shown, the controller 140 of the electronic device 100 according to the embodiment of the present invention can perform the step of detecting the current state of the electronic device 100 (S10).

The electronic device 100 may be in various states. Among the states of the various electronic devices 100, a state in which the electronic device 100 is worn can be defined as a first state, and a state in which the electronic device 100 is not worn can be defined as a second state.

The current state of the electronic device 100 can be sensed through the sensor unit 170. [ For example, the electronic device 100 may be connected to the electronic device 100 through a sensing sensor at a point where the electronic device 100 contacts the user's nose, a spectacle frame 161 of the electronic device 100, Which means that it can be detected whether or not it is worn.

The current state of the electronic device 100 may be sensed through the motion sensor. For example, if the electronic device 100 is worn, it can be sensed that the electronic device 100 is moving through the acceleration sensor and / or the geomagnetic sensor.

Detection of the current state of the electronic device 100 may include detection of the state of the eyeglass frame 161. For example, it means that at least one of the first and second eyeglass frames 161a and 161b can be opened or folded. The state of the spectacle frame 161 can be sensed through a position sensor positioned on a hinge located between the spectacle frame 161 and the body 141. [

The current state of the electronic device 100 may be sensed through at least one of the first and second cameras 110 and 120. For example, it means that the captured image can be analyzed to determine whether the user wears it.

The controller 140 determines whether the electronic device 100 is worn (S20), and if it is worn, the controller 140 may display the content in the first mode (S30).

The display of the first scheme may be a display scheme of a form optimized for the worn state. For example, display of contents through the first and second transparent display areas 131a and 131b of the glass 130 or projection of the contents directly to the user's eye through the projector 210. [

The control unit 140 determines whether the electronic device 100 is worn or not (S20), and if it is not being worn, the control unit 140 may display the content in the second mode (S40).

The display of the second scheme may be a display method of a form optimized for the non-application state. That is, it may mean that the content is not displayed on the glass 130 or displayed directly on the user's eye.

If the electronic device 100 is not worn, the electronic device 100 may typically be on the floor. Even if the content is displayed on the glass 130, it may be difficult for the user to identify the displayed content. Therefore, the control unit 140 can change the display mode of the content so that it is easy for the user to identify in the second state.

Fig. 5 is a view showing a state in which the electronic device of Fig. 1 is worn.

As shown, the electronic device 100 according to the embodiment of the present invention can be worn on the face of the user U. When worn on the face of the user U, the body 141 is supported by the nose of the user U, and the first and second frames 161a and 161b can be supported by both ears of the user.

The user U can observe the outside through the glass 130 and the transparent display area 131. [ For example, the information displayed through the transparent display area 131 on an external object viewed through the glass 130 can be displayed in an augmented reality format.

6 is a flow chart specifically showing the step of displaying in the second scheme of the flowchart of Fig.

As shown, the controller 140 of the electronic device 100 according to an exemplary embodiment of the present invention can display the content in a second method in consideration of various conditions. The electronic device 100 according to the embodiment of the present invention can display the content by projecting using the projector 210 when the electronic device 100 is not worn. That is, it means that the content can be projected on a floor surface or the like so that the user can identify it. The projected image can be appropriately delivered to the user due to the adjustment of the image reflecting the situation such as the floor surface.

The control unit 140 can display the content according to the place where the electronic device 100 is placed (S42).

The location of the electronic device 100 may vary. For example, it means that the material, color, etc. of the place where it is placed may be different.

The state of the bottom surface can be sensed through the sensor unit 170 and / or the cameras 110 and 120. For example, it means that the image of the bottom surface photographed through the cameras 110 and 120 is analyzed to detect the state of the bottom surface.

The control unit 140 can display more information when the projected image is easy to identify because the floor surface is smoother than when the material is rough. For example, the control unit 140 may be able to use smaller fonts when the bottom surface is suitable for projection of the image. The control unit 140 can use more various colors when the material of the bottom surface is suitable for projection of an image.

If the color of the bottom surface is bright, the control unit 140 can project the image more brighter. When the color of the bottom surface is dark, the control unit 140 can project the image relatively dark.

The control unit 140 can display the content according to the direction in which the electronic device 100 is placed (S44).

The electronic device 100 may be laid so that the front surface or the rear surface faces the user. Alternatively, the electronic device 100 may be laid such that the bottom surface is in contact with the bottom surface or the top surface is in contact with the bottom surface. The control unit 140 can determine the direction in which the electronic device 100 is placed based on the results detected by the sensor unit 170 and / or the cameras 110 and 120. The control unit 140 can display an optimized image according to the direction in which it is placed.

The control unit 140 can display the content according to the gesture with respect to the electronic device 100 (S46).

A user may take a specific gesture in front of the cameras 110, 120 of the electronic device 100 or take a specific gesture that makes direct contact with a particular portion of the electronic device 100. [ The control unit 140 can change the manner of displaying the content corresponding to the direct / indirect gesture with respect to the electronic device 100, and the like.

The control unit 140 can display the content differently according to the type of the content to be displayed by the electronic device 100 (S48).

The content to be displayed through the electronic device 100 may vary. For example, a message received through the electronic device 100, a received call, various texts, various moving pictures, and the like can be variously displayed. The content to be displayed through the electronic device 100 may be displayed in a different manner depending on the attribute of the content or the like. In other words, it means that content can be displayed in a manner optimized for specific contents.

FIG. 7 is a diagram showing an embodiment of the electronic device display state of FIG. 1;

As shown, the electronic device 100 according to an embodiment of the present invention can display the content DF in a different manner depending on the direction in which the electronic device 100 is placed.

7A, the electronic device 100 is mounted on the lower body portion 172 of the electronic device 100 and / or the lower portion of the frame side of the electronic device 100 in a second state in which the electronic device 100 is not worn. (174) may be in contact with the floor surface.

The electronic device 100 may be provided with a position sensor and / or a geomagnetic sensor. The control unit 140 of the electronic device 100 can sense the state in which the electronic device 100 is placed through the position sensor and / or the geomagnetic sensor.

A pressure sensor may be located on the lower body portion 172 of the electronic device 100 and / or the frame lower side 174. That is, it is possible to detect that the lower body portion 172 of the electronic device 100 and / or the lower frame side portion 174 of the electronic device 100 are in contact with the floor surface through the pressure sensor.

The control unit 140 can display the content DF so as to correspond to the direction of the user. For example, the location of the user can be detected by analyzing images taken through the cameras 110 and 120. [ When the position of the user is detected, the control unit 140 can project the content DF to the projection plane DA using the projector 210. [ For example, it means that the content (DF) can be displayed using the second projector 214 corresponding to the direction in which the user is located.

7 (b), the electronic device 100 is mounted on the upper body side portion 178 of the electronic device 100 and / or the upper side portion of the eyeglass frame side portion 174 of the electronic device 100 in a second state in which the electronic device 100 is not worn. (176) may be in contact with the floor surface.

The control unit 140 can determine the direction in which the content DF is to be displayed. It is possible to determine an appropriate direction to display the content DF among the front surface direction and the rear surface direction of the electronic device 100 using the cameras 110 and 120 and the like.

When the direction is determined, the control unit 140 can display the content DF correctly in the direction in which the user looks. That is, it means that the content DF can be displayed so that the direction in which the user views and the vertical direction of the content DF are aligned with each other. Therefore, regardless of the direction in which the electronic device 100 is placed, the orientation of the content viewed by the user can be the same. That is, the control unit 140 means that the content can be projected so that the orientation of the content is constant with respect to the direction of the user's gaze regardless of the direction in which the electronic device 100 is placed.

Figs. 8 to 10 are views showing another embodiment of the electronic device display state of Fig.

As shown in these drawings, the controller 140 of the electronic device 100 according to another embodiment of the present invention displays the display state of the contents DF according to the state of the color G and / or the material of the floor G, Can be changed.

As shown in Fig. 8 (a), the color of the floor G on which the electronic device 100 is placed may be in various states. Therefore, in a case where the color of the various floor surfaces G is not considered, there may occur a situation in which a specific region of the content DF is easy to identify but other regions are not easily identified.

The control unit 140 can change the manner of displaying the contents DF according to the state of the floor G as shown in Fig. 8 (b). For example, if the color of the bottom surface G is variable, it means that the brightness and / or color of the content DF can be corrected and displayed based on the dark color or the light color. When the color is corrected, the discrimination power for the displayed content DF can be enhanced.

As shown in Fig. 9A, the bottom surface G may be in a state suitable for projecting an image. For example, the bottom surface G is a smooth material, which means that the projected image can be easily identified. The control unit 140 can display the contents DF in detail when the state of the floor G is easy to identify the image.

As shown in Fig. 9 (b), the bottom surface G may not be suitable for projecting an image. The control unit 140 can change the display state of the content DF in the case where the content DF is not suitable to display on the bottom surface G such as the bottom surface is uneven. For example, it is possible to perform at least one of an operation of increasing the font of the content DF, an operation of adjusting the amount and / or type of information, and an operation of simplifying the color scheme by deleting low importance information . Even in the case of the same information, it is possible to increase the discrimination power of the user with respect to the contents DF by displaying the contents DF differently depending on the state of the floor surface G. [

10, the control unit 140 can display the content DF in an appropriate manner according to the brightness of the floor surface G. As shown in Fig.

As shown in Fig. 10 (a), the bottom surface G may be a bright color. When the bottom surface G is a light color, the control unit 140 can display the contents DF using various shades and / or colors.

As shown in Fig. 10 (b), the bottom surface G may be dark in color. When the bottom surface G is dark color, the control unit 140 can display the content DF using simple contrast and / or color. Therefore, the user's discrimination power with respect to the content DF can be enhanced.

Fig. 11 is a view showing another embodiment of the electronic device of Fig. 1; Fig.

FIG. 11 is a diagram illustrating an operation according to an embodiment of the electronic device of FIG. 1;

The electronic device 100 according to the embodiment of the present invention can change the display of the glass 130 in accordance with the state of the spectacle frame 161. [

As shown in Fig. 11 (a), the eyeglass frame 161 may be in an unfolded state. That is, all of the first and second frames 161a and 161b are positioned at about 90 degrees with respect to the body 141. When all of the first and second eyeglass frames 161a and 161b are in the unfolded state, the controller 140 may determine that the user is using the glass 130. [ Accordingly, the control unit 140 can activate the glass 130. [ For example, it means that an image can be displayed through the transparent display area 131. [

As shown in Fig. 11 (b), one of the spectacle frames 161 may be in a folded state. For example, it means that the first eyeglass frame 161a is folded in the direction of the body 141 and the second eyeglass frame 161b is in a state of being stretched in about 90 directions with respect to the body 141 . Considering that the first eyeglass frame 161a is folded, the control unit 140 can deactivate the glass 130 corresponding to the first eyeglass frame 161a. For example, it means that the first transparent display region 131a on the first eyeglass frame 161a side can be deactivated.

As shown in Fig. 11 (c), when the second eyeglass frame 161b is folded, the controller 140 can deactivate the second eyeglass frame 161b corresponding thereto.

As shown in FIG. 11 (d), when all of the first and second eyeglass frames 161a and 161b are folded, the control unit 140 can deactivate the entire glass 130. FIG. That is, if all of the eyeglass frames 161 are folded, the control unit 140 can determine that the user is no longer willing to use the electronic device 100. Therefore, the glasses 130 can be inactivated at the moment when the spectacle frames 161 are all folded or at the moment when the frames 161 are folded and a predetermined time elapses. For example, it means that the display of the image through the transparent display area 131 can be stopped.

Figs. 12 and 13 are diagrams showing an operation method according to an embodiment of the electronic device of Fig. 1;

As shown in these drawings, the electronic device 100 according to the embodiment of the present invention can adjust the display area DA in accordance with the gesture of the user.

As shown in Fig. 12 (a), the display area DA may be a single area. The content can be displayed over a single display area DA.

The control unit 140 can receive a specific gesture from the user. For example, it means that a gesture operation that moves in a certain direction in a state where a second glass 130b, which is a specific glass 130, is touched or touched can be inputted.

As shown in FIG. 12 (b), when a specific gesture is input from the user, the control unit 140 can divide the display area DA. For example, it can be divided into a first display area DA1 corresponding to the first glass 130a side and a second display area DA2 corresponding to the second glass 130b side. That is, the controller 140 can change the width and / or the number of the display area DA in which the content is displayed according to the attribute of the content and / or the user's input.

13 (a), the control unit 140 can receive another gesture from the user. For example, it means that the first glass 130a can be touched or touched and moved in a certain direction.

As shown in FIG. 13 (b), the controller 140 can merge the divided display areas DA corresponding to the user's touch input.

Figs. 14 to 18 are diagrams showing an operation method according to another embodiment of the electronic device of Fig. 1;

As shown in these figures, the electronic device 100 according to the embodiment of the present invention can effectively display the contents in the projection area in various situations.

A situation may occur in which a new message is received in a second state in which the electronic device 100 is not worn, as shown in Fig. 14 (a). When the control unit 140 detects that the electronic device 100 is in the second state, it can display the fact that the message has been received in the display area DA. That is, it means that the user is expected to be in a state of being distanced from the electronic device 100 by a certain distance, and that the discrimination power can be increased by displaying on the bottom surface instead of the glass 130.

The control unit 140 can display the fact that the message has been received by the character and / or character icon I1. The controller 140 may stop the display of the display area DA after displaying the character and / or character icon I1 for a certain period of time from the time when the character is received, unless otherwise manipulated by the user.

As shown in FIG. 14 (b), a call can be additionally received in the second state. The control unit 140 can display the fact that the call has been received by the character and / or call icon I2.

As shown in Fig. 15 (a), the user can perform a constant gesture operation on the electronic device 100 with the finger F or the like. For example, a gesture operation that touches the glass 130 of the electronic device 100 can be performed.

The control unit 140 can activate the display area DA that was inactivated when the user's gesture operation is performed. That is, the projection of the image using the projector 210 can be restarted.

As shown in (b) of FIG. 15, when receiving a specific gesture input from the user, the controller 140 can sequentially display events received but not confirmed by the user. For example, it means that the call icon (I2) or the like can indicate that there is a call that can not be confirmed in one of the divided display areas (DA).

As shown in Fig. 16A, the user can perform a constant gesture on the electronic device 100 with the finger F or the like. For example, it means that an operation of touching the eyeglass part of the electronic device 100 can be performed.

As shown in FIG. 16B, in response to the user's touch operation, the control unit 140 can display contents of other events that the user has not confirmed. For example, message icons (I1) and / or characters.

As shown in Fig. 17 (a), a message can be received when the electronic device 100 is in the second state. The control unit 140 may display a message icon I1 indicating that a message reception event has occurred.

As shown in FIG. 17 (b), when a specific event such as reception of the message icon I1 occurs, the user may want to perform the subsequent operation after wearing the electronic device 100. [ In such a case, the user can hold the spectacle frame 161 and wear it. For example, it means that the electronic device 100 can be worn by gripping the first and second touch points TP1 and TP2.

The controller 140 can display the contents of the glass 130 in the first state when the electronic device 100 is worn by gripping at least one of the first and second touch points TP1 and TP2. That is, it means that the content can be displayed in a manner different from the second state. When the user touches at least one of the first and second touch points TP1 and TP2 or the transition to the first state is completed, the control unit 140 can stop displaying the content using the projector 210. [

The control unit 180 can determine that the state of the electronic device 100 has been changed if there is a touch on at least one of the first and second touch points TP1 and TP2. For example, it means that the electronic device 100 is not worn but it can be determined that at least one of the first and second touch points TP1 and TP2 is changed to the first state worn when the touch is touched. The touch point may be a part other than the first and second touch points TP1 and TP2 shown in the figure. For example, the touch input to the front side or the back side of the electronic device 100 can be obtained.

The control unit 180 can determine the state of the electronic device 100 by combining the acquired other signal with the touch signal. For example, when the motion sensor senses the operation of lifting the electronic device 100 after touching at least one of the first and second touch points TP1 and TP2, the state of the electronic device 100 is It means that it can be judged as changed.

The control unit 180 can perform another operation according to the touched point. For example, when the first touch point TP1 is touched, an image is displayed on a display close to the first touch point TP1. When the second touch point TP2 is touched, a display close to the second touch point TP2 Quot; image " The operation corresponding to the touch position can be similarly applied even when it is determined that the electronic device 100 is worn.

As shown in Fig. 18 (a), the electronic device 100 may have a plurality of events that are not confirmed by the user. For example, there may be an unacknowledged message event and an unreceived call event. The presence of a plurality of events may be indicated by a message icon I1, a call icon I2, or the like.

As shown in FIG. 18 (b), the user can touch any one of the first and second touch points TP1 and TP2 in accordance with an event to be confirmed. For example, when the first touch point TP1 is touched, the control unit 140 can display contents related to the call icon I2 on the first touch point TP1 side. When the second touch point TP2 is touched, the control unit 140 can display contents related to the message icon I1 on the second touch point TP2 side. That is, when the touch operation of the user with respect to the electronic device 100 is sensed, it means that contents related to the content corresponding to the touch operation can be displayed.

The electronic device 100 can be more conveniently used by performing an operation corresponding to a gesture input that the user can intuitively recognize.

FIG. 19 is a flow chart specifically illustrating a process of detecting the current state of the electronic device of FIG. 4, and FIG. 20 is a diagram illustrating methods of detecting the current state of the electronic device of FIG.

As shown, the current state of the electronic device 100 can be determined based on the state information of the electronic device 100 acquired directly and / or indirectly.

The control unit 180 may proceed to step S12 to detect the state through direct and / or indirect means.

The electronic device 100 may be in various states. For example, the user may be in one of a state in which the user wears the electronic device 100 and a state in which the user does not wear the electronic device 100. The electronic device 100 according to an embodiment of the present invention may be a device that worn on the user's face like a pair of glasses. Therefore, the state in which the electronic device 100 is worn may be a state in which the eyeglass frame 161, which is a frame constituting the electronic device 100, is unfolded and joined to the face portion of the user. The state in which the electronic device 100 is not worn may include a floor, not a face of the user, or a state gripped by a user's hand.

The state of the electronic device 100 may be sensed through a direct and / or indirect method. A direct and / or indirect method of detecting the state of the electronic device 100 is as shown in Fig.

The direct method may be a method of detecting the condition through the sensor. For example, it means that the wearing state of the user can be directly detected through the state of the wearing sensor, the camera, and the spectacle frame. The information obtained from the direct sensing device may be the first information. The direct method can be a relatively accurate method, but the increase in the cost may be caused by the attachment of the sensor.

An indirect method may be a method other than directly sensing the state with a sensor. For example, it implies that the wearing state of the user, such as the time preset by the user and progress of charging, can be indirectly estimated. The information obtained from the indirect sensing device may be the second information. Specific details of the direct method and the indirect method are explained in the corresponding part.

The control unit 180 may proceed to step S14 to detect the current state through the combination of the sensed information.

The sensed information may be at least one. For example, in addition to the first information acquired through the camera, the second information acquired through the progress of the charging may exist.

The control unit 180 can determine whether the electronic device 100 is worn based on at least one of the first information and the second information. Information can be used as a basis for judging the current state of the electronic device 100 more accurately. That is, information based on a plurality of information can be more accurate than information based on one information.

By combining the information, the current state of the electronic device 100 can be detected at a relatively low cost. For example, it is possible to increase the reliability of judgment by combining the information acquired through the existing device installed in the electronic device 100, rather than the information acquired through the sensor, which increases in cost depending on the installation, Can be minimized.

FIGS. 21 and 22 are diagrams illustrating a sensing method using a sensor of the electronic device of FIG.

As shown in these drawings, the electronic device 100 according to an embodiment of the present invention can directly detect whether or not the electronic device 100 is worn through the wear sensor 210 provided on the electronic device 100. [

As shown in Fig. 21, the wear sensor 210 may be positioned at a position where the electronic device 100 is brought into contact with the wearer's body as the wearer wears it. For example, the first sensing sensor 212 and / or the second sensing sensor 214 may be positioned at a portion of the legs of the multi-eyeglass frame 161 that directly contacts the user's head, .

The first and second sensing sensors 212 and 214 can directly detect whether or not they are worn through a method of detecting a pressure applied at the time of wearing and / or a change in an electromagnetic field occurring when the user touches a new place .

As shown in Fig. 22, the electronic device 100 can acquire information from a motion sensor capable of sensing the motion of the user.

The Moessen sensor may include an acceleration sensor or the like. Therefore, it is possible to detect the amount of exercise caused by the movement of the user. The control unit 180 can determine that the electronic device 100 is not worn between t1 and t2 and t3 to t4 when the momentum becomes zero.

Fig. 23 is a diagram showing a detection method using the camera of Fig. 1 electronic device. Fig.

As shown in the figure, the electronic device 100 according to an embodiment of the present invention can sense the wearing state of the electronic device 100 through the camera 110. [

The camera 110 may be one of the direct sensing devices capable of sensing the wearing state of the electronic device 100. [ That is, it means that the apparatus can be a device for producing first information that can determine whether or not the image is worn by analyzing the image depending on whether the image is worn or not.

The first image VA1 photographed through the camera 110 when the user wears the first image VA2 and the second image VA2 photographed through the camera 110 when the electronic device 100 is placed on the bottom surface can be different. For example, the second image VA2 means that the same object can be photographed for a predetermined time or more. The control unit 180 can determine whether or not the electronic device 100 is worn based on the difference between the photographed images.

The control unit 180 can determine the accuracy of the information with the camera 110 in accordance with the determination based on the other information. For example, when the movement of the electronic device 100 is not detected for a predetermined time or more according to the information acquired through the motion sensor, the user may attempt to shoot an image through the camera 110. If there is no change in the photographed object as a result of the image photographed through the camera 110, the controller 180 can determine that the electronic device 100 is in the non-attaching state.

Fig. 24 is a diagram showing a sensing method according to the state of the spectacle frame of the electronic device of Fig. 1;

As shown, the controller 180 of the electronic device 100 according to an embodiment of the present invention can determine whether or not the eyeglass frame 161 is worn based on the state of the eyeglass frame 161.

As shown in Fig. 24 (a), the spectacle frame 161 of the electronic device 100 may be in an unfolded state. Alternatively, as shown in Figs. 24 (b) to 24 (d), at least one of the spectacle frames 161 of the electronic device 100 may be in a folded state.

The control unit 180 can detect the state of the spectacle frame 161. For example, it means that, through the frame sensor, it is possible to detect whether the spectacle frame 161 is unfolded or folded.

The control unit 180 can detect the state of the electronic device 100 based on whether or not the eyeglass frame 161 is tangled. For example, if at least one of the eyeglass frames 161 is in a folded state, the control unit 180 may determine that the electronic device 100 is in a non-attaching state. However, it can be determined that the electronic device 100, in which all of the spectacle frames 161 are unfolded, is in a wear state.

FIG. 25 is a diagram illustrating a time-based sensing method of the electronic device of FIG. 1;

As shown in the figure, the electronic device 100 according to an embodiment of the present invention can determine whether to wear or not to use according to the time set by the user and / or the controller 180.

The control unit 180 can determine whether to wear or not to use according to the set time. For example, it is assumed that the electronic device 100 is not worn within the time range set by the user as the non-wearing time, and the electronic device 100 is estimated to be worn within the time range set by the wearer .

The wearing time or non-wearing time can be applied by the setting of the user. That is, if the user tends not to wear the electronic device 100 at a specific time, it is possible to use the battery of the electronic device 100 efficiently by setting it in advance.

The wearing time or non-wearing time may be set by the control unit 180. [ For example, the controller 180 may sense the time when the electronic device 100 is used through a motion sensor or the like. The controller 180, which senses the time when the electronic device 100 is used, may schedule the wear time of the electronic device 100 to correspond to the time. The control unit 180 can estimate the wearing or not wearing within the time range according to the scheduled time.

FIG. 26 is a view showing a sensing method according to charging of the electronic device of FIG. 1;

As shown in the figure, the controller 180 of the electronic device 100 according to an embodiment of the present invention can determine whether to charge the electronic device 100 based on whether the electronic device 100 is being charged or not.

The electronic device 100 may need to be recharged at regular intervals depending on the degree of use. Charging to the electronic device 100 may be accomplished through a separate charging device 300. For example, it means that the charging can proceed in such a way that the charging line extending from the charging device 300 is connected to the electronic device 100.

The control unit 180 can determine that the electronic device 100 is not worn when the electronic device 100 is being charged. This can be based on a survey of the user's normal use of the electronic device 100.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit and scope of the invention. Accordingly, such modifications or variations are intended to fall within the scope of the appended claims.

100: electronic device 110: wireless communication unit
140: sensing unit 151: display unit
180:

Claims (13)

A frame coupled to at least one of the face so that the device can be worn on the user's face; And
At least one of the first information acquired from the direct sensing device directly sensing the wearing state of the user and the second information acquired from the indirect sensing device indirectly sensing the wearing state of the user, And a controller for determining whether the device is worn or not based on the determination result. The method according to claim 1,
Wherein,
Wherein the electronic device determines whether the device is worn by combining at least one of the first information and the second information. The method according to claim 1,
Wherein the first information comprises:
At least one of a sensing sensor installed at at least one point of the device and contacting at least one point of the user's body, a frame sensor sensing the state of the frame, and a motion sensor sensing motion of the device, Lt; RTI ID = 0.0 > 1, < / RTI > The method according to claim 1,
Wherein the second information comprises:
Wherein the status information includes at least one of a time range for wearing or not wearing the device, and a charging progress for the device. The method according to claim 1,
Further comprising at least one glass equipped with a display function,
Wherein,
And when the device is in the non-use state, displays the content using the at least one glass. The method according to claim 1,
Further comprising at least one projector,
Wherein,
Wherein the at least one projector is used to project the content toward a projection surface when the device is in the non-use state. The method according to claim 1,
Wherein,
Detecting a user's gripping operation on at least one of the devices,
Wherein the electronic device determines that the device is in a wear state regardless of the first and second information. Sensing a state of the device; And
Based on at least one of the first information obtained from the direct sensing device directly sensing the wearing state of the user and the second information acquired from the indirect sensing device indirectly sensing the wearing state of the user, And judging whether or not the electronic device is connected to the electronic device. 9. The method of claim 8,
Wherein the determining step comprises:
And determining whether the device is worn by combining at least one of the first information and the second information. 9. The method of claim 8,
Wherein the first information comprises:
At least one camera installed at least one point of the device and contacting at least one point of the user's body, a frame sensor detecting the state of the frame, and a motion sensor detecting motion of the device And the state information including the acquired information. 9. The method of claim 8,
Wherein the second information comprises:
Wherein the state information includes at least one of a time range for wearing or not attaching the device, and a charging progress for the device. 9. The method of claim 8,
And displaying the content using at least one glass when the device is in the non-use state. 9. The method of claim 8,
And projecting the content toward the projection surface using at least one projector when the device is in the non-application state.

Images