KR20130092360A - Electronic apparatus and method for controlling electronic apparatus thereof - Google Patents

Abstract

An electronic device and a method of setting an angle of view thereof are provided. In the method of setting an angle of view of the electronic device, when a preset event occurs, an angle of view guide UI for guiding setting of a camera angle of view connected to the electronic device is displayed on a region of the display screen, and the angle of view of the camera is displayed using the angle of view guide UI. Set. Accordingly, the user can more easily set the angle of view of the camera using the angle of view guide UI.

Description

[0001] DESCRIPTION [0002] ELECTRONIC APPARATUS AND METHOD FOR CONTROLLING THE SAME [0002]

The present invention relates to an electronic device and a control method thereof, and more particularly, to an electronic device and a control method thereof controlled according to a user voice or a user motion.

Various types of electronic devices have been developed and spread by the development of electronic technology. Especially, in recent years, various types of electronic devices including TVs are used in general households. These electronic devices have gradually become various functions according to the demand of the user. Especially, in the case of TV, recently, it is connected to the Internet and supports Internet service. In addition, the user can view a large number of digital broadcasting channels through the TV.

Accordingly, various input methods for efficiently using various functions of the electronic apparatus are required. For example, an input method using a remote controller, an input method using a mouse, and an input method using a touch pad have been applied to electronic devices.

However, with such a simple input method, it has been difficult to effectively use various functions of the electronic device. For example, if all the functions of the electronic device are controlled to be controlled by only the remote control, it is inevitable to increase the number of buttons of the remote control. In this case, it was never easy for ordinary users to learn how to use the remote control. In addition, in the method of displaying various menus on the screen and allowing the user to find and select the corresponding menu, the user has to check the complicated menu tree and select the menu desired by him.

Therefore, in recent years, technologies using voice recognition and motion recognition have been developed to control electronic devices more conveniently and intuitively. In particular, in order for a user to control the electronic device more efficiently using voice recognition or motion recognition, the electronic device needs a UI for guiding voice recognition or motion recognition.

However, in the related art, there is no proper UI for controlling the electronic device by voice recognition or motion recognition, and thus, there is a lot of inconvenience for the user to control the electronic device using voice recognition or motion recognition.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-described problem, and an object of the present invention is to provide an electronic device and a method of controlling the same, which provide various UIs for a user to more conveniently control the electronic device using voice recognition or motion recognition. In providing.

According to an aspect of the present invention, there is provided a method of controlling an electronic device, the method including: displaying first voice guide information for guiding a user voice for controlling the electronic device; Receiving a user command for controlling an external device connected to the electronic device; And when the user command is input, converting and displaying the first voice guide information into second voice guide information for guiding a user voice for controlling the external device.

The method may further include searching for and reading second voice guide information corresponding to the external device from among the plurality of voice guide information previously stored in the electronic device.

Further, when the electronic device is a TV, the first voice guide information includes at least one of a voice command for power control, a voice command for executing an external device, a voice command for channel setting, and a voice command for volume setting. If the external device is one of a DVD player and a BD player, the second voice guide information may include at least one of a voice command related to power control, a voice command related to execution of an external device, and a voice command related to a playback setting. Can be.

And if the user voice command included in the first voice guide information is input when the first voice guide information is displayed, controlling the electronic device according to the user voice command; And when the user voice command included in the second voice guide information is input, when the second voice guide information is displayed, generates a control signal corresponding to the input user voice command and outputs the generated control signal to the external device. The method may further include transmitting to the device.

In addition, when the second voice guide information is displayed, when a user voice command corresponding to one of the voice commands included in the second voice guide information is input, a control signal corresponding to the input user voice command is generated. step; And wirelessly transmitting the generated control signal to a relay device for transmitting the generated control signal to the external device.

The generated control signal is transmitted to the relay device through Bluetooth communication, and the relay device may convert the transmitted control signal into an IR signal and transmit the converted control signal to the external device.

Each of the first voice guide information and the second voice guide information may include an icon indicating that a mode of the electronic device is a voice control mode.

The first voice guide information and the second voice guide information may be displayed at the bottom of a screen on which content is displayed.

The user command may be a user voice command input through a voice input unit for controlling an external device.

On the other hand, according to an embodiment of the present invention for achieving the above object, an electronic device, a voice input unit for receiving a user voice; A display unit; And display first voice guide information guiding a user voice for controlling the electronic device on the display unit, and when a user command for controlling an external device connected to the electronic device is input, the first voice guide information is displayed. And a control unit which controls the display unit to change and display second voice guide information guiding a user voice for controlling the external device.

The apparatus may further include a storage unit configured to store a plurality of voice guide information, wherein the controller may search for and read second voice guide information corresponding to the external device from among the plurality of voice guide information stored in the storage unit. have.

Further, when the electronic device is a TV, the first voice guide information includes at least one of a voice command for power control, a voice command for executing an external device, a voice command for channel setting, and a voice command for volume setting. If the external device is one of a DVD player and a BD player, the second voice guide information may include at least one of a voice command related to power control, a voice command related to execution of an external device, and a voice command related to a playback setting. Can be.

And an external terminal input unit configured to connect with the external device, wherein the controller, when the first voice guide information is displayed, when a user voice command included in the first voice guide information is inputted, In response to the user voice command, when the user voice command included in the second voice guide information is input when the electronic device is controlled and the second voice guide information is displayed, the electronic device corresponds to the input user voice command. The control signal may be generated to transmit the generated control signal to the external device through the external terminal input unit.

The apparatus may further include a network interface unit configured to communicate with a relay device communicating with the external device, wherein the controller is included in the second voice guide information when the second voice guide information is displayed. When a user voice command corresponding to one of the voice commands is input, a control signal corresponding to the input user voice command may be generated, and the generated control signal may be wirelessly transmitted to the relay device through the network interface unit.

The generated control signal is transmitted to the relay device through Bluetooth communication, and the relay device may convert the transmitted control signal into an IR signal and transmit the converted control signal to the external device.

Each of the first voice guide information and the second voice guide information may include an icon indicating that a mode of the electronic device is a voice control mode.

The first voice guide information and the second voice guide information may be displayed at the bottom of a screen on which content is displayed.

The user command may be a user voice command input through the voice input unit for controlling the external device.

On the other hand, according to an embodiment of the present invention for achieving the above object, a control method of an electronic device comprises the steps of: displaying first motion guide information for guiding a user motion for controlling the electronic device; Receiving a user command for controlling an external device connected to the electronic device; And when the user command is input, changing and displaying the first motion guide information into second motion guide information for guiding a user motion for controlling the external device.

On the other hand, an electronic device according to an embodiment of the present invention for achieving the above object, the voice motion unit for receiving a user motion; A display unit; And display first motion guide information guiding user motion for controlling the electronic device on the display unit, and when a user command for controlling an external device connected to the electronic device is input, the first motion guide information is displayed. And a controller configured to control the display to change and display second motion guide information guiding a user motion for controlling the external device.

On the other hand, according to an embodiment of the present invention for achieving the above object, the method of setting the angle of view of the electronic device, when a predetermined event occurs, to guide the setting of the camera angle of view connected to the electronic device to a region of the display screen Displaying an angle of view guide UI; And setting an angle of view of the camera using the angle of view guide UI.

The angle of view guide UI may not be displayed when an event of entering the motion task mode occurs.

The angle of view guide UI may include a screen displaying an image captured by the camera when the angle of view is set.

The setting may include adjusting the camera to automatically move the angle of view of the camera at a preset speed and direction; If a user command is input while adjusting the camera, setting the angle of view of the time point at which the user command is input to the angle of view of the camera.

The setting may include adjusting the camera according to a user's operation using an external device; If a user command is input while adjusting the camera, setting the angle of view of the time point at which the user command is input to the angle of view of the camera.

The preset event may include an event in which power is supplied to the electronic device when the electronic device is first installed, an event in which a motion task mode is turned on, and an event in which an angle of view setting menu is selected from a control menu of the electronic device. It can be one.

The camera may be a camera that captures a motion of a user for controlling the electronic device in a motion task mode.

On the other hand, according to an embodiment of the present invention for achieving the above object, an electronic device, a camera for photographing the motion of the user; A display unit; And a controller configured to display an angle of view guide UI for guiding setting of the angle of view of the camera in one region of the display unit, and to set the angle of view of the camera using the angle of view guide UI.

The controller may display the screen provided by the electronic device without displaying the angle of view guide UI even when entering the motion task mode.

The angle of view guide UI may include a screen for displaying an image captured by the camera when the angle of view is set.

The controller may adjust the camera so that the angle of view of the camera is automatically moved at a preset speed and direction, and if a user command is input while adjusting the camera, the controller may recognize the angle of view at the time when the user command is input. Can be set to the angle of view of the camera.

The controller may adjust the camera according to a user's operation using an external device, and if a user command is input while adjusting the camera, the controller may set an angle of view at which the user command is input to the angle of view of the camera. have.

The preset event may include an event in which power is supplied to the electronic device when the electronic device is first installed, an event in which a motion task mode is turned on, and an event in which an angle of view setting menu is selected from a control menu of the electronic device. It can be one.

The camera may be a camera that captures a motion of a user for controlling the electronic device in a motion task mode.

On the other hand, according to an embodiment of the present invention for achieving the above object, a control method of an electronic device, if a motion start command is input, displaying an icon and a pointer for performing a motion task mode; Moving the pointer according to a first motion of a user; And executing a function corresponding to the icon when the second motion of the user is input while the pointer is positioned on the icon.

The pointer positioned on the icon may be fixed without moving while the second motion of the user is input.

The executing may include continuously executing a function of an icon on which the pointer is located when the input of the second motion is maintained while the pointer is on the icon.

The first motion of the user may be a spread motion of folding the user's hand, and the second motion of the user may be a grab motion of holding the user's hand.

In addition, the icon may include at least one of a volume-up icon, a volume-down icon, a channel-up icon, and a channel-down icon.

The icon may include a volume-up icon and the volume-down icon displayed in one of a left area and a right area of a display screen; And a channel-up icon and the channel-down icon displayed on the other of the left area and the right area of the display screen.

In addition, current volume level information of the electronic device is displayed in an area where the volume-up icon and the volume-down icon are displayed, and an area where the channel-up icon and the channel-down icon is displayed. Current channel information may be displayed.

And. The method may further include removing the displayed icons and pointers from the display screen when the motion end motion is input.

According to another aspect of the present invention, there is provided an electronic device including: a motion input unit receiving motion of a user; A display unit; And displaying an icon and a pointer for performing a motion task mode when a motion start command is input through the motion input unit, and controlling the display unit to move the pointer according to a user's first motion input to the motion input unit. And a controller configured to execute a function corresponding to the icon when the second motion of the user is input to the motion input unit while the pointer is located on the icon.

The controller may fix the position of the pointer without moving while the second motion of the user is input.

The controller may continuously execute a function of an icon on which the pointer is located when the input of the second motion is maintained while the pointer is on the icon.

The first motion of the user may be a spread motion of folding the user's hand, and the second motion of the user may be a grab motion of holding the user's hand.

In addition, the icon may include at least one of a volume-up icon, a volume-down icon, a channel-up icon, and a channel-down icon.

The icon may include a volume-up icon and the volume-down icon displayed in one of a left area and a right area of a display screen; And a channel-up icon and the channel-down icon displayed on the other of the left area and the right area of the display screen.

In addition, current volume level information of the electronic device is displayed in an area where the volume-up icon and the volume-down icon are displayed, and an area where the channel-up icon and the channel-down icon is displayed. Current channel information may be displayed.

When the motion end motion is input through the motion input unit, the controller may remove the displayed icons and pointers from the display screen of the display unit.

On the other hand, according to an embodiment of the present invention for achieving the above object, a control method of an electronic device capable of speech recognition, comprising: receiving a voice start command; If the voice start command is a first voice start command, the electronic device switches to a first voice task mode controlled according to a user voice input to a voice input unit of the electronic device, and if the voice start command is a second voice start command, the electronic Switching to a second voice task mode controlled according to a user voice input to an external device interworking with the device; And displaying voice guide information corresponding to the switched voice task mode.

The first voice initiation command may be a voice command of a user including a preset word, and the second voice start command may be a user command in which a preset button included in the external device is pressed.

The voice guide information may include an icon area indicating a switched mode among the first voice task mode and the second voice task mode.

The voice guide information may include a plurality of voice commands for guiding a user voice to perform a voice task mode, and included in voice guide information of the first voice task mode and voice guide information of the second voice task. The voice commands may differ from each other.

In addition, the voice guide information of the first voice task mode includes a voice command for performing a channel up / down command, and the voice guide information of the second voice task mode includes a voice command for performing a channel up / down command. Is not included, a voice command for providing a channel list may be included.

The second voice task mode may be controlled by pressing a preset second button of the external device and a user voice command input to the external device.

In addition, the external device may be a remote control.

On the other hand, according to an embodiment of the present invention for achieving the above object, an electronic device, a voice input unit for receiving a user voice; A display unit; And when the voice start command input through the voice input unit is a first voice start command, switch to a first voice task mode controlled according to a user voice input to the voice input unit of the electronic device, and the voice start command is set to a second voice start command. In response to the voice start command, the user enters a second voice task mode controlled according to a user voice input to an external device linked to the electronic device, and displays voice guide information corresponding to the switched voice task mode on the display unit. It includes a control unit.

The first voice initiation command may be a voice command of a user including a preset word, and the second voice start command may be a user command in which a preset button included in the external device is pressed.

The voice guide information may include an icon area indicating a switched mode among the first voice task mode and the second voice task mode.

The voice guide information may include a plurality of voice commands for guiding a user voice to perform a voice task mode, and included in voice guide information of the first voice task mode and voice guide information of the second voice task. The voice commands may differ from each other.

In addition, the voice guide information of the first voice task mode includes a voice command for performing a channel up / down command, and the voice guide information of the second voice task mode includes a voice command for performing a channel up / down command. Is not included, a voice command for providing a channel list may be included.

The second voice task mode may be controlled by pressing a preset second button of the external device and a user voice command input to the external device.

In addition, the external device may be a remote control.

On the other hand, according to an embodiment of the present invention for achieving the above object, a control method of an electronic device, comprising: receiving a two-hand start command for performing a motion task using two hands; Switching to a two-handed task mode for performing a motion task using the two hands when the two-handed start command is input; And displaying a two-handed input guide GUI for performing a motion task using the two hands when the mode is changed to the two-handed task mode.

In the receiving of the input, when a motion start command using one hand is input, the user enters a motion task mode for performing a motion task, and the motion start command using the other hand is changed in a state of switching to the motion task mode. When input, it can be recognized that the two-hand start command has been input.

The receiving of the input may include recognizing that the two-hand start command is input when a shake motion of simultaneously shaking both hands is input.

The motion task using both hands may be a task of enlarging or reducing a display screen.

Also, when the two-handed input guide GUI is moved away from each other while the two-handed input guide GUI is displayed in one area on the display screen, the display screen is enlarged based on a predetermined position within the area where the two-handed input guide GUI is displayed, The method may further include reducing the display screen based on a predetermined position in an area in which the two-handed input guide GUI is displayed when the motions approaching each other are input.

In the displaying of the two-handed input guide GUI, a circular two-handed input guide GUI may be displayed in a central area of the display screen.

The method may further include moving the two-handed input guide GUI having a circular shape so as to correspond to the movement of the two hands when the movement of the two hands is input.

The two-handed input guide GUI is two pointers displayed at points corresponding to the positions of the two hands of the user. The motion task using both hands may be a task of enlarging or reducing a display screen using the two pointers.

According to another aspect of the present invention, there is provided an electronic device including: a motion input unit receiving motion of a user; A display unit; And when a two-handed start command for performing a two-handed motion task is input to the motion input unit, switch to a two-handed task mode for performing the two-handed motion task, and perform the two-handed motion task. And a controller configured to display a two-handed input guide GUI for the display unit.

The controller, when a motion start command using one hand is input to the motion input unit, switches to a motion task mode for performing a motion task, and the other hand changes the motion task mode to the other hand. When a motion start command using the input signal is input, the two hand start command may be recognized as input.

The controller may recognize that the two-handed start command is input when the shake motion of simultaneously shaking both hands is input through the motion input unit.

The motion task using both hands may be a task of enlarging or reducing a display screen.

The controller may be further configured to enlarge the display screen based on a predetermined position within a region where the two-handed input guide GUI is displayed when the two-handed input GUI is displayed in a region on the display screen. When the motions in which the two hands are close to each other are input, the display screen may be reduced based on a predetermined position in an area where the two-handed input guide GUI is displayed.

The two-handed input guide GUI may be a circular GUI in a central area of the display screen.

The controller may move the circular two-handed input guide GUI to correspond to the movement of the two hands when the movement of the two hands is input through the motion input unit.

The two-handed input guide GUI is two pointers displayed at points corresponding to the positions of the two hands of the user, and the motion task using the two hands is a task of enlarging or reducing the display screen using the two pointers. Can be.

On the other hand, according to an embodiment of the present invention for achieving the above object, a control method of an electronic device, comprising: receiving a voice start command through a voice input unit; Switching a mode of the electronic device to a voice task mode when the voice start command is input; and when a voice recognition error occurs in the voice task mode, one of a plurality of feedback messages for guiding a voice recognition error guide. Including; displaying.

And when a voice recognition error occurs repeatedly in the voice task mode, randomly selecting and displaying one of the plurality of feedback messages.

The voice task mode may include a first voice task mode controlled according to a user voice input to a voice input unit of the electronic device and a second voice task controlled according to a user voice input to an external device interoperating with the electronic device. It may include a mode.

The plurality of feedback messages may be different depending on the type of the voice task mode.

The plurality of feedback messages may be different according to the type of the speech recognition error.

The voice recognition error may include an error of not clearly recognizing a user voice input through the voice input unit, an error of pressing a recognition button of an external device for a preset time after inputting the user voice, and the external After pressing the recognition button of the device may include at least one of the error that the user voice is not input for a predetermined time.

The displaying may include displaying a default feedback message when the voice recognition error occurs for the first time.

On the other hand, according to an embodiment of the present invention for achieving the above object, an electronic device, a voice input unit for receiving a user voice; A display unit; And a plurality of feedback messages for guiding a voice recognition error guide when a voice start command is input through the voice input unit, switching a mode of the electronic device to a voice task mode, and when a voice recognition error occurs in the voice task mode. And a controller for displaying one of the display units.

The controller may randomly select and display one of the plurality of feedback messages when a voice recognition error occurs repeatedly in the voice task mode.

The voice task mode may include a first voice task mode controlled according to a user voice input to a voice input unit of the electronic device and a second voice task controlled according to a user voice input to an external device interoperating with the electronic device. It may include a mode.

The plurality of feedback messages may be different depending on the type of the voice task mode.

The plurality of feedback messages may be different according to the type of the speech recognition error.

The voice recognition error may include an error of not clearly recognizing a user voice input through the voice input unit, an error of pressing a recognition button of an external device for a preset time after inputting the user voice, and the external After pressing the recognition button of the device may include at least one of the error that the user voice is not input for a predetermined time.

In addition, when the voice recognition error occurs for the first time, the controller may display a default feedback message on the display unit.

On the other hand, according to an embodiment of the present invention for achieving the above object, a control method of an electronic device comprises: receiving a voice start command through a voice input unit; When the voice start command is input, the voice guide information including a plurality of voice commands for changing the mode of the electronic device to a voice task mode controlled by a user voice and performing the voice task mode in the electronic device is displayed. Making; And changing at least one of the plurality of voice commands to another voice command according to a user input.

The voice guide information may include a fixed command area in which a voice command is fixedly displayed and a change command area in which the voice command is variably changed.

In addition, the fixed command area may include a voice command for powering off the electronic device.

The changing may include executing the application when a user command for executing the application is input; And when the application is executed, changing at least one of the plurality of voice commands into a voice command corresponding to the executed application.

The changing may include receiving a user command for displaying the user preferred voice command; And when the user command is input, changing at least one of the plurality of voice commands into a user preferred voice command set by a user.

The changed voice guide information may include a voice command for performing a switch to the voice guide information before the change.

On the other hand, according to an embodiment of the present invention for achieving the above object, an electronic device, a voice input unit for receiving a user voice; A display unit; And a plurality of voice commands for switching a mode of the electronic device to a voice task mode controlled by a user voice and performing a voice task mode in the electronic device when a voice start command is input through the voice input unit. And a controller configured to display voice guide information on the display unit and change at least one of the plurality of voice commands to another voice command according to a user input.

The voice guide information may include a fixed command area in which a voice command is fixedly displayed and a change command area in which the voice command is variably changed.

In addition, the fixed command area may include a voice command for powering off the electronic device.

When the user command to execute the application is input, the controller may execute the application and change at least one of the plurality of voice commands into a voice command corresponding to the executed application.

The controller may change at least one of the plurality of voice commands into a user preferred voice command set by a user when a user command for displaying the user preferred voice command is input.

The changed voice guide information may include a voice command for performing a switch to the voice guide information before the change.

On the other hand, according to an embodiment of the present invention for achieving the above object, a control method of an electronic device, comprising: receiving a motion start command through a motion input unit; When the motion start command is input, the mode of the electronic device is switched to a motion task mode controlled by a user motion, and motion guide information including a plurality of motion items for performing the motion task mode in the electronic device is displayed. Making; And if an application execution command is input, changing at least one of the plurality of motion items into a motion item corresponding to the executed application.

On the other hand, an electronic device according to an embodiment of the present invention for achieving the above object, a motion input unit for receiving a user motion; A display unit; And a plurality of motion items for switching a mode of the electronic device to a motion task mode controlled by a user motion and performing a motion task mode in the electronic device when a motion start command is input through the motion input unit. And a controller configured to display motion guide information on the display unit and to change at least one of the plurality of motion items into a motion item corresponding to the executed application when an application execution command is input.

According to various embodiments of the present disclosure as described above, the user may control the electronic device more easily and conveniently using various voice UIs or motion UIs.

1 to 3 are block diagrams illustrating a configuration of an electronic device according to various embodiments of the present disclosure;
4 to 7 are diagrams for describing a method of providing different voice guide information according to an external device connected to an electronic device according to one embodiment of the present invention;
8 is a flowchart illustrating a method of providing different voice guide information according to an external device connected to an electronic device according to an embodiment of the present invention;
9 is a diagram illustrating a system including an electronic device, an external device, and a relay device for relaying an electronic device and an external device, according to an embodiment of the present invention;
10 is a diagram illustrating a camera provided in an electronic device according to an embodiment of the present disclosure;
FIG. 11 is a diagram illustrating an angle of view setting UI for setting an angle of view of a camera included in an electronic device according to an embodiment of the present disclosure; FIG.
12 is a flowchart illustrating a view angle setting method of an electronic device according to an embodiment of the present disclosure.
13 to 18 are diagrams for describing a method of performing channel control and volume control using user motion according to various embodiments of the present disclosure;
19 is a flowchart illustrating a control method of an electronic device using a user motion according to an embodiment of the present invention;
20 is a diagram illustrating first voice guide information displayed in a first voice task mode in which a user voice is input through a voice input unit included in an electronic device according to an embodiment of the present disclosure;
FIG. 21 is a diagram illustrating second voice guide information displayed in a second voice task mode in which a user voice is input through a voice input unit provided in an external device interworking with an electronic device according to an embodiment of the present disclosure;
22 is a flowchart illustrating a method of providing a different voice task mode according to a voice input method according to an embodiment of the present invention;
23 to 26 are diagrams for describing a method of controlling an electronic device using a user motion using both hands, according to various embodiments of the present disclosure;
FIG. 27 is a flowchart illustrating a method of controlling an electronic device using a user motion using both hands, according to an embodiment of the present disclosure; FIG.
28 illustrates a feedback message when a voice recognition error occurs according to an embodiment of the present invention.
29 to 32 illustrate a feedback message displayed according to a voice task mode and a voice error type according to various embodiments of the present disclosure;
33 is a flowchart illustrating a control method of an electronic device according to an embodiment of the present disclosure;
34 and 35 are diagrams for describing general voice guide information in a voice task mode according to an embodiment of the present invention;
36 is a diagram illustrating voice guide information specific to an application in a voice task mode according to an embodiment of the present invention;
FIG. 37 illustrates voice guide information including a user preferred voice item in a voice task mode according to an embodiment of the present invention; FIG.
38 is a flowchart illustrating a control method of an electronic device for changing some voice commands of an application according to an embodiment of the present disclosure;
39 is a block diagram illustrating a configuration of an electronic device according to another embodiment of the present disclosure.

Hereinafter, the present invention will be described in more detail with reference to the drawings.

1 is a schematic block diagram illustrating an electronic device according to an embodiment of the present disclosure.

Referring to FIG. 1, the electronic device 100 includes a voice input unit 110, a motion input unit 120, a storage unit 130, a controller 140, and a display unit 193. The electronic device 100 may be implemented as a smart TV, a set-top box, a PC, or a digital TV, a mobile phone, etc., which may be connected to an external network, but is not limited thereto.

The voice input unit 110 receives a voice uttered by the user. The voice input unit 110 converts the input voice signal into an electrical signal and outputs the electrical signal to the control unit 140. For example, the voice input unit 110 may be implemented as a microphone. In addition, the voice input unit 110 may be implemented as an all-in-one as well as an isolated form with the electronic device 100. The separated voice input unit 110 may be connected to the electronic device 100 via a wired or wireless network.

The motion input unit 120 receives a video signal (for example, a continuous frame) of the user's motion and provides the video signal to the control unit 140. For example, the motion input unit 120 may be implemented as a camera unit including a lens and an image sensor. In addition, the motion input unit 120 may be implemented in a separate form as well as integrated with the electronic device 100. The separated motion input unit 120 may be connected to the electronic device 100 via a wired or wireless network.

The storage unit 130 stores various data and programs for driving and controlling the electronic device 100. The storage unit 130 stores a voice recognition module for recognizing a voice input through the voice input unit 110 and a motion recognition module for recognizing a motion input through the motion input unit 120.

The storage unit 130 may include a voice database and a motion database. The voice database refers to a database in which a voice task matching the preset voice and the preset voice is recorded. The motion database refers to a database in which a preset motion and a motion task matching the preset motion are recorded.

The display unit 193 displays an image corresponding to the broadcast signal received through the broadcast receiver. The display unit 193 may display image data (eg, a video) input through the external terminal input unit. The display unit 193 may display voice guide information for performing the voice task and motion guide information for performing the motion task under the control of the controller 140.

The controller 140 controls the voice input unit 110, the motion input unit 120, the storage unit 130, and the display unit 193. The control unit 140 may include a ROM (Read Only Memory) and a RAM (Random Access Memory) for storing a module for controlling a central processing unit (CPU) and the electronic device 100, and data.

When a voice is input through the voice input unit 110, the controller 140 recognizes the voice using the voice recognition module and the voice database. Speech recognition is a method of recognizing speech by distinguishing words according to the type of input speech, including isolated word recognition, continuous speech recognition, continuous speech recognition, and continuous speech recognition (continuous speech recognition), and keyword spotting, which is an intermediate form of isolated word recognition and continuous speech recognition, and detects and recognizes predetermined keywords.

When the user's voice is input, the controller 140 detects the beginning and end of the voice uttered by the user in the input voice signal to determine the voice section. The control unit 140 calculates the energy of the input speech signal, classifies the energy level of the speech signal according to the calculated energy, and detects the speech period through dynamic programming. The controller 140 generates phoneme data by detecting a phoneme, which is a minimum unit of voice, based on an acoustic model in the voice signal in the detected voice section. The controller 140 generates text information by applying a Hidden Markov Model (HMM) probability model to the generated phoneme data. However, as described above, the method of recognizing the user's voice is only an embodiment, and the user's voice can be recognized using another method. Accordingly, the control unit 140 can recognize the voice of the user included in the voice signal.

When the motion is input through the motion input unit 120, the control unit 140 recognizes the motion using the motion detection module and the motion database. Motion recognition separates an image (eg, a continuous frame) input through the motion input unit 120 into a surrounding background and an object (eg, a user's hand) area that is a target of user motion, and continuously The movement of the object can be recognized. When a user motion is input, the controller 140 stores the received image in units of frames and detects an object using the stored frame. The controller 140 detects at least one of the type, the color, and the motion of the object included in the frame to detect the object. The controller 140 may track the movement of the detected object using the position of each object or the shape of each object included in the plurality of frames.

The controller 140 determines a user motion according to the movement of the tracked object. For example, the controller 140 determines the motion of the user using at least one of a change in shape, speed, position, and orientation of the object. The user's motion is a grab, a hand-holding motion, a pointing move, a motion in which a displayed cursor is moved by hand, a slap, a motion in which a hand is moved in one direction over a certain speed, and a hand is left Shake, which is a motion to shake up / right or up and down, and rotate which is a motion to rotate a hand. The technical idea of the present invention can be applied to motions other than the above-described embodiments. For example, it may further include a spread motion of spreading the squeezed hand, and may be determined as a specific motion even when the hand is in a fixed position for a predetermined time.

The controller 140 determines whether the object deviates from a certain area (for example, a rectangle of 40 cm x 40 cm) within a predetermined time (for example, 800 ms) in order to determine whether the motion of the user is a pointing movement or a slab. To judge. If the object does not leave a certain area within a predetermined time, the controller 140 may determine the motion of the user as a pointing movement. If the object is out of the determined area within the determined time, the control unit 140 may determine the motion of the user as a slab. In another example, when it is determined that the velocity of the object is equal to or less than a predetermined velocity (for example, 30 cm / s), the control unit 140 determines the motion of the user as a pointing movement. If it is determined that the speed of the object exceeds the predetermined speed, the controller 140 determines the motion of the user as a slap.

The controller 140 performs a task of the electronic device 100 by using the recognized voice and motion. Tasks of the electronic device 100 may include power control, channel change, volume control, playback of content (e.g., video, music, photos, etc.), selection of a graphical user interface (GUI) displayed on the screen, or an Internet service (e.g., For example, search, browsing, etc.), or at least one of functions that may be performed by the electronic device 100.

A detailed method of controlling the electronic device 100 by the controller 140 will be described in detail later.

2 is a block diagram showing a configuration of an electronic device 100 according to another embodiment of the present invention. Referring to FIG. 2, the electronic device 100 may include a voice input unit 110, a motion input unit 120, a storage unit 130, a controller 140, a broadcast receiver 150, an external terminal input unit 160, and a remote control signal. The receiver 170 includes a network interface 180 and an output 190. The electronic device 100 shown in FIG. 2 may be implemented as a set-top box, a smart TV, or the like.

Meanwhile, descriptions of the voice input unit 110, the motion input unit 120, the storage unit 130, and the controller 140 illustrated in FIG. 2 are described with reference to the voice input unit 110, the motion input unit 120, and the storage unit described with reference to FIG. 1. Since it is the same as the description of the unit 130 and the controller 140, detailed description thereof will be omitted.

The broadcast receiving unit 150 receives a broadcast signal from an external source. The broadcast signal includes video, audio, and additional data (eg, EPG, metadata, etc.). The broadcast receiver 150 may receive various types of broadcast signals such as terrestrial broadcast, cable broadcast, satellite broadcast, and internet broadcast.

The external terminal input unit 160 receives video data (for example, moving pictures, etc.), audio data (e.g., music, etc.) from the outside of the electronic device 100, The external terminal input unit 160 may include at least one of a high-definition multimedia interface input, a component input terminal, a PC input terminal, and a USB input terminal. The remote control signal receiving unit 170 receives a remote control signal input from an external remote control. The remote control signal receiving unit 170 can receive the remote control signal even when the electronic device 100 is in the audio task mode or the motion task mode. The remote control signal receiver 170 may be implemented as a wired or wireless communication interface and may be implemented as a unidirectional or bidirectional communication interface.

The network interface unit 180 may connect the electronic device 100 and an external device (for example, a server or another electronic device) under the control of the controller 140. The controller 140 may control to download an application from an external device connected through the network interface unit 180 or to provide an Internet service to a user, such as web browsing, and to receive image data, audio data, text data, etc. from the external device. Can be controlled. The network interface unit 180 may be implemented as a wired / wireless communication interface and may be implemented as various kinds of bidirectional communication interfaces. For example, at least one of Ethernet, WLAN 182, and Bluetooth may be provided.

The output unit 190 is an external broadcast signal received through the broadcast receiver 150, data input from the external terminal input unit 160, data stored in the storage unit 130, or a network interface 180. The received data is output to an external electronic device (for example, a monitor, a TV, or a speaker). In addition, when the electronic device 100 includes a display or a speaker, the electronic device 100 may output the display through the display or the speaker of the electronic device 100.

Figure 3 is a block diagram of an electronic device 100, in accordance with another embodiment of the present invention. 3, the electronic device 100 includes an audio input unit 110, a motion input unit 120, a storage unit 130, a control unit 140, a broadcast receiving unit 150, an external terminal input unit 160, A remote control signal receiving unit 170, a network interface unit 180, a display unit 193, and an audio output unit 196. At this time, the electronic device 100 may be a digital TV, but is not limited thereto.

3, a voice input unit 110, a motion input unit 120, a storage unit 130, a control unit 140, a broadcast receiving unit 150, an external terminal input unit 160, a remote control signal receiving unit 170, The description of the unit 180 and the display unit 193 is the same as that of the configuration having the same reference numerals in FIG. 1 and FIG. 2, and a detailed description thereof will be omitted.

The audio output unit 196 outputs a sound corresponding to the broadcast signal under the control of the controller 140 or outputs a sound received through the network interface 180. The audio output unit 196 may include at least one of a speaker 196a, a headphone output terminal 196b, or an S / PDIF output terminal 163c.

Meanwhile, as illustrated in FIG. 3, the storage unit 130 may include a power control module 130a, a channel control module 130b, a volume control module 130c, an external input control module 130d, and a screen control module 130e. ), Audio control module 130f, internet control module 130g, application module 130h, search control module 130i, UI processing module 130j, voice recognition module 130k, motion recognition module 130l, Voice database 130m and motion database 130n. These modules 130a to 130n each have a power control function, a channel control function, a volume control function, an external input control function, a screen control function, an audio control function, an internet control function, an application execution function, a search control function, and a UI processing function, respectively. It may be implemented in software to perform the. The controller 140 may execute these software stored in the storage 130 to perform a corresponding function.

As described above, each control module 130a to 130n may be implemented by software stored in the storage 130, but may be implemented through separate hardware.

Hereinafter, various embodiments of the present invention will be described with reference to the drawings.

In particular, with reference to Figures 4 to 8, an embodiment of providing different voice guide information or motion guide information according to the connected external device will be described.

The controller 140 displays first voice guide information for guiding a voice command for controlling the electronic device 100 in the voice task mode on the display 193. In this case, the voice task mode is started when a voice start command is input through the voice input unit 110, and then the electronic device 100 is controlled by the input voice command. Also, the voice task mode may be a mode in which the electronic device 100 is controlled by a voice command input without a voice start command. In this case, another kind of user command for initiating the voice task mode may be used instead of the voice start command. Other types of user commands may include a specific button input of the remote controller, a specific button input of the electronic device 100, a specific motion of the user, and the like.

When a user command for controlling an external device connected to the electronic device 100 is input, the controller 140 changes the first voice guide information into second voice guide information for guiding a user voice for controlling the external device. The display unit 193 is controlled to display. In particular, the plurality of voice guide information is stored in the storage unit 130, and the controller 140 searches for and reads second voice guide information corresponding to an external device from among the plurality of voice guide information stored in the storage unit 130. The read second voice guide information may be displayed on the display unit 193. The plurality of voice guide information respectively corresponds to the electronic device 100 and a plurality of external devices connected to the electronic device 100. If the voice guide information for the external device that the user wants to control is not stored in the storage unit 130, the user may receive the voice guide information through the external terminal input unit 160 and the network interface 180.

In this case, the first voice guide information and the second voice guide information may include different voice commands. For example, when the electronic device 100 is a TV, the first voice guide information may include a voice command for power control, a voice command for executing an external device, a voice command for channel setting, a voice command for volume setting, and the like. May be included. If the external device is one of a DVD player and a BD player, the second voice guide information may include a voice command related to TV power control, a voice command related to external device power control, and a voice command related to function execution of the external device. have.

In particular, when the first voice guide information is displayed, when a voice command included in the first voice guide information is input through the voice input unit 110, the controller 140 controls the electronic device 100 according to the input voice command. To control.

However, when the second voice guide information is displayed, when a voice command included in the second voice guide information is input through the voice input unit 110, the controller 130 generates a control signal corresponding to the input voice command. The generated control signal may be transmitted to an external device through the external terminal input unit 160.

When there is a relay device provided for communication between the electronic device 100 and an external device, if a voice command included in the second voice guide information is input through the voice input unit 110, the controller 140 may input the voice. The control signal corresponding to the command may be generated and the generated control signal may be transmitted to the external device through the relay device. Here, the relay device and the electronic device 100 may communicate through the network interface unit 180, and the relay device and the external device may communicate through a wireless communication interface. In this case, the generated control signal may be transmitted from the electronic device 100 to the relay device by Bluetooth communication, and the relay device converts the transmitted control signal into an IR (Infrared) signal and transmits the control signal to an external device. Can be. The wireless communication interface used for communication between the relay device and the external device may include an RF communication interface in addition to the IR communication interface, and the RF (Radio Frequency) communication interface may include a near field communication (NFC) communication interface and a Zigbe communication interface. And a Bluetooth communication interface, etc. The interface between the relay device and the electronic device 100 and the interface between the relay device and the external device are not limited to the above-described interface, but may be implemented as a wired / wireless communication interface. It can be implemented as a bidirectional communication interface. In particular, when using the existing interface used for the remote control of the external device for communication between the relay device and the external device, the external device is controlled through a voice command or a user's motion input through the electronic device 100 of the present invention. It is easy to implement.

According to the connected external device, a specific embodiment for providing voice guide information will be described in detail with reference to FIGS. 4 to 7.

The controller 140 receives a broadcast signal transmitted from an external broadcast station through the broadcast receiver 150 and performs signal processing on the received broadcast signal. As illustrated in FIG. 4, the controller 140 displays the signal processed broadcast image on the display unit 193 and outputs the sound of the signal processed broadcast signal through the audio output unit 196.

When the voice start command is input through the voice input unit 110, the controller 140 recognizes the voice start command and switches to the voice task mode. In this case, the voice start command is a user command for starting the voice task mode, and the voice task mode is a mode in which the electronic device 100 is controlled by a voice command input to the voice input unit 110. As described above, other types of user commands for initiating the voice task mode may be used instead of the voice start command. Other types of user commands may include a specific button input of the remote controller, a specific button input of the electronic device 100, a specific motion of the user, and the like.

When the voice task mode is switched to, the controller 140 displays first voice guide information 500 for performing the voice task mode as shown in FIG. 5. In this case, the first voice guide information 500 is displayed at the bottom of the screen on which the broadcast image is displayed. In addition, the first voice guide information 500 includes an icon 510 indicating that the mode of the current display apparatus is the voice task mode, and a plurality of voice commands 521 to 526 and 530 for guiding voice commands to the user. The display position of the voice guide information can be changed, and the position where the icon 500 and the voice commands 521 to 526 and 530 in the voice guide information are displayed can be changed.

The voice commands include power off voice command 521, external input voice command 522, channel shortcut voice command 523, channel up / down voice command 524, volume up / down ( UP / DOWN voice commands 525, mute voice commands 526 and MORE voice commands 530. MORE voice command 530 is a command for viewing a voice command other than the displayed voice command. However, the voice command included in the first voice guide information 500 as described above is merely an example and may include other voice commands (for example, a channel list voice command).

When the voice command “Universal Control” is input through the voice input unit 110 while the first voice guide information 500 is displayed, the controller 140 controls an external device to be controlled as shown in FIG. 6. Selectable third voice guide information 600 is displayed. In this case, the third voice guide information 600 includes an icon 610 indicating that the mode of the current display apparatus is the voice task mode and a plurality of voice commands 621 to 625 and 630 for guiding the user's voice. The plurality of voice commands include Watch TV voice commands 621. Watch Video voice commands 622, TV voice commands 623, Set Top Box (STB) voice commands 624, Blu-ray Disc Player (BD) voice commands 625, and MORE voice commands 630. However, the voice command included in the third voice guide information 600 as described above is merely an example and may include other voice commands (eg, DVD player voice commands, USB voice commands, etc.).

When the user voice “BD” is input through the voice input unit 110 while the third voice guide information is displayed, the controller 140 may control the BD using the user voice. The controller 140 searches for voice guide information for controlling the BD among the plurality of voice guide information stored in the storage 130 and displays the voice guide information as shown in FIG. 7.

That is, when the broadcast reception function is performed, the controller 140 displays the first voice guide information 500 as shown in FIG. 5, but when an external device to be controlled is selected, the controller 140 is displayed as shown in FIG. 7. 2 Changes to the voice guide information 700 and displays it. In this case, the second voice guide information 700 includes an icon 710 indicating that the mode of the current display apparatus is the voice task mode and a plurality of voice commands 721 to 726 and 730 for guiding the user's voice. The voice commands include power off voice command (721), external voice command (722), play (pause) voice command (723), previous file voice command (724), next file voice command (725), volume up. Voice commands 726 are included. However, the voice command included in the second voice guide information 700 as described above is just one embodiment, and may include other voice commands (for example, a fast-forward voice command, a rewind voice command, etc.). .

Accordingly, as described above, by providing different voice guide information according to the type of the selected external device, the user can control the external device more conveniently and intuitively using voice recognition.

Meanwhile, in the above-described embodiment, the BD is selected as the external device to be controlled through the voice command. However, this is only an example, and the BD may be selected by using a remote controller. Although the voice guide information is differently provided in the voice task mode according to the type of the device, this is only an example, and the motion guide information may be differently provided in the motion task mode according to the type of the selected external device. .

Hereinafter, a control method of an electronic device according to an embodiment of the present disclosure will be described with reference to FIG. 8.

First, the electronic device 100 switches to the voice task mode (S810). Specifically, when a voice initiation command is input through the voice input unit 110 of the electronic device 100, the electronic device 100 controls the electronic device 100 to control the control mode of the electronic device 100 by a user voice. Switch to voice task mode.

When the voice task mode is switched, the electronic device 100 displays the first voice guide information in operation S820. In this case, when the electronic device 100 performs a broadcast reception function, the first voice guide information includes a voice command for controlling the broadcast reception function. For example, the first voice guide information may include a voice command for channel setting.

In operation S830, the electronic device 100 determines whether a user command for controlling an external device has been input. In this case, the user command may be a user voice command as described with reference to FIG. 6, and may be a command by an external input change button provided in the remote controller interworking with the electronic device 100.

When a user command to control an external device is input (S830-Y), the electronic device 100 changes the first voice guide information into second voice guide information and displays it (S840). At this time, the type of the external device can be selected. If the external device is a BD (Blue-ray) player or a DVD player, the voice command for channel setting disappears from the second voice guide information. For example, a voice command for stopping playback, a voice command for playing the next file, and the like may be included.

As described above, the voice guide information is displayed differently according to the type of the selected external device, so that the user can more conveniently and intuitively control the connected external device using voice recognition.

Meanwhile, in the above-described embodiment, the electronic device 100 is described as being directly connected to an external device through the external terminal input unit 160. However, this is only an example, and the electronic device 100 is the network interface unit 180. FIG. The embodiment of the present invention is also connected to an external device using a relay device connected through), and the electronic device 100 is connected to the external device using both the external terminal input unit 160 and the relay device. Embodiments also apply to the technical idea of the present invention. In detail, the system 10 as illustrated in FIG. 9 includes the electronic device 100, the relay device 200, and the external device 300. In this case, the electronic device 100 may be connected to the external device 300 through the relay device 200.

In detail, when a user voice corresponding to a voice command included in the second voice guide information is input through the voice input unit 110, the electronic device 100 generates a control signal corresponding to the input voice command. The electronic device 100 transmits a control signal to the relay device 200 using Bluetooth communication of the network interface unit 180. When the control signal is transmitted, the relay device 200 converts the received control signal into an IR signal form and transmits it to the external device 300. When the external device 300 receives the IR signal, the external device 300 demodulates the IR signal and is controlled according to a voice command input to the electronic device 100.

The interface between the relay device and the electronic device 100 and the interface between the relay device and the external device are not limited to the above-described interface, but may be implemented as a wired / wireless communication interface and may be implemented as various kinds of two-way communication interfaces.

Hereinafter, an embodiment of an angle of view setting UI for setting an angle of view of the motion input unit 120 will be described with reference to FIGS. 10 to 12.

In particular, in the present embodiment, the motion input unit 120 may be a camera. In this case, as shown in FIG. 10, the camera may be disposed to protrude from the bezel of the upper end of the bezel surrounding the display unit 193 of the electronic device 100. However, this is only an example, and the camera may be disposed so as not to protrude from the upper bezel, and a portion of the bezel corresponding to the position of the camera may be made of a transparent material or formed to form a hole. The camera can also be placed on any of the four sides as well as the top of the bezel.

When a preset event occurs, the controller 140 displays an angle of view guide UI for guiding an angle of view of the camera in one region of the display screen. The controller 140 may set the angle of view of the camera according to an input user command using the angle of view guide UI.

In this case, the preset event is an event in which power is supplied to the electronic device 100 when the electronic device 100 is initially installed, an event in which a motion task mode is turned on, and an angle of view setting menu among control menus of the electronic device 100. May be one of the selected events. Meanwhile, when a preset event occurs, the controller 140 displays the angle of view guide UI 1100 in the center area of the display screen as illustrated in FIG. 11. In this case, the angle of view guide UI 1100 is not displayed on the entire display screen, but is displayed in one area (for example, a center area) of the display screen. Therefore, the user can continue to watch the content image that he is currently watching. Of course, the angle of view guide UI 1100 may be implemented to be displayed on the entire screen area.

In addition, the angle of view guide UI 1100 includes a camera image display screen 1110 displaying an image captured by the camera. Accordingly, the user may be informed of the current angle of view of the camera by checking the image currently captured by the camera.

In this case, the angle of view guide UI 1100 may include a camera image display screen 1110 and guide lines for guiding a desired position of the user. In addition, the angle of view guide UI 1100 may include a guide line for guiding a preferred angle of view of the camera according to the position of the user on the camera image display screen 1110 and the camera image display screen 1110.

When the angle of view guide UI 1100 includes a camera image display screen 1110 and a guide line for guiding an angle of view of a preferred camera, the angle of view of the camera may be manually adjusted by a user and may be automatically adjusted. In this case, as the position of the user in the camera image display screen 1110 is changed, the position of the guide line for guiding an angle of view of the preferred camera may be changed.

Here, the angle of view of the camera can be adjusted by adjusting the position or angle of the actual camera. In addition, the position or angle of the actual camera may be adjusted by selecting an image displayed on the camera image display screen 1110 among the images photographed without adjusting, and in this case, the camera image display screen 1110 may be captured. If a user command is input through the angle of view guide UI 1100 while the angle of view of the camera is adjusted, the controller 140 displays the image of the camera image display screen 1110 at the time when the user command is input. It can be set to the image used to recognize the motion of the camera.

In particular, when the user adjusts the angle of view of the camera using the direction buttons provided on the remote control, the remote control generates a signal containing the selected direction button information and transmits it to the electronic device 100, the control unit 140 from the remote control You can adjust the camera according to the transmitted signal.

The angle of view guide UI 1100 as described above may be used to generate an image for more accurately recognizing a user's motion. 12 is a flowchart illustrating a camera view angle setting method of the electronic device 100 according to an embodiment of the present disclosure.

First, the electronic device 100 determines whether a preset event has occurred (S1210). In this case, the preset event is an event in which power is supplied to the electronic device 100 when the electronic device 100 is initially installed, an event in which a motion task mode is turned on, and an angle of view setting menu among control menus of the electronic device 100. May be one of the selected events. That is, even when the user enters the motion task mode for controlling the electronic device 100 by the user motion, the angle of view setting UI is not displayed, and the angle of view setting UI may be displayed only when a preset event occurs.

When a preset event occurs (S1210-Y), the electronic device 100 displays an angle of view guide UI for setting the angle of view of the camera 120 (S1220). In this case, as illustrated in FIG. 11, the angle of view guide UI 1100 may be displayed in a central area of the display screen and may include a screen 1110 for displaying an image currently photographed by a camera. Accordingly, the user can set the camera angle of view while watching the content image currently output from the electronic device 100. Of course, the angle of view guide UI 1100 may be implemented to be displayed on the entire screen area.

In operation S1230, the electronic device 100 may set an angle of view of the camera using the displayed angle of view guide UI. In this case, when the angle of view guide UI 1100 includes a camera image display screen 1110 and a guide line for guiding a preferred angle of view of the camera, the angle of view of the camera may be manually adjusted by a user and may be automatically adjusted. have. In this case, as the position of the user in the camera image display screen 1110 is changed, the position of the guide line for guiding an angle of view of the preferred camera may be changed.

Here, the angle of view of the camera can be adjusted by adjusting the position or angle of the actual camera. In addition, the position or angle of the actual camera may be adjusted by selecting an image displayed on the camera image display screen 1110 among the images photographed without adjusting, and in this case, the camera image display screen 1110 may be captured. Part of the video.

When a user command is input through the angle of view guide UI 1100 while the angle of view of the camera is adjusted, the electronic device 100 recognizes the motion of the user on the image of the camera image display screen 1110 at the time when the user command is input. It can be set to the image used to play.

In particular, when the user adjusts the angle of view of the camera using the direction buttons provided on the remote control, the remote control generates a signal containing the selected direction button information and transmits the signal to the electronic device 100, the electronic device 100 is a remote control You can adjust the camera according to the signal from the camera.

Accordingly, the user can more easily set the angle of view of the camera using the angle of view guide UI. In addition, by setting the angle of view of the camera each time a predetermined event occurs, rather than setting the angle of view every time the motion task mode is switched, the user has to set the angle of view of the camera each time the motion task mode is switched. Can be reduced.

Hereinafter, an embodiment of a motion UI for controlling the electronic device 100 by user motion will be described with reference to FIGS. 13 to 19.

When a motion start command is input through the motion input unit 120, the controller 140 switches the mode of the electronic device 100 to the motion task mode. In this case, the motion start command may be a motion of shaking a user's hand to the left or right a plurality of times. The motion task mode is a mode in which the electronic device 100 is controlled by a user's motion input through the motion input unit 120. Other types of user commands may be used to initiate the voice task mode instead of the motion start command. Other types of user commands may include a specific button input of a remote controller, a specific button input of the electronic device 100, a specific voice of a user, and the like.

When the motion task mode is switched, the controller 140 displays an icon and a pointer for performing the motion task mode on the display unit 193. In this case, the displayed icon is an icon for controlling the function of the electronic device 100. The icon may be displayed on the left area and the right area of the display screen. In addition, the pointer may be displayed in the center area of the display screen.

In particular, when a broadcast signal is output when the user switches to the motion task mode, the controller 140 displays icons for volume control and channel change. Each icon may be displayed in the left area and the right area of the display screen. The volume control icon includes a volume up icon and a volume down icon, and the channel change icon includes a channel up icon and a channel down icon. In addition, the pointer may be displayed at a specific position (eg, a central area of the screen) of the display screen.

In addition, the controller 140 moves the pointer according to the first motion of the user input through the motion input unit 120. In this case, the first motion of the user may be a spread motion in which the user's hand is open. That is, when a motion to be moved while the user's hand is open is input through the motion input unit 120, the controller 140 may move the pointer according to the movement of the user's hand.

When the user's second motion is input through the motion input unit 120 while the pointer is positioned on the icon, the controller 140 executes a function corresponding to the icon. In this case, the second motion of the user may be a grab motion of holding a hand. For example, when the grab motion of the user is input through the motion input unit 120 while the pointer is positioned on the volume up icon, the controller 140 may increase the volume level by "1" at the current volume level.

Here, the controller 140 controls the position of the pointer to be fixed without moving while the second motion of the user is input. This is because when the user's hand is determined to have moved when the user's second motion is input, and the position of the pointer is changed, the user cannot accurately control the electronic device 100.

In addition, when the pointer is positioned on the icon and the input of the second motion is maintained, the controller 140 may continuously execute the function of the icon on which the pointer is located. For example, when the input of the second motion is maintained while the pointer is positioned on the volume down icon, the controller 140 may continuously decrease the volume level. At this time, if the input of the second motion is maintained, the controller 140 may execute the function of the icon where the pointer is located more quickly. For example, if the pointer is positioned on the volume down icon and the input of the second motion is maintained, the controller 140 may decrease the volume level more quickly.

In addition, the motion end motion may be input through the motion input unit 120. When the motion end motion is input, the controller 140 may remove the displayed icons and pointers from the display screen of the display 110. have. In this case, the motion end motion and the motion start motion may be the same motion.

A method of controlling the electronic device 100 using a user's motion, a plurality of icons, and a pointer will be described in detail with reference to FIGS. 13 to 18.

The controller 140 processes the broadcast signal received through the broadcast receiver 140 to display the broadcast image 1300 on the display screen as shown in FIG. 13.

In this case, when a motion start command is input through the motion input unit 120, the controller 140 switches the control mode of the electronic device 100 to the motion task mode. In this case, the motion task mode is a mode in which the electronic device 100 is controlled by the user's motion through the motion input unit 120. Instead of the motion start command, another kind of user command for initiating the motion task mode may be used. Other types of user commands may include a specific button input of a remote controller, a specific button input of the electronic device 100, a specific voice of a user, and the like.

When the motion task mode is switched to, the controller 140 displays a plurality of icons 1410, 1430, 1440, and 1460 and a pointer 1470 for performing a specific function of the electronic device 100. In detail, as illustrated in FIG. 14, the controller 140 displays a volume up icon 1410 and a volume down icon 1430 for controlling the volume level on the left area of the display screen, and displays the right area of the display screen. The channel up icon 1440 and the channel down icon 1460 for channel control are displayed, and a pointer 1470 is displayed in the center area of the display screen.

At this time, the current volume level information 1420 of the electronic device 100 is displayed between the volume up icon 1410 and the volume down icon 1430. In addition, current channel information (eg, channel name and channel number) 1450 of the electronic device 100 is displayed between the channel up icon 1440 and the channel down icon 1460. Therefore, the user can easily check the currently set channel information and volume level information. The display position of the current volume level information 1420 and the current channel information 1450 may be a position different from the above-described position. When the mode is switched to the motion task mode, the current volume level information 1420 and the current channel information 1450 are directly displayed. Can be displayed.

Meanwhile, in the above-described embodiment, icons 1410 and 1430 for volume level control are displayed in the left area, and icons 1440 and 1460 for channel control are displayed in the right area. It can only be displayed in other areas.

Also, in the above-described embodiment, icons 1410 and 1430 for volume level control and icons 1440 and 1460 for channel control are displayed, but icons for controlling other functions of the electronic device 100 ( For example, an icon for sound off, power off, etc. may be displayed.

When a motion is moved in a state where the user's hand is opened through the motion input unit 120 while the icons 1410, 1430, 1440, 1460 and the pointer 1470 are displayed, the controller 140 moves the motion. The pointer 1470 is moved accordingly.

When the grab motion of the user is input through the motion input unit 120 while the pointer 1470 is positioned on one of the plurality of icons 1410, 1430, 1440, and 1460, the controller 140 controls the pointer ( 1470 may execute a function corresponding to the icon located.

For example, when a motion to be moved to the left is input through the motion input unit 120, the controller 140 moves the pointer 1470 to the left according to the movement motion. As illustrated in FIG. 15, when the grab motion of the user is input through the motion input unit 120 while the pointer 1470 is positioned on the volume down icon 1430, the controller 140 may determine the current electronic device ( Reduce the volume level set at 100) to "1". That is, when the volume level currently set in the electronic device 100 is “21”, when the grab motion of the user is input through the motion input unit 120 while the pointer 1470 is positioned on the volume down icon 1430, The controller 140 sets the volume level of the current electronic device 100 to "20". The controller 140 not only adjusts the volume level of the electronic device 100 but also changes the volume level information 1420 as shown in FIG. 16.

In this case, when the grab motion is input through the motion input unit 120, the controller 140 may fix the pointer 1470 without changing the position of the pointer 1470 even if the user's hand moves.

In addition, according to the number of times that the grab motion of the user is input through the motion input unit 120 while the pointer 1470 is positioned on the volume down icon 1430, the controller 140 currently controls the volume level of the electronic device 100. Can continue to decrease. The number of times the grab motion is input may be calculated as the number of times the grab motion is switched from the grab motion to the grab motion.

As another example, when a motion to be moved to the right is input through the motion input unit 120, the controller 140 moves the pointer 1470 to the right according to the movement motion. As illustrated in FIG. 17, when the grab motion of the user is input twice through the motion input unit 120 while the pointer 1470 is positioned on the channel down icon 1460, the controller 140 displays the current electronic device. Receives and displays a broadcast image of which "2" has been reduced from the channel number set in the apparatus 100. That is, when the channel number currently set in the electronic device 100 is “11”, the grab motion of the user is input twice through the motion input unit 120 while the pointer 1470 is positioned on the channel down icon 1460. If so, the controller 140 may receive and display a broadcast image of which the channel number of the electronic device 100 is “9”. The controller 140 not only controls the channel of the electronic device 100 but also changes the channel information 1450 as shown in FIG. 18.

In addition, according to the number of times that the grab motion of the user is input through the motion input unit 120 while the pointer 1470 is positioned on the channel down icon 1460, the controller 140 may change the channel number of the current electronic device 100. Can continue to decrease.

By the electronic device 100 as described above, the user can conveniently and intuitively control the display device using motion, and control the function of the display device using only the hand position information and the shape change of the hand. This can improve the speed at which the user's motion is recognized.

10 is a flowchart illustrating a control method of the electronic device 100 using a user motion according to an embodiment of the present invention.

First, the electronic device 100 determines whether a motion start command is input through the motion input unit 120 (S1910). In this case, the motion start command may be a motion of shaking a user's hand from side to side a plurality of times. Here, another kind of user command for starting the motion task mode may be used instead of the motion start command. Other types of user commands may include a specific button input of a remote controller, a specific button input of the electronic device 100, a specific voice of a user, and the like.

When the motion start command is input (S1910-Y), the electronic device 100 switches the mode of the electronic device 100 to the motion task mode (S1920). In this case, the motion task mode is a mode in which the electronic device 100 is controlled by user motion.

When the electronic device 100 switches to the motion task mode, the electronic device 100 displays a plurality of icons and pointers on the display screen in operation S1930. In this case, the plurality of icons are displayed on the left or right region of the display screen, and the pointer is displayed on the display screen. It can be displayed in the central area of. In addition, the plurality of icons may include an icon for channel setting and an icon for volume level setting. At this time, the current volume level information of the electronic device 100 is displayed around the icon for setting the volume level. The current channel information (eg, channel name and channel number) of the electronic device 100 is displayed around the icon for channel setting.

In operation S1940, the electronic device 100 determines whether the first motion of the user is input through the motion input unit 120. In this case, the user motion may be a motion of moving the user's hand in the open state.

If it is determined that the first motion is input (S1940-Y), the electronic device 100 moves the pointer on the display screen according to the first motion (S1950).

In operation S1960, the electronic device 100 determines whether a user's second motion is input through the motion input unit 120. In this case, the user motion may be a grab motion holding the user's hand.

If it is determined that the second motion is input (S1960-Y), the electronic device 100 executes a function corresponding to the icon where the pointer is located (S1970). For example, if the pointer is located on the volume up icon and the second motion is determined, the electronic device 100 increases the volume level currently set in the electronic device 100. In addition, according to the number of times the second motion is input while the pointer is located on a specific icon, the electronic device 100 may execute a function of the icon where the pointer is located. The number of times that the second motion is input may be calculated as the number of times that the second motion is converted from the first motion to the second motion.

When the second motion is input, the electronic device 100 may fix the pointer without moving even if the user's hand moves.

By the control method of the electronic device as described above, the user can control the electronic device 100 more conveniently and intuitively by using the user motion, the display device using only the position information of the hand and the shape change of the hand By controlling the function of the user can improve the speed at which the user motion is recognized.

Hereinafter, an embodiment of providing different voice guide information according to a voice input method will be described with reference to FIGS. 20 to 22.

In particular, when a voice start command is input, the controller 140 determines whether the input voice start command is a first voice start command or a second voice start command. Here, the voice initiation command is a command for entering the control mode of the electronic device 100 into the voice task mode controlled by the user voice input through the voice input unit 110. In particular, the first voice initiation command is a user voice command including a preset word input through the voice input unit 110 provided in the electronic device 100, and the second voice initiation command is associated with the electronic device 100. It may be a user command that a predetermined button included in an external device (for example, a remote controller) is pressed. However, the above-described first voice start command and the second voice start command are merely exemplary and may be implemented by other voice start commands.

If it is determined that the voice start command is the first voice start command, the controller 140 switches the mode of the electronic device 100 to the first voice task mode. In this case, the first voice task mode is a voice task mode controlled according to a user voice input to the voice input unit of the electronic device 100.

If it is determined that the voice start command is the second voice start command, the controller 140 switches the control mode of the electronic device 100 to the second voice task mode. The second voice task mode is a voice task mode that is controlled according to a user voice input to an external device interworking with the electronic device 100. In particular, in the second voice task mode, the user's voice may be input while the voice input button provided in the external device is pressed. Alternatively, in the second voice task mode, the user's voice may be input by pressing the voice input button provided on the external device once, inputting the user voice, and then pressing the voice input button again.

In particular, in the first voice task mode, the electronic device 100 is not controlled by the user's voice input by the external device, and in the second voice task mode, the user voice input to the voice input unit provided in the electronic device 100. The electronic device 100 may not be controlled by the electronic device 100.

When the control mode of the electronic device 100 is switched to the voice start mode, the controller 140 displays voice guide information corresponding to the switched voice task mode. In detail, when the mode of the electronic device 100 is switched to the first voice task mode, the controller 140 displays first voice guide information corresponding to the first voice task mode. When the control mode of the electronic device 100 is switched to the second voice task mode, the controller 140 displays second voice guide information corresponding to the second voice task mode.

The first voice guide information and the second voice guide information will be described in more detail with reference to FIGS. 20 and 21.

20 is a diagram illustrating first voice guide information according to an embodiment of the present invention. As shown in FIG. 20, the first voice guide information 2000 is displayed at the bottom of a screen on which a broadcast image is displayed. In addition, the first voice guide information 2000 includes an icon 2010 indicating that the control mode of the display apparatus is the first voice task mode and a plurality of voice commands 2021 to 2027 for guiding the user's voice. The voice commands include power off voice command 2021, external input voice command 2022, channel shortcut voice command 2023, channel up / down voice command 2024, volume up / down ( UP / DOWN voice commands 2025, mute voice commands 2026 and MORE voice commands 2027. MORE voice command 2027 is a command for viewing a voice command other than the displayed voice command.

In this case, the icon 2010 indicating that the first voice task mode is in the shape of a microphone may be illustrated in FIG. 20.

In particular, the first voice guide information 2000 may include a voice command corresponding to a button that can be executed by pressing one of the buttons of the remote controller. For example, the first voice guide information 2000 may include a channel up / down voice command 2024, a volume up / down voice command 2025, a mute voice command 2026, and the like.

FIG. 21 is a diagram illustrating second voice guide information 2100 according to an embodiment of the present invention. As illustrated in FIG. 21, the second voice guide information 2100 is displayed at the bottom of a screen on which a broadcast image, which is the same area as the area where the first voice guide information 2000 is displayed, is displayed. In addition, the second voice guide information 2100 includes an icon 2110 indicating that the mode of the current display apparatus is the second voice task mode and a plurality of voice commands 2121 to 2127 for guiding the user's voice. The plurality of voice commands include channel shortcut voice command 2121, search voice command 2122, external input voice command 2123, channel list voice command 2124, favorite voice command 2125, and MORE voice command 2126. ) Is included. In this case, the favorite voice command 2125 is a voice command for displaying a menu including a function frequently used by a user (for example, executing a specific application).

In this case, the icon 2110 indicating the second voice task mode may have a remote controller shape different from the icon 2010 indicating the first voice task mode shown in FIG. 20. Accordingly, the user may check whether the current voice task mode is the first voice task mode or the second voice task mode through the icons 2010 and 2110 included in the voice guide information 2000 and 2100.

The plurality of voice commands included in the second voice guide information 2100 may be partially different from the plurality of voice commands included in the first voice guide information 2000. In particular, the second voice guide information 2100 may not include a voice command corresponding to a button that may be executed by pressing one of the buttons provided on the remote controller. For example, the second voice guide information 2100 may not include a channel up / down voice command 2024, a volume up / down voice command 2025, a mute voice command 2026, and the like. This is because the user holds the remote control in the second voice task mode, so it may be more convenient to press the remote control button than the user speaks.

Instead, the second voice guide information 2100 uses buttons on the remote control, such as a search voice command 2122, an external input voice command 2123, a channel list voice command 2124, and a favorite voice command 2125. For example, a voice command corresponding to a function requiring two or more button inputs to enter a function may be included.

That is, as described above, by providing different voice guide information according to the first voice task mode and the second voice task mode, the user can efficiently and conveniently control the electronic device 100 according to the plurality of voice task modes. It becomes possible.

When one of the first voice guide information 2000 and the second voice guide information 2100 is displayed, the controller 140 may display the electronic device 100 according to a user voice input to the voice input unit 110 in a corresponding voice task mode. ). For example, when a user voice of “mute off” is input through the voice input unit 110 while the first voice guide information 2000 is displayed, the controller 140 sets the volume level of the electronic device 100 to “. O "can be set. In addition, when a user voice of "channel list" is input through the voice input unit 110 while the second voice guide information 2100 is displayed, the controller 140 may display the channel list on the display unit 193. have.

22 is a flowchart illustrating a method of providing a different voice task mode according to a voice input method according to an embodiment of the present invention.

First, the electronic device 100 receives a voice start command in operation S2210. In this case, the voice initiation command is a command for entering the mode of the electronic device 100 into a voice task mode controlled by a user voice input through the voice input unit 110. In particular, the first voice initiation command is a user voice command including a preset word input through the voice input unit 110 provided in the electronic device 100, and the second voice initiation command is associated with the electronic device 100. It may be a user command that a predetermined button included in an external device (for example, a remote controller) is pressed.

In operation S2220, the electronic device 100 determines whether the input voice start command is the first voice start command.

If the input voice start command is the first voice start command (S2220-Y), the electronic device 100 switches the mode of the electronic device 100 to the first voice task mode (S2230). Here, the first voice tag mode is a mode for controlling the electronic device 100 according to a user voice input through the voice input unit 110 provided in the electronic device 100.

In particular, when it is switched to the first voice task mode, the electronic device 100 displays first voice guide information in operation S2240. The first voice guide information may include an icon indicating that the current mode of the electronic device 100 is the first voice task mode and a plurality of voice commands for performing the first voice task mode. In this case, the plurality of commands included in the first voice guide information may include, for example, a "channel up / down voice command", "volume up / down voice command", and a "voice off voice command". The voice command 100 may be immediately executed.

In operation S2280, the electronic device 100 performs a voice task using the first voice guide information.

However, if the voice start command is not the first voice start command (S2220-N), the electronic device 100 determines that the input voice start command is the second voice start command (S2250).

In operation S2260, the electronic device 100 switches the mode of the electronic device 100 to the second voice tag mode. In this case, the second voice task mode is a mode for controlling the electronic device 100 according to a user voice input through the voice input unit 110 included in an external device (for example, a remote controller) interoperating with the electronic device 100. to be. In particular, in the second voice task mode, the preset second button (for example, a voice input button) of the external device is pressed and then controlled by a user voice input to the external device.

When the mobile device enters the second voice task mode, the electronic device 100 displays second voice guide information in operation S2270. Here, the second voice guide information may include an icon indicating that the current mode of the electronic device 100 is the second voice task mode and a plurality of voice commands for performing the second voice task. In this case, the icon indicating the second voice task mode is different from the icon indicating the first voice task mode. The plurality of commands included in the second voice guide information may include voice commands having a depth, such as "external input voice command", "channel list voice command", and "favorite voice command".

In operation S2280, the electronic device 100 performs a voice task using the second voice guide information.

By the control method of the electronic device 100 as described above, the user can more efficiently control the electronic device 100 by using a different voice input method.

Hereinafter, an embodiment of a two-handed input guide GUI for performing a two-handed task mode will be described with reference to FIGS. 23 to 27.

When a two-handed start command for performing a motion task (hereinafter referred to as a "two-handed task") using two hands is input, the controller 140 switches to a two-handed task mode for performing a motion task using both hands. Here, the two-handed task may be a task for zooming in or out of the display screen. Here, another kind of user command for initiating the two-handed task mode may be used instead of the two-handed start command. Other types of user commands may include a specific button input of the remote controller, a specific button input of the electronic device 100, a specific motion of the user, and the like.

In particular, a two-handed start command for performing a two-handed task may be sequentially input one by one, or both hands may be simultaneously input.

In detail, when a motion start command using one hand is input through the motion input unit 120, the controller 140 switches to a motion task mode for performing a motion task using one hand. When the motion start command using the other hand is input through the motion input unit 120 while the motion task mode is switched, the controller 140 may recognize that the two hand start command is input. Here, the motion start command using one hand may be a shake motion in which one hand is shaken plural times in the left and right direction.

Alternatively, in a general control mode in which the electronic device 100 is controlled by using a remote controller, when a shake motion of shaking both hands in the left and right directions at the same time through the motion input unit 120 is input, the controller 140 inputs a two-hand start command. Can be recognized.

When switching to the two-handed task mode, the controller 140 displays a two-handed input guide GUI for performing a two-handed task.

Specifically, the two-handed input guide GUI may be a circular GUI having a diameter of a straight line connecting two points on the screen corresponding to the positions of both hands. This will be described in detail with reference to FIGS. 23 to 25.

When a two-hand start command is input through the motion input unit 120, the controller 140 switches the control mode of the electronic device 100 to the two-hand task mode and displays the motion guide information 2300 for performing the motion task mode. do. In this case, the motion guide information 2300 may be displayed only when a motion start command using one hand is sequentially input, and may not be displayed when a motion start command using both hands is simultaneously input.

In addition, when a two-hand start command is input, the controller 140 displays a two-handed input guide GUI 2330 for performing a two-handed task mode. In this case, the two-handed input guide GUI 2330 may be a circular GUI, as shown in FIG. Of course, an ellipse, a triangle, a rectangle, or a straight line such as a shape capable of intuitively recognizing the position of both hands of the user may be a GUI of another shape. The position of the two-handed input guide GUI 2330 is determined depending on the position of the two hands of the user, but may be set to be displayed in the center area of the display screen.

When a motion in which two hands of the user move while maintaining a predetermined interval is input through the motion input unit 120, the controller 140 moves the two hand input guide GUI 2330 of the display screen. For example, as shown in FIG. 23, while the two-handed input guide GUI 2330 is displayed in the center area of the display screen, two hands of the user are moved to the right through the motion input unit 120 while maintaining a predetermined interval. When the motion is input, the controller 140 moves the two-handed input guide GUI 2330 to the right as shown in FIG. 24.

When the two-handed input guide GUI 2330 is displayed in one area on the display screen, when the motions of the two hands are separated from each other are input, the controller 140 zooms on the basis of a predetermined position in the area in which the two-handed input guide GUI 2330 is displayed. Perform the seal. For example, as shown in FIG. 24, when the two-handed away motion is input while the two-handed input guide GUI 2330 is displayed in the right area on the display screen, the controller 140 displays the motion as shown in FIG. 25. The display screen may be enlarged based on a predetermined position in the area where the two-handed input guide GUI 2330 is displayed. In this case, the motion of moving both hands away may be a motion in which both hands move away from each other, and one hand may be a motion in which only one hand is fixed and only the other hand moves.

In addition, when a motion in which both hands are close to each other is input while the two-handed input guide GUI 2330 is displayed in one area on the display screen, the controller 140 may refer to a predetermined position within the area in which the two-handed input guide GUI 2330 is displayed. Zoom-out can be performed. Here, the predetermined position in the region where the two-handed input guide GUI 2330 is displayed may be a position that is the center point or the center of gravity of the region in which the two-handed input guide GUI is displayed.

According to another embodiment of the present invention, the two-handed input guide GUI is not a circular GUI, as shown in FIGS. 23 to 25, but two pointers 2630-1 and 2630-2 as shown in FIG. 26. ) Can be implemented. In this case, each of the two pointers 2630-1 and 2630-2 may be one of a circle shape, an ellipse shape, a palm shape, and an arrow shape, but is not limited thereto.

In this case, when two pointers 2630-1 and 2630-2 are displayed in one region on the display screen, motions in which both hands are separated from each other are input, and the control unit 140 has two pointers 2630-1 and 2630-2. Perform zoom-in based on a predetermined position associated with. In addition, when a motion in which both hands are close to each other is input while two pointers 2630-1 and 2630-2 are displayed in one region on the display screen, the controller 140 controls the two pointers 2630-1 and 2630-2. ), The zoom-out may be performed based on a predetermined position associated with the. In this case, the predetermined position related to the two pointers may be set as the center point or center of gravity of a line connecting two pointers, or a center point of an outline including two pointers (eg, a circle, an ellipse, a triangle, a rectangle, etc.). Can be. In addition, one of the two pointers may be set to a predetermined position. In this case, the pointer corresponding to the non-moving hand may be a reference among the two hands corresponding to the two pointers, and the display screen may be enlarged or reduced according to the movement of the moving hand.

However, when two pointers 2630-1 and 2630-2 are displayed, when only one hand moves, the position of the pointer corresponding to the moved hand moves according to the movement of one hand, and when both hands move. Both pointer positions are moved. The display screen is enlarged or reduced while the pointer position is moved.

As described above, the user can perform a more intuitive and convenient screen zoom using both hands, and is similar to the screen zoom using a multi-touch, which can be performed in an electronic device capable of touch input. To provide a user experience.

27 is a flowchart illustrating a method of performing a motion task using both hands according to an embodiment of the present invention.

First, the electronic device 100 determines whether a two-hand start command is input (S2710). In this case, the two-hand start command may be sequentially input one by one, or both hands may be simultaneously input.

In detail, when a motion start command using one hand is input through the motion input unit 120 and a motion start command using the other hand is input, the electronic device 100 may recognize that the two hand start command is input. have. Alternatively, when a shake motion of shaking both hands in the left and right directions at the same time through the motion input unit 120 is input, the electronic device 100 may recognize that the two-hand start command is input.

When a two-hand start command is input (S2710-Y), the electronic device 100 switches the control mode of the electronic device 100 to the two-hand task mode (S2720). In this case, the two-handed task mode is a mode in which the electronic device 100 is controlled by using the motions of both hands. The two-handed task may include a task of enlarging or reducing the display screen.

When the user enters the two-handed task mode, the electronic device 100 generates and displays a two-handed input guide GUI for performing the two-handed task (S2730). In this case, the two-handed input guide GUI may be a circular GUI 2330 as shown in FIG. 23, and may be two pointer GUIs 2630-1 and 2630-2 as shown in FIG. 26. However, this is only an example, and may be a GUI having another shape as long as the shape of the user's hands can be intuitively recognized, such as an ellipse, a triangle, a rectangle, and a straight line.

In operation S2740, the electronic device 100 performs a two-handed task using the two-handed input guide GUI.

In detail, when the two-handed input guide GUI is a circular GUI, if the motion to be moved while keeping both hands at a predetermined interval is input through the motion input unit 120, the electronic device 100 may move the circular GUI. When the motion in which both hands move away or close to each other is input, the electronic device 100 may enlarge or reduce the display screen based on the point where the circular GUI is displayed.

Alternatively, when the two-handed input guide GUI is two pointers, when the motion of moving one hand is input through the motion input unit 120, the electronic device 100 moves the pointer corresponding to the moved hand among the two pointers. When the motion in which both hands move away or close to each other is input, the electronic device 100 may enlarge or reduce the display screen based on an intermediate point between the two pointers.

According to various embodiments of the present disclosure as described above, a user may perform a more intuitive and convenient function of enlarging / reducing a display screen using a two-handed control GUI, and may be performed in an electronic device capable of touch input. It provides a user experience similar to the zoom of a screen using a multi-touch.

Hereinafter, an embodiment of randomly outputting a feedback message guiding a voice error will be described with reference to FIGS. 28 to 33.

When a voice start command is input, the controller 140 switches the control mode of the electronic device 100 to the voice task mode. In this case, the voice task mode is a mode in which the electronic device 100 is controlled by a user voice input through the voice input unit 110.

The voice initiation command may be a user voice command including a preset word input through the voice input unit 110 provided in the electronic device 100 (hereinafter referred to as a “first voice start command”) or the electronic device 100. The control unit may be a user command (hereinafter, referred to as a “second voice start command”) in which a preset button included in an external device (for example, a remote controller) interworking with the user is pressed. 140 switches the mode of the electronic device 100 to the first voice task mode, in which the first voice task mode is a voice task mode controlled according to a user voice input to the voice input unit of the electronic device 100. When the second voice initiation command is input, the controller 140 switches the control mode of the electronic device 100 to the second voice task mode, wherein the second voice task mode is connected to an external device that cooperates with the electronic device 100. To the input voice Is referred to a task control speech mode, that is, particularly, in the second voice task mode, the user's voice can be inputted while pressing a speech input button provided in the external device.

When the mode of the electronic device 100 is switched to one of the first voice task mode and the second voice task, the controller 140 displays the voice guide information for guiding a user voice for performing the voice task mode. ). In this case, the voice guide information 400 includes a mode guide icon 2810 indicating a mode of the current display device and a plurality of voice commands 2821 to 2827 for guiding a user's voice, as shown in the lower part of FIG. 28. do. Multiple voice commands include power off voice command (2821), external voice command (2822), channel shortcut voice command (2823), channel up / down (UP / DOWN) voice command (2824), volume up / down ( UP / DOWN voice commands 2825, mute voice commands 2826, and MORE voice commands 2827. Here, the MORE voice command 2827 is a command for viewing a voice command other than the displayed voice command.

The mode guide icon 2810 is different depending on the first voice task mode and the second voice task mode. For example, the mode guide icon 2810 in the first voice task mode may include an icon in the form of a microphone, and the mode guide icon 2810 in the second voice task mode may include an icon in the form of a remote controller.

When a voice recognition error occurs while performing a voice task using the voice guide information 2800, as illustrated in FIG. 28, the controller 140 may include one of a plurality of feedback messages 2850 for guiding the voice recognition error. Is displayed. In this case, when a voice recognition error occurs, when the user's voice input through the voice input unit 110 is too small, the voice input unit 110 recognizes the user's voice and there is no command matching the voice database. And at least one of a user's operation immaturity.

In particular, the controller 140 may display the feedback message 2850 differently according to the mode of the voice task and the type of the voice recognition error.

In detail, the controller 140 may display a feedback message differently according to a case where a voice recognition error occurs in the first voice task mode and a case where a voice recognition error occurs in the second voice task mode. For example, in the case of a voice recognition error in the first voice task mode, the controller 140 may display one of the plurality of feedback messages 2901 to 2913 illustrated in FIG. 29. In the case of a voice recognition error in the second voice task board, the controller 140 may display one of the plurality of feedback messages 3001 to 3015, 3101 to 3107, and 3201 to 3206 as shown in FIGS. 30 to 32. You can ..

In addition, the controller 140 may display the feedback message 450 differently according to the type of the voice recognition error in the second voice task mode. For example, when the recognition result of the user's voice input through the voice input unit 110 does not have a command matching the voice database or the user's voice is smaller than the preset value, the controller 140 may not recognize the user's voice. One of the plurality of feedback messages 3001 to 3015 illustrated in FIG. 30 may be displayed. If the voice input button of the external device is continuously pressed even after the user voice is input, the controller 140 may display one of the plurality of feedback messages 3101 to 3107 illustrated in FIG. 31. When the user's voice is not input for a preset time after the voice input button of the external device is pressed, the controller 140 may display one of the plurality of feedback messages 3201 to 3206 as illustrated in FIG. 32.

In particular, when the first voice recognition occurs, the controller 140 may display a feedback message defaulted according to the voice task mode and the type of the voice recognition error. For example, when a voice recognition error occurs in the first voice task mode, the controller 140 may display “Please speak again” which is the first message 2901 among the plurality of feedback messages shown in FIG. 29. have. When the user's voice input in the second voice task mode is not recognized, the controller 140 may display “Please speak again” which is the first message 3001 among the plurality of feedback messages shown in FIG. 30. . When the voice input button is pressed for a preset time even after the user voice input in the second voice task mode, the controller 140 releases the "button" of the first message 3101 among the plurality of feedback messages shown in FIG. 31. ". If the user's voice is not input for a preset time after the voice input button is pressed in the second voice task mode, the controller 140 may display the first message (of the plurality of feedback messages shown in FIG. 32). 3201), “Please tell me the command you want.”

Meanwhile, as described above, the default feedback message according to the voice task mode and the type of the voice recognition error may be set at the time of manufacture, and may be changed by a user's operation.

When the voice recognition error occurs repeatedly, the controller 140 may randomly display one of the remaining messages except the default feedback message. For example, when a voice recognition error occurs repeatedly in the first voice task mode, the controller 140 randomly displays one of the messages 2902 to 2913 except for the first message 2901 shown in FIG. 29. can do. When the user voice input in the second voice task mode is not repeatedly recognized, the controller 140 randomly selects one of the messages 3002 to 3015 except for the first message 3001 shown in FIG. 30. Can be displayed. When the voice input button is continuously pressed even after the user voice input in the second voice task mode, the controller 140 presets one of the remaining messages 3102 to 3107 except for the first message 3101 shown in FIG. 31. It can be displayed randomly (for example, 10 seconds). If the user's voice is not input for a predetermined time after the voice input button is pressed in the second voice task mode, the controller 140 may store the remaining messages 3202 to 3206 except for the first message 3201 shown in FIG. 32. May be randomly displayed every predetermined time (for example, 10 seconds).

As described above, the plurality of feedback messages are differently provided for each voice recognition error and voice task mode, so that the user can accurately check the error of the voice recognition. In addition, it is possible to obtain an effect as if the user is talking to the electronic device, so that the entertainment element can be increased.

33 is a flowchart illustrating a method of providing a feedback message when a voice recognition error occurs in the electronic device 100 according to an embodiment of the present disclosure.

First, the electronic device 100 determines whether a voice start command is input (S3310). In this case, the voice initiation command is a user command for switching the control mode of the electronic device 100 to the voice task mode, and includes a user including a preset word input through the voice input unit 110 provided in the electronic device 100. The first voice start command, which is a voice command, and the second voice start command, which is a user command of pressing a preset button included in an external device (for example, a remote controller) that interworks with the electronic device 100, may be included.

When the voice start command is input (S3310-Y), the electronic device 100 switches the control mode of the electronic device 100 to the voice task mode (S3320). In this case, when the input voice start command is the first voice start command, the electronic device 100 switches to the first voice task mode controlled by the user voice input through the voice input unit 110 of the electronic device 100. do. When the input voice start command is the second voice start command, the electronic device 100 switches to the second voice task mode controlled by the user voice input through the voice input unit 110 of the external device.

While performing the voice task mode, the electronic device 100 determines whether a voice recognition error has occurred (S3330). In this case, when a voice recognition error occurs, when the voice of the user input through the voice input unit 110 is smaller than a preset value, the voice of the user input through the voice input unit 110 is recognized and matched with the voice database. At least one of a case in which there is no command and a case in which an operation of a user is immature may be included.

When a voice recognition error occurs (S3330-Y), the electronic device 100 displays one of the plurality of feedback messages (S3340). In this case, the feedback message may be displayed differently for each voice task mode and for each voice recognition error. For example, when a voice recognition error occurs in the first voice task mode, the electronic device 100 displays one of the plurality of feedback messages 2901 to 2913 illustrated in FIG. 29. Alternatively, when a voice recognition error occurs in the second voice task mode, the electronic device 100 may display one of the plurality of feedback messages 3001 to 3015, 3101 to 3107, and 3201 to 3206 shown in FIGS. 30 to 32. Can be. In this case, when a voice recognition error occurs for the first time, the electronic device 100 may display a default feedback message among the plurality of feedback messages.

In operation S3350, the electronic device 100 determines whether a voice recognition error occurs repeatedly.

If the voice recognition error occurs repeatedly (S3350-Y), the electronic device 100 may randomly display another feedback message among the plurality of feedback messages (S3360). For example, the voice recognition mode may be repeatedly performed in the first voice task mode. When a voice recognition error occurs, the electronic device 100 may randomly display one of the remaining messages 2902 to 2913 except for the first message 2901 illustrated in FIG. 29. In addition, when the user voice input in the second voice task mode is not repeatedly recognized, the electronic device 100 randomizes one of the remaining messages 3002 to 3015 except for the first message 3001 shown in FIG. 30. Can be displayed. When the voice input button is continuously pressed after the user voice input in the second voice task mode, the electronic device 100 presets one of the remaining messages 3102 to 3107 except for the first message 3101 shown in FIG. 31. It can be displayed randomly every time (for example, 10 seconds). If the user's voice is not input for a predetermined time after the voice input button is pressed in the second voice task mode, the electronic device 100 may display the remaining messages 3202 to 3206 except for the first message 3201 illustrated in FIG. 32. ) Can be displayed randomly every predetermined time (for example, 10 seconds).

As described above, the plurality of feedback messages are differently provided for each voice recognition error and voice task mode, so that the user can accurately check the error of the voice recognition. In addition, it is possible to obtain an effect as if the user is talking to the electronic device, thereby increasing the entertainment factor.

Hereinafter, an embodiment of providing different guide information according to an application or providing different guide information according to a user's preference will be described with reference to FIGS. 34 to 38.

The controller 140 determines whether a voice start command for entering the voice task mode is input. When a voice start command is input, the controller 140 switches the mode of the electronic device 100 to the voice task mode. In this case, the voice task mode is a mode in which the electronic device is controlled by a user voice command input by the voice input unit 110. As described above, other types of user commands for initiating the voice task mode may be used instead of the voice start command. The other type of user command may include a specific button input of the remote controller, a specific button input of the electronic device 100, a specific motion of the user, etc. When the user enters the voice task mode, the controller 150 displays the voice guide on the display screen. Display the information. In this case, the voice guide information includes a plurality of voice commands for guiding a user voice input in order to perform the voice task mode in the electronic device 100.

When a specific command of a user is input, the controller 140 changes at least one of the plurality of voice commands included in the voice guide information into another voice command. In this case, the specific command of the user may be a user command for executing a specific application or a user command for displaying a user preferred voice command.

In particular, the voice guide information includes a fixed command area in which a voice command (eg, a "power off" voice command) of some of the voice commands is fixedly displayed and a change command area in which the voice command is variably changed. Therefore, when a specific command of the user is input, the controller 140 may change the voice command included in the change command area of the voice guide information into another command.

In one embodiment of the present invention, when a user command for executing a specific application is input, the controller 140 executes an application corresponding to the user command. In addition, the controller 140 may change at least one command among a plurality of voice commands included in the voice guide information into a voice command required for the currently executed application.

In this case, the voice command required for the application is stored in the storage 130 of the electronic device 100 when the application is installed. When the execution command of the application is input, the controller 140 may read out a voice command required for the application stored in the storage 130 and display it on the display 193.

In another embodiment of the present invention, when a user command for displaying a user's preferred voice command is input, the controller 140 changes at least one command among a plurality of voice commands included in the voice guide information into a user's preferred voice command. Can be. In this case, the user preference voice command may be a voice command registered in advance by a user using a voice command setting menu.

The changed voice guide information may include a voice command for switching to the voice guide information before the change. For example, the voice command for switching to the voice guide information before the change may include a "end" voice command.

Accordingly, the user may perform the voice task mode by using the voice guide information optimized for the user by application and user preference. Specific embodiments of the present invention will be described in more detail later with reference to FIGS. 34 to 37.

In an embodiment of the present invention, the control unit 140 receives a broadcast signal transmitted from an external broadcast station through the broadcast receiving unit 150 and performs signal processing on the received broadcast signal. 34, the controller 140 displays the signal processed broadcast image on the display unit 193.

When the voice start command is input through the voice input unit 110, the controller 140 recognizes the voice start command and switches to the voice task mode. In this case, the voice start command is a user command for switching to the voice task mode, and the voice task mode is a mode in which the electronic device 100 is controlled by a user voice input to the voice input unit 110. In this case, other types of user commands for starting the voice task mode may be used instead of the voice start command. Other types of user commands may include a specific button input of the remote controller, a specific button input of the electronic device 100, a specific motion of the user, and the like.

When the voice task mode is switched to, the controller 140 displays first voice guide information 3500 for performing the voice task mode as illustrated in FIG. 35. In this case, the first voice guide information 3500 is displayed at the bottom of the screen on which the broadcast image is displayed.

In addition, the first voice guide information 3500 includes an icon 3510 indicating that the mode of the current display apparatus is the voice task mode and a plurality of voice commands 3351 to 3526 and 3530 for guiding the user's voice. The voice commands include power off voice command 3351, external input voice command 3352, channel shortcut voice command 3523, channel up / down voice command 3524, volume up / down ( UP / DOWN voice commands 3525, mute voice commands 3526, and MORE voice commands 3530. MORE voice command 3530 is a command for viewing voice commands other than the displayed voice commands. At this time, the power-off voice command (3521) and MORE voice command (3530) is located in the fixed command area is fixedly displayed, the external input voice command (3522), the channel shortcut voice command (3523), the channel up / down ( The UP / DOWN voice command 3524, the volume up / down voice command 3525, and the mute voice command 3526 may be located in a change command area that can be changed variably.

When the map application execution command is input, as illustrated in FIG. 36, the controller 140 executes the map application, and the first voice guide information 3500 corresponds to the second voice guide information 3600 corresponding to the map application. To).

In detail, when the map application is executed, the controller 140 reads a voice command corresponding to the map application stored in the storage 130. The controller 140 changes the voice command displayed in the change item area into the read voice command.

For example, as shown in FIG. 36, the controller 140 displays the power-off voice command 3621 and the MORE voice command 3630 that are displayed in the fixed command area. In addition, the controller 140 controls the external input voice command 3352, the channel shortcut voice command 3523, the channel up / down voice command 3524, and the volume up / down that are displayed in the change command area. (UP / DOWN) voice command (3525), mute voice command (3526) to external input voice command (3622), placefinding voice command (3623), directions voice command (3624) and end voice command (3625) You can change it. At this time, the end voice command 3625 is a voice command for guiding a user voice input for returning to the voice guide information before the change. In this case, when the termination voice command 3625 is executed, the controller 140 may also terminate the corresponding application.

Therefore, the user can easily check the functions available using the map application through the voice guide information.

In another embodiment of the present invention, as shown in FIG. 35, a user command (for example, a user voice called “Favorite”) for executing a user preferred voice command while the first voice guide information is displayed is input. As shown in FIG. 37, the controller 140 changes the voice guide information 3500 to the third voice guide information 3700 including the user's preferred voice command.

In detail, when a user command for executing a user preferred voice command is input, the controller 140 reads out the user preferred voice command stored in the storage 130. The controller 140 changes the voice command displayed in the change command area into the read voice command.

For example, as shown in FIG. 37, the controller 140 displays the power-off voice command 3721 and the MORE voice command 3730 that are displayed in the fixed command area. In addition, the controller 140 controls the external input voice command 3352, the channel shortcut voice command 3523, the channel up / down voice command 3524, and the volume up / down that are displayed in the change item area. (UP / DOWN) Voice commands (3525), mute voice commands (3526) are user preferred voice commands, Internet voice commands (3722), 3D voice commands (3723), paired voice commands (3724) and end voice commands (3725). Can be changed to In this case, the end voice command 3725 is a voice command for guiding a user voice input for returning to the first voice guide information before the change.

Therefore, the user can control the electronic device 100 using his or her favorite voice command.

38 is a flowchart illustrating a method for changing a voice command in voice guide information according to an embodiment of the present invention.

First, the electronic device 100 determines whether a voice start command is input (S3810). In this case, the voice start command is a user command for changing the mode of the electronic device 100 to the voice task mode.

When the voice start command is input (S3810-Y), the electronic device 100 switches the control mode of the electronic device 100 to the voice task mode (S3820). In this case, the voice task mode is a mode in which the electronic device 100 is controlled by a user voice input through the voice input unit 110.

When the voice task mode is switched, the electronic device 100 displays voice guide information in operation S3830. In this case, when the electronic device 100 performs a broadcast reception function, the voice guide information includes a voice command for controlling the broadcast reception function.

In operation S3840, the electronic device 100 determines whether a user command for changing a voice command is input. For example, the electronic device 100 determines whether a user command for executing a specific application (eg, a map application) is input and whether a user command for displaying a user's preferred voice command is input.

If it is determined that a user command for changing a voice command is input (S3840-Y). The electronic device 100 changes at least one of the voice commands included in the voice guide information in operation S3850. In this case, the changed at least one voice command may be a voice command displayed in a change command area among voice commands included in the voice guide information.

For example, when the user command for changing the voice command is a user command for executing a specific application, the electronic device 100 may transmit the voice command displayed in the change command area among the voice commands included in the voice guide information to the specific application. It can be changed by the corresponding voice command. Alternatively, when the user command for changing the voice command is a user command for displaying the user's preferred voice command, the electronic device 100 may convert the voice command displayed in the change command area among the commands included in the voice guide information as the user's preferred voice command. You can change it.

In operation S3860, the electronic device 100 performs a voice task using the changed voice guide information.

As described above, by providing different voice guide information according to an application executed in the electronic device and a user's preference, the user can control the electronic device more conveniently and efficiently.

34 to 38 illustrate that the voice guide information is changed, this is only an embodiment, and an embodiment in which a motion command included in the motion guide information for performing the motion task mode is changed is also an embodiment of the present invention. It may be included in the technical idea.

Specifically, when a motion start command is input through the motion input unit 120, the controller 140 switches the mode of the electronic device to the motion task mode controlled by the user motion. In addition, the controller 140 displays motion guide information including a plurality of motion commands for performing the motion task mode in the electronic device 100.

When an application execution command is input while the motion guide information is displayed, the controller 140 may change at least one of a plurality of motion commands into a motion command corresponding to the executed application.

As described above, by changing and providing a voice command according to an application executed in the electronic device, the user can control the electronic device more conveniently and efficiently.

Meanwhile, in the above-described embodiment, the remote controller is assumed as an external device for controlling the electronic device 100. However, this is only an example, and the electronic device 100 may be used using a portable terminal device such as a smart phone, a PDA, or the like. Can be controlled.

The program code for performing the control method according to the above various embodiments may be stored in various types of recording media. More specifically, it may be a random access memory (RAM), a flash memory, a ROM (Read Only Memory), an EPROM (Erasable Programmable ROM), an Electrically Erasable and Programmable ROM (EEPROM), a register, a hard disk, a removable disk, And may be stored in various types of recording media readable by a terminal, such as a memory, a CD-ROM, and the like.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is clearly understood that the same is by way of illustration and example only and is not to be construed as limiting the scope of the invention as defined by the appended claims. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention.

110: voice input unit 120: motion input
130: storage unit 140:
150: broadcast receiver 160: external terminal input
170: Remote control signal receiving unit 180: Network interface unit
190: video output unit 193: display unit
196: Audio output section

Claims (14)

In the method of setting the angle of view of the electronic device,
Displaying an angle of view guide UI for guiding setting of a camera angle of view connected to the electronic device in a region of a display screen when a preset event occurs;
And setting an angle of view of the camera using the angle of view guide UI. The method of claim 1,
The angle of view guide UI,
When the event to enter the motion task mode occurs, the angle of view setting method characterized in that it is not displayed. The method of claim 1,
The angle of view guide UI,
And a screen for displaying an image captured by the camera when the angle of view is set. The method of claim 1,
The setting step,
Adjusting the camera so that the angle of view of the camera automatically moves at a predetermined speed and direction;
And setting an angle of view at the point in time at which the user command is input to the angle of view of the camera, when a user command is input while adjusting the camera. The method of claim 1,
The setting step,
Adjusting the camera according to a user's operation using an external device;
And setting an angle of view at the point in time at which the user command is input to the angle of view of the camera, when a user command is input while adjusting the camera. The method of claim 1,
The preset event may include:
When the electronic device is initially installed, the power is supplied to the electronic device, an event in which the motion task mode is turned on, and an angle of view setting menu is selected from among control events of the electronic device. Way. The method of claim 1,
The camera comprises:
And a camera for capturing a user's motion for controlling the electronic device in a motion task mode. In an electronic device,
A camera for photographing a user's motion;
A display unit;
And a controller configured to display an angle of view guide UI for guiding setting of the camera angle of view in one region of the display unit, and to set the angle of view of the camera using the angle of view guide UI. 9. The method of claim 8,
The control unit,
The electronic device may display a screen provided by the electronic device without displaying the angle of view guide UI even when entering the motion task mode. 9. The method of claim 8,
The angle of view guide UI,
And a screen for displaying an image captured by the camera when the angle of view is set. 9. The method of claim 8,
The control unit,
Adjusting the camera so that the angle of view of the camera automatically moves at a predetermined speed and direction, and if a user command is input while adjusting the camera, setting the angle of view at the time when the user command is input to the angle of view of the camera. An electronic device, characterized in that. 9. The method of claim 8,
The control unit,
And controlling the camera according to a user's operation using an external device, and when a user command is input while adjusting the camera, an angle of view at which the user command is input is set as an angle of view of the camera. . 9. The method of claim 8,
The preset event may include:
And an event in which power is supplied to the electronic device upon initial installation of the electronic device, an event in which a motion task mode is turned on, or an event in which an angle of view setting menu is selected from a control menu of the electronic device. . 9. The method of claim 8,
The camera comprises:
And a camera for capturing a motion of a user for controlling the electronic device in a motion task mode.

Images