KR102161050B1 - Method for executing function of device, and device thereof - Google Patents

Abstract

The present invention relates to a method capable of performing a predetermined function of a device more quickly and easily based on information about the movement of the device, and a device and a recording medium therefor. A device according to a preferred embodiment of the present invention stores a motion detection unit that detects a motion of a device in a standby mode of the device, motion information based on motion information, and at least one function information corresponding to the motion information. And a controller that controls the device to execute a function corresponding to the motion information of the device in a standby mode by using motion information, motion information, and at least one function information.

Description

Device function execution method and device for it {METHOD FOR EXECUTING FUNCTION OF DEVICE, AND DEVICE THEREOF}

The present invention relates to function execution of a device, and more particularly, to a method of executing a function of a device based on a movement of the device, and a device that executes the method.

As functions of mobile devices such as smart phones become smarter, applications, services, and contents that can be used by users based on the device are increasing, and functions that can be executed by the devices are increasing.

Accordingly, accessibility to applications, services, and content or to functions executable by the device may be degraded. In particular, accessibility to applications, services, and content in the standby mode state of the device or/and accessibility to functions executable by the device may be degraded.

An object to be solved by the present invention is to provide a method of executing a function of a device based on movement of a device in a standby mode state of the device, and a device and a recording medium therefor.

Another problem to be solved by the present invention is to provide a method of executing a function of a device and a device and a recording medium therefor based on the movement of the device and status information about the device in the standby mode of the device.

Another problem to be solved by the present invention is to provide a method of executing a function of a device based on a state of an operation mode of the device and a movement of the device, and a device and a recording medium therefor.

Another problem to be solved by the present invention is to provide a method of executing a function of a device, and a device and a recording medium therefor, based on an operation mode state of a device, movement of the device, and context information about the device.

A device according to an exemplary embodiment of the present invention for achieving the above-described tasks includes: a motion detector configured to detect movement of the device in a standby mode state of the device; A storage unit for storing motion information based on the motion information and at least one function information corresponding to the motion information; And a control unit controlling the device to execute a function corresponding to the motion information of the device in the standby mode by using the motion information, the motion information, and the at least one function information. Do.

The standby mode state of the device may include at least one of an idle state of an application processor included in the device, a deactivation state of a function related to a touch screen included in the device, and a screen lock setting state of the device.

The function related to the touch screen may include at least one of a touch sensing function of the touch screen and a display function of the touch screen.

The standby mode state of the device may be a state in which other components included in the device other than the motion detection unit, the storage unit, and the control unit are deactivated, or a state in which power consumption by the other components is not generated, or the motion detection unit , A state in which only power consumption by the storage unit and the control unit is generated.

The controller may control the device to display a gateway screen before executing the function.

The gateway screen may include notification information indicating execution of the function and selection information for selecting an execution mode for the function.

The gateway screen may include selection information for selecting an execution mode for each of the plurality of functions when there are a plurality of functions corresponding to motion information of the device.

The device may include: a context information detector configured to detect at least one context information about the device; The storage unit stores the motion information, the at least one function information, and mapping information regarding the detected at least one situation information, and the function executed by the control unit is the at least one detected by the situation information detection unit. It is preferable that it is determined based on the situation information of the device, information about the movement of the device, and the mapping information.

The at least one situation information may include at least one of current time information, location information of the device, schedule information stored in the device, and log information of the device.

A method of executing a function of a device according to an exemplary embodiment of the present invention for achieving the above tasks includes: detecting movement of the device in a standby mode state of the device; Detecting motion information based on the motion information; Detecting at least one piece of function information corresponding to the detected motion information; And executing a function based on the detected at least one function information.

In a computer-readable recording medium in which one or more programs including instructions for executing a device function execution method according to a preferred embodiment of the present invention for achieving the above object are recorded, the method for executing the function of the device is described above. It is performed in the same way as the function execution method of one device.

1 is an example of a functional block diagram of a device according to an embodiment of the present invention.
2 is a diagram illustrating an example of mapping information related to an operation mode of a device, motion information of a device, and function information of a device according to an exemplary embodiment of the present invention.
3 is a diagram illustrating an example of motion information of a device.
4A to 4J are diagrams for explaining an example of a function of a device executed based on motion information of the device and an operation mode of the device.
FIG. 5 is a diagram illustrating an operation between a sensing unit and a processor based on a seamless sensing platform (SSP).
6A is a flowchart illustrating a method of executing a function of a device according to an exemplary embodiment of the present invention.
6B is a flowchart illustrating a method of executing a function of a device according to another exemplary embodiment of the present invention.
FIG. 7 is a flowchart illustrating a process that may be performed in step S604 of FIG. 6A or step S609 of FIG. 6B.
FIG. 8 is a diagram for explaining an example in which a predetermined function is executed by the device in steps S701 and S702 of FIG. 7.
9 is a flowchart illustrating a process that may be performed in step S604 of FIG. 6A or step S609 of FIG. 6B.
10 is a diagram for explaining an example in which a predetermined function is executed by the device in steps S901 and S902 in FIG. 9.
11 is a functional block diagram of a device according to another exemplary embodiment of the present invention.
12 is an example of classifying programs and/or instruction sets stored in the storage unit of FIG. 11 for each module.
13A and 13B are flowcharts illustrating a method of executing a function of a device according to another exemplary embodiment of the present invention.
14 is a functional block diagram of a device according to another exemplary embodiment of the present invention.
15 is a flowchart illustrating a method of executing a function of a device according to another exemplary embodiment of the present invention.
16A and 16B are flowcharts illustrating a method of executing a function of a device according to another exemplary embodiment of the present invention.
17 is an example for explaining an example of executing a function of a device according to the method shown in FIG. 16.
18A to 18F are exemplary diagrams of a gateway screen.
19A and 19B are flowcharts illustrating a method of executing a function of a device according to another exemplary embodiment of the present invention.
20 is an exemplary view of a screen for describing a case of executing a function of a device according to the method illustrated in FIG. 19.
21 is a functional block diagram of a device according to another exemplary embodiment of the present invention.

Since the present invention can apply various transformations and have various embodiments, specific embodiments are illustrated in the drawings and will be described in detail in the detailed description. However, this is not intended to limit the present invention to a specific embodiment, it should be understood to include all conversions, equivalents, or substitutes included in the spirit and scope of the present invention. In describing the present invention, when it is determined that a detailed description of a related known technology may obscure the subject matter of the present invention, a detailed description thereof will be omitted.

Terms such as first and second may be used to describe various components, but the components should not be limited by terms. The terms are only used for the purpose of distinguishing one component from another component.

The terms used in the present application are used only to describe specific embodiments, and are not intended to limit the present invention. The terms used in the present application have selected general terms that are currently widely used as possible while considering the functions of the present invention, but this may vary according to the intention of a technician working in the field, precedents, or the emergence of new technologies. In addition, in certain cases, there are terms arbitrarily selected by the applicant, and in this case, the meaning of the terms will be described in detail in the description of the corresponding invention. Therefore, the terms used in the present invention should be defined based on the meaning of the term and the overall contents of the present invention, not a simple name of the term.

Singular expressions include plural expressions unless the context clearly indicates otherwise. In the present application, terms such as "comprise" or "have" are intended to designate the presence of features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, but one or more other features. It is to be understood that the presence or addition of elements or numbers, steps, actions, components, parts, or combinations thereof, does not preclude in advance.

Input information referred to throughout the specification is user input information, and is touch-based input information. The touch-based input information may include user's gesture-based input information. For example, tap (tap or touch), long tap (long tap or long touch), touch and hold, touch and drag, double tap, drag , Panning (panning), flick (flick), drag and drop (drag and drop), and may be included in touch-based input information such as sweep (sweep), but is not limited thereto.

The input information is not limited to the above-described touch-based input information. For example, the input information may include movement-based input information or vision-based input information.

The motion-based input information may be based on a motion-based user's gesture (eg, shaking a device, rotating a device, and lifting a device). For example, a motion-based input of a device indicating a motion-based user gesture of a device upside-down in the direction of gravity as mentioned in an embodiment to be described later, indicating a request for executing a predetermined function Can be set by information.

Vision-based input information may be based on information recognized by analyzing an input image acquired by a camera without contacting the device. For example, as mentioned in an embodiment to be described later, information on recognizing the user's face or the information on the user's eyes included in the input image obtained by the camera is requested to activate a predetermined function of the device. It can be set as vision-based input information indicating.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, and in the description with reference to the accompanying drawings, the same or corresponding components are assigned the same reference numbers, and redundant descriptions thereof will be omitted. do.

1 is a functional block diagram of a device 100 according to an exemplary embodiment of the present invention. FIG. 1 is a diagram of a device 100 that executes a predetermined function based on motion information based on information on the movement of the device 100 and an operation mode state of the device 100. Yes.

Referring to FIG. 1, the device 100 includes, but is not limited to, a sensing unit 101, a storage unit 102, a processor 103, and an information input/output unit 104. That is, the device 100 may include more or fewer components than the components illustrated in FIG. 1.

For example, the device 100 may further include an element capable of detecting at least one piece of context information about the device 100 as shown in FIG. 14 to be described later. In addition, the device 100 transmits and receives at least one context information about the device 100 by transmitting and receiving data between a component capable of detecting at least one of the above-described situation information, the processor 103, and the storage unit 102. It can be configured to detect. At least one piece of context information will be described in more detail in FIG. 14 to be described later. Information about the state of the operation mode of the device 100 may be included in context information about the device 100.

The operation mode state of the device 100 may include a standby mode state and an active mode state, but is not limited thereto.

The standby mode state of the device 100 is included in the black screen state of the device 100, the idle state of the application processor included in the device 100, and the device 100 It may include at least one of a deactivation state of a function related to the touch screen and a screen lock setting state of the device 100.

The deactivation state of a function related to the touch screen may include at least one of a deactivation state of a touch sensing function of the touch screen and a deactivation state of a display function of the touch screen, but is not limited thereto. The touch sensing function deactivation state may indicate an off state of the touch sensing function of the device 100. The deactivation state of the display function of the touch screen may represent the black screen state of the device 100.

The standby mode state of the device 100 may include an inactive state of components other than the sensing unit 101, the storage unit 102, and the processor 103 included in the device 100. The standby mode state of the device 100 includes a function based on an interface with the sensing unit 101 and the storage unit 102 among the functions of the processor 103 included in the device 100, a function related to the sensing unit 101, and A deactivation state for functions of the device 100 other than functions related to the storage unit 102 may be included.

The standby mode state of the device 100 may include a low power state in which only the sensing unit 101, the storage unit 102, and the processor 103 included in the device 100 are operated. That is, the standby mode state of the device 100 may include a low power state in which power is consumed by the processor 103, the sensing unit 101, and the storage unit 102. The low power state may be, for example, a state in which power is consumed in a range of several mW to several kW, but the low power state is not limited as described above.

The standby mode state of the device 100 includes a low power state in which power consumption is not generated by components other than the sensing unit 101, the storage unit 102, and the processor 103 included in the device 100. I can. The standby mode state of the device 1000 may include a state in which power lower than the power consumed in the active mode state of the device 100 is consumed.

The processor 103 includes a co-processor, and the co-processor can perform a function based on an interface between the processor 103 and the sensing unit 101 and an interface between the processor 103 and the storage unit 102. have. In this case, the aforementioned low power state may refer to a state in which power is consumed by the auxiliary processor, the sensing unit 101 and the storage unit 102. The coprocessor may use, for example, a micro controller unit operated at a low clock rate.

The standby mode state of the device 100 may include an activation state of an application processor included in the device 100. That is, when the screen lock setting state of the device 100 is operated in the active state of the application processor and the screen lock setting state of the device 100 is set to the standby mode state of the device 100, the device 100 waits. The mode state may include an activation state of the application processor.

The application processor may be included in the processor 103. The inclusion of the application processor in the processor 103 may be regarded as including the application processor and the aforementioned auxiliary processor. When the application processor and the coprocessor are included in the processor 103, the standby mode state of the device 100 may be an active state, and the application processor may be an inactive state. The standby mode state of the device 100 is not limited as described above.

The device 100 is, for example, a smart phone, a smart TV, a personal computer (PC), a desktop PC, a notebook, a smart board, a tablet PC, and a mobile device. Devices (mobile devices), handheld devices or handheld computers, media players, e-book terminals, personal digital assistants (PDAs), digital cameras with a function to sense the motion of the device, and motion of the device It may be a digital CE (Consumer Electronics) having a function that can be sensed, but is not limited thereto.

For example, the device 100 may be a device wearable by a user. Devices that can be worn by the user include, for example, watches, glasses, belts (eg, waist belts, hair belts, etc.), and various jewelry (eg, rings, arms, feet, hair pins, neckbands, etc.) , Earphones, helmets, various body protectors (e.g. knee protectors, elbow protectors). It may include devices that can be used for purposes such as shoes, gloves, clothing, hats, prosthetic limbs for the disabled, prosthetics for the disabled, and the like. User wearable devices include communication functions and data processing functions. Devices that can be worn by a user are not limited to devices that can be used for the above-described purposes.

The sensing unit 101 detects a movement of the device 100. The movement of the device 100 is a rotation-based movement and a rotation direction (eg, clockwise, counterclockwise, +z-axis direction, and the like, for example, upside-down of the device 100). ?z axis direction), a linear direction-based movement such as horizontally lifting the device 100 horizontally, and a movement distance of the device 100 according to the linear direction-based movement, but are not limited thereto. For example, the movement of the device 100 may include a shake-based movement of the device 100 as described above.

The sensing unit 101 includes at least one sensor to detect movement of the device 100. That is, the sensing unit 101 includes a gyro sensor capable of sensing rotation-based motion of the device 100 and an acceleration sensor capable of sensing a linear motion and movement distance of the device 100 ( Accelerometer Sensor), but is not limited thereto.

For example, the sensing unit 101 includes a magnetic field sensor capable of sensing the rotation direction of the device 100, an orientation sensor capable of sensing the tilt direction of the device 100, and a device. A GPS sensor (Grobal Position System Sensor) that can sense the location information of the device 100, a gravity sensor that senses the direction of gravity of the device 100, and the number of rotations of the device 100 can be sensed. It may further include at least one of the rotational speed sensor. The sensor further included in the sensing unit 101 is also not limited to the above-mentioned.

The gyro sensor may be composed of three gyro sensors so as to sense the rotational angular speed of the device 100 in the three axes (x, y, and z). In this case, the sensing unit 101 is the x-axis rotation angle (roll (roll, left and right rotation) angle), y-axis rotation angle (pitch (tilt) angle), and z-axis rotation angle (yo (yaw, horizontal rotation) angle) and the rotation direction can be converted into electrical signals and output.

The acceleration sensor may be configured to sense a change in acceleration in three axes (x-axis, y-axis, z-axis) of the device 100 or a change in acceleration in two axes (x-axis, y-axis), respectively. In this case, the sensing unit 101 may convert the result of sensing the linear acceleration of the device 100 and the tilt angle in each axis direction into an electric signal and output it. The electrical signal for the sensed result output from the sensing unit 101 is transmitted to the processor 103.

The sensing unit 101 may be referred to as a motion detection unit that detects movement of the device 100. The signal output from the sensing unit 101 may be referred to as a sensing value for the movement of the device 100 or information on the movement of the device 100.

The storage unit 102 stores at least one program and data related to the program. At least one program stored in the storage unit 102 includes motion information of the device 100 based on information about the motion of the device 100 and at least one of the at least one device 100 corresponding to the motion information of the device 100. It includes a program capable of controlling the device to execute a function based on the function information. The data related to the program may include information on the motion of the device 100, motion information of the device 100, and mapping information on the function information of the device 100 described above.

FIG. 2 is an example of a table for explaining mapping information regarding operation mode state information of the device 100, motion information of the device 100, and function information of the device 100. The example of the table shown in FIG. 2 does not include information describing a mapping relationship between information about motion of the device 100 and motion information of the device 100. However, motion information of the device such as 90° clockwise rotation, 180° clockwise rotation, and 270° rotation clockwise may be determined based on information about the movement of the device 100 output from the sensing unit 101. I can.

Data related to a program stored in the storage unit 102 may include table information as shown in FIG. 2. The data related to the program stored in the storage unit 102 does not include information related to the activation mode state of the device 100, but information about the movement of the device 100 related to the standby mode state of the device 100, the device It may include motion information of (100) and mapping information about function information of the device (100).

Referring to FIG. 2, the operation mode state of the device 100 may include a standby mode state and an activation mode state. The motion information of the device 100 may include information indicating 90° rotation in the clockwise direction, information indicating 180° rotation in the clockwise direction, and information indicating 270° rotation in the clockwise direction.

The above-described standby mode state may be referred to as a sleep mode state, a deactivation mode state, or an idle state, but is not limited thereto. The above-described active mode state may be referred to as a running mode state, but is not limited thereto.

3A and 3B are diagrams for describing rotation-based motion information of the device 100. That is, FIG. 3A is an example for describing motion information based on a state in which the device 100 is placed vertically. The motion information shown in FIG. 3A includes horizontal span motion information according to a 90° rotation clockwise, horizontal span motion information according to a 270° rotation clockwise, and upside-down motion information according to a 180° rotation.

The rotation-based motion information of the device 100 is not limited to 90° rotation, 180° rotation, and 270° rotation as shown in FIG. 3A. For example, the rotation-based motion information of the device 100 may be set based on information on a motion according to a rotation of 90° or less in a clockwise direction. That is, rotation-based motion information of the device 100 may be set on the basis of information on the movement according to the rotation by 45° in the clockwise direction.

The rotation-based motion information of the device 100 may include motion information based on information on motion generated as the device 100 rotates by 90° in a counterclockwise direction. The rotation-based motion information of the device 100 is based on motion information based on motion information generated as the device 100 rotates by 90° in the clockwise direction, and as the device 100 rotates by 90° in the counterclockwise direction. It may include motion information based on information about the generated motion.

The rotation-based motion information of the device 100 is motion information based on information on a motion that is upside down (rotated by 180°) in the +z-axis direction based on a state in which the device 100 is placed vertically as shown in FIG. 3B. It may include one of motion information based on information about a motion that is upside down (rotated by 180°) in the ?z-axis direction. The rotation-based motion information of the device 100 may include motion information based on information about a motion that is upside down (rotated by 180°) in the ±z-axis direction based on a state in which the device 100 is placed horizontally.

Meanwhile, the standby mode state of the device 100 may be changed to the active mode state according to motion information detected in the standby mode state of the device 100.

In the standby mode state of the device 100, the information input/output unit 104 may be in an inactive state. For example, a touch screen is included in the information input/output unit 104, and the standby mode state of the device 100 is set to a black screen state of the touch screen, or a function related to the touch screen is set to a deactivated state. When the device 100 is set to the screen lock setting state, the information input/output unit 104 may be in an inactive state in the standby mode state of the device 100.

The activation mode state of FIG. 2 may include an active state of the sensing unit 101, the storage unit 102, the processor 103, and the information input/output unit 104 included in the device 100. The activation mode state of FIG. 2 includes not only the sensing unit 101, the storage unit 102, the processor 103, and the information input/output unit 104 included in the device 100, but also at least one other component not shown. It may include an active state.

The activation mode state of FIG. 2 includes a power consumption state in which power is consumed by the sensing unit 101, the storage unit 102, the processor 103, and the information input/output unit 104 included in the device 100. I can. The activation mode state of FIG. 2 is not only applied to the sensing unit 101, the storage unit 102, the processor 103, and the information input/output unit 104 included in the device 100, but also at least one other component not shown. The power consumption state in which power is consumed may be included.

The activation mode state of FIG. 2 may include an activation state of an application processor included in the device 100. The activation state of the application processor may represent a state in which power is consumed by the application processor.

The activation mode state of FIG. 2 may include a state in which more than the power consumed by the device 100 is consumed in the standby mode state of FIG. 2.

The activation mode state of FIG. 2 may include a state in which at least one of an application, a service, and content set in the device 100 or downloadable from the outside by the device 100 may be executed or an execution request may be made. have.

The state in which at least one of the application, service, and content is being executed may include a multitasking state. The state in which execution of at least one of an application, a service, and a content can be requested is an icon, a screenshot, or a user interface for setting the execution mode of the application, service, and content in the information input/output unit 104. A screen including) may be displayed or may include a state in which it can be displayed.

Referring to FIG. 2, the relationship between operation mode status information of the device 100, motion information of the device 100, and function information of the device 100 will be described in more detail below.

That is, when the motion information of the device 100 corresponds to information on the movement indicating 90° rotation in the clockwise direction, and the operation mode state of the device 100 is in the standby mode, it can be executed by the device 100. The predetermined function that exists is the time check function.

4A to 4J are examples for explaining a predetermined function of the device 100 that is executed according to an operation mode state of the device 100 and motion information of the device 100.

Referring to FIG. 4A, when the device 100 is in a standby mode and a black screen is displayed through the information input/output unit 104 (401), the device 100 from the sensing unit 101 When a sensing value representing a 90° rotation in a clockwise direction (motion information) is received, the processor 103 detects motion information of the device 100 from the information stored in the storage unit 102 according to the received sensing value. . The motion information detected at this time is motion information indicating a 90° rotation clockwise.

The processor 103 detects function information from the storage unit 102 using motion information of the device 100 detected in the standby mode of the device 100. Detecting information from the storage unit 102 may be referred to as an information read or an information search, but is not limited thereto.

Referring to FIG. 2, when motion information of the device 100 indicates a 90° rotation clockwise and the operation mode state of the device 100 is the standby mode state, the function information detected from the storage unit 102 is Time check function information. According to the detected function information, the processor 103 controls the function of the device 100 so that the time check function is executed. Accordingly, the black screen of the information input/output unit 104 is changed to a screen 402 including time information.

The screen provided according to the execution of the time check function on the black screen may be referred to as a first screen. The first screen may refer to a screen provided for the first time on a black screen, but is not limited thereto. For example, the first screen may represent a screen that is provided for the first time on a black screen and that can provide various information so that a user can stay for a certain amount of time or longer. Various information may include, for example, gateway-related information to be described later, but is not limited thereto.

When the first screen is provided, the application processor included in the device 100 may be in an inactive state, but may be in an active state. This may be determined according to information provided through the first screen. For example, when information provided through the first screen is provided in an inactive state of an application processor included in the device 100, the application processor may be in an inactive state. When information provided through the first screen is provided in an active state of an application processor included in the device 100, the application processor may be in an active state.

When the screen 402 including the above-described time function is displayed, the application processor included in the device 100 may be in an inactive state. As described above, the application processor may be included in the processor 103 and set to an inactive state or an active state. However, the application processor may be installed outside the processor 103.

In FIG. 2, when the operation mode state of the device 100 is the standby mode state, and the motion information of the device 100 indicates 180° rotation in the clockwise direction, a predetermined function that can be executed by the device 100 is This is a Quick Note function. This is the example of the screen shown in FIG. 4B.

Referring to FIG. 4B, when the device 100 is in a standby mode and a black screen is displayed through the information input/output unit 104 (403), the device 100 from the sensing unit 101 When a sensing value representing a rotation of 180° clockwise is received, the processor 103 recognizes that the motion information of the device 100 is rotated 180° clockwise. Recognition of motion information according to the sensing value by the processor 103 may be based on an operation of detecting motion information from the storage unit 102 using the received sensing value. Therefore, motion information recognition by the processor 103 may be referred to as motion information detection, but is not limited thereto.

After detecting motion information of the device 100, the processor 103 may detect an operation mode state of the device 100. The processor 103 may detect motion information of the detected device 100 and predetermined function information corresponding to an operation mode state of the detected device 100 from the storage unit 103.

In FIG. 2, when the operation mode state of the device 100 is in the standby mode state and motion information of the device 100 is detected to indicate 180° rotation in the clockwise direction, predetermined function information read from the storage unit 103 Is the quick note function information. Accordingly, the processor 103 executes the quick note function, and the screen of the information input/output unit 104 may be changed from a black screen to a note screen 404 as shown in FIG. 4B.

The recording icon and camera icon included in the note screen 404 illustrated in FIG. 4B may be used for a quick note function. That is, when a user's command for selecting a Voice Recording icon is input on the screen 404, the recorded content may be displayed on the note screen. For example, when a user's voice signal "8 am, I am going to school" is input, the processor 103 converts the input user's voice signal into text information, and converts the converted text information to the note screen. Display. Accordingly, the user can see the message "8 am, I am going to school" through the notebook screen.

To this end, the processor 103 may include a function of converting an audio signal received through the information input/output unit 104 into text information that can be displayed. In this case, the font of the displayed text information may be set in advance. The displayed text information may be stored in the storage unit 102 according to the user's request for storage.

Therefore, the desired content can be memo on the note screen by using a stylus pen, but the desired content can be recorded by using the recording function. Accordingly, the user can take notes more quickly and can use the quick note function of the device 100 without a stylus pen.

Also, when the stylus pen is mounted on the device 100, the quick note function of the device 100 can be used without taking out the stylus pen. When the recording icon is selected, the processor 103 may display a corresponding execution screen through the information input/output unit 104 while executing the recording application.

When a command for selecting a camera icon is input on the screen 404, an image captured using the camera may be displayed on the quick note screen. To this end, the processor 103 may perform a function of superimposing the image captured through the camera on the quick note screen.

For example, the processor 103 may divide and display a screen according to execution of a camera application and a quick note screen. For example, an image captured through a camera may be displayed on the left, and a note screen may be displayed on the right, so that a message related to the captured image may be input through the note screen. The area in which the captured image is displayed and the area in which the note screen is displayed are not limited thereto. The captured image may be a still image or a moving image.

The size of the screen on which the captured image is displayed and the screen of the quick note may be set in advance. Only the captured image according to the user's command may be stored in the storage unit 102, or the captured image and a message input through the note screen may be stored in the storage unit 102 together. Accordingly, the user can capture and store an image to be captured quickly using the quick note function, or store a message related to the captured image together.

When the captured image is saved, execution of the camera application may be automatically terminated, but the camera application may be terminated according to a user's request. This operation depends on the environment setting of the device 100. For the recording function and capture function described above, the information input/output unit 104 may include a microphone and a camera.

When executing a corresponding application using the recording icon and camera icon included in the quick note screen 404 described above, the screen 404 may be defined as a recording application or a gateway screen for executing the camera application. have.

The gateway screen may include notification information notifying execution of a function before executing a predetermined function. The gateway screen may include selection information for selecting an execution mode for at least one function. The selection information may be defined as the above-described recording icon and camera icon. A description of the gateway screen will be described in more detail in FIGS. 17 and 18A to 18F to be described later.

When the quick note function indicates a function of quickly executing a note application installed in the device 100, the quick note function may be based on the note application installed in the device 100.

In the quick note function, the record icon and camera icon can be selected at the same time. In this case, the captured image and text information of an audio signal corresponding to the captured image may be displayed together on the note screen. Simultaneous selection of the record icon and the camera icon may be performed by multi-touching the record icon and the camera icon. The simultaneous selection of the recording icon and the camera icon may depend on the environment setting of the device 100 in which the camera icon is automatically selected according to the selection of the recording icon. Simultaneous selection of the recording icon and the camera icon may depend on the environment setting of the device 100 in which the recording icon is automatically selected according to the selection of the camera icon.

A predetermined function executed by the device 100 when the operation mode state of the device 100 is in the standby mode state, and motion information based on the motion information of the device 100 indicates 180° rotation in the clockwise direction. The information may be universal queue function information. This is the example shown in FIG. 4C.

4C, the operation mode state of the device 100 is in the standby mode state, a black screen 405 is displayed on the information input/output unit 104, and motion information based on information on the movement of the device 100 is clockwise. In the case of 180° rotation, this is an example in which the universal cue function is executed.

That is, the predetermined function information read from the storage unit 102 by the processor 103 is universal queue function information, and the processor 103 displays the screen of the information input/output unit 104 in the universal queue in a black screen. The device 100 is controlled to be converted to the information screen 406. The universal cue may be included in the storage unit 102.

When the operation mode state of the device 100 is in the standby mode state and the motion information of the device 100 indicates 180° rotation in the clockwise direction, predetermined function information that can be executed by the device 100 is queued (Universal Queue) may be list display function information.

When the predetermined function information is the cue list display function information, as the cue list display function is executed by the processor 103, the screen of the information input/output unit 104 is a black screen 407 as shown in FIG. 4D. In the cue list screen 408 is converted. The cue list is stored in the storage unit 103, and information based on the cue list may be provided from the storage unit 103 or a server (not shown). A screen 409 of FIG. 4D is a screen for downloading information of a queue selected based on a queue list from a server (not shown).

In FIG. 2, when the operation mode state of the device 100 is in the standby mode state and motion information of the device 100 indicates 270° rotation in the clockwise direction, predetermined function information that can be executed by the device 100 Is the Byte Information Viewer function.

The byte information viewer function is a function that shows necessary information according to a screen or environment set in the device 100. For example, information that can be provided, such as ticket information, security card information, payment barcode information, memo information, coupon information, etc. previously designated by the user using the Byte Information Viewer function, is not limited thereto.

By using the Byte Information Viewer function, the user quickly sweeps the information left on the Clipboard while using a specific application, the information left by the Byte Information Viewer through a specific interaction, screen capture, and information in the notepad ( swiping).

4E is an example of a screen for executing the byte information viewer function. That is, when the operation mode state of the device 100 is in the standby mode state and a black screen is displayed through the information input/output unit 104 (410), the device 100 is clockwise from the sensing unit 101 270 When a sensing value indicating the rotation is received, the processor 103 recognizes motion information of the device 100 corresponding thereto.

When the motion information is recognized, the processor 103 detects predetermined function information from the storage unit 102 using the detected operation mode status of the device 100 and motion information of the device 100. Referring to FIG. 2, predetermined function information detected from the storage unit 102 is byte information viewer function information. The processor 103 executes the byte information viewer function, and the screen of the information input/output unit 104 is converted from a black screen to a preset information screen 411.

Referring to FIG. 2, the operation mode state of the device 100 is the active mode state, the motion information of the device 100 indicates a 90° rotation clockwise, and the function currently executed by the device 100 is web browsing. In the case of a function, the predetermined function information that can be executed by the device 100 is browser secrete mode execution function information. 4F is an example of a screen corresponding to this.

Referring to FIG. 4F, when the operation mode state of the device 100 is executing the web browsing function (412), the device 100 rotates 90 clockwise based on a sensing value received from the sensing unit 101. When motion information indicating rotation is detected, the processor 103 detects predetermined function information from the storage unit 102 using the motion information of the device 100 and the operation mode state of the device 100. The detected predetermined function information is browser incognito mode execution function information. Accordingly, the processor 103 executes the browser incognito mode. According to the browser incognito mode execution, log information such as a user's search history, surfing history, log-in information, etc. executed afterwards are not recorded in the device 100.

While the incognito mode is being executed, when a sensing value indicating the 90° rotation of the device 100 in the reverse clockwise direction is received from the sensing unit 101 (that is, when the sensing value is received as a reference value), the processor 103 Can turn off the incognito mode of web browsing. The secret mode execution function and the secret mode cancellation function by the processor 103 read motion information from the storage unit 102 using the received sensing value, and the storage unit 102 uses the read motion information and the sensing value. It can be performed in a manner that reads predetermined function information from.

In FIG. 2, the operation mode state of the device 100 indicates the active mode state, the motion information of the device 100 indicates 180° rotation in the clockwise direction, and an arbitrary application is currently being executed by the device 100. At this time, a predetermined function that can be executed by the device 100 is a function of switching to another application. 4G is an example of a screen corresponding to this.

Referring to FIG. 4G, when the operation mode state of the device 100 is executing a specific SNS (Social Network Service) (414), the device 100 is rotated 180° clockwise from the sensing unit 101. When the sensing value is received, the processor 103 detects motion information of the device 100 from the storage unit 102 using the sensing value. The processor 103 detects predetermined function information from the storage unit 102 using the detected motion information of the device 100 and the operation mode state of the device 100. The predetermined function information detected in the case of Fig. 4G is function information for switching to another application.

Accordingly, the processor 103 executes a function of switching to another application (415, 416). The other application described above may include, but is not limited to, one of a preset application, an application executed immediately before, and another application being multitasked. When there are a plurality of applications being multitasked, other applications may include applications that have been recently executed.

During application switching, the processor 103 may immediately switch the screen, but may provide an animation effect as shown in the screens 415 and 416 of FIG. 4G. The screens 415 and 416 of FIG. 4G display a heavy stone on the down side of the device 100 due to the accordion effect, and a sensing value indicating the rotation of the device 100 clockwise 180° from the sensing unit 101 is received. Then, the processor 103 displays a screen which gradually compresses the original application screen while gradually lowering the heavy stone.

The animation effect is not limited to the above-described accordion effect. For example, the animation effect may include various animation effects such as an animation effect in which a blurred image becomes clear, an animation effect in which an image moves from top to bottom, and an animation effect that rotates an image equal to the rotation angle of the device 100. I can. These various animation effects can be set by the user in advance. Before being set by the user, the animation effect can be displayed in the form of a demonstration in advance.

Referring to FIG. 4H, when the operation mode state of the device 100 indicates that a specific application (eg, Facebook) is running (417), it is sensed that the device 100 is rotated 180° clockwise. If so, it is switched to a predetermined application (eg, KakaoTalk) (418). If the device 100 is rotated 180° clockwise again while a predefined application (eg, KakaoTalk) is running (419), it switches to a specific application (eg, Facebook) that was previously executed ( 420). In this way, to switch the application executed by the device 100, motion information of the device 100 stored in the storage unit 102, the operation mode status information of the device 100, and a predetermined number that can be executed by the device 100 You can set the function information of. The rotation of the device 100 on the screen 419 may be set to rotate 180° in the reverse clockwise direction.

If the above-described operation mode state of the device 100 indicates that a service or content is being executed, the predetermined function information of the device 100 according to the predetermined motion information of the device 100 is another service, another content, or another application. Can be set to switch to.

When the operation mode status of the device 100 indicates that a service or application is running, and multiple accounts are set for the currently running service or application, the device 100 according to the predetermined motion information of the device 100 The predetermined function information may be set to perform a function of changing a currently used account to another account.

In FIG. 2, when the operation mode state of the device 100 is in the active mode state and indicates that a specific list is displayed, and the motion information of the device 100 indicates 180° rotation in the clockwise direction, it is executed by the device 100 As illustrated in FIG. 4I, the predetermined function may be a function of changing a list sorting method. That is, as shown in the screen 421 of FIG. 4I, when the motion information of the device 100 indicates a 180° rotation of the list sorted in ascending order, the processor 103 is in descending order. It can be changed to the sorted list screen 422.

In FIG. 2, when the operation mode state of the device 100 is the active mode state, and the motion information of the device 100 indicates 270° rotation clockwise, the voice recorder is irrespective of the function being executed by the device 100. A predetermined function may be set to perform the function. For example, when the device 100 is displaying the home screen and a sensing value indicating that the device 100 is rotated by 270° in the clockwise direction is received, the device 100 is The voice recorder function can be executed accordingly.

The predetermined motion information of the device 100 and the predetermined function information of the device 100 according to the operation mode state of the device 100 are not limited as defined in FIG. 2. For example, as for the predetermined motion information of the device, only motion information of upside-down (rotating the device 100 by 180°) in a clockwise direction may be defined. As shown in FIG. 4J, as for the predetermined motion information of the device 100, only motion information 423 lifting the device 100 in a horizontal direction and lifting it in a vertical direction may be defined. The predetermined function information corresponding to the motion 423 illustrated in FIG. 4J may match the function information of one of the functions defined in FIG. 2. However, the function information that can be matched is not limited as defined in FIG. 2.

The predetermined motion information of the device 100 is not limited as described above. For example, predetermined motion information of the device 100 is motion information for holding the device 100 in the vertical direction and lifting it in the vertical direction, motion information for holding the device 100 in the vertical direction, and moving it by a predetermined distance in the left or/and right direction. It may include information, motion information held in the horizontal direction and moved by a predetermined distance in the left or/and right direction. The predetermined distance may be defined as a distance greater than or equal to a minimum distance at which the device 100 can be recognized as being moved in the left or right direction by the sensing unit 101. The minimum distance may be determined according to a sensor included in the sensing unit 101.

4j shows that when a sensing value indicating that the device 100 is in the standby mode and the device 100 is held in the horizontal direction and lifted in the vertical direction from the sensing unit 101 is generated, a preset application is displayed. This is the case to run. The sensing value indicating that the device 100 is lifted in the horizontal direction and lifted in the vertical direction is, for example, the x-axis change amount is less than 30°, the y-axis change amount is 90° or more, the acceleration change amount is greater than T, and T is It may be set to be an integer, but the sensing value is not limited as described above. That is, the sensing value may be determined according to a sensor included in the sensing unit 101.

At least one program stored in the storage unit 102 is an application execution program, a service execution program, and a content storage program. And a content playback program.

As described above, the processor 103 executes at least one program stored in the storage unit 102, and uses the value sensed from the sensing unit 101 and the information stored in the storage unit 102. Motion information can be recognized.

The processor 103 may detect the state of the operation mode of the device 100. When information on the operation mode status of the device 100 is stored in a flag register of the processor 103 or a predetermined area of the storage unit 102, the processor 103 is a flag register or the storage unit 102 The operation mode state of the device 100 may be determined by reading information on the operation mode state of the device 100 from the above-described predetermined area of. The determination of the operation mode state of the device 100 may be referred to as detection of the operation mode state of the device 100. The processor 103 may include a RAM including the above-described flag register.

The processor 103 controls the overall operation of the device 100 and may be referred to as one or more processors. The processor 103 may control operations of the sensing unit 101, the storage unit 102, and the information input/output unit 104. The processor 103 may be referred to as a controller, a microprocessor, a digital signal processor, or the like.

The processor 103 may include a low-power processor 510 and an application processor 520 that control the sensing unit 101 by a seamless sensing platform (SSP) as shown in FIG. 5. The low power processor 510 may be defined as a coprocessor, and the application processor 520 may be defined as a main processor. 5 is a diagram for explaining a relationship between the SSP-based sensing unit 101 and the processor 103.

The low-power processor 510 illustrated in FIG. 5 may be configured as a low-power MCU operated in the standby mode state of the device 100 mentioned in FIG. 1 described above. The low power processor 510 may include a sensor hub 511 and an SSP manager 512. The first to nth sensors 501_1 to 501_n may be attached to the sensor hub 511. The first to nth sensors 501_1 to 501_n are included in the sensing unit 101. The SSP manager 512 may be included in the framework of the application processor 520.

The sensor hub 511 may receive a value sensed from the first to nth sensors 501_1 to 501_n. The first to nth sensors 501_1 to 501_n and the sensor hub 511 may transmit and receive a sensed value based on communication such as Bluetooth low energy (Bluetooth Low Energy) communication. Communication between the first to nth sensors 501_1 to 501_n and the sensor hub 511 is not limited to low-power Bluetooth communication.

When the operation mode state of the device 100 indicates the standby mode state, the application processor 520 may be set to the standby mode state. When the application processor 520 is set to the standby mode and the application processor 520 that is set to the standby mode needs to be changed to the active mode state, the sensor hub 511 is used for seamless sensing (SSP). Platform) based data communication protocol can perform data communication with the SSP manager 512. A case in which the application processor 520 needs to be changed from the standby mode state to the active mode state may be determined according to predetermined function information to be executed by the device 100 mentioned in the above-described embodiments.

The operation between the sensor hub 511 and the SSP manager 512 is as follows. That is, the sensor hub 511 transmits an interrupt signal indicating that there is data to be transmitted to the SSP manager 512 (513). The SSP manager 512 transmits a signal requesting a data type and length to be transmitted by the sensor hub 511 to the sensor hub 511 (514). The sensor hub 511 transmits the contents of the format and length of data to be transmitted to the SSP manager 512 (515).

The SSP manager 512 transmits a reception preparation complete message (Start to read MSG) to the sensor hub 511 (516). When a reception preparation complete message (Start to read MSG) is received (516), the sensor hub 511 processes the sensed value into a previously promised packet and transmits it to the SSP manager 512 (517). A sensed value transmitted from the sensor hub 511 to the SSP manager 512 may be referred to as being transmitted as an electrical signal.

The SSP manager 512 detects motion information from information stored in the storage unit 120 using a sensed value received from the sensor hub 511 in the standby mode of the device 100 as mentioned in FIG. 1. . The SSP manager 512 may detect predetermined function information of the device 100 based on the detected motion information, and control a function of the device 100 based on the detected function information.

In addition, the SSP manager 512 detects motion information from the information stored in the storage unit 120 using the sensed value received from the sensor hub 511 as mentioned in FIG. 1, and Similarly, the state of the operation mode of the device 100 is checked. The SSP manager 512 detects predetermined function information of the device 100 from the storage unit 120 using the checked operation mode status and the detected motion information, and based on the detected function information, Function can be controlled.

The information input/output unit 104 may include a display unit capable of outputting screen information according to the execution of the predetermined function described above by the processor 103. The display unit is configured as a touch screen to receive user's touch-based input information. As described above, the information input/output unit 104 may be in a black screen state in the standby mode state of the device 100, may be in a state in which power is not consumed, a function related to the touch screen may be in a disabled state, and The display function related to the screen may be inactive, but is not limited thereto.

6A is a flowchart illustrating a method of executing a function of a device according to an exemplary embodiment of the present invention. 6A illustrates a case in which a predetermined function is executed according to an operation mode state of the device 100 when motion information of the device 100 is predetermined motion information. The flowchart of FIG. 6A may be performed by the processor 103 of the device 100.

In step S601, the processor 103 receives information on the movement of the device 100. Information on the movement of the device 100 may be received from sensors included in the sensing unit 101 mentioned in FIG. 1 on a continuous sensing platform basis as mentioned in FIG. 5.

Based on the information on the movement of the device 100, the processor 103 detects predetermined motion information (S602). When motion information of the device 100 is detected, the processor 103 detects information about the state of the operation mode of the device 100 (S603). Detecting information about the operation mode status of the device 100 may be referred to as checking the operation mode status of the device 100.

When the operation mode state of the device 100 is an active mode state, the information on the operation mode state of the device 100 may include information indicating what state the device 100 is currently in. For example, the information on the state of the operation mode of the device 100 may include information indicating which application is being executed when the application is executed, but is not limited thereto. The detection of the operation mode state of the device 100 in step S603 may be performed in the same manner as mentioned in the description of the processor 103 of FIG. 1.

In step S604, the processor 103 executes a predetermined function based on the information on the operation mode state of the device 100 and motion information of the device 100. A predetermined function may be detected and executed from the storage unit 102 as described in FIGS. 2 and 4A to 4J described above.

6B is a flowchart illustrating a method of executing a function of a device according to another exemplary embodiment of the present invention. 6B is a case in which an operation mode state of the device 100 is set to a standby mode state. 6B may be performed by the processor 103 of the device 100.

Referring to FIG. 6B, when the device 100 is in the standby mode, the processor 103 receives information on the movement according to the movement of the device 100 from the sensor unit 101. I can. In this case, the processor 103 may be the low power processor 510 of FIG. 5. Accordingly, the processor 103 may receive information on the movement according to the movement of the device 100 from the sensor unit 101 through a data communication protocol based on the Seamless Sensing Platform (SSP).

In the standby mode state of the device 100 (S605), the processor 103 receives information about the movement of the device 100 from the sensor unit 101 (S606). The processor 103 detects motion information from the storage unit 102 by using the received motion information (S607). When motion information is detected, the processor 103 detects at least one piece of function information corresponding to the detected motion information from the storage unit 102 (S608).

The motion information detection and the detection of the at least one function information described above may be referred to as detection of at least one function information according to the storage structure of the motion information and at least one function information stored in the storage unit 102. For example, in the case of detecting at least one function information from the storage unit 102 by the processor 103 using the motion information received from the sensor unit 101, the motion information detection and the above-described The detection of at least one function information may be referred to as detection of the at least one function information described above.

The processor 103 controls the device 100 to execute a function based on the at least one function information received from the storage unit 102 (S609). The operation flowchart illustrated in FIG. 6B may be performed as described in FIGS. 4A to 4E. In step S609, the processor 103 may display a gateway screen as shown in FIGS. 17 and 18A to 18F, which will be described later, before executing the function.

7 is a flowchart illustrating a process that can be included in step S604 of FIG. 6A or step S609 of FIG. 6B described above.

7 illustrates a process of executing a predetermined function of the device 100 according to a result of determining whether the user is looking at the device 100.

That is, in step S701, the processor 103 determines whether the user is looking at the device 100 before executing a predetermined function. Determining whether the user is looking at the device 100 may be determined according to whether the user's face is included in the image acquired using the camera included in the device 100. Alternatively, it may be determined whether the user is looking at the device 100 according to whether the user's face included in the obtained image is looking at the device 100, but it is determined whether the user is looking at the device 100 It is not limited as described above. .

The processor 103 may determine whether the user's face is included in the image acquired using the face region extraction technology. The processor 103 may determine whether the user's face included in the acquired image is looking at the device 100 using the feature value detection method. The feature value detection method detects feature values for the distance between the user's eyes, the thickness of the nose, the height and shape of the cheekbones, and the ratio of the width and height of the forehead in the face. The processor 103 may determine whether the user is looking at the device 100 by estimating a direction in which the user's face included in the image is directed using the detected feature value.

Instead of the above-described method of recognizing the user's face, it may be implemented to determine whether the user is looking at the device 100 by detecting the user's pupils from the acquired image and estimating the movement of the pupils.

As a result of the determination in step S701, if it is determined that the user is looking at the device 100, the processor 103 controls the device 100 to execute the function based on the predetermined function information (S702).

As a result of the determination in step S702, if it is determined that the user is not looking at the device 100, the processor 103 controls the device 100 to not execute the function based on the predetermined function information (S703).

In order to determine whether the user is looking at the device 100 by the processor 103 using a facial region extraction and feature value detection or pupil motion estimation method as mentioned in FIG. 7, the storage unit 102 At least one related application program may be stored and provided to the processor 103 at the request of the processor 103. The processor 103 may determine whether the user is looking at the device 100 as described above by executing a related application program provided from the storage unit 102.

FIG. 8 shows an example of a screen in which a predetermined function is activated by the device 100 according to steps S701 and S702 of FIG. 7. That is, as shown in the screen 810 of FIG. 8, when the device 100 is in the standby mode and the screen is in the black screen, the device 100 is rotated 180° clockwise by the sensing value. If recognized, the processor 103 activates the function of the front camera 821. As shown in the screen 820, the processor 103 temporarily switches the operation mode state of the device 100 to the active mode state in order to execute an application related to the front camera 821, but the information input/output unit 104 The screen output through) can maintain a black screen state. However, the processor 103 may output a screen in which the camera mode is executed through the information input/output unit 104.

The processor 103 may determine whether the user is looking at the device 100 based on the above-described user's face recognition for the image 822 obtained using the front camera 821 or the motion estimation of the user's pupils. . If it is determined that the user is looking at the device 100, the processor 103 executes a predetermined function that can be executed according to the operation mode state of the device 100 and motion information of the device 100 (830 ).

9 is an operation flowchart for explaining another process that may be included in step S604 of FIG. 6A or step S609 of FIG. 6B described above. 9 illustrates a process in which a predetermined function is executed by the device 100 upon receiving preset user gesture-based information corresponding to an execution request for a predetermined function.

That is, in step S901, the processor 103 determines whether gesture-based information of the user corresponding to the execution request for the predetermined function has been received before executing the predetermined function. As shown in FIG. 10, gesture-based information of the user is 2 touches while holding the device 100 with both hands while the device 100 is placed horizontally (for example, 2 touches based on the thumbs of both hands). ) Can be defined in advance. However, in a state in which the device 100 is placed horizontally, it is defined in advance as 1 touch (for example, 1 touch using the thumb of the hand holding the device 100) while holding the device 100 with one hand. Can be.

The state of the device 100 is not limited to the state placed horizontally as described above. For example, the state of the device 100 may include a state placed vertically. In the above-described state in which the device 100 is placed horizontally, as illustrated in FIG. 10, a bezel of the device 100 having height information (Height, or vertical information) included in information about the size of the device It can represent a state in which the face has a value approximating a right angle to the ground. The state in which the device 100 is placed vertically may indicate a state in which the bezel surface of the device 100 having width information included in the information on the size of the device 100 has a value approximating a right angle to the ground. have. A state in which the bezel surface of the device 100 has a value approximating a right angle to the ground may be set in consideration of an error range sufficiently.

The two touches and one touch described above may be recognized using information on the predicted touch area stored in advance. The information on the predicted touch area described above may include an error range. Information about the predicted touch area may be set in advance using size information of the device 100 and size information of a user's hand. The size information of the user's hand may be changed according to the user's body size. The size information of the user's hand may be determined using the scanned image of the user's hand. The size information of the device 100 may use information included in the spec information of the device 100 stored in advance.

The information on the predicted touch area described above may be set through a process of registering a touch area by a user. For example, a user may use the device 100 to create the same situation, register a touched area in the produced situation as a predicted touch area, and then use it. When registering the predicted touch area, the user can set a possible error range.

The above-described gesture-based information of the user may be stored to be mapped to information on a corresponding operation mode state of the device 100 stored in the storage unit 104 and motion information of the device 100.

The above-described gesture-based information of the user stored in the storage unit 104 may include at least coordinate information of the touch surface. The coordinate information of the touch surface described above includes the size of the device 100, the coordinate information of the touch surface that is predicted to generate thumb-based two touches of both hands when the user holds the device 100 with both hands, and the device ( When holding 100) with the right hand, coordinate information of the touch surface where 1 touch based on the thumb of the right hand is expected to occur, and 1 based on the thumb of the left hand when holding the device 100 with the left hand The coordinate information of the touch surface in which the touch is expected to occur may be included, but is not limited thereto. The coordinate information of the touch surface may include coordinate information indicating a 2D screen area. In step S901, if it is determined that an execution request for a predetermined function has been received based on the user's gesture described above, the processor 103 executes the predetermined function described above in step S902.

In step S903, if it is determined that an execution request for a predetermined function has not been received based on the user's gesture described above, the processor 103 does not execute the predetermined function described above in step S903.

FIG. 10 shows an example of a screen on which a predetermined function is executed by the device 100 according to steps S901 and S902 of FIG. 9. In the screen 1010 of FIG. 10, when the operation mode state of the device 100 is in the standby mode state and the screen is in the black screen state, a sensing value indicating a movement in which the device 100 is lifted vertically by a predetermined distance or more As a result, the processor 103 recognizes motion information of the device 100.

After recognizing the motion information of the device 100, if it is recognized that a multi-touch has occurred based on the thumbs of both hands holding the device 100 (S1020), the processor 103 is in the operation mode state of the device 100 And a predetermined function determined according to motion information of the device 100 is executed (1030). In the case of FIG. 10, the predetermined function is a case of continuously executing an application that was executed just before the operation mode state of the device 100 is set to the standby mode state.

11 is a functional block diagram of a device 1100 according to another exemplary embodiment of the present invention. Referring to FIG. 11, the device 1100 includes an information input unit 1101, a sensing unit 1102, a touch screen 1103, a camera 1104, an audio input unit 1105, an audio output unit 1106, and a storage unit ( 1107), a wireless communication unit 1108, a wired communication unit 1109, a processor 1110, and a power supply unit 1114. The configuration of the device 1100 is not limited as shown in FIG. 11. That is, the configuration of the device 1100 may include more or fewer components than the components illustrated in FIG. 11. For example, the device 1100 may not include the wired communication unit 1109.

The device 1100 shown in FIG. 11 has a predetermined function according to the movement of the device 1100 in the standby mode of the device 1100 based on the first processor 1111 regardless of the operation of the second processor 1112 Can run. The first processor 1111 is the aforementioned low-power processor, and the second processor 1112 may be defined as the above-described application processor, but is not limited thereto. The relationship between the first processor 1111 and the second processor 1112 will be described in more detail when the corresponding components are described below.

The standby mode state of the device 1100 may include the low power consumption state mentioned in FIG. 1, which is a power consumption state by the sensing unit 1102, the first processor 1111, and the storage unit 1107. The standby mode state of the device 1100 may include a state in which power is not consumed by components of the device 1100 other than the sensing unit 1102, the first processor 1111, and the storage unit 1107. . The standby mode state of the device 1100 may include an inactive state of the AP 1113 of the second processor 1112. The standby mode state of the device 1100 may include a black screen state of the touch screen 1103. The standby mode state of the device 1100 may include at least one of a deactivation state of a function related to a touch screen of the touch screen 1103 and a deactivation state of a touch sensing function of the touch screen 1103. The standby mode state of the device 1100 is not limited as described above.

The information input unit 1101 may be in a state in which power is not consumed in the standby mode state of the device 1100. The information input unit 1101 may be in an inactive state in the standby mode state of the device 1100. The information input unit 1101 may input input data for controlling the operation of the device 1100. For example, a command to power on/off the device 1100 may be input. The information input unit 1101 includes a key pad, a dome switch, a jog wheel, a jog switch, a hardware (H/W) button, a hot key, and a touch. It may include a panel, but is not limited thereto.

The sensing unit 1102 may be in an active state in a standby mode state and an activation mode state of the device 1100. The sensing unit 1102 is configured as described in the sensing unit 101 of FIG. 1 and outputs a signal that senses the movement of the device 1100. The sensing unit 1102 may be referred to as a motion detection unit that detects movement of the device 1100.

The sensing unit 1102 may output a signal that senses the position of the device 1100, whether a user is in contact, the orientation of the device 1100, and acceleration or deceleration of the device 1100. The sensing unit 1102 may further include a proximity sensor and a motion sensor. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object existing in the vicinity using the force of an electromagnetic field or infrared rays without mechanical contact. Examples of the proximity sensor include a transmission type photoelectric sensor, a diffuse reflection type photoelectric sensor, a mirror emission type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive type proximity sensor, a magnetic type proximity sensor, and an infrared proximity sensor.

The sensing unit 1102 may output a signal obtained by sensing a sensor-based user's gesture. The sensing unit 1102 may include first to nth sensors 501_1 to 501_n like the sensing unit 101 shown in FIG. 5. The sensing unit 1102 may operate in both a standby mode state and an activation mode state of the device 1100.

The touch screen 1103 may be in a black screen state as described above in the standby mode state of the device 1100. The touch screen 1103 may be in a state in which power is not consumed in the standby mode state of the device 1100. The touch screen 1103 may be in a deactivated state of a function related to the touch screen 1103 or/and a deactivated state of a touch sensing function of the touch screen 1103 in the standby mode state of the device 1100. The touch screen 1103 may output a screen or information indicating a screen lock setting state of the device 1100 in the standby mode state of the device 1100. The touch screen 1103 may be in an inactive state in the standby mode state of the device 1100.

The touch screen 1103 may be configured in a resistive (reduced pressure) method or a capacitive type, but is not limited thereto. The touch screen 1103 may receive user input information depending on the user's touch-based gesture described above. User input information dependent on the user's touch-based gesture may be defined by various combinations of the number of touches, a touch pattern, a touch area, and a touch intensity.

The touch screen 1103 may be provided with various sensors for detecting a touch or a proximity touch of the touch screen 1103. A sensor provided in the touch screen 1103 may generate a signal that senses the above-described touch-based user gestures or patterns. The proximity sensor for the touch screen 1103 may be the same as the proximity sensor included in the sensing unit 1102.

As an example of a sensor for detecting a touch of the touch screen 1103, a tactile sensor may be included. The tactile sensor can detect various information such as roughness of a contact surface, hardness of a contact object, and temperature of a contact point. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object existing in the vicinity using the force of an electromagnetic field or infrared rays without mechanical contact. Examples of the proximity sensor include a transmission type photoelectric sensor, a diffuse reflection type photoelectric sensor, a mirror emission type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive type proximity sensor, a magnetic type proximity sensor, and an infrared proximity sensor.

The touch of the touch screen 1103 is a case where a pointer is touched on the touch panel. The proximity-touch of the touch screen 1103 is a case where the pointer is not actually touched on the touch panel and is approached within a predetermined distance from the touch panel. The pointer is a tool for touching a specific part of the touch screen 1103 or touching a specific part of the touch screen 1103. Examples of the pointer include, but are not limited to, a stylus pen and a finger.

The touch screen 1103 displays information output by the device 1100. For example, the touch screen 1103 may display a screen in response to a user's gesture or touch pattern sensed through sensors provided in the touch screen 1103. The touch screen 1103 may display a screen in response to control data input through the information input unit 1101 or user input information. The touch screen 1103 may display a screen in response to a signal sensed through the sensing unit 1102. The touch screen 1103 may display at least one of the screens illustrated in FIGS. 4A to 4J described above.

The touch screen 1103 may be referred to as an input and output device. The screen displayed on the touch screen 1103 includes a GUI (Graphic User Interface) screen based on a user interface (UI).

The touch screen 1103 includes a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, and a three-dimensional display. 3D display), and AMOLED (Active-Matrix Organic Light-Emitting Diode), but are not limited thereto. The touch screen 1103 may be referred to as a display. The device 1100 may include two or more touch screens 1103. In case the device 1100 includes two touch screens 1103, the touch screen 1103 may be configured in a dual touch mode. The dual touch mode may refer to a front touch mode of the device 1100 and a rear touch mode of the device 1100, but is not limited thereto.

The camera 1104 processes an image frame such as a still image or a video obtained by an image sensor (or an optical sensor) in a video call mode or a photographing mode. The image frame processed by the camera 1104 may be displayed on the touch screen 1103. The image frames processed by the camera 1104 may be stored in the storage unit 1107 or transmitted to the outside through the wireless communication unit 1108 or the wired communication unit 1109.

The camera 1104 may be in a state in which power is not consumed in the standby mode state of the device 1100. The camera 1104 may be in an inactive state in the standby mode state of the device 1100. Two or more cameras 1104 may be provided depending on the configuration of the device 1100. That is, it may include a front camera and a rear camera of the device 1100. In the standby mode of the device 1100, the front camera may be operated to recognize a user's face or obtain an image for estimating the movement of the user's pupils as in FIG. 8 described above. Estimating the movement of the user's pupil may be referred to as tracking the movement of the user's pupil. The camera 1104 may be used as an input device for recognizing a user's spatial gesture.

The audio input unit 1105 may be in a state in which power is not consumed in the standby mode state of the device 1100. The audio input unit 1105 may be in an inactive state in the standby mode state of the device 1100. The audio input unit 1105 receives an external sound signal in a call mode, a recording mode, or a voice recognition mode, converts it into electrical voice data, and transmits it to the processor 1110. The audio input unit 1105 may be configured as a microphone, for example. The audio input unit 1105 may include a function based on various noise removal algorithms for removing noise generated in a process of receiving an external sound signal.

The audio input unit 1105 may be activated when the recording icon is selected in FIG. 4B described above. An external sound signal input through the audio input unit 1105 may be stored in the storage unit 1107 through the processor 1110. An external sound signal input through the audio input unit 1105 may be transmitted to the outside through the processor 1110 and the wireless communication unit 1108. An external sound signal input through the audio input unit 1105 may be transmitted to the outside through the processor 1110 and the wired communication unit 1109.

The audio output unit 1106 may be in a state in which power is not consumed in the standby mode state of the device 1100. The audio output unit 1106 may be in an inactive state in the standby mode state of the device 1100. The audio output unit 1106 outputs an audio signal or an audio signal received from the outside or read from the storage unit 1107 in a call mode or an audio reproduction mode. The audio output unit 1106 may be configured as a speaker. When the content is reproduced, the audio output unit 1106 outputs an audio signal included in the reproduced content if an audio signal is included in the reproduced content. The audio input unit 1105 and the audio output unit 1106 may be integrally configured like a headset.

The storage unit 1107 may be operated in a standby mode state and an activation mode state of the device 1100. The storage unit 1107 may be in an active state in a standby mode state and an activation mode state of the device 1100. The storage unit 1107 may store at least one program and/or instruction set and a resource configured to be executable by the processor 1110 to be described later.

The at least one program described above may include at least one program for executing the function execution method of the device 1100 according to an exemplary embodiment of the present invention. At least one of the above-described programs is an operating system program of the device 1100, an application program related to various functions (or services) performed by the device 1100, and a hardware component included in the device 1100. ), and an application program that controls at least one external device of the device 1100, but is not limited thereto.

The above-described external device may include an accessory of the device 1100. An accessory refers to a device whose functions are controlled by the device 1100 as an application program related to the accessory is executed by the device 1100, but is not limited thereto.

The storage unit 1107 may store at least one program capable of determining whether a value sensed by the sensing unit 1102 corresponds to predetermined motion information of the device 1200 and data related to the at least one program. have. The first processor 1111 may load at least one of the above-described programs stored in the storage unit 1107 and execute the loaded program to determine whether the received sensing value corresponds to predetermined motion information of the device 1200. have.

That is, when a sensing value is received from the sensing unit 1102 as the program is executed, the first processor 1111 uses the received sensing value to provide predetermined motion information corresponding to the sensing value received from the storage unit 1107. Can be detected.

At least one program for determining whether the above-described sensing value corresponds to predetermined motion information of the device 1100 may be stored in advance in the first processor 1111. In order to store the at least one program described above, the first processor 1111 may include a memory such as RAM (Random Access Memory).

Resources stored in the storage unit 1107 may include information obtained by mapping a sensing value, predetermined motion information of the device 1100, and predetermined function information, as mentioned in FIG. 2 described above. The resources stored in the storage unit 1107 may include information about the device 1100, information necessary to operate an application program set in the device 1100, and information necessary to execute a program for driving the above-described hardware components. However, it is not limited thereto.

The information on the device 1100 may include user information of the device 1100, but is not limited thereto. The storage unit 1107 may store the information mentioned when describing FIGS. 7 and 9 described above.

The storage unit 1107 includes a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg, SD, XD memory, etc.), a ROM (Read-Only Memory), an EEPROM (Electronically Erasable Programmable Read) -only memory), a programmable read-only memory (PROM) magnetic memory, and an optical disk, but are not limited thereto.

At least one program and/or instruction set stored in the storage unit 1107 may be classified into a plurality of modules according to functions.

12 is an example of classifying programs and/or instruction sets stored in the storage unit 1107 for each module. Referring to FIG. 12, the storage unit 1107 includes an operating system 1201, a wireless communication module 1202, a wired communication module 1203, a graphic module 1204, a global position system (GPS) module 1205, and a UI. (User Interface) module 1206, sensing module 1207, contact and motion module 1208, power module 1209, and an application database (DB) module 1210, including, but not limited to.

The application DB module 1210 includes a device function execution module 1211, a camera module 1212, a voice recorder module 1213, a web browsing module 1214, and a queue management module 1215 according to a preferred embodiment of the present invention. It may include, but is not limited to this. For example, the application DB module 1210 includes various application modules such as an email module, a social network service (SNS) module, a video conference module, an image management module, a browsing module, a calendar module, a widget module, a search module, and a word document creation module. It may contain more.

The operating system 1201 may control and manage general functions of the device 1100. The operating system 1201 may include a software component that enables communication between hardware and software components in the device 1100.

The wireless communication module 1202 may enable communication with at least one external device through the wireless communication unit 1108. The wireless communication module 1202 may include a software component for processing data received from at least one external device and data transmitted to the at least one external device through the wireless communication unit 1108. The wireless communication module 1202 may enable wireless communication with a server (not shown) or a repeater (not shown) through the wireless communication unit 1108, but the wireless communication target is not limited as described above.

The wired communication module 1203 may enable communication between the wired communication unit 1109 formed of an element such as a Universal Serial Bus (USB) port, and at least one external device (not shown). The wired communication module 1203 may include a software component for processing data transmitted and received with at least one external device through the wired communication unit 1109.

The graphics module 1204 includes a software component for adjusting brightness and rendering of a graphic displayed on the touch screen 1103 and a software component providing a virtual keyboard (or soft keyboard) for inputting text in the application module 1210. Can include.

The GPS module 1205 may include a software component that determines the location of the device 1100 and provides the determined location information to an application providing a location-based service. The UI module 1206 may include a software component that provides a UI necessary for an application that provides UI information based on the touch screen 1103.

The sensing module 1207 may include a software component that determines a sensing value received from the sensing unit 1102 and provides a sensing value to a specific application included in the application DB module 1210 based on the determined result. . For example, if the sensing value received from the sensing unit 1102 is information on the motion of the device 1100, the sensing module 1207 transmits the received sensing value to the device function execution module 1211.

The device function execution module 1211 detects motion information of the device 1100 corresponding to the received sensing value from the storage unit 1107. When motion information of the device 1100 corresponding to the received sensing value is detected, the device function execution module 1211 is stored in the information stored in the storage unit 1107 or in an unillustrated flag register included in the first processor 1111. An operation mode state of the device 1100 may be checked using the stored information. The timing of checking the state of the operation mode of the device 1100 is not limited as described above. For example, the state of the operation mode of the device 1100 may be checked before receiving the above-described sensing value.

The device function execution module 1211 detects information about the checked operation mode status and predetermined function information mapped to the detected motion information of the device 1100, and executes a function corresponding to the detected predetermined function information. have.

The device function execution module 1211 may operate according to the operation mode state of the device 1100 without checking the operation mode state of the device 1100.

That is, as illustrated in FIG. 6B, the device 1100 may be executed in the standby mode state. That is, the device function execution module 1211 may receive the sensing value in the standby mode state of the device 1100. Receiving the sensing value in the standby mode state of the device 1100 may be performed in the manner described with reference to FIG. 5.

When a sensing value is received in the standby mode state of the device 1100, the device function execution module 1211 detects motion information of the device 1100 from the storage unit 1107 using the received sensing value. Using the detected motion information of the device 1100, the device function execution module 1211 detects predetermined function information mapped to the detected motion information from the storage unit 1107, and corresponds to the detected predetermined function information. Function can be executed.

The device function execution module 1211 detects motion information and predetermined function information of the device 1100 from the storage unit 1107 according to the received sensing value when the device 1100 is in the active mode, and detects the It is possible to execute the function based on the function information of.

The contact and motion module 1208 may include a software component that detects a touch contact based on the touch screen 1103 and provides a result of tracking a motion based on the contact to a specific application included in the application DB module 1210. have. For example, when a touch contact based on the touch screen 1103 as in FIG. 10 is detected, the contact and motion module 1208 transmits information on the sensed touch contact to the device function execution module 1211. .

The power module 1209 is interlocked with the operating system 1201 to control power supply to hardware components in the device 1100, and includes a software component that controls a power saving mode for power supplied to the touch screen 1103. .

The storage unit 1107 does not store the modules included in the application DB 1210 among the program and/or instruction set shown in FIG. 12, but indicates location information such as a URL (Uniform Resource Locator) of the application module and the application module. Only display information that can be stored can be stored.

In this case, the processor 1110 may access an external device having an application DB through the wireless communication unit 1108 or the wired communication unit 1109 to use a corresponding program and/or instruction set. In this case, the external device includes, but is not limited to, a device having a cloud server or an application database.

Only the location information of the application module and display information indicating the application module may be stored in the storage unit 1107. In this case, when a user's selection signal based on information on the application module being displayed through the touch screen 1103 is received, the processor 1110 uses the location information of the application module selected by the user to transmit the wireless communication unit 1108. ) Or through the wired communication unit 1109, the information stored in the above-described external device may be searched.

The storage unit 1107 may store information stored in the storage unit 102 illustrated in FIG. 1. The storage unit 1107 may further store schedule information of a user and log information of the device 1100. Schedule information stored in the storage unit 1107 and log information of the device 1100 may be provided to the first processor 1111 as status information about the device 1200. The first processor 1111 may request context information on the device 1200 from the storage unit 1107 or may request the above-described schedule information and log information from the storage unit 1107.

The wireless communication unit 1108 may be in a state in which power is not consumed in the standby mode state of the device 1100. The wireless communication unit 1108 may be in an inactive state in the standby mode state of the device 1100. The wireless communication unit 1108 may be controlled by the first processor 1111 in the standby mode state of the device 1100 and set to an active state.

The wireless communication unit 1108 includes wireless Internet communication, wireless intranet communication, wireless telephone network communication, wireless LAN (LAN) communication, Wi-Fi communication, Wi-Fi Direct (WFD, Wi-Fi Direct) communication, and 3G (Generation). Communications, 4G (4 Generation) LTE (Long Term Evolution) communications, Bluetooth communications, infrared communications (IrDA, Infrared Data Association), RFID (Radio Frequency Identification) communications, UWB (Ultra WideBand) communications, Zigbee Data can be transmitted and received with external devices through a wireless network such as communication.

The wireless communication unit 1108 may include at least one of a broadcast reception module, a mobile communication module, a wireless Internet module, a wired Internet module, a short-range communication module, and a location information module, but is not limited thereto.

The wired communication unit 1109 may be in a state in which power is not consumed in the standby mode state of the device 1100. The wired communication unit 1109 may be in an inactive state in the standby mode state of the device 1100. The wired communication unit 1109 may transmit and receive data to and from an external device through a wired network such as wired Internet. The wired communication unit 1109 may transmit and receive data to and from an external device (not shown) using a plug and play interface such as a Universal Serial Bus (USB) port (not shown).

The power supply unit 1114 supplies power to hardware components included in the device 1100. The power supply unit 1114 includes one or more power sources such as a battery and an AC power source. The device 1100 does not include the power supply unit 1114, but may include a connection unit (not shown) that can be connected to an external power supply unit (not shown). The power supply unit 1114 may supply power to the sensing unit 1102, the first processor 1111, and the storage unit 1107 in the standby mode state of the device 1100. The power supply unit 1114 may not supply power to components other than the sensing unit 1102, the first processor 1111, and the storage unit 1107 in the standby mode of the device 1100.

The processor 1110 controls the overall operation of the device 1100 and may be referred to as one or more processors. The processor 1110 is an information input unit 1101, a sensing unit 1102, a touch screen 1103, and a camera 1103 using the operating system 1201 and various modules 1202 to 1215 stored in the storage unit 1107. , The audio input unit 1105, the audio output unit 1106, the storage unit 1107, the wireless communication unit 1108, the wired communication unit 1109, and the power supply unit 1114 can be controlled overall. The processor 1110 may be referred to as a controller, a microprocessor, a digital signal processor, or the like.

The processor 1110 is based on an information input unit 1101, a sensing unit 1102, a touch screen 1103, a camera 1104, and an audio input unit 1105 using the operating system 1201 and the UI module 1206. User interface can be provided.

The processor 1110 executes at least one program related to a method of executing a function of the device 1100 according to a preferred embodiment of the present invention, and performs the operation flowchart of FIG. 6A, 6B, and FIG. 13A or 13B described later. can do.

The processor 1110 may read and execute the program from the storage unit 1107. The processor 1110 may download and execute the program from an external device connected through the wireless communication unit 1108 or the wired communication unit 1109. The above-described external device may be referred to as an application providing server or an application market server. The external device may include a cloud server or a device capable of communicating around the device 1100, but is not limited thereto. The processor 1110 may be understood as including an interface function between various hardware components in the device 1100 and the processor 1110.

The processor 1110 includes a first processor 1111 and a second processor 1112. The first processor 1211 may correspond to the low power processor 510 of FIG. 5, and the second processor 1212 may correspond to the application processor 520 of FIG. 5, but is not limited thereto. The second processor 1112 illustrated in FIG. 11 may include an AP 1113. This is because the second processor 1112 may be referred to as including an additional processor such as a communication processor (CP). The communication processor is a processor that controls communication-based operations.

The standby mode state of the second processor 1112 may represent the standby mode state of the device 1100. The standby mode state of the second processor 1112 may indicate the standby mode state of the AP 1113.

In the standby mode state of the device 1100, the first processor 1111 may operate as described above. When it is necessary to wake up the AP 1113 of the second processor 1112 in order to execute a function based on the predetermined function information detected by the first processor 1111, the first processor 1111 is the AP 1113 The activation mode state setting request signal can be transmitted with. The first processor 1111 may be configured with a micro control unit (MCU) as described above.

The first processor 1111 may be connected to the wireless communication unit 1108 to receive context information about the device 1100 from the outside, such as location information and time information of the device 1100. To this end, the first processor 1111 may set the wireless communication unit 1108, which is set to the inactive state from the standby mode state of the device 1100, to the active mode state. Setting the activation mode state of the wireless communication unit 1108 described above may be temporarily performed.

13A and 13B illustrate a device function execution method according to another preferred embodiment of the present invention based on the relationship between the sensing unit 1102, the first processor 1111, and the second processor 1112 shown in FIG. It is a drawing for explanation. The second processor 1112 shown in FIGS. 13A and 13B may be referred to as the AP 1113 of FIG. 11.

In step S1301, the sensing unit 1101 transmits the sensing value to the first processor 1111. In step S1302, the first processor 1111 receives a sensing value. Steps S1301 and S1302 of FIG. 13A may be referred to as steps of continuously receiving a sensing value from the sensing unit 1101 by the first processor 1111 in the standby mode of the device 1100.

In step S1303, the first processor 1111 detects motion information of the device 1100 using the received sensing value.

When motion information of the device 1100 is detected, the first processor 1111 checks whether the operation mode state of the device 1100 is a standby mode state (S1304). Checking the operation mode state of the device 1100 in step S1304 is performed in a storage location such as a flag register (not shown) included in the first processor 1111 as mentioned in FIGS. 1 and 2 above. It may be performed by detecting information on the stored operation mode state or by detecting information on the operation mode state stored in a predetermined area of the storage unit 1107.

The information on the operation mode status stored in the flag register and the information on the operation mode status stored in the storage unit 1107 are, for example, values of '0' and '1'. It can indicate whether it is in a standby mode or an active mode. In the case of the activation mode state, additional information indicating in more detail the operation mode state of the device 1100 may be included.

The additional information may include information indicating that the device 1100 is currently browsing the web or may include information indicating that Facebook is being executed. The additional information may be stored in the above-described predetermined area of the storage unit 1107. When the operation mode state of the device 1100 is the active mode state and there is the above-described additional information, detecting the operation mode state of the device 1100 in more detail using the additional information is performed by the second processor 1112 Can be done by The predetermined area of the storage unit 1107 is an area that can be changed with respect to recorded data, and is an area that can be accessed by both the first processor 1111 and the second processor 1112.

When the operation mode state of the device 1100 is not the standby mode state, it indicates that the second processor 1112 is in the active mode state. If the second processor 1112 is in the active mode and the detected predetermined function information is executed by the second processor 1112, the first processor 1111 transmits the detected motion information to the second processor 1112. Transmit (S1305).

The second processor 1112 detects predetermined function information from the storage unit 1107 using the received motion information (S1306).

Before detecting the predetermined function information, the second processor 1112 uses the additional information on the operation mode state of the device 1100 stored in the storage unit 1107 as described above to obtain more detailed information on the operation mode state. Can be detected. The additional information may be stored in a temporary storage location included in the second processor 1112. When additional information is stored in a temporary storage location included in the second processor 1112, the second processor 1112 receives motion information from the first processor 1111, and is stored in the temporary storage location. Information about the detailed operation mode status of the device 1100 may be detected using the additional information. The temporary storage location provided in the second processor 1112 may be configured with a storage medium such as RAM.

The second processor 1112 determines whether the second processor 1112 is a subject to execute a predetermined function according to the detected predetermined function information (S1307). This determination may be performed using predetermined meta data for each function, but is not limited thereto. For example, when the power level (or power consumption level) required to execute a predetermined function included in the metadata of a predetermined function is equal to or higher than a predetermined reference value, the second processor 1112 executes the predetermined function. The subject to be performed may be determined by the second processor 1112. The above-described predetermined reference value information may be determined according to the level of power consumed by the device 1100 when only the first processor 1111 is operated. Meta data for each function may be stored in the storage unit 1107.

The second processor 1112 may determine a subject to execute a predetermined function by using information on a subject executing a predetermined function stored in the storage unit 1107. That is, the second processor 1112 using information on the execution subject mapped to the predetermined function information stored in the storage unit 1107 (information indicating the first processor 1111, information indicating the second processor 1112). ) Can determine a subject that needs to execute a predetermined function.

When it is determined that the second processor 1112 is the subject to execute the predetermined function, the second processor 1112 executes the above-described predetermined function (S1308).

When the subject that needs to execute the predetermined function is not the second processor 1112 but the first processor 1211, the second processor 1112 requests the first processor 1111 to execute the predetermined function (S1309 ), the second processor 1112 is converted to the standby mode (S1310). Accordingly, the first processor 1111 executes a predetermined function (S1311). When the second processor 1112 is switched from the active mode state to the standby mode state, the power consumption state of the device 1100 may become a low power consumption state as in the standby mode state of the device 1100 described above. That is, the power consumption state of the device 1100 may be a power consumption state based on the sensing unit 1101, the first processor 1111, and the storage unit 1107.

On the other hand, when the operation mode state of the device 1100 is the standby mode state in step S1304, the method proceeds to step S1312.

The first processor 1111 detects predetermined function information from the storage unit 1107 using the detected motion information (S1312). When predetermined function information is detected, the first processor 1111 determines whether the first processor 1111 is the subject to execute a predetermined function according to the detected predetermined function information (S1313). Determination of a subject to execute a predetermined function may be performed in the same manner as described in step S1307 described above. That is, when the power level required to execute a predetermined function included in the metadata of the predetermined function information is less than a predetermined reference value, the subject to execute the predetermined function information can be determined by the first processor 1111. have.

The method of determining the subject who should execute the predetermined function is not limited as described above. For example, as described above, the first processor 1111 may determine a subject that needs to execute a predetermined function by using information about an execution subject mapped to predetermined function information stored in the storage unit 1107. .

As a result of the determination, if the subject to execute the predetermined function is the first processor 1111, the first processor 1111 performs the predetermined function while maintaining the operation mode state of the device 1100 in the standby mode ( S1314).

As a result of the determination in step S1313, if it is determined that the subject to execute the predetermined function is not the first processor 1111, the first processor 1111 transmits an activation mode state setting request signal to the second processor 1112. (S1315). Accordingly, the second processor 1112 switches from the standby mode to the active mode (S1316).

When the second processor 1112 is converted to the activation mode state, the second processor 1112 notifies the first processor 1111 that the transition to the activation mode state is performed (S1317). Flag information indicating the operation mode state of the device 1100 stored in the first processor 1111 or the storage unit 1107 is updated to the active mode state. The first processor 1111 transmits a predetermined function execution request signal to the second processor 1112 (S1318), and the second processor 1112 executes a predetermined function (S1319).

14 is a functional block diagram of a device according to another exemplary embodiment of the present invention. 14 is an example of executing a function of a device based on information about movement of the device and situation information about the device. The function execution of the device, which will be described later, may be executed as at least one of the screen examples illustrated in FIGS. 4A to 4J described above.

Referring to FIG. 14, the device 1400 includes, but is not limited to, a sensing unit 1410, a context information detection unit 1420, a storage unit 1430, an information input/output unit 1440, and a processor 1450. That is, as mentioned in FIG. 1, the number of components included in the device 1400 may be fewer or more than those shown in FIG. 14.

For example, when the processor 1450 is configured to detect context information on the device 1400, the context information detection unit 1420 may not be included in the device 1400. When receiving context information such as location information and time information of the device 1400 from outside, the device 1400 may include a context information receiver instead of the context information detector 1420. The context information receiving unit may be composed of a communicable component such as the wireless communication unit 1108 illustrated in FIG. 11, but is not limited thereto. The outside may include a GPS (Grobal Positioning System) server.

Like the sensing unit 101 of FIG. 1, the sensing unit 1410 senses the motion of the device 1400 based on the SSP of FIG. 5 and transmits the sensing value to the processor 1450. The transmitted sensing value may be referred to as information on the motion of the device 1400. The sensing unit 1410 may operate in a standby mode state and an activation mode state of the device 1400.

The context information detection unit 1420 is configured to detect current time information, current location information of the device 1400, and operation mode status of the device 1400, respectively, but is not limited thereto. That is, current situation information on the device 1400 may be detected by further referring to schedule information stored in the storage unit 1430 and log information of the device 1400.

The context information detection unit 1420 may also operate based on a seamless context detection platform. When the context information detection unit 1420 operates based on a continuous context information detection platform, the context information detection unit 1420 is similar to the data communication method between the sensor hub 511 and the SSP manager 512 shown in FIG. 5. And the processor 1450 may be connected to transmit context information.

In this case, the context information detection unit 1420 may be configured to be controlled by a low-power processor when detecting context information such as time information, and under control of an application processor when detecting context information other than time information. . To this end, the context information detector 1420 may include an independent component according to detectable context information. For example, the context information detection unit 1420 may independently include a component for detecting time information and a component for detecting location information.

When the context information detection unit 1420 includes an independent component as described above, some components may be in an active state in the standby mode state of the device 1400, and components other than some components may be in an inactive state. have. An activation state of some components of the context information detector 1420 may indicate a power consumption state. The inactive state of components other than some components of the context information detection unit 1420 may indicate a state in which power is not consumed by components other than the some components.

Some of the above-described components are components controlled by a low-power processor, and may include, for example, a component that detects context information regarding the above-described time information. Components other than some of the above-described components are components controlled by the above-described application processor, and may include, for example, components that detect the above-described location information, but are included in the context information detection unit 1420 The elements are not limited as described above.

The context information that can be detected by the context information detector 1420 may be detected as follows, but is not limited thereto.

That is, when predetermined motion information on the device 1400 is recognized, the context information detector 1420 may detect whether the operation mode state of the device 1400 is a standby mode or an active mode. The context information detector 1420 may detect whether the device 1400 is located indoors or outdoors. Detecting whether the device 1400 is located indoors or outdoors may be performed using a triangulation method based on GPS reception information or information received from a plurality of APs (Access Points).

When the device 1400 is located indoors, the context information detector 1420 may detect indoor information (eg, information such as an office or a house) through communication with a plurality of APs indoors. When the device 1400 is located outdoors, location information (eg, information such as a train station A, a movie theater B, etc.) may be detected based on GPS information or information received from a plurality of APs.

The context information detection unit 1420 may detect current time information based on GPS-based time information or a system clock signal in the device 1400.

The context information detection unit 1420 may detect related schedule information or/and log information among schedule information or/and log information stored in the storage unit 1430 using the detected time information and the location information of the device 1400. . The context information detector 1420 may infer context information using the detected schedule information or/and log information.

When predetermined motion information for the device 1400 is recognized, the context information detector 1420 is in a state in which the user of the device 1400 is walking or running and is stopped, and at this time, the operation mode state of the device 1400 is a standby mode. Context information indicating a state can be detected. In order to detect such situation information, the situation information detection unit 1420 may detect a function capable of using the information stored in the storage unit 1430 or/and the information stored in the processor 1450 and the movement speed of the device 1400. It may include functions that are there. In order to perform a function of detecting the moving speed of the device 1400, the situation information detecting unit 1420 holds reference speed information necessary for detecting the moving speed in advance or the reference speed information stored in the storage unit 1430 Can be configured to use.

When predetermined motion information on the device 1400 is recognized, the context information detection unit 1420 is in a state in which the user is holding the device 1400 in front of movie theater B, and the operation mode state of the device 1400 is in the standby mode state. , By checking schedule information, time information, and log information of the device 1400, situation information indicating that reservation information exists in a time adjacent to the current time in movie theater B may be detected. To this end, the context information detection unit 1420 has a function of detecting the moving speed of the device 1400, a function of reading necessary information from the storage unit 1430 or/and the processor 1450, as described above, and A function of acquiring location information and time information of the device 1400 may be included.

When predetermined motion information for the device 1400 is recognized, the situation information detection unit 1420 is in a state in which the user is holding the device 1400 at train station A, and the operation mode state of the device 1400 is in the standby mode state. , By checking schedule information, time information, and log information of the device 1400, situation information indicating that a train ticket departing from A train station is reserved may be detected. To this end, the context information detection unit 1420 has a function of detecting the moving speed of the device 1400, a function of reading necessary information from the storage unit 1430 or/and the processor 1450, as described above, A function of acquiring location information and time information of the device 1400 may be included.

When predetermined motion information on the device 1400 is recognized, the context information detection unit 1420 is in a state in which the user is holding the device 1400, the operation mode state of the device 1400 is in the active mode state, and the device ( 1400) may detect context information that is browsing the web. To this end, the context information detection unit 1420 may include a function of detecting a moving speed of the device 1400, a function of reading necessary information from the storage unit 1430 and/or the processor 1450, and the like.

When predetermined motion information for the device 1400 is recognized, the context information detection unit 1420 indicates that the user is holding the device 1400 at Exit 7 of Gangnam Station, and the operation mode of the device 1400 is in the standby mode. , The user may detect appointment information of a time adjacent to the current time as context information. To this end, the context information detection unit 1420 has a function of detecting location and time information, a function of reading necessary information from the storage unit 1430 and/or the processor 1450, a function of checking schedule information of the device 1400, etc. It may include.

The context information detector 1420 may be configured to detect only time information and location information as context information. In this case, the processor 1450 refers to information about the operation mode status of the device 1400 stored in the storage unit 1430, schedule information, and log information based on the received time information and location information. ) Can be detected in more detail.

Meanwhile, the storage unit 1430 is configured like the storage unit 102 shown in FIG. 1 and may store information and programs. The information input/output unit 1440 may have the same configuration as the information input/output unit 104 illustrated in FIG. 1.

When the processor 1450 operates as a low-power processor (or coprocessor) as in the processor 103 of FIG. 1, the standby mode state of the device 1400 is the sensing unit 1410 included in the device 1400, Some or all components included in the information detection unit 1420, the storage unit 1430, and the power consumption state or an activation state by the processor 1450 may be included.

When the processor 1450 operates as the above-described low-power processor, the standby mode state of the device 1400 is a part or all of the components included in the sensing unit 1410 and the context information detection unit 1420 included in the device 1400 A state in which power is not consumed by components included in the device 1400 other than the element, the storage unit 1430, and the processor 1450 may be included.

When the processor 1450 operates as the aforementioned low power processor, the standby mode state of the device 1400 is related to the touch screen as mentioned in FIG. 1 described above for the touch screen included in the information input/output unit 1440. At least one of a touch sensing function, a display function of the touch screen, and a screen lock setting state of the device 1400 may be included.

The processor 1450 may include the low-power processor and the application processor described above as mentioned in FIG. 1. When the application processor is included in the processor 1450, the standby mode state of the device 1400 may include an activation state of a low-power processor included in the processor 1450 and an inactivation state of the application processor. When an application processor is included in the processor 1450, the standby mode state of the device 1400 may include a power consumption state by a low-power processor included in the processor 1450. The standby mode state of the device 1400 may include a state in which power is not consumed by an application processor included in the processor 1450.

When the processor 1450 includes a low-power processor and an application processor, the processor 1450 may operate as shown in the flowcharts of FIGS. 15, 16A, 16B, 19A, and 19B. 15, 16A, 16B, 19A, and 19B, the operation of the processor 1450 will be described below.

15 is a flowchart illustrating a method of executing a function of a device according to another exemplary embodiment of the present invention. Referring to FIG. 15, in step S1501, the processor 1450 receives a sensing value from the sensing unit 1410. Receiving a sensing value from the sensing unit 1410 may be based on the SSP as mentioned in FIG. 5.

The processor 1450 detects predetermined motion information from the storage unit 1430 based on the received sensing value (S1502). The predetermined motion information stored in the storage unit 1430 may consider an error range of a received sensing value. For example, when the above-described predetermined motion information indicates 180° rotation, the received sensing value may be expressed as an electrical signal corresponding to 180°±α. α may have an integer value greater than or equal to 0.

When predetermined motion information is detected, the processor 1450 receives the context information from the context information detection unit 1420 (S1503). Receiving the context information from the context information detection unit 1420 may be performed by transmitting a context information request signal from the processor 1450 to the context information detection unit 1430.

The processor 1450 executes a function of the device based on the received context information and predetermined motion information regarding the device 1400 (1504).

When time information and location information are received from the status information detection unit 1420, the processor 1450 uses the received time information and location information to store schedule information, log information, and device 1400 in the storage unit 1430. It is possible to detect current status information on the device 1400 by detecting information on the operation mode status of. In this case, step S1503 may be referred to as a context information detection step, and the context information used in step S1504 is the above-described current context information regarding the above-described device 1400.

15 may be performed based on a standby mode state of the device 1400 or may be performed based on an activation mode of the device 1400. Accordingly, the function performed in step S1504 may differ depending on the state of the operation mode of the device 1400.

16A is a flowchart illustrating a method of executing a function of a device according to another exemplary embodiment of the present invention. 16A is an example in which a function of executing an embedded gateway is added in the device 1400 when the operation mode state of the device 1400 indicates the standby mode state to the operation flowchart of FIG. 15. If a predetermined function executed by the device 1400 is configured as a service, the above-described gateway may be referred to as a service gateway.

The processor 1450 receives a sensing value from the sensing unit 1410 (S1601). The received sensing value may be referred to as information about the motion of the device 1400. Using the received sensing value, the processor 1450 detects motion information of the device 1400 (S1602). When the context information is received from the context information detector 1420 (S1603), the processor 1450 checks the operation mode state of the device 1400. When the operation mode state of the device 1400 is the standby mode state (S1604), the processor 1450 reads the embedded gateway information from the storage unit 1430 and executes the embedded gateway screen (S1605). The processor 1450 detects predetermined function information based on predetermined motion information and situation information, and executes a predetermined function according to the detected predetermined function information (S1606).

In step S1604, if the operation mode state of the device 1400 is not the standby mode state, the processor 1450 does not execute the embedded gateway screen, and detects predetermined function information based on the situation information and motion information of the device 1400. Then, a predetermined function is executed according to the detected predetermined function information (S1607).

FIG. 16B is a flowchart illustrating a method of executing a function of a device according to another exemplary embodiment of the present invention when the operation mode of the device 1400 is in the standby mode as shown in FIG. 6B.

Referring to FIG. 16B, in step 1608, when the operation mode of the device 1400 is in the standby mode, the processor 1450 receives a sensing value from the sensing unit 1410 (S1609). The received sensing value may be referred to as information about the motion of the device 1400.

The processor 1450 detects motion information of the device 1400 by using the received sensing value (S1610). Upon receiving the context information from the context information detector 1420 (S1611), the processor 1450 executes the embedded gateway screen using the received context information and the detected motion information (S1612). The processor 1450 detects predetermined function information based on predetermined motion information and situation information, and executes a predetermined function according to the detected predetermined function information (S1613).

FIG. 17 is an example of a screen for explaining an embedded gateway screen when predetermined motion information of the device 1400 is detected and an operation mode state of the device 1400 is a standby mode state.

That is, when the operation mode state of the device 1400 is in the standby mode, as in the screen 1710, and the black screen state, when a movement of the device 1400 rotated 90° clockwise is detected, the screen 1720 is displayed. As shown, the device 1400 displays a gateway screen. The gateway screen can be displayed for a very short time. For example, it may be displayed for about 5 seconds, but is not limited thereto. The time when the gateway screen is displayed may be set when setting the environment of the device 1400.

As illustrated in FIG. 17, the gateway screen may be executed by the co-processor when the processor 1450 includes a co-processor (eg, a low-power processor) and a main processor (eg, an application processor). Therefore, when a predetermined function to be executed must be executed by the coprocessor and the main processor is in the standby mode, the device 1400 maintains the standby mode state of the main processor and executes the predetermined function by the auxiliary processor. Can (1730).

The embedded gateway screen may be provided in various forms as shown in FIGS. 18A to 18F.

That is, as shown in FIG. 18A, the gateway screen may include manufacturer identification information (eg, logo) of the device 1400 and a command asking the user to release the lock.

As shown in FIG. 18B, the gateway screen may include manufacturer identification information of the device 1400 and information for selecting a predetermined executable application. 18B is a case in which information for selecting a predetermined executable application is shown as an icon. However, information from which a user can select a predetermined executable application is not limited to the above-described icons. For example, information for selecting a predetermined executable application may be provided in a text form.

When four icons are provided as shown in FIG. 18B, it indicates that there are four applications corresponding to predetermined function information that can be executed according to motion information and context information of the device 1400. Accordingly, the user can select at least one of four executable predetermined applications by using the icon.

As shown in FIG. 18C, the gateway screen may include manufacturer identification information of the device 1400 and information for a user to select whether to execute a predetermined function. In the case of FIG. 18C, information for a user to select whether to execute a predetermined function is provided in the form of an image in the content/advertising area.

The information displayed through the content/advertising area may be a part of an image (eg, a thumbnail or a representative image) representing a predetermined executable function or an image reduced in size, but is not limited thereto. The user may select to execute a predetermined function based on a touch on the content/advertising area. That is, the user can request execution of a predetermined function by touching the content/advertising area. The information displayed through the content/advertising area corresponds to predetermined function information determined according to motion information and context information of the device 1400 and may be previously stored in the storage unit 1430.

The gateway screen shown in FIG. 18D includes manufacturer identification information of the device 1400, a lock (or screen lock setting state) release message, and an icon for selecting at least one executable application. The gateway screen shown in FIG. 18E contains information based on a content/advertising area, which is information that a user can select whether to execute a predetermined function of the device 1400, and a manufacturer identification information of the device 1400, a lock release message. Include. The gateway screen shown in FIG. 18F includes manufacturer identification information of the above-described device 1400, a lock release message, information for a user to select whether to execute the above-described predetermined function (content/advertisement area), and at least the above-described executable. Includes information (icon) for selecting one application.

The gateway screen is not limited to FIGS. 18A to 18F. For example, the gateway screen may not include the “lock release” message shown in FIGS. 18A, 18D, 18E, and 18F.

The gateway screens shown in FIGS. 18A to 18F can be applied to the device 100 shown in FIG. 1 or the device 1100 shown in FIG. 11. When applied to FIGS. 1 and 11, the gateway screen shown in FIGS. 18A to 18F may be referred to as being provided according to the operation mode state of the device and motion information of the device without considering the context information as described above. .

19A is a flowchart illustrating a method of executing a function of a device according to another exemplary embodiment of the present invention. FIG. 19A is a case in which a function for selecting whether to execute a function through an embedded gateway screen is further included in the operation flow chart of FIG. 16A. Accordingly, since steps S1901 to S1904 of FIG. 19A are the same as steps S1601 to S1604 of FIG. 16A, descriptions are omitted to avoid redundant descriptions below.

If the operation mode state of the device 1400 is the standby mode state in step S1904, the processor 1450 reads and executes the embedded gateway from the storage unit 1430 (S1905). The embedded gateway screen executed at this time may correspond to one of FIGS. 18B to 18F.

Accordingly, through the information input/output unit 1440, manufacturer identification information of the device 1400 and information for selecting whether to execute a function are output. In particular, when there are a plurality of executable predetermined functions, a plurality of pieces of information for selecting whether or not to execute the function may be displayed, such as one screen among FIGS. 18B, 18D, and 18F. The information for selecting whether to execute the function corresponds to predetermined function information determined based on predetermined motion information of the device, detected situation information, and information about the operation mode state of the device 1400.

In step S1906, when an execution request for a predetermined function desired to be executed is received, the processor 1450 executes the predetermined function requested to be executed (S1907). However, if the function execution is not requested in step S1906, the processor 1450 returns to the operating state prior to the motion information recognition of the device 1400.

When the operation mode state of the device 1400 is in the standby mode state, when an execution request is not received for a predetermined time or longer, it may be determined that the function execution is not requested. The predetermined time may be managed by the processor 1450 and stored in the storage unit 1430 for management.

In step S1904, if the operation mode state of the device 1400 is not the standby mode state (if the operation mode state of the device 1400 is the active mode state), the processor 1450 may output information for selecting whether to execute the function. Can be (S1909). The information output at this time may be displayed in the form of a pop-up window, but is not limited thereto. In addition, the output information is information for selecting whether to execute a predetermined function determined according to an operation mode state, motion information, and situation information of the device 1400.

When a function execution request is received based on the information displayed on the device 1400, the processor 1450 executes the requested function in step S1907. If a function execution request is not received based on the information being displayed, the processor 1450 returns to the operating state prior to the motion information recognition of the device 1400.

When the device 1400 is in the active mode, if other function menus are requested or selected while information for selecting whether or not to execute the function is displayed as described above, or if execution is not requested for a predetermined time or longer as described above, It may be determined that the function execution request has not been received.

19B is a flowchart illustrating a method of executing a function of a device according to another exemplary embodiment of the present invention. FIG. 19B is a case in which a function for selecting whether to execute a function through an embedded gateway screen is further included in the operation flowchart of FIG. 16B. Accordingly, steps S1910 to S1913 of FIG. 19B are performed similarly to steps S1608 to S1611 of FIG. 16B, and steps S1914 to S1917 are performed similarly to steps S1905 to S1908 of FIG. 19A.

FIG. 20 includes information (eg, an icon) for selecting at least one executable application and information (eg, content/advertising area) for a user to select whether to execute a predetermined function as shown in FIG. 18F This is an example of a screen when a device 1400 is requested to execute a predetermined function through an embedded gateway screen.

That is, when the operation mode state of the device 1400 is in the standby mode and in the black screen state (2010), when upside down motion information and situation information of the device 1400 are detected, motion information and situation of the device 1400 The screen 2020 of FIG. 20 is displayed by the predetermined function information determined based on the information.

As the content/advertising area is selected in the screen 2020 of FIG. 20, a screen 2030 including train ticket information is displayed. In this case, a partial image of the train ticket displayed on the screen 2030 or an image obtained by reducing the size of the train ticket may be displayed in the content/advertising area, but may be provided in the form of text information.

Step S1504 of Fig. 15, Step S1606 and Step S1607 of Fig. 16A, Step S1613 of Fig. 16B, Step S1907 of Fig. 19A, and Step S1917 of Fig. 19B are to include the processes shown in Figs. It can be transformed.

21 is a functional block diagram of a device according to another exemplary embodiment of the present invention. FIG. 21 is an example in which the context information detection unit 1420 included in the functional block diagram of the device 1400 of FIG. 14 is included in the functional block diagram of FIG. 11. Accordingly, the processor 2111 may operate like the processor 1450 of FIG. 14.

The processor 2111 includes a first processor 2122 and a second processor 2113 as shown in FIG. 11. The first processor 2122 receives a sensing value from the sensing unit 2102 based on the continuous sensing platform mentioned in FIG. 5, and the situation based on the continuous context information detection platform described in FIG. Context information may be received from the information detector 2103.

An information input unit 2101, a touch screen 2104, a camera 2105, an audio input unit 2106, an audio output unit 2107, a wireless communication unit 2109, a wired communication unit 2110, and a power supply unit 2115 shown in FIG. ) Is an information input unit 1101, a touch screen 1103, a camera 1104, an audio input unit 1105, an audio output unit 1106, a wireless communication unit 1108, a wired communication unit 1109, and a power supply unit shown in FIG. It is configured and operated similarly to (1114).

The storage unit 2108 shown in FIG. 21 has a configuration similar to that of a combination of the storage unit 1430 shown in Fig. 14 and the storage unit 1107 shown in Fig. 11, and the storage unit 1430 and the storage unit 1107 ) And at least one program.

The standby mode state of the device 2100 may include states as described in FIGS. 1, 11, and 14. That is, the standby mode state of the device 2100 may include a power consumption state by the sensing unit 2102, some components of the context information detection unit 2103, the first processor 2112, and the storage unit 2108. have. The standby mode state of the device 2100 may include a power consumption state by the sensing unit 2102, the context information detection unit 2103, the first processor 2112, and the storage unit 2108. In the standby mode state of the device 2100, components included in the device 2100 excluding the sensing unit 2102, some components of the context information detection unit 2103, the first processor 2112, and the storage unit 2108 It may include a state in which power is not consumed by. In the standby mode state of the device 2100, power is supplied by components included in the device 2100 other than the sensing unit 2102, the context information detection unit 2103, the first processor 2112, and the storage unit 2108. May contain unconsumed states.

The standby mode state of the device 2100 may include at least one of a function related to the touch screen 2104 mentioned in FIG. 11 and a screen lock setting state of the device 2100.

One or more programs including instructions for performing a method of implementing a method of executing a function of a device according to embodiments of the present invention with a computer may be recorded as computer-readable codes on a computer-readable recording medium. . The computer-readable recording medium includes all types of storage devices storing data that can be read by a computer system. Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tapes, floppy disks, and optical data storage devices. In addition, the computer-readable recording medium can be distributed over a network-connected computer system, and stored and executed as computer-readable codes in a distributed manner.

So far, the present invention has been looked at around its preferred embodiments. Those of ordinary skill in the art to which the present invention pertains will be able to understand that the present invention can be implemented in a modified form without departing from the essential characteristics of the present invention. Therefore, the disclosed embodiments should be considered from an illustrative point of view rather than a limiting point of view. The scope of the present invention is shown in the claims rather than the foregoing description, and all differences within the scope equivalent thereto should be construed as being included in the present invention.

Claims (27)

In a device having a plurality of operation modes,
A sensor detecting movement of the device;
A storage unit configured to store information on the plurality of operation modes, motion information based on information on motion of the device, and mapping information obtained by mapping function information of the device; And
Using the sensor to obtain information on the movement of the device,
Determine motion information corresponding to the motion information of the device based on the obtained motion information,
Detect the operation mode of the device,
When the operation mode of the device is detected as a standby mode, determining a first function to be performed by the device based on the mapping information, standby mode information and the determined motion information,
Controlling the device to execute the determined first function,
If it is detected that the operation mode of the device is not the standby mode, determine a second function based on information about the application being executed by the device, the mapping information, and the determined motion information,
A device comprising a processor for controlling the device to execute the determined second function. delete delete The device of claim 1, wherein the standby mode of the device includes an idle state of an application processor included in the device. The device of claim 1, wherein the standby mode of the device includes at least one of a deactivation state of a function related to a touch screen included in the device, and a screen lock setting state of the device. The method of claim 5, wherein the function related to the touch screen,
A device comprising at least one of a touch sensing function of the touch screen and a display function of the touch screen. delete The method of claim 1, wherein the processor,
A device that controls the device to display a gateway screen before executing the first function or the second function. The method of claim 8, wherein the gateway screen,
A device including notification information notifying execution of the first function or the second function. delete The method of claim 8, wherein the gateway screen,
When a plurality of functions correspond to the determined motion information of the device, the device including selection information for selecting an execution mode of each of the plurality of functions. The method of claim 1, wherein the device,
Further comprising a context information sensor for detecting at least one context information about the device,
The mapping information further includes the at least one context information,
The processor further considers the at least one piece of context information to determine the first function or the second function. The method of claim 12, wherein the at least one context information,
A device comprising at least one of current time information, location information of the device, schedule information stored in the device, and log information of the device. In the function execution method of a device having a plurality of operation modes,
Determining motion information corresponding to information on motion of the device using a sensor included in the device;
Detecting an operation mode of the device;
When the operation mode of the device is detected as a standby mode, a first function is determined based on standby mode information, the determined motion information, and mapping information, and the mapping information is information of the plurality of operation modes of the device, and the motion Information and information obtained by mapping the function information of the device;
Controlling the device to execute the determined first function;
If it is detected that the operating mode of the device is not the standby mode, determining a second function based on information on an application being executed by the device, the mapping information, and the determined motion information; And
And controlling the device to execute the determined second function. delete delete The method of claim 14, wherein the standby mode of the device includes an idle state of an application processor included in the device. The method of claim 14, wherein the standby mode of the device includes at least one of a deactivation state of a function related to a touch screen included in the device, and a screen lock setting state of the device. The method of claim 18, wherein the function related to the touch screen,
A device function execution method comprising at least one of a touch sensing function of the touch screen and a display function of the touch screen. delete The method of claim 14, wherein the method comprises:
And displaying a gateway screen before executing the first function or the second function. The method of claim 21, wherein the gateway screen,
A method of executing a function of a device, including notification information indicating execution of the first function or the second function. delete The method of claim 21, wherein the gateway screen,
When a plurality of functions correspond to the determined motion information of the device, a function execution method of a device including selection information for selecting an execution mode of each of the plurality of functions. The method of claim 14, wherein the method comprises:
Further comprising the step of detecting at least one context information about the device by a context information sensor of the device,
The mapping information further includes the at least one context information,
The first function or the second function is determined by further considering the detected at least one context information. The method of claim 25, wherein the at least one context information,
A device function execution method comprising at least one of current time information, location information of the device, schedule information stored in the device, and log information of the device. A computer-readable recording medium on which one or more programs including instructions for executing the method of executing a function of claim 14 are recorded.

Images