KR101468273B1 - Multi-function input interface apparatus - Google Patents

Abstract

The present invention relates to a multifunctional input interface device, and more particularly, in the case of setting any three-dimensional space matching a screen of a smart device and positioning and moving an instruction module on the space, A multifunctional input interface device capable of detecting various motions of a moving object and detecting movement of the moving object, and using the data (movement and angle data for all directions) of the movement of the instruction module to provide various input signals to the smart device .

Description

[0001] Multi-function input interface apparatus [0002]

The present invention relates to a multifunctional input interface device, and more particularly, to a multifunctional input interface device, in which an instruction module is positioned in an arbitrary three-dimensional space matching with a smart device, To a multifunctional input interface device capable of providing various input signals to a smart device.

More specifically, the present invention relates to a light source module that detects movement of an instruction module that emits light in a specific region and generates data related to positional information of the instruction module, And an image sensor capable of detecting divergent light, thereby enabling a more efficient and precise generation of an input signal.

Due to the development of technology, various electronic devices are becoming smart, and there is a tendency to be connected to a network not limited to a place. Various kinds of input interface devices have been developed to replace the existing mouse, keyboard, joystick, and touch screen according to the trend.

Unlike conventional mice, keyboards, joysticks, etc., various input interface devices based on human interfaces such as speech recognition and motion recognition have been developed. It is possible to input various input Various input interface devices capable of providing signals have also been developed.

Meanwhile, various kinds of electronic devices (for example, a mobile terminal, a tablet computer, a notebook computer, a notebook computer, a notebook computer, a notebook computer, A portable computer, a smart computer, a portable information device, a portable display device, or a personal computer, a TV, etc.).

Accordingly, the present inventors have found that by placing an instruction module in an arbitrary three-dimensional space matched with a smart device, detecting movement of the instruction module, and generating data on the position information of the instruction module through the sensing module, A multifunctional input interface device capable of providing a signal.

The present invention is not limited to one electronic device, but provides a multifunctional input interface device usable in various kinds of electronic devices.

More specifically, it is an object of the present invention to provide a smart device that sets an arbitrary three-dimensional space matching a screen of a smart device and, when the instruction module is positioned and moved in the space, the sensing module senses the movement of the instruction module, And to provide a multifunctional input interface device capable of providing various input signals to a smart device on the basis of the data (movement and angle data for all directions) about the movement of the instruction module.

It is an object of the present invention to provide a multifunctional input interface device which adds a function of detecting a voice recognition function and a user's touch operation to the input interface device unlike the conventional technique of simply recognizing a movement of a user and generating an input signal, .

Furthermore, it is an object of the present invention to provide a light source module, comprising: at least two light-emitting modules for emitting light in a specific area so as to detect movement of the indicating module; And an image sensor capable of detecting divergent light, thereby providing a multifunctional input interface device capable of generating an input signal more effectively and precisely.

The present invention relates to a multifunctional input interface device, comprising: an instruction module located in any three-dimensional space matching a smart device; And a sensing module for sensing movement of the instruction module and generating data on the position information of the instruction module, wherein the sensing module transmits one or more input signals to the smart device based on the generated data .

Preferably, the instruction module further includes a direction sensor capable of sensing a movement of the instruction module in a three-dimensional reference direction.

Preferably, the direction sensor is an acceleration sensor.

Preferably, the instruction module further includes a voice recognition unit to enable voice recognition by a user.

Preferably, the instruction module further includes a motion detection sensor for sensing a touch operation of the user.

Preferably, the motion detection sensor is a touch-type touch sensor.

Preferably, the instruction module further includes a communication unit capable of transmitting and receiving one or more data with the detection module.

Preferably, the communication unit uses at least one of RF, WiBro, HSDPA, Wi-Fi, WiMAX, ZIGBEE, Bluetooth, UWB, IrDA, and SWAP.

Advantageously, the communication unit provides an input signal to the wirelessly adjustable electronic product.

Preferably, the instruction module further includes a vibration element that vibrates the instruction module so as to recognize movement of the instruction module, voice of the user, or operation of the interface device in response to a touch operation of the user .

Preferably, the instruction module further includes at least two light divergence modules for diverging light in a specific area, and the sensing module includes an image sensor capable of detecting light emitted from the at least two light divergence modules And further comprising:

Preferably, the sensing module may include a calculation unit that calculates an interval variation and a size variation of the optical image based on two or more optical images detected by the image sensor, and calculates a separation distance between the indication module and the sensing module, And further comprising:

Preferably, the operation unit calculates the interval of the optical image using motion information on the three-dimensional reference direction of the instruction module sensed by the direction sensor.

Advantageously, said at least two light-emitting modules provide an input signal to an infrared adjustable electronic product.

Preferably, the image sensor includes a wide-pass filter for blocking light outside a specific region.

Preferably, the sensing module further includes a USB port so as to be electrically connected to the smart device.

Preferably, the sensing module is configured to transmit one or more input signals to the smart device based on at least one of data on the position information of the instruction module and data on the touch operation of the user received from the motion detection sensor .

According to the present invention, it is possible to provide a multifunctional input interface device that can be used in various kinds of electronic devices without being limited to one electronic device.

In addition, according to the present invention, when setting an arbitrary three-dimensional space matching with a screen of a smart device and positioning and moving the instruction module on the space, the sensing module senses the movement of the instruction module, It is possible to utilize and calculate data (data on all directions) of information to provide various input signals to the smart device.

According to the present invention, unlike the conventional technique of simply recognizing the movement of a user and generating an input signal, the above-described input interface device is provided with a function of detecting a voice recognition function and a user touch operation, Signal. ≪ / RTI >

Further, according to the present invention, there is provided a light source module, comprising: at least two light-emitting modules for emitting light in a specific area so as to detect movement of the indicating module; And an image sensor capable of detecting the divergent light, thereby generating an effect that the input signal can be generated more effectively and precisely.

1 is a view showing a state in which a multifunctional input interface device according to the present invention is used,
FIG. 2 is a schematic view of the components of the instruction module 100 and the sensing module 200 of the multifunctional input interface device according to the present invention,
3 is a diagram illustrating a principle in which an image sensor detects movement of a light diverging module and detects a change in distance in a multifunctional input interface device according to the present invention,
FIG. 4 is a diagram showing a principle of calculating more accurately when the image sensor recognizes the movement of the light-emitting module and detects a change in distance,
5 is a diagram for explaining functions of the instruction module 100 and the sensing module 200 according to the motion and operation of the multifunctional input interface device according to the present invention.

A preferred embodiment of a multifunctional input interface device according to the present invention will be described with reference to the accompanying drawings. In this process, the thicknesses of the lines and the sizes of the components shown in the drawings may be exaggerated for clarity and convenience of explanation. In addition, the terms described below are defined in consideration of the functions of the present invention, which may vary depending on the intention or custom of the user, the operator. Therefore, the definitions of these terms should be described based on the contents throughout this specification.

As used herein, the term "motion" is used to include not only bidirectional movement in the X-axis, Y-axis, and Z-axis with respect to the three-dimensional reference direction, but also variations in angle with respect to the three-dimensional reference direction.

Multifunctional Input Interface - Component Description

FIG. 1 is a diagram illustrating a state in which the multifunctional input interface device according to the present invention is used. FIG. 2 schematically shows the components of the instruction module 100 and the detection module 200 of the multifunctional input interface device according to the present invention. Fig.

1 and 2, the multi-function input interface device according to the present invention will be described in detail. The multifunctional input interface device according to the present invention can be used to provide an arbitrary input that matches a smart device 300 (e.g., a mobile terminal, a tablet computer, a portable computer, a smart computer, a portable information device, a portable display device, An instruction module 100 located in a three-dimensional space of the display device 100; And a sensing module 200 for sensing movement of the instruction module 100 to generate data on the position information of the instruction module 100 and transmitting one or more input signals to the smart device 300 based on the generated data .

The instruction module 100 includes a direction sensor 110, a voice recognition unit 120, a motion detection sensor 130, a communication unit 140, and a control unit 150.

The direction detecting sensor 110 detects the movement of the instruction module 100 in the three-dimensional reference direction. That is, the direction detecting sensor 110 detects whether the instruction module 100 moves in the X-axis direction, the Y-axis direction, the Z-axis direction, and / So that the instruction module 100 can detect the change of the angle with respect to the three-dimensional reference direction of the instruction module 100 itself.

The direction detecting sensor 110 senses the movement of the instruction module 100 in the three-dimensional reference direction and transmits the data to the control unit 150. The control unit 150 converts the data into data and transmits the data to the sensing module 200 do.

In this case, the direction detecting sensor 110 is preferably composed of an acceleration sensor (various sensing principles such as an inertia type, a gyro type, and a silicon semiconductor type can be used) It should be noted that the types of sensors used in particular are not limited as long as they are capable of detecting movement.

The voice recognition unit 120 recognizes the user's voice and transmits an input signal corresponding to the recognized voice to the control unit 150 to be described later and the control unit 150 converts the data into data and transmits the data to the detection module 200 .

For example, the voice recognition unit 120 may include a voice receiving unit for receiving a user's voice signal and converting the user's voice signal into voice recognition data having a main parameter and a sub-parameter for identifying the voice signal; A pattern storage unit for storing voice model data patterns; A feature extraction unit for extracting recognition features of speech recognition data according to main and sub parameters; And a controller for comparing the recognition feature and the voice model data pattern and outputting a command code corresponding to the voice model data pattern when there is an voice model data pattern matching the recognition feature.

In this case, the voice recognition unit 120 can use a known voice recognition sensor. As described above, the type of the specially used sensor is not limited as long as it can recognize the user's voice and output the corresponding input signal .

The operation detecting sensor 130 senses the touch operation of the user and transmits a corresponding input signal to the controller 150, which will be described later, and the controller 150 converts the data into data and transmits the data to the sensing module 200.

The motion sensing sensor 130 may be a contact type touch sensor using a principle of capacitance change type, electric conductivity variation type (resistance variation type), light amount variation type, and the like. Meanwhile, it should be noted that the type of the specially used sensor is not limited as long as the touch operation of the user can be detected.

The communication unit 140 transmits / receives one or more data to / from the sensing module 200. The sensing module 200 transmits data generated by the direction sensing sensor 110, the voice recognition unit 120, and the motion sensing sensor 130 to the sensing module 200.

The communication unit 140 can transmit the data to the sensing module 200 using one or more of RF, WiBro, HSDPA, Wi-Fi, WiMAX, ZIGBEE, Bluetooth, UWB, IrDA, and SWAP, It is noted that data can be transmitted using a wireless communication scheme of the type shown in FIG.

It should be noted that the communication unit 140 can communicate with wirelessly adjustable electronic products in addition to the functions described above and can provide various input signals.

The control unit 150 determines whether the motion of the instruction module 110 is detected by the direction sensor 110 or the voice of the user is recognized by the voice recognition unit 120 or the user's touch operation is detected from the motion detection sensor 130 And transmits the signal to the communication unit 140.

In addition, the controller 150 may be a microprocessor capable of performing a known role such as basically operating and controlling the instruction module 110, and a description of these basic functions will be omitted.

The indicating module 100 according to the present invention may further include a vibrating device 160, a light emitting module 170, and a battery 180.

The vibration element 160 vibrates the instruction module 100 so as to recognize movement of the instruction module 100, voice of the user, or operation of the interface device according to a user's touch operation.

It should be noted that the vibration element 160 does not limit the type of the vibrating element 160 if vibrations of only a level capable of recognizing the user's touching operation or the execution process by the movement of the instruction module 100 are generated.

The battery 180 serves to supply power so that the instruction module 100 can be driven wirelessly. A secondary battery can be used, and for example, a lithium ion secondary battery, a lithium polymer secondary battery, or the like can be used.

Note that this battery 180 may be configured to be charged from a computer or connected to an outlet by using a USB port / connector (not shown).

The light diverting module 170 emits light of a specific area so that the sensing module 200, which will be described later, can recognize the position of the indicating module 100. Such a light diverting module 170 will be described later with reference to Figs. 3 to 5.

The sensing module 200 according to the present invention includes a communication unit 210 and a control unit 220. The image sensor 230 may further include an image sensor 230, an image processor 240, and an operation unit 250, which can detect light emitted from the light diverting module 170.

The communication unit 210 receives data from the instruction module 100 and transmits one or more input signals to the smart device 300 that requires the data.

The control unit 220 receives the data received from the instruction module 100 and converts the data into various input signals and transmits the data to the communication unit 210.

In addition, the controller 220 may be a microprocessor capable of performing a known role such as basically operating and controlling the sensing module 200, and a description of these basic functions will be omitted.

The image sensor 230 detects light emitted from the light diverting module 170. The image sensor 230, the image processor 240, and the operation unit 250 will be described later with reference to FIGS. 3 to 5.

Meanwhile, the sensing module 200 according to the present invention may further include a USB port (not shown) and a switch module (not shown).

The USB port serves to provide an input terminal so that the detection module 200 can be electrically connected to the smear device 300. Note that this USB port is illustratively shown, and that the sensing module 200 can communicate with the smart device 300 wirelessly.

The switch module provides a switch to enable the user to turn on / off the sensing module 200 as needed.

The components such as the USB port and the switch module are well known in the art, so a detailed description thereof will be omitted.

Light divergence  Modules and Image Sensors - How It Works

FIG. 3 is a diagram illustrating a principle of an image sensor sensing movement of a light diverging module to detect a distance change in the multifunctional input interface device according to the present invention. And more accurately calculates the distance when the distance is detected.

3 to 4, the light emitting diodes 170 provided in the instruction module 100 of the multi-function input interface device according to the present invention and the image sensor 230 provided in the detection module 200 are specifically described I will explain.

The light diverting module 170 emits light of a specific area so that the sensing module 200 can know the position of the indicating module 100. Preferably, two or more light emitting diodes 170 are provided on the front surface of the indicating module 100.

It is preferable that the light emitting module 170 uses infrared (IR) light, but it should be noted that the type of the light emitting module 170 is not limited as long as the image sensor 230 can detect light.

It is noted that the light diverting module 170 may provide various input signals to the infrared-adjustable electronic product such as, for example, a TV remote control, in addition to the functions described above.

The image sensor 230 detects light emitted from at least two light emitting modules 170 and converts light or light received through the lens into electrical signals. The image sensor 230 may further include a wide-pass filter (not shown), which can block light outside the specific area emitted by the light diverting module 170 due to the wide-pass filter.

Note that although the image sensor 230 is shown herein as being attached to the sensing module 200, an image sensor mounted on the smart device itself may be used.

The image processor 240 interprets and stores the electrical signals converted by the image sensor 230. The image processor 240 may be a microprocessor capable of performing a known role, and a description of such a basic function will be omitted.

The calculation unit 250 calculates the interval variation and the size variation of two or more optical images based on two or more optical images detected by the image sensor 230 and calculates a distance between the indication module 100 and the detection module 200 And to perform the function of calculating.

3, the first light diverting module L? And the second light diverting module L? In the three-dimensional space are arranged such that a 'to b' A change in the size of the perceived light and a change in the interval occur on the screen that the image sensor 240 perceives. That is, when the first light diverting module L? And the second light diverting module L? Are located at the A position, the light is small in size and the interval between the lights is C, but the first light diverting module L? When the two light diverting modules L < 2 > are at the B position, the size of the light becomes larger and the interval between the lights becomes D. The calculation unit 250 can easily calculate the separation distance between the instruction module 100 and the sensing module 200 of the instruction module 100 (that is, the positional change on the Y axis of the instruction module 100) .

The calculation unit 250 calculates the interval of the optical image using the motion information of the instruction module 100 sensed from the direction sensor 110 in the three-dimensional reference direction.

4, assuming that the first light diverting module L① and the second light diverting module L② move in the same space (that is, in an ideal state) in the three-dimensional space , The length between the optical images a and b, which are the intervals between the optical images, is constantly changed (see Fig. 4 (a)). However, in the case where it is assumed that the first light diverting module L? And the second light diverting module L? Move in the three-dimensional space in a state where the light is diverted, the length between a and b varies depending on the angle? Therefore, the operation unit 250 can calculate the length between the actual a and the actual b using the motion information on the three-dimensional reference direction of the instruction module 100 (see Fig. 4 (b)).

With this configuration, according to the multifunctional input interface device of the present invention, it is possible to set arbitrary three-dimensional space matching with screens of various kinds of smart devices 300, (I) the image sensor 240 of the sensing module 200 senses two or more lights emitted from the instruction module 100 to continuously calculate the position information of the instruction module 100, (ii) ) Various input signals can be generated by using the data (data on all directions) related to the motion of the instruction module 100.

In addition, the instruction module 100 generates various input signal data by adding (iii) a voice recognition function to enable the user to recognize the voice, and (iv) a touch function to detect the touch operation of the user, It is possible to transmit the input signal to the smart device 300.

Multifunction Input Interface - Input Example  Explanation

5 is a diagram for explaining functions of the instruction module 100 and the sensing module 200 according to the motion and operation of the multifunctional input interface device according to the present invention.

Referring to FIG. 5, the functions according to the motion and the operation of the multifunctional input interface device will be described in detail.

When the instruction module 100 starts moving, the light emitting module 170 of the instruction module 100 is turned on and the direction detecting sensor 110 and the motion detecting sensor 130 generate data at an arbitrary time interval And transmits it to the detection module 200.

At this time, the direction sensing sensor 110 senses the movement (that is, the movement or angle with respect to the three-dimensional reference direction) of the instruction module 100, and the sensing module 200 more accurately checks the position of the instruction module 100 I will help you.

When the signal indicating the operation of the instruction module 100 is received, the sensing module 200 photographs the instruction module 100 by operating the image sensor 230, calculates the positional change of each image, 170) and generates position data.

At this time, it is possible to more easily calculate the distance between the sensing module 200 and the instruction module 100 by confirming the change in the interval and size of two or more light beams to be photographed. Based on the generated input signal data, To the smart device (300).

Further, since the instruction module 100 is provided with a voice recognition function and a touch function to detect the user's touch operation so that the voice recognition of the user can be performed, it is possible to provide more various input signals.

An input embodiment according to the operation of the multi-function input interface according to the present invention will be described as follows. For example, movement of the instruction module 100 in the X and Y directions causes the cursor to move in the X and Y directions on the screen of the smart device 300. The movement of the instruction module 100 in the Z direction can be recognized by clicking the left button of the mouse on the screen. The movement in the Z direction with the motion detection sensor 130b being pressed can be recognized by clicking the right button of the mouse on the screen. When the motion detection sensor 130a and the motion detection sensor 130b are pressed together, a function defined by the motion operation can be performed. When the motion detection sensor 130c is pressed, various modes can be selected. When all these operations are performed, the vibration element vibrates to inform the user of the operation state.

In this manner, the sensing module 200 can receive data on the position information of the instruction module 100 and data on the touch operation of the user received from the motion sensors 130a, 130b, and 130c, Generates an input signal and provides it to the smart device 300.

It should be noted, on the other hand, that the input embodiments according to the above-described operations are for illustrative purposes only, and that the present invention is not limited by these descriptions.

Also, while one instruction module 100 is shown and described herein as being provided, it should be noted that more than one instruction module may be provided to recognize more definitive operations and to perform functions such as multi-touch.

Also, although the instruction module is shown and described in the form of a ring inserted into a finger in the present specification, it can be manufactured and used in various forms (for example, in the form of a bar) without changing the technical concept of the present invention Please note.

In addition, although the sensing module is shown and described as being provided separately from the smart device in the present specification, it is possible to detect light emitted from the light diverting module and to generate data on the position information of the indicating module by detecting the motion of the indicating module Note that any smart device as such may function and function as a sensing module.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention as defined in the appended claims. It will be understood that the present invention can be changed.

100: instruction module
110: Direction sensor
120:
130: motion detection sensor
140:
150:
160: Vibration element
170: light emitting module
180: Battery
200: Detection module
210:
220:
230: Image sensor
240: image processor
250:
300: Smart device

Claims (17)

An instruction module including at least two light divergence modules located in an arbitrary three-dimensional space matching with the smart device and emitting light in a specific region, and a direction sensor capable of sensing movement with respect to the three-dimensional reference direction;
An image sensor for detecting movement of the instruction module to generate data on the position information of the instruction module, and detecting light emitted from the at least two light emitting modules;
And an operation unit that transmits one or more input signals to the smart device based on the generated data and calculates an interval change and a size change of the two or more optical images based on two or more optical images detected by the image sensor Sensing module,
Wherein the calculation unit calculates a separation distance between the instruction module and the sensing module based on a change in size and a change in size of the two or more optical images in accordance with the distance between the two light emitting diodes and the image sensor, When the distance between the light diverting module and the image sensor is not the same, calculating the interval between the two or more optical images using the motion information on the three-dimensional reference direction of the instruction module sensed by the direction sensor Features,
Multifunction input interface device.
delete The method according to claim 1,
Wherein the direction sensor is an acceleration sensor.
Multifunction input interface device.
The method according to claim 1,
The instruction module includes:
Further comprising a voice recognition unit for enabling the user to recognize the voice.
The method according to claim 1,
The instruction module includes:
Further comprising a motion detection sensor for detecting a touch operation of the user,
Multifunction input interface device.
6. The method of claim 5,
Wherein the motion detection sensor is a touch-type touch sensor.
7. The method according to any one of claims 1 to 6,
The instruction module includes:
And a communication unit capable of transmitting and receiving one or more data with the detection module.
Multifunction input interface device.
8. The method of claim 7,
Wherein the communication unit uses at least one of RF, WiBro, HSDPA, Wi-Fi, WiMAX, ZIGBEE, Bluetooth, UWB, IrDA,
Multifunction input interface device.
8. The method of claim 7,
Characterized in that the communication section provides an input signal to a wirelessly adjustable electronic product,
Multifunction input interface device.
8. The method of claim 7,
The instruction module includes:
Further comprising a vibrating element for vibrating the instruction module so as to recognize movement of the instruction module, voice of the user, or operation of the interface device according to a touch operation of the user.
Multifunction input interface device.
delete delete delete The method according to claim 1,
Characterized in that the at least two light-emitting modules provide an input signal to the infrared adjustable electronics.
Multifunction input interface device.
The method according to claim 1,
Characterized in that the image sensor comprises a wide-pass filter for blocking light outside of a specific area.
Multifunction input interface device.
The method according to claim 1,
The sensing module includes:
Further comprising a USB port so as to be electrically connected to the smart device,
Multifunction input interface device.
6. The method of claim 5,
The sensing module includes:
Wherein the at least one input module provides the at least one input signal to the smart device based on at least one of data on the position information of the instruction module and data on the touch operation of the user received from the motion detection sensor.
Multifunction input interface device.

Images