KR100751093B1 - Input device and method of digital processing device - Google Patents

Abstract

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an input device and a method of a digital processing apparatus. The present invention relates to an input device and a method for detecting a motion of an object in an image captured by a camera, calculating a motion vector, and selecting one or more character information determined corresponding to the calculated motion vector to select a character type. Reads the character information corresponding to the character type selection information by receiving the information. When an input command of displayed character information is displayed by displaying read character information on a display screen, an input method of a digital processing apparatus for displaying the character information as input information on the display screen is provided. According to the present invention, there is an advantage in that the size of the display screen of the digital processing device can be enlarged, and the digital processing device can be downsized by thinning the thickness of the digital processing device by not including a separate keypad. .

Motion, handheld, camera, input, detection

Description

Input device and method for digital processing device

1 illustrates an example of a mobile terminal having a user interface for implementing an input method according to an exemplary embodiment of the present invention.

2 is a diagram illustrating a configuration of a portable terminal including an input device according to an embodiment of the present invention.

3 is a diagram illustrating a configuration of an image frame for calculating a motion vector of an object included in an image according to a preferred embodiment of the present invention.

Figure 4 is a flow chart showing the order in which the input is made according to an embodiment of the present invention.

Figure 5 is an exemplary view showing the actual implementation of the input method in a mobile terminal according to an embodiment of the present invention.

The present invention relates to an input device and a method of a digital processing device. More particularly, the present invention detects a movement of a subject captured by a camera and recognizes a button icon displayed on a display screen of the digital processing device. It relates to possible input devices and methods.

As an example of a digital processing device, a portable terminal refers to an electronic device that is formed in a small size to facilitate a user's portability in order to perform a function such as a game or a mobile communication. The portable terminal includes a mobile communication terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), and the like.

Among them, a mobile communication terminal is essentially a device implemented so that a mobile user can make a telephone call with a remote receiver. However, due to the development of science and technology, recent mobile communication terminals have additional functions such as a camera function and a multimedia data reproduction function in addition to the essential functions such as a telephone call function, a short message transmission and reception function, and an address book management function.

Digital devices having such various functions are important to be miniaturized to increase portability while including various functions in one device.

However, since these digital processing devices must include a keypad-type input device for implementing functions, there is a limit in miniaturization of the digital processing device as the input device is included in the digital processing device.

In particular, in the case of a portable terminal, there is a limitation in that the size of the liquid crystal screen of the portable terminal is further increased due to the arrangement of the keypad, and there is a limitation in that the thickness of the portable terminal is thinner.

In order to solve the conventional problems as described above, the present invention proposes an input method and apparatus of a digital processing apparatus that can enlarge the size of the display screen of the digital processing apparatus.

The present invention also proposes an input method and apparatus for a digital processing apparatus capable of miniaturizing the digital processing apparatus, such as making the thickness of the digital processing apparatus thinner by not including a separate keypad.

Still other objects of the present invention will be readily understood through the following description of the embodiments.

In order to achieve the above object, according to an aspect of the present invention there is provided an input device included in the digital processing device.

According to a preferred embodiment of the present invention, an input device included in a digital processing device, the input device comprising: a memory unit for storing one or more character types and one or more character information corresponding to each character type; A key input unit for inputting arbitrary character type selection information and an input command of the selected character information; An operation recognition unit which detects a movement of an object in the image captured by the camera, calculates a motion vector from the reference position, and transfers the motion vector to the controller; A display unit for displaying button information indicating character information according to an arbitrary character type, character information recognized using the motion vector, and displaying character information recognized according to the input command as input information; And a control unit which reads the character information recognized by the motion vector from the memory unit and transmits the character information to the display unit, and controls to display the recognized character information as the input information on the display unit when the input command is input. An input device included in a digital processing device is provided.

According to another aspect of the present invention, an input method of a digital processing apparatus is provided.

According to a preferred embodiment of the present invention, an input method of a digital processing device, the method comprising: receiving a first character type selection information (a); (B) detecting a movement of an object in the image captured by the camera and calculating a motion vector; (C) reading character information determined corresponding to the calculated motion vector among one or more character information according to the first character type selection information; Displaying the read character information on a display screen (d); And (e) displaying the character information on the display screen as input information when the input command of the displayed character information is input.

According to another preferred embodiment of the present invention, there is provided an input method of a digital processing apparatus, comprising: (a) detecting a motion of an object in an image captured by a camera and calculating a motion vector; (B) selecting one or more character information determined corresponding to the calculated motion vector; (C) receiving first character type selection information and reading character information corresponding to the first character type selection information; Displaying the read character information on a display screen (d); And (e) displaying the character information on the display screen as input information when the input command of the displayed character information is input.

According to another aspect of the present invention, a recording medium recording an input method of a digital processing apparatus is provided.

According to a preferred embodiment of the present invention, a program of instructions that can be executed in a digital processing apparatus is tangibly implemented to perform an input method of the digital processing apparatus, and records a program that can be read by the digital processing apparatus. A recording medium comprising: receiving a character type selection information (a); (B) detecting a movement of an object in the image captured by the camera and calculating a motion vector; (C) reading character information determined corresponding to the calculated motion vector among one or more character information according to the character type selection information; Displaying the read character information on a display screen (d); And (e) displaying the text information as input information on the display screen when the input command of the displayed text information is input.

According to another preferred embodiment of the present invention, a program of instructions that can be executed in the digital processing device to perform the input method of the digital processing device is tangibly embodied and can be read by the digital processing device. A recording medium having recorded thereon, the method comprising: detecting a movement of an object in an image captured by a camera and calculating a motion vector; (B) selecting one or more character information determined corresponding to the calculated motion vector; Receiving character type selection information and reading character information corresponding to the character type selection information (c); Displaying the read character information on a display screen (d); And (e) displaying the text information as input information on the display screen when the input command of the displayed text information is input.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description of the present invention, the same reference numerals will be used for the same means regardless of the reference numerals in order to facilitate the overall understanding.

In the following description, the portable terminal most widely used among digital processing apparatuses will be described as an example, but it will be apparent to those skilled in the art that the input apparatus and method according to the present invention can be implemented in other digital processing apparatuses.

First, a portable terminal implemented with a user interface for implementing an input method according to an exemplary embodiment of the present invention will be described.

1 illustrates an example of a mobile terminal having a user interface for implementing an input method according to an exemplary embodiment of the present invention.

As shown in FIG. 1, the portable terminal 100 according to an exemplary embodiment of the present invention includes a character type key 110, a character input key 120, and a display unit 130. The button icon 140 and the input window 150 are included and displayed.

The character type key 110 inputs an input command of one or more pieces of arbitrary character type selection information. This key is used when the user selects the type of text to be input. Types of characters include, for example, numbers such as Korean, English, and Japanese, as well as numbers, special characters, and symbols.

The character type key 110 is preferably provided in the form of a button on the portable terminal 100 so that the user can select the type of character to be input when the character is input.

The character input key 120 inputs an input command of the selected character. When the selected character is displayed in the input window, it confirms whether the displayed character matches the selected character and finally executes the input command.

Detailed functions and operations of the character type key 110 and the character input key 120 will be described in detail with reference to FIG. 4 showing the order in which letters, numbers, etc. are input by the present invention.

The display unit 130 displays information including letters, numbers, pictures, and the like of the mobile terminal 100. The display unit 130 may be a liquid crystal display (LCD), which is preferably provided in the portable terminal.

The display unit 130 may include a button icon 140 and an input window 150, and the button icon 140 may be implemented by using a keypad of a conventional mobile terminal as a screen as illustrated in FIG. 1. A type user interface may be provided.

The input window 150 displays letters or numbers input or selected in the user interface of the mobile terminal.

Therefore, the portable terminal according to an exemplary embodiment of the present invention can be configured as a portable terminal only by the display unit 130 without including a keypad.

The configuration of the mobile terminal according to an exemplary embodiment of the present invention, which is composed of only the display unit 130 and can be input, will be described with reference to FIG. 2.

2 is a diagram illustrating a configuration of a portable terminal including an input device according to an embodiment of the present invention.

As shown in FIG. 2, the portable terminal according to an exemplary embodiment of the present invention includes an image sensor unit 200, a key input unit 210, a motion recognition sensor unit 220, a control unit 230, and a memory unit 240. ), And may include a display unit 250.

The image sensor unit 200 generates image or image data corresponding to a subject photographed by a camera (not shown). Although not shown in FIG. 2, the image sensor unit 200 may generate raw data from the light signal generated by the camera, and may generate image or image data by encoding the generated raw data. In addition to this, in addition to the image sensor, it may further include other components such as a multimedia control processor.

The camera may transmit the light signal of the photographed subject embedded in or external to the portable terminal to the image sensor unit.

In addition, the camera starts capturing an image by an operation start command, and the operation start command may be input by a sensing value of a sensor for detecting pressure or a movement or selection of a predetermined key button.

The key input unit 210 receives a signal from the character type key 110 and the character input key 120 shown in FIG. Therefore, since the keypad is not included separately, a signal generated from two keys of the character type key 110 and the character input key 120 may be input.

The motion recognition unit 220 compares an image or an image generated by the image sensor unit 200 and calculates a motion vector.

The motion vector can be calculated in various ways. For example, each frame constituting the image is divided into m (natural numbers) xn (natural numbers) regions, and the amount of change between the image data of pixels of each region in successive frames is used. Motion vectors can be calculated. The division of the region of the frame for the calculation of the motion vector is described in detail in the description of FIG. 3.

The controller 230 generates a control signal for controlling each component to control the overall function of the mobile terminal.

The memory unit 240 stores one or more character types and one or more character information corresponding to each character type. In addition, the captured image or video information, and other information necessary for the operation of the portable terminal can be stored.

The display unit 250 outputs information necessary for the portable terminal and an image or an image processed by the image sensor unit 200 to the display unit.

As shown in FIG. 1, the display unit 130 of the display unit 250 may display a button icon 140 and an input window 150.

The image or image captured by the camera is processed by the image sensor 200 and transmitted to the motion recognition unit 220. The motion recognition unit 220 calculates a motion vector from the image or image data, and the control unit 230 uses the key value input from the key input unit 210 and the motion vector calculated from the motion recognition sensor unit 220. The information is read from the memory 250 and displayed on the display 250.

A method for recognizing the direction of the vector by the motion recognition will be described with reference to FIG. 3.

3 is a diagram illustrating a configuration of an image frame for calculating a motion vector of an object included in an image according to an exemplary embodiment of the present invention.

Each frame constituting the image is divided into m (natural numbers) x n (natural numbers) regions, and a motion vector is calculated using the amount of change between image data of pixels of each region in successive frames.

As shown in FIG. 3, an image frame may be divided into 9 regions of 3 × 3 in order to calculate a motion vector in the image frame according to an exemplary embodiment of the present invention.

A motion vector is calculated by comparing pixels included in nine regions of the divided image frame. Therefore, eight directions may be set based on the fifth frame.

In order to calculate a motion vector, a reference position may be set in an initial screen to calculate a motion vector based on the reference position.

For example, when a person's finger is captured by the camera, the first direction the finger points to is in area 5. As you move your finger, remember the number of the area where your finger went too far.

For example, it is assumed that a character is input by sensing a finger movement using a finger, and the button icon of the display unit is the same as a keypad of the current mobile terminal as shown in FIG. 1.

If the reference point is set to point to the button icon of the number '5', the finger points to the number '5' when entering the character for the first time. . When the user moves the finger to point the number '7', the finger moves from the area 5 to the area 7 shown in FIG. 3.

The motion vector by the divided regions is performed by comparing pixels constituting the captured image.

If the user wants to input the number '7', the number '7' may be selected by clicking a finger or pressing a character input key while pointing to the number '7'.

For example, if you move your finger to point to the number '0', area 8 is recognized from area 5 to area 8 again and area 8 is memorized twice. It will recognize that your finger points to the number '0' located twice.

The image frame composed of these nine divided regions is only an example and the present invention is not limited thereto.

With reference to FIG. 4, an operation of inputting a character or the like in a mobile terminal by recognizing an operation by the above configuration and method will be described.

4 is a flowchart illustrating a sequence of input according to a preferred embodiment of the present invention. In the description of FIG. 4, a case in which a finger is pointed to a button icon and text is input by the operation of a finger will be described as an example.

First, when a user photographs a hand with a camera built in or external to the mobile terminal to input characters using the mobile terminal, the direction of the finger in the first image captured as shown in FIG. 3 is the button icon of the number '5'. Point to. This corresponds to the initial screen for inputting text into the mobile terminal according to the present invention.

The user first presses the character type key 110 to select Korean, English, numbers, special symbols, and the like (S400). When the finger moves to point the button icon 140 to be input, the motion recognition unit 220 of the mobile terminal 100 calculates a motion vector to detect the movement of the finger (S402).

The motion recognition unit 220 calculates a vector of the direction and the position of the user's moved finger using the vector pattern as described with reference to FIG. 3 (S404).

The character information is read from the memory unit 240 from the result of the calculation (S406) and displayed on the display unit 130 of the display unit 250 (S408).

If the character displayed on the display unit 130 is the character that he / she wants to input, the user presses the character input key 120 to input the selected character (S410).

In the flowchart of FIG. 4, first, the character type key 110 is used to select a type of character, and then the finger is moved in the direction in which the corresponding character is located. However, first, the user moves the finger on the initial screen to select the button icon 140. It is also possible to convert characters, numbers, etc. that can be represented by the selected button icon 140 by pressing the character type key 120.

In addition, to indicate that the button icon 140 selected by moving a finger is finally selected, for example, a finger click operation may be performed to recognize and finally input the same.

If the selected character information does not match, it is also possible to update the character type so that another character type can be selected by pressing the character type key again. For example, after selecting a button icon representing the number '7', the Korean 'ㅂ, pt', the English 'P, Q, R, and S', the number '7' is displayed on the screen, but you want to enter the Korean 'ㅂ'. In this case, the character type key can be converted by pressing the character type key once more, and the character can be modified in this way.

The implementation of an input method such as a character according to the present invention, which is performed by such a method and procedure, in an actual portable terminal will be described.

5 is an exemplary view showing an actual implementation of an input method in a mobile terminal according to an embodiment of the present invention.

As shown in FIG. 5, in order to actually implement the input method according to the present invention in a portable terminal, one hand fixes the portable terminal and the character type key 110 and the character input key ( 120) can be pressed.

When a finger of the other hand is captured by a camera built in or external to the portable terminal, the direction indicated by the finger is displayed on the button icon 140 on the screen. As a method of displaying the direction indicated by the tip of the finger on the button icon 140, for example, a method of lighting only the button icon 140 positioned in the direction indicated by the finger among the button icons may be used.

In this state, when the finger (preferably the tip of the finger for easy identification) is moved, the button icon 140 located in the pointing direction is turned on.

When the button icon 140 is displayed, when the user clicks a button with a finger, the character indicated by the button icon 140 is displayed in the input window.

If the displayed letter is correct, the selected letter is input by pressing the letter input key 120.

Therefore, according to the input method according to the preferred embodiment of the present invention, it is possible to input a character by pressing a button with only one hand. In addition, it is possible to input characters even without a separate keypad.

In addition, the button icon displayed on the screen may be provided in the same form as a keypad currently provided in the mobile terminal, thereby making it easier to use the user.

With reference to the above configuration and the input order will be described that the input method according to the present invention is carried out by taking a case of the character input in the portable terminal with a built-in camera. The configuration of the button icon is assumed to be the same as that of the keypad of the current mobile terminal.

First, a finger is photographed by a camera of the portable terminal for inputting text into the portable terminal. You can set your fingertip to point to the '5' button icon on the first screen. In this state, move your finger to point to the '7' button icon. When the fingertip points at the '7' button icon, the '7' button icon displayed on the screen turns on. Thus, the user can know exactly which button icon his fingertip points to.

When the user performs a finger click operation, '7' is selected and displayed in the input window. To input '7', press the character input key and '7' is finally input.

If you enter a different type of character, press the character type key to change the type of character displayed by the button icon. For example, select '7' and press the character type key once to select 'ㅂ', or press twice to select 'p'.

You can also select the character type by pressing the character type key on the initial screen first. For example, in the initial state, if you press the number, character type key once, and Korean, press twice, if you press the character type key once and select '7' as above, 'ㅂ' is displayed in the input window.

According to the input device and method according to the present invention, various combinations of Korean, English, numerals, and special symbols can be input. In addition, it is apparent that the input device according to the present invention can be used not only for a portable terminal but also for various digital processing apparatuses.

Preferred embodiments of the present invention described above are disclosed for purposes of illustration, and those skilled in the art will be able to make various modifications, changes, and additions within the spirit and scope of the present invention. Additions should be considered to be within the scope of the following claims.

As described above, according to the input device and the method of the digital processing apparatus according to the present invention, there is an advantage that the size of the display screen of the digital processing apparatus can be enlarged.

In addition, by not including a separate keypad, there is an advantage in that the digital processing apparatus can be miniaturized, such as making the thickness of the digital processing apparatus thinner.

Claims (17)

An input device included in a digital processing device, A memory unit for storing one or more character types and one or more character information corresponding to each character type; A key input unit for inputting arbitrary character type selection information and an input command of the selected character information; An operation recognition unit which detects a movement of an object in the image captured by the camera, calculates a motion vector from the reference position, and transfers the motion vector to the controller; Displayed character information using the button icon representing the character information according to an arbitrary character type and the motion vector, and the selected character information and input according to the input command of the character selection information and the selected character information input by the key input unit. A display unit for displaying information; And The character information recognized using the motion vector is read from the memory unit and transmitted to the display unit. When the character selection information and the selected character information input command are input from the key input unit, the selected character information and the input information are displayed. And a control unit for controlling the display unit to be displayed on the display unit. Claim 2 was abandoned when the setup registration fee was paid. The method of claim 1, The at least one character type is an input device included in a digital processing device, characterized in that at least one of Hangul, foreign language characters, numbers, symbols. The method of claim 1, The key input unit, And a character type key for inputting the input command of the arbitrary character type selection information and a character input key for inputting the input command of the selected character information. The method of claim 1, The operation recognition unit, And dividing each frame constituting the image into an m (natural number) xn (natural number) region, and calculating the motion vector using a change amount between image data of pixels of each region in consecutive frames. Input device included in the device. The method of claim 1, And the camera starts capturing the image by an operation start command, wherein the operation start command is input by a sensing value of a sensor for detecting pressure or movement or selection of a predetermined key button. In the input method of the digital processing device, (A) receiving first character type selection information; (B) detecting a movement of an object in the image captured by the camera and calculating a motion vector; (C) reading character information determined corresponding to the calculated motion vector among one or more character information according to the first character type selection information; Displaying the read character information on a display screen (d); And And (e) displaying the character information on the display screen as input information when an input command of the displayed character information is input. In the input method of the digital processing device, Calculating a motion vector by detecting a movement of an object in the image captured by the camera; (B) selecting one or more character information determined corresponding to the calculated motion vector; (C) receiving first character type selection information and reading character information corresponding to the first character type selection information; Displaying the read character information on a display screen (d); And And (e) displaying the character information on the display screen as input information when an input command of the displayed character information is input. The method according to claim 6 or 7, And if the second character type selection information is input, updating (f) the character information so as to correspond to the second character type selection information is followed by step (d). Claim 9 was abandoned upon payment of a set-up fee. The method according to claim 6 or 7, The at least one character type is at least one of Hangul, foreign language characters, numbers, and symbols. The method according to claim 6 or 7, Step (b) is, And dividing each frame constituting the image into an m (natural number) xn (natural number) region, and calculating the motion vector using a change amount between image data of pixels of each region in consecutive frames. Input method of the device. The method according to claim 6 or 7, The camera starts capturing the image by an operation start command, and the operation start command is input by a sensing value of a sensor for detecting pressure or a movement or selection of a predetermined key button. Input method. In the recording medium on which a program of instructions that can be executed in a digital processing device is tangibly embodied to perform an input method of a digital processing device. (A) receiving first character type selection information; (B) calculating a motion vector by detecting a movement of an object in the image captured by the camera; (C) reading character information determined corresponding to the calculated motion vector among one or more character information according to the first character type selection information; Displaying the read character information on a display screen (d); And And (e) displaying the character information on the display screen as input information when an input command of the displayed character information is input. In the recording medium on which a program of instructions that can be executed in a digital processing device is tangibly embodied to perform an input method of a digital processing device. Calculating a motion vector by detecting a movement of an object in the image captured by the camera; (B) selecting one or more character information determined corresponding to the calculated motion vector; (C) receiving first character type selection information and reading character information corresponding to the character type selection information; Displaying the read character information on a display screen (d); And And (e) displaying the text information on the display screen as input information when the input command of the displayed text information is input. Claim 14 was abandoned when the registration fee was paid. The method according to claim 12 or 13, And when the second character type selection information is input, updating (f) the character information so as to correspond to the second character type selection information is followed by step (d). Claim 15 was abandoned upon payment of a registration fee. The method according to claim 12 or 13, And the at least one type of character is at least one of Korean, foreign language characters, numbers, and symbols. Claim 16 was abandoned upon payment of a setup registration fee. The method according to claim 12 or 13, Step (b) is, An input method comprising dividing each frame constituting the image into an m (natural number) xn (natural number) region, and calculating the motion vector using an amount of change between image data of pixels of each region in consecutive frames. Recording medium. Claim 17 was abandoned upon payment of a registration fee. The method according to claim 12 or 13, The camera starts capturing the image by an operation start command, and the operation start command is input by a sensing value of a sensor for detecting pressure or movement or by selection of a predetermined key button. Record carrier.

Images