CN110456945A - Information input method, terminal, and computer-readable storage medium - Google Patents

Abstract

The invention belongs to the technical field of input devices, and relates to an information input method, a first terminal, and a computer-readable storage medium. Get the operation information of the object in the operation area. Therefore, the information input method provided by the present invention can project the operation area equivalent to the peripheral device when the projection input mode is turned on, so that the corresponding operation information can be obtained according to the information input operation performed by the user in the operation area, and the Corresponding responses are made according to the operation information to realize the input of information or corresponding operations. Therefore, the information input method provided by the present invention is applied to the terminal, so that the terminal can break through the limitation of the external size of the terminal without using physical peripherals, guaranteeing The user has a suitable operation area for the user to perform the information input operation, so the convenience and accuracy of the user's information input operation can be guaranteed.

Description

Information input method, terminal, and computer-readable storage medium

technical field

The present invention relates to the technical field of input devices, and in particular, to an information input method, a first terminal, and a computer-readable storage medium.

Background technique

At present, people are inseparable from various smart terminals in work and life, and smart terminals such as mobile phones, tablet computers, and smart watches are particularly popular due to their small size, lightness, and powerful functions.

However, due to the limitation of external dimensions of smart terminals such as mobile phones, tablet computers, and smart watches, a full-function keyboard cannot be realized when inputting information, or the operating area is too small, and it is easy to press wrongly.

For the above problems, those skilled in the art have been seeking solutions.

The preceding statements are intended to provide general background information and may not constitute prior art.

SUMMARY OF THE INVENTION

In view of this, the present invention provides an information input method, a first terminal and a computer-readable storage medium, the purpose of which is to provide a terminal with an information input method to meet the needs of users during information input operations, and to ensure that users can access information. Ease and accuracy of input operations.

The present invention is realized in this way:

The present invention provides an information input method, which is applied to a first terminal. The information input method includes: starting a projection input mode, and identifying an operation area by light effects. Get the operation information of the object in the operation area.

Further, the information input method further includes: responding according to the operation information and/or sending the operation information to the associated second terminal.

Further, in the step of acquiring the operation information of the object in the operation area, the step includes: when it is detected that there is an object in the operation area, 3D modeling is performed on the object to acquire the position information and/or action information of the object in real time.

Further, the operation area includes a projection keyboard. When it is detected that an object exists in the operation area, the step of performing 3D modeling on the object to obtain the position information and/or motion information of the object in real time includes: when the acquired motion information is a tapping gesture, acquiring the tapped position information .

Further, when the acquired action information is a tapping gesture, after the step of acquiring the tapped position information, the step includes: comparing the position information with the coordinate information of the projection keyboard to confirm that the position information in the projection keyboard corresponds to the position information. Projection keys. Get the operation information corresponding to the projection key.

Further, the operation area includes a graphics drawing area. The step of acquiring the operation information of the object in the operation area includes: acquiring the position change track of the object according to the acquired position information of the object. The operation information is obtained according to the position change trajectory, and the operation information is graphic information.

Further, the operation area includes a projection keyboard. In the step of turning on the projection input mode and identifying the operation area through the light effect, the step includes: turning on the projection input mode and obtaining the user's biometric information. Obtain user age information based on user biometric information. Obtain the size information of the projected keyboard according to the user's age information. Project the corresponding size of the projection keyboard according to the size information.

Further, the information input method further includes: sending operation information to the associated second terminal, so that the second terminal responds according to the operation information. When the response abnormality information fed back by the second terminal is received, the relative position information of the user and the operation area is detected. Acquire the position adjustment information of the operation area according to the relative position information, and adjust the position of the operation area according to the position adjustment information of the operation area.

The present invention also provides a first terminal including a memory and a processor. The processor is used to execute the computer program stored in the memory to implement the steps of the information input method as described above.

The present invention also provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the above-described information input method are implemented.

In the information input method, the first terminal and the computer-readable storage medium provided by the present invention, the information input method includes: starting a projection input mode, and identifying an operation area by light effects. Get the operation information of the object in the operation area. Therefore, the information input method provided by the present invention is applied to the terminal. When the projection input mode is turned on, the operation area equivalent to the peripheral device can be projected, so that the corresponding information input operation can be obtained according to the information input operation performed by the user in the operation area. operation information, and corresponding responses can be made according to the operation information to realize information input or corresponding operations. Therefore, the information input method provided by the present invention can break through the limitation of the size of the terminal without using physical peripherals, ensuring that users have an A suitable operation area is provided for the user to perform the information input operation, so the convenience and accuracy of the user's information input operation can be guaranteed.

In order to make the above-mentioned and other objects, features and advantages of the present invention more obvious and easy to understand, the preferred embodiments are exemplified below, and are described in detail as follows in conjunction with the accompanying drawings.

Description of drawings

1 is a schematic flowchart of an information input method provided by a first embodiment of the present invention;

2 is a schematic flowchart of an information input method provided by a second embodiment of the present invention;

3 is a schematic structural diagram of a first terminal provided by a third embodiment of the present invention;

FIG. 4 is a schematic diagram of the appearance of a first terminal provided by a third embodiment of the present invention.

Detailed ways

In order to make the objectives, technical solutions and advantages of the present invention clearer, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the described embodiments are only some, but not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

The embodiments of the present invention will be described in further detail below with reference to the accompanying drawings.

First embodiment:

FIG. 1 is a schematic flowchart of an information input method provided by a first embodiment of the present invention. For a clear description of the information input method provided by the first embodiment of the present invention, please refer to FIG. 1 .

The information input method provided by the first embodiment of the present invention, applied to the first terminal, includes the following steps:

S11: Turn on the projection input mode, and identify the operation area through the light effect.

In one embodiment, in step S11: turn on the projection input mode, identify the operation area by light effect, may but not be limited to include: when the projection input mode is turned on, the operation area is identified by the light effect, and projected in the operation area. Project the keyboard or graphics drawing area.

In one embodiment, when the projection input mode is turned on, a projection keyboard can be projected in the operation area by default in an initial state. Specifically, when the projection input mode is turned on, the default projection properties in the initial state may be preset, wherein the projection properties may include, but are not limited to, a projection keyboard or a graphics drawing area.

In one embodiment, before the step of turning on the projection input mode and identifying the operation area including the projection keyboard by the light effect, may include but is not limited to: acquiring image information of the physical keyboard. The image information of the physical keyboard is parsed to obtain the coordinates of each key of the keyboard in the image information. The setting parameters of the projection keyboard are obtained according to the image information of the physical keyboard and the coordinates of each key. Therefore, in the information input method provided by this embodiment, the style of the projection keyboard can be customized before the projection keyboard is projected in the operation area.

In other embodiments, when the projection input mode is turned on, the operation area is identified by the light effect, and the step of projecting the projection keyboard or the graphics drawing area in the operation area may, but is not limited to, include: when the projection input mode is turned on, obtaining User information input requirement information. If the acquired information input requirement information is text input, the operation area is identified by the light effect, and a projection keyboard is projected in the operation area. If the acquired information input requirement information is input graphics, the operation area is identified by the light effect, and the graphics drawing area is projected in the operation area.

In other embodiments, when the projection input mode is turned on, the acquired information input requirement information may include, but is not limited to, information based on the type of the currently running application, the type of the selected information input box in the current page, the input method mode information, etc. For example, if the application currently running on the terminal is "Memo", and the application type of "Memo" is text, then the acquired information input requirement information is the input text; for another example, the application currently running on the terminal is "Memo" "Personal Graffiti", the application type of "Personal Graffiti" is graphics, and the obtained information input requirement information is input graphics. For example, the input method mode information is handwriting input, and the acquired information input requirement information is an input graphic.

In one embodiment, the operation area includes a projection keyboard, and in step S11 , the projection input mode is turned on, and the operation area is identified by light effects, which may include but is not limited to: turning on the projection input mode and obtaining user biometric information. Obtain user age information based on user biometric information. Obtain the size information of the projected keyboard according to the user's age information. Project the corresponding size of the projection keyboard according to the size information. Wherein, the size information of the projected keyboard may include, but is not limited to, the overall size of the projected keyboard, the key distance, the size of the key identification, and the like. Wherein, the size information of the projection keyboard is obtained according to the user's age information. For example, if the user's age information is less than 30 years old, the first size information of the projection keyboard is obtained; for another example, if the user's age information is between 30 and 50 years old, then the first size information of the projection keyboard is obtained. The second size information of the projected keyboard; for another example, if the age information of the user is greater than 50 years old, the third size information of the projected keyboard is acquired.

S12: Obtain operation information of objects in the operation area.

In one embodiment, the object within the operating area may be, but is not limited to, a human hand, an operating tool (eg, a sensor pen, a stick, etc.), and the like.

In one embodiment, the information input method further includes: responding according to the operation information and/or sending the operation information to the associated second terminal. Among them, the response is made according to the operation information. For example, if the obtained operation information is graphic information, the graphic information will be identified, and if the graphic information is identified as the word "sound", a "sound" will be generated in the selected edit box on the page. For another example, if the obtained operation information is pinyin "yin", the text corresponding to "yin" is displayed through the input method on the page; for another example, if the obtained operation information is graphic information, the graphic information is added to the drawing in the software. Specifically, the information input method provided by this embodiment is capable of all functions of information input peripherals such as a physical keyboard, a physical writing tablet, and a physical drawing tablet.

In one embodiment, the operation information is graphic information, and after step S12: the step of acquiring the operation information of the object in the operation area, it includes: when the response abnormality information is obtained according to the operation information, detecting the relative position information of the user and the operation area. . Acquire the position adjustment information of the operation area according to the relative position information, and adjust the position of the operation area according to the position adjustment information of the operation area. For example, if the operation information is image information, when the corresponding text information cannot be obtained according to the operation information (for example, in the case of handwritten input), when the response exception information is obtained, the relative position of the user and the operation area is adjusted to avoid the inappropriate position of the operation area. The resulting response is abnormal.

In one embodiment, the step of acquiring the operation information of the object in the operation area may include, but is not limited to, including: when an object is detected in the operation area, 3D modeling is performed on the object to obtain the position information of the object and/or the object in real time. Action information.

In one embodiment, the first terminal includes a 3D interaction module, and the 3D interaction module includes an infrared device, a coding projection device, and a camera device. Wherein, the coding projection device is used to project the operation area, and the operation area includes a coordinate network, wherein the infrared device is used to cover the operation area by infrared rays, and the camera device is used to collect the image information of the operation area, so When there is an object in the operation area, the 3D interaction module can model the object in 3D, and then can accurately obtain the position information and/or action information of the object according to the 3D modeling. In one embodiment, the coding projection device can also project a projection keyboard in the operating area.

In one embodiment, the operating area includes a projected keyboard. When it is detected that there is an object in the operation area, the step of 3D modeling the object to obtain the position information and/or motion information of the object in real time may include but is not limited to: when the acquired motion information is a tapping gesture, acquiring the tapped gesture location information of the click.

In one embodiment, when the acquired motion information is a tap gesture, the step of acquiring the tapped position information may include but is not limited to: when an object is detected in the operation area, 3D modeling is performed on the object to obtain the tapped position information. properties of objects. When the attribute of the acquired object is the human hand, the motion information of the fingers of the human hand is acquired according to the 3D modeling. When the acquired motion information of the finger is the tapping posture, the position information of the position tapped by the finger is acquired.

In one embodiment, when the acquired motion information is a tap gesture, after the step of acquiring the tapped position information, or when the acquired finger motion information is a tap gesture, the position of the tapped position is acquired. After the step of location information, it may include but is not limited to: comparing the location information with the coordinate information of the projected keyboard to confirm the projected keys in the projected keyboard corresponding to the location information. Get the operation information corresponding to the projection key.

In one embodiment, in the step of acquiring the position information of the position tapped by the finger, it may include but is not limited to: comparing the position information with the coordinate information of the projection keyboard to confirm that the projection keyboard corresponds to the position information. projection button, and change the color of the projection button. And when the acquired action information is recovery from the tapping gesture, the color of the projected button is restored to the original color. Therefore, in the information input method provided by this embodiment, when the projection keyboard is tapped, the projection keyboard will have visual feedback.

In one embodiment, the operating area includes a graphics drawing area. The step of acquiring the operation information of the object in the operation area includes: acquiring the position change track of the object according to the acquired position information of the object. The operation information is obtained according to the position change trajectory, and the operation information is graphic information. Therefore, the information input method provided by this embodiment can realize graphic drawing and handwritten font input.

In an embodiment, the information input method provided in this embodiment further includes: monitoring the ambient brightness in real time to obtain ambient brightness information. Obtain the brightness setting information of the operation area according to the ambient brightness information. The brightness of the operation area is adjusted according to the brightness setting information of the operation area.

In one embodiment, the information input method provided in this embodiment is applied to a first terminal, where the first terminal may include, but is not limited to, a mobile terminal (such as a mobile phone, a smart watch, etc.), a fixed terminal (such as a desktop computer) and many more.

The information input method provided by the first embodiment of the present invention is applied to a first terminal, and includes S11: turning on a projection input mode, and identifying an operation area by light effects. S12: Obtain operation information of objects in the operation area. Therefore, when the first terminal using the information input method provided in this embodiment is turned on, when the projection input mode is turned on, the first terminal can project the operation area equivalent to the peripheral device, so that the first terminal can perform the operation according to the user's operation area in the operation area. The corresponding operation information can be obtained through the information input operation of the device, and the corresponding response can be made according to the operation information to realize the input of information. Therefore, the information input method provided in this embodiment is applied to the first terminal, so that the first terminal does not need to use The physical peripheral device can break through the limitation of the size of the terminal and ensure that the user has a suitable operation area for the user to perform information input operations, thus ensuring the convenience and accuracy of the user's information input operations.

Second embodiment:

FIG. 2 is a schematic flowchart of an information input method provided by a second embodiment of the present invention. For a clear description of the information input method provided by the second embodiment of the present invention, please refer to FIG. 2 .

The information input method provided by the second embodiment of the present invention includes the following steps:

S21: The first terminal turns on the projection input mode, and identifies the operation area through the light effect.

S22: The first terminal acquires the operation information of the object in the operation area, and sends the operation information to the associated second terminal.

In an embodiment, for the specific implementation and beneficial effects of the first terminal in the information input method provided by this embodiment, reference may be made to the information input method provided by the first embodiment of the present invention, which will not be repeated here.

S23: After receiving the operation information, the second terminal responds according to the operation information.

In an embodiment, before the step of receiving the operation information by the second terminal, the second terminal and the first terminal may be associated with, but not limited to, by means of wireless communication. Among them, the way of wireless communication, such as Bluetooth communication, WiFi communication and so on.

In one embodiment, the operation information is graphic information, and in step S23: after the second terminal receives the operation information, the step of responding according to the operation information may, but is not limited to, include: when the second terminal obtains the response abnormality information, feedback The response exception information is sent to the first terminal. When the first terminal receives the response abnormality information fed back by the second terminal, it detects the relative position information of the user and the operation area. The first terminal acquires the position adjustment information of the operation area according to the relative position information, and adjusts the position of the operation area according to the position adjustment information of the operation area. Therefore, in this embodiment, when the second terminal uses the first terminal as a peripheral device to perform handwriting input, the second terminal can make the first terminal adjust according to the user's position when the text information cannot be obtained according to the operation information sent by the first terminal. The position of the operation area projected by the first terminal avoids that handwriting recognition cannot be performed due to the inappropriate position of the operation area.

In one embodiment, the information input method provided in this embodiment may also include, but is not limited to, including: after the first terminal receives the input method mode information sent by the second terminal, acquiring the projection attribute according to the input method mode information. The first terminal projects an operation area corresponding to the projected attribute. The first terminal obtains the projection attribute according to the input method mode information. For example, if the input method mode information is handwriting input, the obtained projection attribute is the graphics drawing area; for another example, if the input method mode information is pinyin input, the obtained projection attribute for the projected keyboard.

In one embodiment, the information input method provided in this embodiment may further include, but is not limited to, including: after the first terminal receives the current application attribute sent by the second terminal, acquiring the projection attribute according to the current application attribute. The first terminal projects an operation area corresponding to the projected attribute. Among them, get the projected properties based on the current application properties, eg. If the current application attribute is drawing software, the obtained projection attribute is the graphics drawing area; for example, if the current application attribute is text editing software, the obtained projection attribute is the projection keyboard.

The information input method provided by the second embodiment of the present invention includes: S21: The first terminal enables the projection input mode, and identifies the operation area by light effect. S22: The first terminal acquires the operation information of the object in the operation area, and sends the operation information to the associated second terminal. S23: After receiving the operation information, the second terminal responds according to the operation information. Therefore, the information input method provided in this embodiment is applied between the first terminal and the second terminal, the first terminal can be used as a peripheral of the second terminal, and the first terminal can be a portable mobile terminal, so this embodiment can make The second terminal does not need to configure other peripherals, and only needs to use a portable mobile terminal such as a user's mobile phone to realize multi-mode information input, thereby enabling the second terminal to save hardware costs.

Third embodiment:

FIG. 3 is a schematic structural diagram of a first terminal provided by a third embodiment of the present invention. FIG. 4 is a schematic diagram of the appearance of a first terminal provided by a third embodiment of the present invention. To clearly describe the first terminal provided by the third embodiment of the present invention, please refer to FIG. 3 and FIG. 4 .

The first terminal 1 provided by the third embodiment of the present invention includes: a processor A101 and a memory A201, wherein the processor A101 is configured to execute the computer program A6 stored in the memory A201 to realize the information input as described in the first embodiment steps of the method.

In an implementation manner, the first terminal 1 provided in this embodiment may include at least one processor A101 and at least one memory A201. Wherein, at least one processor A101 may be referred to as a processing unit A1, and at least one memory A201 may be referred to as a storage unit A2. Specifically, the storage unit A2 stores a computer program A6, and when the computer program A6 is executed by the processing unit A1, the first terminal 1 provided in this embodiment implements the steps of the information input method described above, for example, in FIG. 1 The shown step S11: the projection input mode is turned on, and the operation area is identified by the light effect. For another example, step S12 shown in FIG. 1 : acquiring operation information of objects in the operation area.

In one embodiment, the first terminal 1 provided in this embodiment may include a plurality of memories A201 (referred to as storage units A2 for short), and the storage units A2 may include, for example, random access memory (RAM) and/or cache memory. and/or read only memory (ROM), etc.

In one embodiment, the first terminal 1 further includes a bus connecting different components (eg, the processor A101 and the memory A201, the touch display screen A3, the 3D interaction module A7, etc.).

In an implementation manner, the first terminal 1 in this embodiment may further include a communication interface (eg, an I/O interface A4), and the communication interface may be used to communicate with an external device.

In an embodiment, the first terminal 1 provided in this embodiment may further include a communication apparatus A5.

In an embodiment, referring to FIG. 3 and FIG. 4 , the first terminal 1 provided in this embodiment further includes a 3D interaction module A7. The 3D interaction module A7 includes an infrared device A71, a coding projection device A72 and a camera device A73. Wherein, the coding projection device is used to project the operation area, and the operation area includes a coordinate network, wherein the infrared device is used to cover the operation area by infrared rays, and the camera device is used to collect the image information of the operation area, so When there is an object in the operation area, the 3D interaction module can model the object in 3D, and then can accurately obtain the position information and/or action information of the object according to the 3D modeling. Wherein, the coding projection device can also project a projection keyboard in the operation area.

In one embodiment, the infrared device A71 and the coding projection device A72 in the 3D interaction module A7 can cooperate to calculate the depth information of the object in the operation area, and then the camera device A73 can be used to draw the outline of the object, and then can according to The depth information and the outline of the object realize 3D modeling.

The first terminal 1 provided by the third embodiment of the present invention includes a memory A101 and a processor A201, and the processor A101 is configured to execute the computer program A6 stored in the memory A201 to implement the information input method described in the first embodiment. Therefore, the first terminal 1 provided in this embodiment can break through the limitation of the size of the first terminal without using physical peripherals, and ensure that the user has a suitable operation area for the user to perform information input operations, so the first terminal can To ensure the convenience and accuracy of the user's information input operation.

The third embodiment of the present invention also provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program A6, and when the computer program A6 is executed by the processor A101, implements the information input method as in the first embodiment For example, the steps shown in FIG. 1 are S11 to S12.

In one embodiment, the computer-readable storage medium provided by this embodiment may include any entity or device capable of carrying computer program code, a recording medium, such as ROM, RAM, magnetic disk, optical disk, flash memory, and the like.

When the computer program A6 stored in the computer-readable storage medium provided by the third embodiment of the present invention is executed by the processor A101, the convenience and accuracy of the user's information input operation on the terminal can be guaranteed.

The technical features of the above-described embodiments can be combined arbitrarily. For the sake of brevity, all possible combinations of the technical features in the above-described embodiments are not described. However, as long as there is no contradiction between the combinations of these technical features, All should be regarded as the scope described in this specification.

As used herein, the terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion, in addition to those elements listed, but also other elements not expressly listed.

The above are only preferred embodiments of the present invention and are not intended to limit the present invention. Any modification, equivalent replacement or improvement made within the spirit and principle of the present invention shall be included in the protection scope of the present invention. Inside.

Claims (10)

1. a kind of data inputting method, which is characterized in that be applied to first terminal, the data inputting method includes:

Projection input pattern is opened, operating area is identified by light efficiency；

Obtain the operation information of the object in the operating area.

2. data inputting method as described in claim 1, which is characterized in that the data inputting method further include:

Response is carried out according to the operation information and/or the operation information is sent to associated second terminal.

3. data inputting method as described in claim 1, which is characterized in that in the object obtained in the operating area Operation information the step of in, comprising:

Detect that the operating area there are when the object, carries out 3D modeling to the object to obtain the object in real time Location information and/or action message.

4. data inputting method as claimed in claim 3, which is characterized in that include projected keyboard in the operating area；

Detect that there are when the object, it is described to obtain in real time to carry out 3D modeling to the object for the operating area described In the step of location information and/or action message of object, comprising:

When getting the action message to tap posture, the location information being tapped is obtained.

5. data inputting method as claimed in claim 4, which is characterized in that get the action message described as percussion When posture, after the step of obtaining the location information being tapped, comprising:

The location information is compared with the coordinate information of the projected keyboard, with confirm in the projected keyboard with it is described The corresponding projection key of location information；

Obtain the operation information corresponding with the projection key.

6. data inputting method as described in claim 1, which is characterized in that the operating area includes graphic plotting region；

In the operation information for obtaining the object in the operating area the step of, comprising:

The change in location track of the object is obtained according to the location information of the object of acquisition；

The operation information is obtained according to the change in location track, the operation information is graphical information.

7. data inputting method as described in claim 1, which is characterized in that include projected keyboard in the operating area；

In the step of unlatching projects input pattern, identifies operating area by light efficiency, comprising:

Projection input pattern is opened, user biological characteristic information is obtained；

Age of user information is obtained according to the user biological characteristic information；

According to the dimension information of projected keyboard described in the age of user acquisition of information；

The projected keyboard of corresponding size is projected out according to the dimension information.

8. data inputting method as described in claim 1, which is characterized in that the data inputting method further include:

The operation information is sent to associated second terminal, so that the second terminal is rung according to the operation information It answers；

When receiving the response abnormality information of the second terminal feedback, the relative position of detection user and the operating area is believed Breath；

Information acquiring operation regional location adjustment information depending on that relative position, and adjusted and believed according to the operating area position Breath adjusts the position of the operating area.

9. a kind of first terminal, which is characterized in that including memory and processor；

The processor is for executing the computer program stored in the memory to realize such as any one of claim 1-8 The step of described data inputting method.

10. a kind of computer readable storage medium, which is characterized in that be stored with computer on the computer readable storage medium Program realizes such as data inputting method of any of claims 1-8 when the computer program is executed by processor The step of.