CN105843402A - Screen reading application instruction input method and device based on wearable equipment - Google Patents
Screen reading application instruction input method and device based on wearable equipment Download PDFInfo
- Publication number
- CN105843402A CN105843402A CN201610313246.3A CN201610313246A CN105843402A CN 105843402 A CN105843402 A CN 105843402A CN 201610313246 A CN201610313246 A CN 201610313246A CN 105843402 A CN105843402 A CN 105843402A
- Authority
- CN
- China
- Prior art keywords
- gesture
- reading
- reading screen
- subject performance
- screen
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 38
- 230000033001 locomotion Effects 0.000 claims abstract description 87
- 230000009471 action Effects 0.000 claims abstract description 52
- 230000006870 function Effects 0.000 claims description 41
- 230000008878 coupling Effects 0.000 claims description 11
- 238000010168 coupling process Methods 0.000 claims description 11
- 238000005859 coupling reaction Methods 0.000 claims description 11
- 230000005540 biological transmission Effects 0.000 claims description 6
- 230000000875 corresponding effect Effects 0.000 description 108
- 238000004891 communication Methods 0.000 description 11
- 230000001133 acceleration Effects 0.000 description 10
- 208000029257 vision disease Diseases 0.000 description 10
- 230000006399 behavior Effects 0.000 description 9
- 230000008859 change Effects 0.000 description 6
- 238000004590 computer program Methods 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 239000000284 extract Substances 0.000 description 4
- 230000010354 integration Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 241000208340 Araliaceae Species 0.000 description 2
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 description 2
- 235000003140 Panax quinquefolius Nutrition 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 230000002596 correlated effect Effects 0.000 description 2
- 238000012217 deletion Methods 0.000 description 2
- 230000037430 deletion Effects 0.000 description 2
- 235000008434 ginseng Nutrition 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 201000004569 Blindness Diseases 0.000 description 1
- 230000003321 amplification Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000001771 impaired effect Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the invention discloses a screen reading application instruction input method based on wearable equipment. The method comprises the steps that movement locus data of movement operation sent by the connected wearable equipment is received, wherein the movement operation is input by the user through the connected wearable equipment; feature data of the movement locus data is obtained; a preset action/gesture database is searched for a target action/gesture matched with the feature data; a screen reading function operation corresponding to the target action/gesture is determined and executed. In addition, the embodiment of the invention further discloses a screen reading application instruction input device based on the wearable equipment. By the adoption of the screen reading application instruction input method and device based on the wearable equipment, operation convenience of screen reading application instruction input can be improved.
Description
Technical field
The present invention relates to human-computer interaction technique field, particularly relate to the application of a kind of reading screen based on wearable device
Instruction input method and device.
Background technology
Along with quickly popularizing of the computer equipment such as smart mobile phone, PC, various mobile Internets are applied
Also emerge in an endless stream, increasing user can the life that brings to mobile interchange technology of sense of reality convenient and
Wireless enjoyment；But, in society, some specific group is also required to use the computers such as smart mobile phone to set
Standby, that is, to have certain handicapped crowd, the visually impaired colony of such as disturbance people, especially total blindness,
It is entirely and listens to sound to operate computer by ear.
(include in the auxiliary operation function using the terminal units such as smart mobile phone, panel computer, PC
But it is not limited to Voiceover, Talkback etc. and reads screen software and the application of other similar functions) time, Yong Hujie
Surface element and function thereof can be extracted and pass through TTS (Text to Speech, text-to-speech technology)
Selected word voice is played back, to help user to understand the content that mobile phone screen is currently displaying；
Further, user can by carrying out on the touchscreen clicking on, the operation such as slip, terminal is operated, gives
User brings the most more rich experience, in particular so that there is certain handicapped crowd's (example
Such as specific groups such as the disability personnel of visual disorder, old peoples) can clog-free use smart mobile phone etc. eventually
End equipment.
It is to say, terminal must could be operated by the input equipment such as hand-held intelligent mobile phone, mouse by user.
As a example by smart mobile phone, from the point of view of user, even if there being the auxiliary of voice, it is also desirable to user is showing with finger
Show and repeatedly click on or slide on interface.If it addition, mobile phone is the most at one's side, then cannot be carried out behaviour
Make so that user uses the experience of the terminal units such as smart mobile phone the best.Further, for existing
From the point of view of certain handicapped crowd (specific group such as the disability personnel of such as visual disorder, old people),
Will there is also certain problem by searching mobile phone quickly and accurately, this has resulted in the certain handicapped people of existence
Group specific groups such as () the disability personnel of such as visual disorder, old peoples is the facility of operation when using mobile phone
Property not enough.
It is to say, there is the facility of operation in the mode of operation of the terminal units such as smart mobile phone of the prior art
Property not enough problem.
Summary of the invention
Based on this, there is operation in the mode of operation for terminal units such as the smart mobile phones in solution conventional art
The technical problem that convenience is not enough, spy proposes a kind of reading screen based on wearable device application instruction input side
Method.
A kind of reading screen application instruction input method based on wearable device, including:
Receive the motion trace data of the motor performance that the wearable device connected sends, described motor performance
It it is the wearable device input connected described in user passes through；
Obtain the characteristic of described motion trace data；
Subject performance/the gesture mated with described characteristic is searched in default gesture database；
Determine the reading screen feature operation corresponding with described subject performance/gesture, perform described reading and shield feature operation.
Optionally, wherein in an embodiment, after the described step reading screen feature operation of described execution also
Including: obtain the described execution result reading screen feature operation；In described default speech database search with
Described voice message message corresponding to execution result reading screen feature operation；Play described voice message message.
Optionally, wherein in an embodiment, described lookup and described spy in default gesture database
Also include after the step of the subject performance/gesture levying Data Matching:
Obtain the current display interface of terminal, obtain the reading screen function check boxes of described current display interface；
Described determine corresponding with the described subject performance/gesture step reading screen feature operation particularly as follows:
Screen function check boxes of reading according to described current display interface determines corresponding with described subject performance/gesture
Read screen feature operation.
Optionally, wherein in an embodiment, described reading screen feature operation is that voice applications opens operation；
The described step reading screen feature operation of described execution is particularly as follows: open operation according to described voice applications and open
Dynamic unlatching with described voice applications operates corresponding voice applications.
Optionally, wherein in an embodiment, described determine the reading screen corresponding with described subject performance/gesture
The step of feature operation particularly as follows: be sent to read screen application by described subject performance/gesture, and described reading shields application
For searching in described default reading screen feature operation data base and described mesh according to described subject performance/gesture
The reading screen feature operation of mark action/gesture coupling.
Optionally, wherein in an embodiment, the motion that the wearable device that described reception has connected sends
Also include before the step of the motion trace data of operation: receive the reading screen application open command of user's input,
Described reading screen application open command is applied corresponding with described screen of reading, and starts according to described screen application open command of reading
Described screen of reading is applied.
Optionally, wherein in an embodiment, described lookup and institute in default action/gesture database
State characteristic coupling subject performance/gesture step after also include: obtain user input for described
The feedback information of subject performance/gesture；Or obtain described characteristic and described subject performance/gesture mate ginseng
Examine value, generate the feedback information for described subject performance/gesture according to described coupling reference value；Described method
Also include: determine the more new data of described default action/gesture database according to described feedback information；According to
Action/the gesture database preset described in described renewal Refresh Data.
Additionally, there is operation just in the mode of operation for terminal units such as the smart mobile phones in solution conventional art
The technical problem that profit is not enough, it is also proposed that a kind of reading screen application instruction inputting device based on wearable device.
A kind of reading screen application instruction inputting device based on wearable device, including:
Motion trace data receiver module, for receiving the motor performance of the wearable device transmission connected
Motion trace data, described motor performance is the wearable device input connected described in user passes through；
Characteristic acquisition module, for obtaining the characteristic of described motion trace data；
Subject performance/gesture searches module, for searching and described characteristic in default gesture database
Subject performance/the gesture of coupling；
Operation determines execution module, for determining the reading screen feature operation corresponding with described subject performance/gesture,
Perform described reading and shield feature operation.
Optionally, wherein in an embodiment, described device also includes voice message message playback module,
For: obtain the described execution result reading screen feature operation；In described default speech database search with
Described voice message message corresponding to execution result reading screen feature operation；Play described voice message message.
Optionally, wherein in an embodiment, described device also includes display interface acquisition module, is used for
Obtain the current display interface of terminal, obtain the reading screen function check boxes of described current display interface；Described behaviour
Make to determine that the reading screen function check boxes that execution module is additionally operable to according to described current display interface determines and described mesh
The reading screen feature operation that mark action/gesture is corresponding.
Optionally, wherein in an embodiment, described reading screen feature operation is that voice applications opens operation；
Described operation determines that execution module is additionally operable to: opening operation startup according to described voice applications should with described audio frequency
The voice applications corresponding with opening operation.
Optionally, wherein in an embodiment, described operation determines that execution module is additionally operable to: by described mesh
Mark action/gesture is sent to read to shield application, and described reading screen application is used for according to described subject performance/gesture described
That presets reads the reading screen feature operation that in screen feature operation data base, lookup is mated with described subject performance/gesture.
Optionally, wherein in an embodiment, described device also includes reading screen application opening module, is used for
Receiving the reading screen application open command of user's input, described reading screen application open command is right with described reading screen application
Should, start described reading according to described reading screen application open command and shield application.
Optionally, wherein in an embodiment, described device also includes feedback information acquisition module and data
Storehouse more new module, wherein: described feedback information acquisition module is used for: obtain user input for described mesh
The feedback information of mark action/gesture；Or obtain described characteristic and described subject performance/gesture mate reference
Value, generates the feedback information for described subject performance/gesture according to described coupling reference value；Described data base
More new module is used for: determine the more new data of described default action/gesture database according to described feedback information；
According to the action/gesture database preset described in described renewal Refresh Data.
Implement the embodiment of the present invention, will have the advantages that
After have employed above-mentioned reading screen application instruction input method based on wearable device and device, Yong Huke
With by wearable device is rocked, the motor performance such as trace, then relevant by this motor performance
Data are sent to terminal by the communication connection between terminal and wearable device, and terminal is according to the number received
According to determining that user needs the operational order corresponding with reading screen application of input to complete to read the input of the instruction of screen application
And performed by reading screen software device that corresponding operational order is sent to computer corresponding, it is achieved that logical
Crossing wearable device applies input instruction and reading screen software by the output of operational order to the reading screen of terminal, compares
From the point of view of in conventional art, user must input the scheme of instruction by the physical button of terminal or touch screen, can
Improve the operation ease of instruction input；Further, such scheme also achieves at user's not handheld terminal
In the case of the most operable terminal, to read screen application send instruction carry out associative operation, further improve
User uses the operation ease reading screen application；In particular for there is certain handicapped crowd (such as
The specific groups such as the disability personnel of visual disorder, old people) from the point of view of, the raising of its operation ease is the brightest
Aobvious.
Accompanying drawing explanation
In order to be illustrated more clearly that the embodiment of the present invention or technical scheme of the prior art, below will be to enforcement
In example or description of the prior art, the required accompanying drawing used is briefly described, it should be apparent that, describe below
In accompanying drawing be only some embodiments of the present invention, for those of ordinary skill in the art, do not paying
On the premise of going out creative work, it is also possible to obtain other accompanying drawing according to these accompanying drawings.
Wherein:
Fig. 1 is a kind of flow process reading screen application instruction input method based on wearable device in an embodiment
Schematic diagram；
Fig. 2 is a kind of flow process reading screen application instruction input method based on wearable device in an embodiment
Schematic diagram；
Fig. 3 is the schematic flow sheet of the feedback update method of action/gesture database in an embodiment；
Fig. 4 is a kind of structure reading screen application instruction inputting device based on wearable device in an embodiment
Schematic diagram；
Fig. 5 is to run aforementioned screen of reading based on wearable device in an embodiment to apply instruction input method
The structural representation of computer equipment.
Detailed description of the invention
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clearly
Chu, be fully described by, it is clear that described embodiment be only a part of embodiment of the present invention rather than
Whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art are not making creation
The every other embodiment obtained under property work premise, broadly falls into the scope of protection of the invention.
There is the convenience of operation not in the mode of operation for terminal units such as the smart mobile phones in solution conventional art
The technical problem of foot, in the present embodiment, spy proposes the application instruction of a kind of reading screen based on wearable device
Input system, this system includes wearable device and terminal, concrete, wearable device by WIFI or
Bluetooth or the connected mode such as wired are connected with terminal and (it should be noted that in the present embodiment, wearable set
Standby it is not limited to WIFI with the connected mode between terminal or bluetooth is connected, it is also possible to be other wireless telecommunications companies
Connect mode or wire communication connected mode).Concrete, wearable device includes motion sensor, You Xianhuo
Wireless communication module, motion sensor is for detecting the motor performance of wearable device, wired or wireless communication
Module is used for carrying out data transmission between terminal；Terminal is to possess the computer of wired or wireless ability to communicate
Equipment, such as, can carry out the terminal units such as the smart mobile phone of wired or wireless communication, panel computer, and lead to
Cross the wired or wireless communication set up between wearable device to be connected and carry out data transmission each other.
Concrete, in the end side of said system, it is also proposed that a kind of reading screen based on wearable device is applied
The method of instruction input, the realization of the method can be dependent on computer program, and this computer program can run on
On computer system based on von Neumann system, this computer program can be corresponding with wearable device
Read screen application program or screen reading application program and read screen application or screen reading application program associates
The application program of the exercise data acquisition corresponding with wearable device.This computer system can be can be with intelligence
Wearable device establishes a connection or the smart mobile phone of correspondence, panel computer, palm PC, notes
The computer equipment such as this computer or PC.
Concrete, the reading screen application of terminal, some is user installation, and some is also likely to be the most built-in
: such as based on IOS system voiceover is exactly built-in, NVDA based on windows system
It it is exactly the third party software of user installation.
Concrete, as it is shown in figure 1, above-mentioned reading screen application instruction input method based on wearable device includes
Following steps:
Step S101: receive the motion trace data of the motor performance that the wearable device connected sends, fortune
Dynamic operation is the wearable device input that user passes through to have connected.
In implementing, the wearable device described in the embodiment of the present invention can be intelligent watch, intelligence hands
Ring, intelligent earphone etc. are easy to the equipment that user wears, and do not limit at this.It should be noted that in this reality
Execute in example, can be attached also by bluetooth, WIFI, the mode such as wired between wearable device and terminal
Set up correspondence, say, that after setting up communication connection relation between wearable device and terminal,
Transmission and the reception of data can be realized between terminal and wearable device.
This wearable device is mounted with motion sensor, for detecting and obtain the fortune of this wearable device
Dynamic operation, such as, motion sensor is acceleration transducer and/or gyroscope, and acceleration transducer is permissible
Detecting axial line movement, gyroscope can detect rotational angular velocity when deflection, inclination.Such as, may be used
Wearable device acceleration information on tri-directions of X, Y, Z is detected by 3-axis acceleration sensor,
And by integration, the acceleration information on tri-directions of X, Y, Z is converted into instantaneous velocity, and general i.e. speed per hour
Degree integration on a timeline makees the movement locus on X, Y, Z, then by the movement locus on three directions
It is superimposed, obtains the movement locus figure of wearable device.
It is to say, user can be operated by wearable device input motion, and obtain this motor performance
Motion trace data, by with the communication connection relation between terminal by the movement locus of corresponding motor performance
Data are sent to terminal.It should be noted that in the present embodiment, user is inputted by wearable device
The operations such as motor performance includes singly being not limited to rocking, curve, slip.
Step S102: obtain the characteristic of motion trace data.
When movement locus is mated with the movement locus preset or parameter preset etc., it is by fortune
The characteristic of dynamic track is compared, so, in the present embodiment, send out receiving wearable device
After the motion trace data of the motor performance that the user sent is inputted by wearable device, need this motion
Track data is analyzed, and extracts the characteristic in this motion trace data.
Such as, the information of the characteristic point of predetermined number in this movement locus, in the present embodiment, feature are extracted
Point is for limiting the point of motion characteristic in motor performance, this feature point can reflect the shape facility of movement locus.
In other embodiments, features described above data can be amplitude or the formation duration of movement locus of movement locus.
Step S103: the subject performance that lookup is mated with characteristic in default action/gesture database/
Action/gesture.
In the present embodiment, read screen apply discernible action/gesture to include but not limited to left to draw, right draw, on
Lower slider, double-clicking, click, user can be arranged as required to multiple action/gesture, the most double refers to scaling.
Action/gesture database is the operational motion/gesture reading to preset in screen application, say, that when detecting
During operational motion/the gesture mated with the operational motion/gesture in action/gesture database, this operation can be moved
Work/gesture is judged to effective action/gesture, is otherwise judged to invalid operation action/gesture.
In the present embodiment, the operating gesture in gesture database need to be preset defeated with by wearable device
Corresponding relation between the motor performance entered, namely set operating gesture in gesture database and pass through to wear
Corresponding relation between the motion trace data characteristic of correspondence data of the motor performance wearing equipment input.Upper
After stating corresponding relation foundation, can be searched and characteristic number in default gesture database by this corresponding relation
According to corresponding subject performance/gesture, the target that the motor performance that i.e. inputted by wearable device with user is corresponding
Action/gesture.
It should be noted that in the present embodiment, the matching relationship in subject performance/gesture with characteristic is
Determine according to characteristic, such as, when characteristic is characteristic point information, above-mentioned matching relationship is permissible
Characteristic point on the desired guiding trajectory corresponding with subject performance/gesture with the characteristic point in motion trace data
Degree of joining exceedes preset value, in other embodiments, characteristic be the amplitude of movement locus, length, time
During the information such as length, above-mentioned matching relationship can also is that the parameters such as the amplitude of movement locus, length, duration meet
The preset value corresponding with subject performance/gesture.
Step S104: determine the reading screen feature operation corresponding with subject performance/gesture.
Step S105: perform to read screen feature operation.
In implementing, in reading screen application, each operational motion gesture is an all corresponding concrete behaviour
Instruct, for example, it is possible to arrange the buttons/areas choosing place, touch point corresponding to " clicking " and play and be somebody's turn to do
The speech message that buttons/areas is corresponding, it is also possible to arrange " double-click " correspondence open link corresponding to current check boxes/
The page.
In the present embodiment, the reading screen feature operation that subject performance/gesture is corresponding includes but not limited to open reading screen
Apply, open certain page, change the position etc. reading screen check boxes.Further, subject performance/gesture is corresponding
Read screen feature operation to be determined according to default corresponding relation, such as, when input in step S101
When motor performance is for rocking twice, corresponding subject performance/gesture can be to dub twice, corresponding reading screen merit
The page/the link corresponding for opening current reading screen check boxes can be operated.
Optionally, in one embodiment, after step S105, for read screen feature operation perform knot
Really, user can also know relevant instruction execution result by the form of speech play, in order to user is not
In the case of the related content on the display screen checking terminal, know relevant reading screen function by sound
The implementation status of operation.
Concrete, as in figure 2 it is shown, in step S105: after performing described reading screen feature operation, above-mentioned side
Method also comprises the steps S106-step S108:
Step S106: obtain the described execution result reading screen feature operation；
Step S107: in described default speech database search with described read screen feature operation perform knot
The voice message message that fruit is corresponding；
Step S108: play described voice message message.
Read the execution result of screen feature operation to include and run succeeded, perform failure, and run succeeded and also wrap
Include the specific instruction result of this reading screen function command, such as, have selected certain space of current display interface
Or the information such as picture, further for example, the position at Xu's center place moved in current display interface, then example
As, open a new operation pages etc..
Such as, when reading the operation pages that screen feature operation opens QQ music, voice message message is permissible
It is: QQ music is opened.The most such as, when read screen feature operation executions result corresponding be have selected ought
" deletion " button in front display interface, then voice message message may is that selected button " returns ".
In one embodiment, can determine in step S105 according to the particular content on the display interface of terminal
The performed particular content reading screen feature operation.
Concrete, above-mentioned steps S103: search the mesh mated with characteristic in default gesture database
Also include after the step of mark action/gesture: obtain the current display interface of terminal, obtain current display interface
Reading screen function check boxes；Further, step S104: determine the reading screen function behaviour corresponding with subject performance/gesture
The step made is particularly as follows: determine and subject performance/gesture pair according to the reading screen function check boxes of current display interface
The reading screen feature operation answered.
The related content that the current display interface of terminal is i.e. shown at the display interface of terminal.Read screen function to choose
Frame is check boxes corresponding with reading screen application on display interface, in general, on the display interface of terminal
The quantity reading screen function check boxes is one, and reading screen function check boxes can a corresponding button, it is also possible to right
Answer an icon or a control or passage or a link etc..
It should be noted that in the present embodiment, if read screen function check boxes corresponding be one exercisable
Button, then the operation for this reading screen function check boxes include but not limited to click enter, mobile check boxes,
Return upper level catalogue etc.；If read screen function check boxes corresponding be one section of inoperable word, then for
The operation of this reading screen function check boxes can be mobile check boxes, but can not be click on the operations such as entrance.Therefore,
For reading, screen particular content corresponding to function check boxes is different, and operational order corresponding to subject performance/gesture also can
Change therewith.
Concrete, according to the reading screen function check boxes of current display interface, determine corresponding with subject performance/gesture
Reading screen feature operation, and in step S105, perform this reading screen feature operation.
In another embodiment, the particular content of above-mentioned reading screen feature operation by read screen should be for determining.Tool
Body, above-mentioned steps S104: determine the reading screen feature operation corresponding with described subject performance/gesture particularly as follows:
Subject performance/gesture is sent to read screen application, and described reading shields application for existing according to described subject performance/gesture
The described default reading screen function that in screen feature operation data base, lookup is mated with described subject performance/gesture of reading is grasped
Make.
It is to say, after finding subject performance/gesture in step s 103, by this subject performance/gesture
It is sent to read screen application, reads screen and apply after receiving this subject performance/gesture, according to this subject performance/hands
Gesture is in the reading screen feature operation data base reading screen application, according between operating gesture and reading screen feature operation
Corresponding relation, searches the reading screen feature operation corresponding with subject performance/gesture.Master is noted that in this reality
Executing in example, reading screen feature operation corresponding to subject performance/gesture is unique, and if not finding correspondence
Read screen feature operation, then corresponding subject performance/gesture is judged to invalid operation gesture.I.e. answer for reading to shield
Being used for saying, the present embodiment disclosure of that is not required to change the result reading screen application itself, it is only necessary to one
The interface that the subject performance of individual correspondence/gesture receives, connecing of the related data inputted by wearable device
Receive and extract and all can have been applied by other.
In one embodiment, reading screen feature operation is that voice applications opens operation；Above-mentioned steps S105: hold
Row reads to shield the step of feature operation particularly as follows: open operation according to voice applications and start and voice applications unlatching behaviour
Make corresponding voice applications.
It is to say, user can pre-set the unlocking condition of voice applications, i.e. open behaviour with voice applications
The characteristic making corresponding subject performance/gesture and the motor performance corresponding with subject performance/gesture should
The requirement met, or the feature of subject performance/gesture corresponding to operation and motor performance is opened with voice applications
Corresponding relation between data；So that user all can directly open voice applications at arbitrary interface,
From the point of view of this is for the disability personnel of visual disorder, the voice applications using frequency the highest can be opened more easily,
Improve the convenience of operation.
In the present embodiment, as in figure 2 it is shown, in the above-mentioned methods, optional step also includes: in step
S101: also include step before receiving the motion trace data of the motor performance that the wearable device connected sends
Rapid S100: the reading screen application open command of reception user's input, reads screen application open command right with reading screen application
Should, read screen application according to reading screen application open command startup.
Read the application open command that screen application is corresponding of reading that screen application open command is and installs in terminal, right
From the point of view of the disability personnel of visual disorder, the first step of mobile phone is used to be accomplished by opening reading screen application, by mobile phone
It is provided with reading screen pattern to facilitate use.User can pre-set read screen application open command concrete operations or
Person's system can also carry out the setting being correlated with, and such as, adopting consecutive click chemical reaction Home key 3 times, when terminal detects
During the reading screen application open command that user inputs, start according to the reading screen application open command detected to read to shield and answer
With, it is set to terminal read screen pattern.
Optionally, in one embodiment, it is also possible to the motor performance every time inputted according to user is to data base
Correct, say, that the motor performance every time inputted according to user and the input habit of user, set up
Personalized motion/the gesture database corresponding with user so that user during upper once input operation,
Comparison with sample database is the quickest and accurate.
Concrete, as it is shown on figure 3, search and described feature in default action/gesture database described
After the step of the subject performance/gesture of Data Matching, said method also comprises the steps:
Step S2011: obtain the feedback information for described subject performance/gesture of user's input；
Or
Step S2012: obtain described characteristic and described subject performance/gesture mates reference value, according to
Described coupling reference value generates the feedback information for described subject performance/gesture；
Step S202: determine the more new data of described default action/gesture database according to described feedback information；
Step S203: according to the action/gesture database preset described in described renewal Refresh Data.
Feedback information includes the lookup result of subject performance/gesture and does not meets when user expects user accordingly
Feedback page input feedback information, further comprises user input motor performance concrete operating parameter with
User's input habit of determining of matching degree between sample parameter in the action/gesture database preset anti-
Feedforward information, say, that feedback information can be user's manual feedback, it is also possible to terminal is according to user's
Operating habit determines.
After feedback information gets, according to the particular content of feedback information, to default action/gesture number
It is modified according to the corresponding relation between the sample parameter in storehouse and sample parameter and operating parameter, then
Update action/gesture database, in order to action/gesture database that user uses when inputting corresponding operating next time
For the data base after updating.
Additionally, be that the mode of operation of the terminal units such as the smart mobile phone in solution conventional art is for visual disorder
Disabled from the point of view of there is the technical problem that the convenience of operation is not enough, in one embodiment, it is also proposed that
A kind of reading screen application instruction inputting device based on wearable device, as shown in Figure 4, said apparatus includes
Motion trace data receiver module 101, characteristic acquisition module 102, subject performance/gesture searches module
103 and operation determine execution module 104.
Concrete, motion trace data receiver module 101, for receiving what the wearable device connected sent
The motion trace data of motor performance, motor performance is the wearable device input that user passes through to have connected.
Wearable device described in the embodiment of the present invention can be intelligent watch, Intelligent bracelet, intelligent earphone
Etc. being easy to the equipment that user wears, do not limit at this.It should be noted that in the present embodiment, can wear
Wear between equipment and terminal and can be attached and set up correspondence by bluetooth, WIFI, the mode such as wired,
It is to say, after setting up communication connection relation between wearable device and terminal, terminal sets with wearable
Transmission and the reception of data can be realized between Bei.
This wearable device is mounted with motion sensor, for detecting and obtain the fortune of this wearable device
Dynamic operation, such as, motion sensor is acceleration transducer and/or gyroscope, and acceleration transducer is permissible
Detecting axial line movement, gyroscope can detect rotational angular velocity when deflection, inclination.Such as, may be used
Wearable device acceleration information on tri-directions of X, Y, Z is detected by 3-axis acceleration sensor,
And by integration, the acceleration information on tri-directions of X, Y, Z is converted into instantaneous velocity, and general i.e. speed per hour
Degree integration on a timeline makees the movement locus on X, Y, Z, then by the movement locus on three directions
It is superimposed, obtains the movement locus figure of wearable device.
It is to say, user can be operated by wearable device input motion, and obtain this motor performance
Motion trace data, by with the communication connection relation between terminal by the movement locus of corresponding motor performance
Data are sent to the motion trace data receiver module 101 of terminal.It should be noted that in the present embodiment,
The operations such as user includes singly being not limited to rocking by the motor performance that wearable device inputs, curve, slip.
Characteristic acquisition module 102, for obtaining the characteristic of motion trace data.
When movement locus is mated with the movement locus preset or parameter preset etc., it is by fortune
The characteristic of dynamic track is compared, so, in the present embodiment, receive mould in motion trace data
Block 101 receives the motion rail of motor performance that the user that wearable device sends is inputted by wearable device
After mark data, need this motion trace data is analyzed, and by characteristic acquisition module 102
Extract the characteristic in this motion trace data.
Such as, characteristic acquisition module 102 extracts the information of the characteristic point of predetermined number in this movement locus,
In the present embodiment, characteristic point is to limit the point of motion characteristic in motor performance, and this feature point can reflect
The shape facility of movement locus.In other embodiments, features described above data can be movement locus amplitude or
The formation duration of person's movement locus.
Subject performance/gesture searches module 103, for searching and characteristic in default gesture database
Subject performance/the gesture of coupling.
In the present embodiment, read screen apply discernible action/gesture to include but not limited to left to draw, right draw, on
Lower slider, double-clicking, click, user can be arranged as required to multiple action/gesture, the most double refers to scaling.
Action/gesture database is the operational motion/gesture reading to preset in screen application, say, that when target is moved
Work/action/gesture lookup module 103 detects and mates with the operational motion/gesture in action/gesture database
During operational motion/gesture, this operational motion/gesture can be judged to effective action/gesture, otherwise be judged to nothing
Effect operational motion/gesture.
In the present embodiment, need to preset operational motion/gesture in action/gesture database with by wearing
Wear the corresponding relation between the motor performance of equipment input, namely the operation in setting action/gesture database is moved
Between work/gesture and the motion trace data characteristic of correspondence data of motor performance inputted by wearable device
Corresponding relation.After above-mentioned corresponding relation is set up, subject performance/gesture searches module 103 can be by being somebody's turn to do
Corresponding relation searches the subject performance/gesture corresponding with characteristic in default action/gesture database, i.e.
Subject performance/gesture that the motor performance that inputted by wearable device with user is corresponding.
It should be noted that in the present embodiment, the matching relationship in subject performance/gesture with characteristic is
Determine according to characteristic, such as, when characteristic is characteristic point information, above-mentioned matching relationship is permissible
Characteristic point on the desired guiding trajectory corresponding with subject performance/gesture with the characteristic point in motion trace data
Degree of joining exceedes preset value, in other embodiments, characteristic be the amplitude of movement locus, length, time
During the information such as length, above-mentioned matching relationship can also is that the parameters such as the amplitude of movement locus, length, duration meet
The preset value corresponding with subject performance/gesture.
Operation determines execution module 104, for determining the reading screen feature operation corresponding with subject performance/gesture,
Perform to read screen feature operation.
In implementing, in reading screen application, each operating gesture is all corresponding, and a concrete operation refers to
Order, for example, it is possible to the buttons/areas choosing place, touch point corresponding to " clicking " is set and play and this button/
The speech message that region is corresponding, it is also possible to " double-click " correspondence is set and opens link/page that current check boxes is corresponding.
In the present embodiment, the reading screen feature operation that subject performance/gesture is corresponding includes but not limited to open reading screen
Apply, open certain page, change the position etc. reading screen check boxes.Further, subject performance/gesture is corresponding
Read screen feature operation to be determined according to default corresponding relation, such as, when input in step S101
When motor performance is for rocking twice, corresponding subject performance/gesture can be to dub twice, corresponding reading screen merit
The page/the link corresponding for opening current reading screen check boxes can be operated.
Optionally, in one embodiment, as shown in Figure 4, said apparatus further comprises display interface acquisition
Module 105, for obtaining the current display interface of terminal, obtains the reading screen function choosing of described current display interface
Center；Operation determines that execution module 104 is additionally operable to the reading screen function check boxes according to described current display interface
Determine the reading screen feature operation corresponding with described subject performance/gesture.
The related content that the current display interface of terminal is i.e. shown at the display interface of terminal.Read screen function to choose
Frame is check boxes corresponding with reading screen application on display interface, in general, on the display interface of terminal
The quantity reading screen function check boxes is one, and reading screen function check boxes can a corresponding button, it is also possible to right
Answer an icon or a control or passage or a link etc..
It should be noted that in the present embodiment, if read screen function check boxes corresponding be one exercisable
Button, then the operation for this reading screen function check boxes include but not limited to click enter, mobile check boxes,
Return upper level catalogue etc.；If read screen function check boxes corresponding be one section of inoperable word, then for
The operation of this reading screen function check boxes can be mobile check boxes, but can not be click on the operations such as entrance.Therefore,
For reading, screen particular content corresponding to function check boxes is different, and operational order corresponding to subject performance/gesture also can
Change therewith.
Concrete, according to the reading screen function check boxes of current display interface, operation determines that execution module 104 is true
The fixed reading screen feature operation corresponding with subject performance/gesture, and perform this reading screen feature operation.
In another embodiment, the particular content of above-mentioned reading screen feature operation by read screen should be for determining.Tool
Body, described operation determines that execution module 104 is additionally operable to: described subject performance/gesture is sent to read screen should
With, described reading screen application is used for according to described subject performance/gesture in described default reading screen feature operation data
Storehouse is searched the reading screen feature operation mated with described subject performance/gesture.
It is to say, after subject performance/gesture lookup module 103 finds subject performance/gesture, operation
Determining that this subject performance/gesture is sent to read screen application by execution module 104, reading screen is applied and is being received this mesh
After mark action/gesture, according to this subject performance/gesture in the reading screen feature operation data base reading screen application,
According to the corresponding relation between operating gesture and reading screen feature operation, search the reading corresponding with subject performance/gesture
Screen feature operation.It should be noted that in the present embodiment, the reading screen function behaviour that subject performance/gesture is corresponding
Work is unique, and if operating the reading screen feature operation determining that execution module 104 does not find correspondence, then
Corresponding subject performance/gesture is judged to invalid operation gesture.I.e. should be used for saying for reading screen, the present embodiment
Disclosure of that is not required to change the result reading screen application itself, it is only necessary to and corresponding subject performance/
The interface that gesture receives, reception and the extraction of the related data inputted by wearable device all can be by them
He has applied.
Optionally, in one embodiment, above-mentioned reading screen feature operation is that voice applications opens operation；Operation
Determine that execution module 104 is additionally operable to: open operation startup according to described voice applications and open with described voice applications
Open the voice applications that operation is corresponding.
It is to say, user can pre-set the unlocking condition of voice applications, i.e. open behaviour with voice applications
The characteristic making corresponding subject performance/gesture and the motor performance corresponding with subject performance/gesture should
The requirement met, or the feature of subject performance/gesture corresponding to operation and motor performance is opened with voice applications
Corresponding relation between data；So that user all can directly open voice applications at arbitrary interface,
From the point of view of this is for the disability personnel of visual disorder, the voice applications using frequency the highest can be opened more easily,
Improve the convenience of operation.
Optionally, in one embodiment, as shown in Figure 4, said apparatus also includes that reading screen application opens mould
Block 106, for receiving the reading screen application open command of user's input, described reading screen application open command is with described
Read screen application correspondence, start described reading according to described reading screen application open command and shield application.
Read the application open command that screen application is corresponding of reading that screen application open command is and installs in terminal, right
From the point of view of the disability personnel of visual disorder, the first step of mobile phone is used to be accomplished by opening reading screen application, by mobile phone
It is provided with reading screen pattern to facilitate use.User can pre-set read screen application open command concrete operations or
Person's system can also carry out the setting being correlated with, such as, adopting consecutive click chemical reaction Home key 3 times, opens when reading screen application
Opening module 106 when the reading screen application open command that user inputs being detected, the reading screen application according to detecting is opened
Open instruction and start reading screen application, read screen and apply opening module 106 to be set to terminal read screen pattern.
Optionally, in one embodiment, determine that execution module 104 performs described reading screen function behaviour in operation
After work, for reading to shield the execution result of feature operation, user can also be known by the form of speech play
Relevant instruction execution result, in order to user is in the feelings of the related content need not checked on the display screen of terminal
Under condition, know the relevant implementation status reading screen feature operation by sound.
Concrete, as shown in Figure 4, described device also includes voice message message playback module 107, is used for:
Obtain the described execution result reading screen feature operation；Described default speech database is searched and described reading
Shield the voice message message that the execution result of feature operation is corresponding；Play described voice message message.
Read the execution result of screen feature operation to include and run succeeded, perform failure, and run succeeded and also wrap
Include the specific instruction result of this reading screen function command, such as, have selected certain space of current display interface
Or the information such as picture, further for example, the position at Xu's center place moved in current display interface, then example
As, open a new operation pages etc..
Such as, when reading the operation pages that screen feature operation opens QQ music, voice message message is play
The voice message message that module 107 is play may is that QQ music is opened.The most such as, when reading screen function
Operation execution result corresponding be to have selected " deletion " button in current display interface, voice message message is broadcast
The voice message message that amplification module 107 is play may is that selected button " returns ".
Optionally, in one embodiment, it is also possible to the motor performance every time inputted according to user is to data base
Correct, say, that the motor performance every time inputted according to user and the input habit of user, set up
Personalized motion/the gesture database corresponding with user so that user during upper once input operation,
Comparison with sample database is the quickest and accurate.
Concrete, as shown in Figure 4, described device also includes feedback information acquisition module 108 and data base more
New module 109, wherein: described feedback information acquisition module 108 is used for: obtain user input for described
The feedback information of subject performance/gesture；Or obtain described characteristic and described subject performance/gesture mate ginseng
Examine value, generate the feedback information for described subject performance/gesture according to described coupling reference value；Described data
Storehouse more new module 109 is used for: determine described default action/gesture database more according to described feedback information
New data；According to the action/gesture database preset described in described renewal Refresh Data.
Feedback information includes the lookup result of subject performance/gesture and does not meets user when expecting, feedback information obtains
The feedback information that the user that delivery block 108 obtains inputs in corresponding feedback page, further comprises feedback information
The concrete operating parameter of the motor performance of user's input that acquisition module 108 obtains and the action/gesture preset
The feedback information of user's input habit that the matching degree between sample parameter in data base determines, namely
Saying, the feedback information that feedback information acquisition module 108 obtains can be user's manual feedback, it is also possible to eventually
End determines according to the operating habit of user.
After feedback information acquisition module 108 gets feedback information, according to the particular content of feedback information,
Database update module 109 to the sample parameter in default action/gesture database and sample parameter with
Corresponding relation between operating parameter is modified, then update action/gesture database, in order to use next time
Action/the gesture database used during the input corresponding operating of family is the data base after updating.
Implement the embodiment of the present invention, will have the advantages that
After have employed above-mentioned reading screen application instruction input method based on wearable device and device, Yong Huke
With by wearable device is rocked, the motor performance such as trace, then relevant by this motor performance
Data are sent to terminal by the communication connection between terminal and wearable device, and terminal is according to the number received
According to determining that user needs the operational order corresponding with reading screen application of input to complete to read the input of the instruction of screen application
And performed by reading screen software device that corresponding operational order is sent to computer corresponding, it is achieved that logical
Crossing wearable device applies input instruction and reading screen software by the output of operational order to the reading screen of terminal, compares
From the point of view of in conventional art, user must input the scheme of instruction by the physical button of terminal or touch screen, can
Improve the operation ease of instruction input；Further, such scheme also achieves at user's not handheld terminal
In the case of the most operable terminal, to read screen application send instruction carry out associative operation, further improve
User uses the operation ease reading screen application；In particular for there is certain handicapped crowd (such as
The specific groups such as the disability personnel of visual disorder, old people) from the point of view of, the raising of its operation ease is the brightest
Aobvious.
In one embodiment, as it is shown in figure 5, Fig. 3 illustrate a kind of run above-mentioned based on wearable device
The terminal of computer system based on von Neumann system reading screen application instruction input method.This computer
System can be connected with wearable device smart mobile phone, panel computer, palm PC, notebook computer
Or the terminal unit such as PC.Concrete, it may include the outer input interface 1001 that connected by system bus,
Processor 1002, memorizer 1003 and output interface 1004.Wherein, outer input interface 1001 is optional
Can at least include network interface 10012.Memorizer 1003 can include external memory 10032 (such as hard disk,
CD or floppy disk etc.) and built-in storage 10034.Output interface 1004 can at least include display screen 10042 etc.
Equipment.
In the present embodiment, the operation of this method is based on computer program, the program file of this computer program
Be stored in the external memory 10032 of aforementioned computer system based on von Neumann system, operationally by
It is loaded in built-in storage 10034, is transferred to after being then compiled as machine code in processor 1002 perform,
So that computer system based on von Neumann system forms motion trace data in logic receive mould
Block 101, characteristic acquisition module 102, subject performance/gesture searches module 103 and operation determines execution
Module 104.And during above-mentioned reading screen application instruction input method based on wearable device performs, input
Parameter all received by outer input interface 1001, and be transferred in memorizer 1003 caching, the most defeated
Enter and process in processor 1002, after the result data of process or be cached in is carried out in memorizer 1003
Process continuously, or be passed to output interface 1004 and export.
Above disclosed be only present pre-ferred embodiments, certainly can not with this limit the present invention it
Interest field, the equivalent variations therefore made according to the claims in the present invention, still belong to the scope that the present invention is contained.
Claims (14)
1. a reading screen application instruction input method based on wearable device, it is characterised in that including:
Receive the motion trace data of the motor performance that the wearable device connected sends, described motor performance
It it is the wearable device input connected described in user passes through；
Obtain the characteristic of described motion trace data；
Subject performance/the gesture mated with described characteristic is searched in default action/gesture database；
Determine the reading screen feature operation corresponding with described subject performance/gesture, perform described reading and shield feature operation.
Method the most according to claim 1, it is characterised in that described execution is described reads screen feature operation
Step after also include:
Obtain the described execution result reading screen feature operation；
The language corresponding with the execution result of described reading screen feature operation is searched in described default speech database
Sound prompting message；
Play described voice message message.
Method the most according to claim 1, it is characterised in that described in default gesture database
Also include after searching the step of the subject performance/gesture mated with described characteristic:
Obtain the current display interface of terminal, obtain the reading screen function check boxes of described current display interface；
Described determine corresponding with the described subject performance/gesture step reading screen feature operation particularly as follows:
Screen function check boxes of reading according to described current display interface determines corresponding with described subject performance/gesture
Read screen feature operation.
Method the most according to claim 1, it is characterised in that described reading screen feature operation is that audio frequency should
With opening operation；
Described execution described read screen feature operation step particularly as follows:
Open operation according to described voice applications and start the voice applications corresponding with the unlatching operation of described voice applications.
Method the most according to claim 1, it is characterised in that described determine with described subject performance/
Gesture corresponding read screen feature operation step particularly as follows:
Described subject performance/gesture is sent to read screen application, and described reading shields application for moving according to described target
Work/gesture is searched in described default reading screen feature operation data base and is mated with described subject performance/gesture
Read screen feature operation.
Method the most according to claim 5, it is characterised in that what described reception had connected wearable sets
Also include before the step of the motion trace data of the motor performance that preparation is sent:
Receiving the reading screen application open command of user's input, described reading screen application open command should with described screen of reading
By correspondence, start described reading screen application according to described screen application open command of reading.
7. according to the arbitrary described method of claim 1 to 6, it is characterised in that described in default action
Also include after/gesture database is searched the step of the subject performance/gesture mated with described characteristic:
Obtain the feedback information for described subject performance/gesture of user's input；
Or
Obtain described characteristic and described subject performance/gesture mates reference value, according to described coupling reference
Value generates the feedback information for described subject performance/gesture；
Described method also includes:
The more new data of described default action/gesture database is determined according to described feedback information；
According to the action/gesture database preset described in described renewal Refresh Data.
8. a reading screen application instruction inputting device based on wearable device, it is characterised in that including:
Motion trace data receiver module, for receiving the motor performance of the wearable device transmission connected
Motion trace data, described motor performance is the wearable device input connected described in user passes through；
Characteristic acquisition module, for obtaining the characteristic of described motion trace data；
Subject performance/gesture searches module, for searching and described characteristic in default gesture database
Subject performance/the gesture of coupling；
Operation determines execution module, for determining the reading screen feature operation corresponding with described subject performance/gesture,
Perform described reading and shield feature operation.
Device the most according to claim 8, it is characterised in that described device also includes that voice message disappears
Breath playing module, is used for:
Obtain the described execution result reading screen feature operation；
The language corresponding with the execution result of described reading screen feature operation is searched in described default speech database
Sound prompting message；
Play described voice message message.
Device the most according to claim 8, it is characterised in that described device also includes display interface
Acquisition module, for obtaining the current display interface of terminal, obtains the reading screen function of described current display interface
Check boxes；
Described operation determines that the reading screen function check boxes that execution module is additionally operable to according to described current display interface is true
The fixed reading screen feature operation corresponding with described subject performance/gesture.
11. devices according to claim 8, it is characterised in that described reading screen feature operation is audio frequency
Operation is opened in application；
Described operation determines that execution module is additionally operable to: opens operation according to described voice applications and starts and described sound
The voice applications that operation is corresponding is opened in frequency application.
12. devices according to claim 8, it is characterised in that described operation determines execution module also
For: described subject performance/gesture is sent to read screen application, and described reading shields application for according to described target
Action/gesture is searched in described default reading screen feature operation data base and is mated with described subject performance/gesture
Reading screen feature operation.
13. devices according to claim 12, it is characterised in that described device also includes reading screen application
Opening module, for receive user input reading screen application open command, described reading screen application open command and
Correspondence applied by described screen of reading, and shields application according to described reading screen application described reading of open command startup.
14. according to Claim 8 to 13 arbitrary described devices, it is characterised in that described device also includes
Feedback information acquisition module and database update module, wherein:
Described feedback information acquisition module is used for:
Obtain the feedback information for described subject performance/gesture of user's input；
Or
Obtain described characteristic and described subject performance/gesture mates reference value, according to described coupling reference
Value generates the feedback information for described subject performance/gesture；
Described database update module is used for:
The more new data of described default action/gesture database is determined according to described feedback information；
According to the action/gesture database preset described in described renewal Refresh Data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610313246.3A CN105843402A (en) | 2016-05-12 | 2016-05-12 | Screen reading application instruction input method and device based on wearable equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610313246.3A CN105843402A (en) | 2016-05-12 | 2016-05-12 | Screen reading application instruction input method and device based on wearable equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105843402A true CN105843402A (en) | 2016-08-10 |
Family
ID=56591869
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610313246.3A Pending CN105843402A (en) | 2016-05-12 | 2016-05-12 | Screen reading application instruction input method and device based on wearable equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105843402A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108269460A (en) * | 2018-01-04 | 2018-07-10 | 高大山 | A kind of reading method of electronic curtain, system and terminal device |
| CN108717271A (en) * | 2018-05-30 | 2018-10-30 | 辽东学院 | Man-machine interaction control method, device, system and readable storage medium storing program for executing |
| CN111930227A (en) * | 2020-07-02 | 2020-11-13 | 安徽华米智能科技有限公司 | Method and device for automatically switching NFC card of wearable device and wearable device |
| WO2024001828A1 (en) * | 2022-06-29 | 2024-01-04 | 华为技术有限公司 | Wrist-worn-device control method and related system, and storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101741952A (en) * | 2009-12-10 | 2010-06-16 | 中国科学技术大学 | Mobile phone interactive system for the blind and its device |
| CN102810023A (en) * | 2011-06-03 | 2012-12-05 | 联想(北京)有限公司 | Gesture recognition method and terminal equipment |
| CN103092517A (en) * | 2013-01-22 | 2013-05-08 | 广东欧珀移动通信有限公司 | A method and device for quickly opening a preset program through gesture operation |
| CN103226386A (en) * | 2013-03-13 | 2013-07-31 | 广东欧珀移动通信有限公司 | A gesture recognition method and system based on a mobile terminal |
| CN103593056A (en) * | 2013-11-26 | 2014-02-19 | 青岛海信电器股份有限公司 | Gesture data recognizing and processing method, television and gesture input device |
| CN103809735A (en) * | 2012-11-12 | 2014-05-21 | 腾讯科技（深圳）有限公司 | Gesture recognition method and gesture recognition device |
| US20150020035A1 (en) * | 2012-04-06 | 2015-01-15 | Uc Mobile Limited | Method, apparatus and mobile terminal for controlling an application interface by means of a gesture |
| CN104360738A (en) * | 2014-11-06 | 2015-02-18 | 苏州触达信息技术有限公司 | Space gesture control method for graphical user interface |
-
2016
- 2016-05-12 CN CN201610313246.3A patent/CN105843402A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101741952A (en) * | 2009-12-10 | 2010-06-16 | 中国科学技术大学 | Mobile phone interactive system for the blind and its device |
| CN102810023A (en) * | 2011-06-03 | 2012-12-05 | 联想(北京)有限公司 | Gesture recognition method and terminal equipment |
| US20150020035A1 (en) * | 2012-04-06 | 2015-01-15 | Uc Mobile Limited | Method, apparatus and mobile terminal for controlling an application interface by means of a gesture |
| CN103809735A (en) * | 2012-11-12 | 2014-05-21 | 腾讯科技（深圳）有限公司 | Gesture recognition method and gesture recognition device |
| CN103092517A (en) * | 2013-01-22 | 2013-05-08 | 广东欧珀移动通信有限公司 | A method and device for quickly opening a preset program through gesture operation |
| CN103226386A (en) * | 2013-03-13 | 2013-07-31 | 广东欧珀移动通信有限公司 | A gesture recognition method and system based on a mobile terminal |
| CN103593056A (en) * | 2013-11-26 | 2014-02-19 | 青岛海信电器股份有限公司 | Gesture data recognizing and processing method, television and gesture input device |
| CN104360738A (en) * | 2014-11-06 | 2015-02-18 | 苏州触达信息技术有限公司 | Space gesture control method for graphical user interface |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108269460A (en) * | 2018-01-04 | 2018-07-10 | 高大山 | A kind of reading method of electronic curtain, system and terminal device |
| CN108269460B (en) * | 2018-01-04 | 2020-05-08 | 高大山 | Electronic screen reading method and system and terminal equipment |
| CN108717271A (en) * | 2018-05-30 | 2018-10-30 | 辽东学院 | Man-machine interaction control method, device, system and readable storage medium storing program for executing |
| CN111930227A (en) * | 2020-07-02 | 2020-11-13 | 安徽华米智能科技有限公司 | Method and device for automatically switching NFC card of wearable device and wearable device |
| WO2024001828A1 (en) * | 2022-06-29 | 2024-01-04 | 华为技术有限公司 | Wrist-worn-device control method and related system, and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20240303268A1 (en) | Intelligent automated assistant for media exploration | |
| US11500672B2 (en) | Distributed personal assistant | |
| DK180326B8 (en) | User activity shortcut suggestions | |
| EP4057128A1 (en) | Continuous dialog with a digital assistant | |
| US20250078835A1 (en) | Voice assistant discoverability through on-device targeting and personalization | |
| EP3701520B1 (en) | Multi-turn canned dialog | |
| US10282416B2 (en) | Unified framework for text conversion and prediction | |
| DK179760B1 (en) | Intelligent automatiseret assistent til udforskning af medier | |
| US20200380973A1 (en) | Voice assistant discoverability through on-device targeting and personalization | |
| US20190371315A1 (en) | Virtual assistant operation in multi-device environments | |
| CN106133748B (en) | Device, method and graphical user interface for manipulating a user interface based on fingerprint sensor input | |
| EP4538836A2 (en) | Multi-modal interfaces | |
| EP3443556A1 (en) | Detecting a trigger of a digital assistant | |
| CN107329743A (en) | Methods of exhibiting, device and the storage medium of five application page | |
| CN105788597A (en) | Voice recognition-based screen reading application instruction input method and device | |
| CN107967055A (en) | A kind of man-machine interaction method, terminal and computer-readable medium | |
| AU2020313970B2 (en) | Health event logging and coaching user interfaces | |
| CN107111415B (en) | Equipment, method and graphic user interface for mobile application interface element | |
| CN105843402A (en) | Screen reading application instruction input method and device based on wearable equipment | |
| CN105653134A (en) | An application switching method and a system thereof | |
| US20220116399A1 (en) | Media service configuration | |
| CN105824429A (en) | Screen reading application instruction input method and device based on infrared sensor | |
| CN105446489B (en) | Voice Dual-mode control method, device and user terminal | |
| CN105867641A (en) | Screen reading application instruction input method and device based on brain waves | |
| KR20160016545A (en) | Method for Providing Information and Device thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160810 |