CN106033286A - Virtual touch interaction method and device based on projection display and robot - Google Patents
Virtual touch interaction method and device based on projection display and robot Download PDFInfo
- Publication number
- CN106033286A CN106033286A CN201510100189.6A CN201510100189A CN106033286A CN 106033286 A CN106033286 A CN 106033286A CN 201510100189 A CN201510100189 A CN 201510100189A CN 106033286 A CN106033286 A CN 106033286A
- Authority
- CN
- China
- Prior art keywords
- projection
- module
- indicant
- menu
- virtual touch
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 19
- 230000003993 interaction Effects 0.000 title abstract description 5
- 238000012545 processing Methods 0.000 claims abstract description 16
- 230000002452 interceptive effect Effects 0.000 claims description 14
- 238000004458 analytical method Methods 0.000 claims description 4
- 238000010411 cooking Methods 0.000 claims description 3
- 238000012790 confirmation Methods 0.000 claims description 2
- 230000008569 process Effects 0.000 abstract description 5
- 238000005516 engineering process Methods 0.000 description 3
- 230000003321 amplification Effects 0.000 description 2
- 238000003199 nucleic acid amplification method Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000035800 maturation Effects 0.000 description 1
- 230000004899 motility Effects 0.000 description 1
- 230000005693 optoelectronics Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
Landscapes
- Position Input By Displaying (AREA)
Abstract
The invention relates to a virtual touch interaction method, a virtual touch interaction device and a robot based on projection display, wherein a microcontroller, a data processing module, a projection menu display module and an image acquisition module are arranged; the projection control device is operated according to the position information in the target equipment, so that the equipment is operated in a virtual touch mode, the physical space is saved, and the rapidness and the flexibility of the equipment operation are improved; whether the indicating object is touched or not is judged according to the shadow state of the indicating object in the image identification process, so that the identification and control accuracy is improved, and the probability of misoperation is reduced.
Description
Technical field
The present invention relates to virtual technical field of touch control, specifically, relate to virtual touch-control exchange method based on Projection Display, device and robot.
Background technology
The convenient, fast of man-machine interaction increasingly focused on by current electronic equipment, and the input equipment keyboard of traditional computer carries out word input.The keyboard of entity occupies physical space greatly, the maturation of wireless technology makes Wireless Keyboard become possibility, Wireless Keyboard brings more free space and operation comfort to computer operator, but the keyboard of Wireless Keyboard entity to be used, the appearance of the touch screen technology of latest development makes the keyboard breaking away from entity become possibility, the input of word is carried out with the simulation soft keyboard in display screen, the direct touch-control to display screen is utilized to realize controlling the content in computer display screen is operated, such as, bank queuing machine, cash dispenser, smart mobile phone, panel computer etc., above-mentioned is all by operating the equipment of entity to realize controlling the operation to computer.
Above-mentioned few physical button product is attractive in appearance with appearance exquisiteness, and operation is succinct convenient and is substantially pursued by market, but, it is limited by the restriction of touch screen size, in some occasions, slightly shows narrow in the operation of entity touch screen enterprising pedestrian machine interactive touch-control, underaction.
Based on above reason, this is to propose a kind of new man machine interface interactive mode scheme, designs a kind of projection type virtual touch menu and controls device, is widely portable to multiple occasion, install, carry simple and convenient, swift to operate, accuracy rate is high, substantially increases Consumer's Experience.
Summary of the invention
The present invention proposes virtual touch-control exchange method based on Projection Display, device and robot, is operated equipment by virtual touch way for realization, and its concrete technical scheme is as follows:
A kind of virtual touch-control exchange method based on Projection Display, the method includes:
The graphical analysis that equipment projects on specific interface is touched according to the indicant received, identify that indicant Yes/No carries out the operating state of touching operation, and the positional information of touching, and determine the positional information in the target device of correspondence according to described positional information and then run menu instructions.
Further, also include the image recognition according to the shadow state to indicant, determine the method that indicant Yes/No carries out touching operation；I.e. according to the different images feature of shade produced by indicant vacant state, touching state, its Yes/No is carried out touch operation to be identified.
A kind of virtual touch-control interactive device based on Projection Display, this device includes:
Microcontroller, data processing module, projection module, projection menu display module, image capture module, described projection module, projection menu display module, image capture module be connected with microcontroller respectively, wherein,
Described projection module, is controlled by microcontroller, for projecting the menu of target device to interface surface；
Projection menu display module, for producing the light of interface menu；
Image capture module, touches the image of target device projection in interface surface for gathering indicant, and transmits to data processing module；
Data processing module touches location of projection for indicant Yes/No carries out touching operation being identified, determine indicant, and determines the positional information of the target device menu of correspondence according to described positional information, and transmits to microcontroller；
Microcontroller, described microcontroller is connected with described keyboard projecting cell, image acquisition units, data processing unit respectively, for coordinating and control the operation of described touch-control system.
Comprise the virtual touch-control Self-help ordering machine people of the virtual touch-control interactive device of Projection Display,
Further, projection module, projection menu display module, image capture module are arranged in robot palm, and projection interface is desktop.
Further, the menu of described target device comprise the style of cooking select, be discussed in detail, page turning, confirmation option.
Virtual touch-control exchange method based on Projection Display provided by the present invention, device and robot, have the advantage that
Touch target device projection picture in interface surface according to the indicant received and determine the positional information that indicant is touched, and determine the positional information in the target device of correspondence according to the location of projection information of indicant touching；Operate according to the positional information projection control in target device, thus realize by virtual touch way, equipment being operated, save physical space, improve the agility also motility of equipment operation；In image recognition processes, the shadow state according to indicant judges that indicant Yes/No carries out touching operation, improves the accuracy identifying with controlling, reduces the probability that maloperation occurs.
Accompanying drawing explanation
Fig. 1 is the structure meaning block diagram of the present invention virtual touch-control interactive device based on Projection Display；
Fig. 2,3 be in the embodiment of the present invention 1 the indicant Yes/No of virtual touch-control interactive device based on Projection Display carry out touch operation chart；
Fig. 4 is the structural representation of the Self-help ordering machine people in the embodiment of the present invention 2 containing virtual touch-control interactive device based on Projection Display.
Detailed description of the invention
Below in conjunction with the accompanying drawings and embodiment virtual touch-control exchange method based on Projection Display to the present invention, device and robot are described in further detail.
With reference to a kind of virtual touch-control interactive device based on Projection Display of Fig. 1, this device includes: microcontroller, data processing module, projection module, projection menu display module, image capture module, described projection module, projection menu display module, image capture module are connected with microcontroller respectively, wherein, described projection module, it is controlled by microcontroller, for projecting the menu of target device to interface surface；Projection menu display module, for producing the light of interface menu；Image capture module, touches the image of target device projection in interface surface for gathering indicant, and transmits to data processing module；Data processing module touches location of projection for indicant Yes/No carries out touching operation being identified, determine indicant, and determines the positional information of the target device menu of correspondence according to described positional information, and transmits to microcontroller；Microcontroller, described microcontroller is connected with described keyboard projecting cell, image acquisition units, data processing unit respectively, for coordinating and control the operation of described touch-control system.
Embodiment 1, the interactive process of virtual touch-control interactive device based on Projection Display:
Target device human-computer interaction interface entity menu is incident upon specific interface with certain amplification by projection module, and indicant (such as finger) carries out touching operation in view field；
The whole virtual menu imagery zone of image capture module acquired projections includes the image of indicant, and transmits to data processing module；
Data processing module by signal through opto-electronic conversion be specific image encoding format data stream, carry out touching operation to identify, indicant state is divided into vacant state and touching state, there is different shadow state, as shown in Fig. 2 Yu Fig. 3, process computing module according to image aspects algorithm, indicant shade to be analyzed, identify that reminders Yes/No carries out touching operation；If it does not, proceed image acquisition analysis, extract corresponding to the position that indicant is touched on the virtual menu image being projected out in the position of equipment entity menu if it is, analyze, transmit a signal to microcontroller thus run the operation behavior of correspondence.
Embodiment 2, containing the Self-help ordering machine people of virtual touch-control interactive device based on Projection Display:
As shown in Figure 4, Self-help ordering machine people containing virtual touch-control interactive device based on Projection Display, equipment entity menu apparatus, projection module, projection menu display module, image capture module is arranged in robot palm, microcontroller, data processing module is arranged in robot fuselage, before robot walks to dining table to be serviced, visitor has when need to order dishes, robot stretches out palm, menu in palm is incident upon desktop with certain amplification by projection module, in the present embodiment, interface menu comprises the style of cooking and selects, it is discussed in detail, may select and comprise video, audio frequency introduction etc., and page turning, confirm option, user carries out selecting operation as required.Indicant state is divided into vacant state and touching state, has different shadow state, processes computing module and is analyzed indicant shade according to image aspects algorithm, identifies that reminders Yes/No carries out touching operation；If not, proceed image acquisition analysis, if, analyze and extract corresponding to the position that indicant is touched on the virtual menu image being projected out in the position of equipment entity menu, transmit a signal to microcontroller, the instruction of guest is sent the display device to kitchen by wire/wireless communication module by microcontroller, and service personal performs associative operation according to the behavior of ordering dishes of guest.
As described above, it is only presently preferred embodiments of the present invention, can not limit, with this, the scope that the present invention implements, the simple equivalence i.e. in every case made according to scope of the present invention patent and invention description content changes and modifies, the most still remaining within the scope of the patent.
Claims (6)
1. a virtual touch-control exchange method based on Projection Display, it is characterised in that the method includes:
The graphical analysis that equipment projects on specific interface is touched according to the indicant received, identify that indicant Yes/No carries out the operating state of touching operation, and the positional information of touching, and determine the positional information in the target device of correspondence according to described positional information and then run menu instructions.
A kind of virtual touch-control exchange method based on Projection Display, it is characterised in that: include the image recognition according to the shadow state to indicant, determine the method that indicant Yes/No carries out touching operation；I.e. according to the different images feature of shade produced by indicant vacant state, touching state, its Yes/No is carried out touch operation to be identified.
3. a virtual touch-control interactive device based on Projection Display, it is characterised in that this device includes:
Microcontroller, data processing module, projection module, projection menu display module, image capture module, described projection module, projection menu display module, image capture module be connected with microcontroller respectively, wherein,
Described projection module, is controlled by microcontroller, for projecting the menu of target device to interface surface；
Projection menu display module, for producing the light of interface menu；
Image capture module, touches the image of target device projection in interface surface for gathering indicant, and transmits to data processing module；
Data processing module touches location of projection for indicant Yes/No carries out touching operation being identified, determine indicant, and determines the positional information of the target device menu of correspondence according to described positional information, and transmits to microcontroller；
Microcontroller, described microcontroller is connected with described keyboard projecting cell, image acquisition units, data processing unit respectively, for coordinating and control the operation of described touch-control system.
4. a virtual touch-control Self-help ordering machine people, it is characterised in that: comprise virtual touch-control interactive device based on Projection Display as claimed in claim 3.
One the most according to claim 4 virtual touch-control Self-help ordering machine people, it is characterised in that: described projection module, projection menu display module, image capture module are arranged in robot palm, and projection interface is desktop.
One the most according to claim 4 virtual touch-control Self-help ordering machine people, it is characterised in that: the menu of described target device comprise the style of cooking select, be discussed in detail, page turning, confirmation option.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510100189.6A CN106033286A (en) | 2015-03-08 | 2015-03-08 | Virtual touch interaction method and device based on projection display and robot |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510100189.6A CN106033286A (en) | 2015-03-08 | 2015-03-08 | Virtual touch interaction method and device based on projection display and robot |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106033286A true CN106033286A (en) | 2016-10-19 |
Family
ID=57149903
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510100189.6A Pending CN106033286A (en) | 2015-03-08 | 2015-03-08 | Virtual touch interaction method and device based on projection display and robot |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106033286A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106713880A (en) * | 2016-12-02 | 2017-05-24 | 北京数科技有限公司 | Portable intelligent projection system |
| CN107067542A (en) * | 2016-12-16 | 2017-08-18 | 贵州中小乾信金融信息服务有限公司 | Finance and money management is serviced and analytical equipment |
| CN107943351A (en) * | 2017-11-22 | 2018-04-20 | 苏州佳世达光电有限公司 | Touch identifying system and method in perspective plane |
| CN109255733A (en) * | 2018-10-09 | 2019-01-22 | 深圳市三宝创新智能有限公司 | A kind of food and beverage sevice method, computer equipment, storage medium and robot |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030193479A1 (en) * | 2000-05-17 | 2003-10-16 | Dufaux Douglas Paul | Optical system for inputting pointer and character data into electronic equipment |
| TW201135558A (en) * | 2010-04-01 | 2011-10-16 | Compal Communication Inc | Projecting system with touch controllable projecting picture |
| US20120044208A1 (en) * | 2010-08-19 | 2012-02-23 | Hyundai Motor Company | Electronic Switch Apparatus for Vehicle |
| CN102945101A (en) * | 2012-10-10 | 2013-02-27 | 京东方科技集团股份有限公司 | Operation method for projection control device, projection control device and electronic equipment |
| CN103955316A (en) * | 2014-04-28 | 2014-07-30 | 清华大学 | Fingertip touch detection system and method |
-
2015
- 2015-03-08 CN CN201510100189.6A patent/CN106033286A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030193479A1 (en) * | 2000-05-17 | 2003-10-16 | Dufaux Douglas Paul | Optical system for inputting pointer and character data into electronic equipment |
| TW201135558A (en) * | 2010-04-01 | 2011-10-16 | Compal Communication Inc | Projecting system with touch controllable projecting picture |
| US20120044208A1 (en) * | 2010-08-19 | 2012-02-23 | Hyundai Motor Company | Electronic Switch Apparatus for Vehicle |
| CN102945101A (en) * | 2012-10-10 | 2013-02-27 | 京东方科技集团股份有限公司 | Operation method for projection control device, projection control device and electronic equipment |
| CN103955316A (en) * | 2014-04-28 | 2014-07-30 | 清华大学 | Fingertip touch detection system and method |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106713880A (en) * | 2016-12-02 | 2017-05-24 | 北京数科技有限公司 | Portable intelligent projection system |
| CN106713880B (en) * | 2016-12-02 | 2019-03-15 | 北京一数科技有限公司 | A kind of portable intelligent optical projection system |
| CN107067542A (en) * | 2016-12-16 | 2017-08-18 | 贵州中小乾信金融信息服务有限公司 | Finance and money management is serviced and analytical equipment |
| CN107943351A (en) * | 2017-11-22 | 2018-04-20 | 苏州佳世达光电有限公司 | Touch identifying system and method in perspective plane |
| CN109255733A (en) * | 2018-10-09 | 2019-01-22 | 深圳市三宝创新智能有限公司 | A kind of food and beverage sevice method, computer equipment, storage medium and robot |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN205485930U (en) | Input device and keyboard | |
| US7849421B2 (en) | Virtual mouse driving apparatus and method using two-handed gestures | |
| EP3754471B1 (en) | Method and portable terminal for providing a haptic effect | |
| KR101872426B1 (en) | Depth-based user interface gesture control | |
| WO2018076523A1 (en) | Gesture recognition method and apparatus, and in-vehicle system | |
| EP3693843B1 (en) | Method and apparatus for designating entire area using partial area touch in a portable equipment | |
| EP3002664B1 (en) | Text processing method and touchscreen device | |
| CN102262504A (en) | User interaction gestures with virtual keyboard | |
| US20150220150A1 (en) | Virtual touch user interface system and methods | |
| US20140300542A1 (en) | Portable device and method for providing non-contact interface | |
| US20140327611A1 (en) | Information processing apparatus and method, and program | |
| US20110280441A1 (en) | Projector and projection control method | |
| JPWO2014203301A1 (en) | Information display terminal | |
| KR20140019630A (en) | Method and system for tagging and searching additional information about image, apparatus and computer readable recording medium thereof | |
| CN103105930A (en) | Non-contact type intelligent inputting method based on video images and device using the same | |
| EP3423929A1 (en) | A method for inserting characters in a character string and a corresponding digital device. | |
| CN102880304A (en) | Character inputting method and device for portable device | |
| EP3039520B1 (en) | Display apparatus and ui providing method thereof | |
| US20150016726A1 (en) | Method and electronic device for processing handwritten object | |
| CN105242776A (en) | Control method for intelligent glasses and intelligent glasses | |
| CN106033286A (en) | Virtual touch interaction method and device based on projection display and robot | |
| CN105335086A (en) | Touch screen operation method and apparatus | |
| KR20150100332A (en) | Sketch retrieval system, user equipment, service equipment, service method and computer readable medium having computer program recorded therefor | |
| CN104007916B (en) | A kind of information processing method and electronic equipment | |
| CN105760092B (en) | A kind of application control method, apparatus and electronic equipment for touch panel device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20161019 |