CN100435075C - Touch projection screen system and its realization - Google Patents
Touch projection screen system and its realization Download PDFInfo
- Publication number
- CN100435075C CN100435075C CNB200510083833XA CN200510083833A CN100435075C CN 100435075 C CN100435075 C CN 100435075C CN B200510083833X A CNB200510083833X A CN B200510083833XA CN 200510083833 A CN200510083833 A CN 200510083833A CN 100435075 C CN100435075 C CN 100435075C
- Authority
- CN
- China
- Prior art keywords
- projection screen
- finger
- interface circuit
- computing machine
- vision sensor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034 method Methods 0.000 claims abstract description 33
- 230000004438 eyesight Effects 0.000 claims description 21
- 230000008569 process Effects 0.000 claims description 10
- 238000013528 artificial neural network Methods 0.000 claims description 9
- 238000011217 control strategy Methods 0.000 claims description 9
- 238000012545 processing Methods 0.000 claims description 9
- 238000004519 manufacturing process Methods 0.000 claims description 6
- 239000000463 material Substances 0.000 claims description 6
- 238000012216 screening Methods 0.000 claims description 6
- 230000005540 biological transmission Effects 0.000 claims description 4
- 239000002253 acid Substances 0.000 claims description 3
- 230000009471 action Effects 0.000 claims description 3
- 150000001336 alkenes Chemical class 0.000 claims description 3
- 238000004458 analytical method Methods 0.000 claims description 3
- 238000000605 extraction Methods 0.000 claims description 3
- 238000011478 gradient descent method Methods 0.000 claims description 3
- JRZJOMJEPLMPRA-UHFFFAOYSA-N olefin Natural products CCCCCCCC=C JRZJOMJEPLMPRA-UHFFFAOYSA-N 0.000 claims description 3
- 229920006389 polyphenyl polymer Polymers 0.000 claims description 3
- 230000009467 reduction Effects 0.000 claims description 3
- 238000012937 correction Methods 0.000 claims description 2
- 230000000007 visual effect Effects 0.000 abstract 2
- 238000005516 engineering process Methods 0.000 description 5
- 238000012549 training Methods 0.000 description 4
- 230000008859 change Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000011161 development Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 239000011521 glass Substances 0.000 description 2
- 230000008676 import Effects 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 230000008447 perception Effects 0.000 description 2
- 239000011324 bead Substances 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 238000003909 pattern recognition Methods 0.000 description 1
- 230000001915 proofreading effect Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000004304 visual acuity Effects 0.000 description 1
Images
Landscapes
- Position Input By Displaying (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
A touch type of projection screen system is featured as forming visual transducer by digital camera shooting tube and its interface circuit, digital signal processor and computer interface circuit; connecting digital camera shooting tube to its interface circuit being connected with digital signal processor as its output signal to be connected with computer; setting projection screen on transparent support body and setting visual transducer between projector and projection screen at height as the same height of projection screen; connecting projector and said transducer to computer. Its realizing method is also disclosed.
Description
Technical field
The present invention relates to a kind of rear projection screen, relate to a kind of touch rear projection screen system and its implementation especially.
Background technology
Along with movable frequent day by day such as commercial affairs, exhibitions, demonstration and audio-visual education programme, the large screen projection technology has become the multimedia show means of people's indispensability, in every field such as business office, scientific research, education and instruction, army's training, sector application, the widespread use of large screen projection equipment.
The sustainable development that constantly appears as the large screen projection technology of new technology provides possible condition, projector has developed into high brightness till now (more than 5000 lumens) and high resolving power (more than 1024 * 768) from early stage low-light level (below 800 lumens), the giant-screen material is also moulded curtain in vain from what the earliest white wall medium (gain 0.8) developed into gain 0.9, be that gain is about 2 a glass bead screen etc. afterwards, can reach 8 metal screen up to recent gain, still be that the development or the change of giant-screen material of projector all is in order to improve the image effect of projection screen system better.
But, screen prjection of the prior art system is mostly only just as unidirectional show media, can not carry out information inquiry so as touch-screen, function such as write, interactive performance is bad, especially in teleconference, when a plurality of people of different location need work by the computing machine of networking, has bigger limitation on same content; From another aspect, traditional touch screen technology comprises resistance-type, condenser type, ultrasonic type, four kinds of ways of realization of infrared type can not be accomplished bigger size and also very high to the environment for use requirement, the at present domestic touch-screen that also is not fit to the oversize rear projection screen usually.
Summary of the invention
The present invention promptly is a kind of touch rear projection screen system and its implementation that proposes at the present situation of above-mentioned prior art, this system can utilize vision sensor perception and identification finger or lip pencil thing on the back projection giant-screen the position and transfer it to computer instruction information, make projection screen have touch screen functionality.
For achieving the above object, the invention provides a kind of touch projection screen system, comprise: transparent supporting body, projection screen, projector, computing machine, this system also comprises vision sensor, described vision sensor comprises digital camera, utilizing camera interface circuit, digital signal processor, computer interface circuit, described digital camera links to each other with the utilizing camera interface circuit, described utilizing camera interface circuit also is connected with digital signal processor, and the output signal of described digital signal processor is connected with computing machine by the computer interface circuit; Described projection screen is installed on the transparent supporting body; Described vision sensor is arranged between projection screen and the projector, the same height of projection screen; Described vision sensor all is connected with computing machine with projector.
Described vision sensor can be arranged on the same height in the place ahead of projection screen; Described digital camera is more than one or one; Described projection screen is a polyphenyl olefin(e) acid material.
The present invention also provides a kind of implementation method based on above-mentioned touch projection screen system, and this method comprises the steps:
(1) starts correction;
(2) the projection screen unique point pick up, dimensionality reduction;
(3) EXPERT SYSTEM screening
(4) judge whether information meets definite condition;
(5) if having, neural network algorithm;
(6) judged whether finger position;
(7), carry out finger position and extract if having;
(8) finger position of extraction and the transmission information of vision sensor are compared;
(9) Computer Processing comparison information drives mouse action, controls.
The five point location methods of employing are proofreaied and correct in described startup, be specially: the cursor of computing machine successively from the upper left corner-upper right corner-screen intermediate point-lower left corner-lower right corner, when the cursor of computing machine during in each position, the user aims at cursor position on the screen with laser pen, continue some seconds, jump to the next position Deng cursor,, repeat as above to operate until all five points and all carry out in next position.
Described expert system is judged finger information and identification finger position on the image, comprise total data storehouse, control strategy and production rule, data in the described total data storehouse comprise: some posterior infromations that finger had that under situation about thinking, produce in the practice and data to graphical analysis and in image processing process can representative image in some data messages of finger information, described control strategy is the algorithm that how as far as possible to reduce wrong identification finger information under various environment, and described production principle is contacted and coordinateed total data storehouse and control strategy.
Adopt the learning method of mean cluster method in the described neural network algorithm, use the learning method of gradient descent method as output layer as hidden layer.
The present invention has following remarkable advantage:
1, makes the super-large projection screen become touch-screen and become possibility;
2, the sensor placement location is flexible, can be positioned over behind the projector in 1 to 4 meter the scope, and sensor is placed highly can be from the ground to about 4 meters height;
2, the size of projecting apparatus screen is determined by five point location methods, and the size that changes screen can not proposed extra demand to sensor;
3, five point location method methods are simple, accurate positioning.
Description of drawings
Fig. 1 is the structural representation of a kind of touch projection screen system of the present invention;
Fig. 2 is the theory diagram of vision sensor;
Fig. 3 is the process flow diagram of the implementation method of a kind of touch projection screen system of the present invention;
Fig. 4 is five point location synoptic diagram of the present invention.
Embodiment
Below in conjunction with the drawings and specific embodiments the present invention is further detailed, but not as a limitation of the invention.
With reference to figure 1, a kind of touch projection screen system, comprise: transparent supporting body 1, projection screen 2, vision sensor 3, projector 4 and computing machine 5, transparent supporting body 1 can be made for materials such as glass, projection screen 2 is made for polyphenyl olefin(e) acid material, it is installed on the transparent supporting body 1, can be used as display terminal and touch screen interface, vision sensor 3 is provided with and is installed between projection screen 2 and the projector 4, it highly can be consistent with projection screen 2, also can be positioned over projection screen 2 under, several times direct reflection by level crossing realizes the perception to projection screen 2 scopes, (not identifying among the figure), projector 4 all is connected with computing machine 5 by 232 interfaces or the USB interface of standard with vision sensor 5, realizes mutual communication function.
With reference to figure 2, vision sensor 3 comprises digital camera 31, utilizing camera interface circuit 32, digital signal processing circuit 33, computer interface circuit 34, wherein digital camera 31 can be set to one or more, act as: obtain the object information on the projection screen 2, it links to each other with utilizing camera interface circuit 32, after receiving digital camera 31 Information Monitorings, utilizing camera interface circuit 32 passes to digital signal processing circuit 33, digital signal processing circuit 33 is the acquired signal digitizing, subsequently the feature of object and judge whether that the user imports or interfere information on the recognition screen; To user's input information, calculate user's finger or physical coordinates and the steering order of other objects on screen, pass to computing machine 5 by computer interface circuit 34 subsequently and carry out corresponding operation.
With reference to figure 3, the implementation method step in the actual use of above-mentioned touch projection screen system is as follows:
Step 101: start and proofread and correct;
Step 102: the projection screen unique point is picked up, dimensionality reduction;
Step 103: EXPERT SYSTEM screening;
Step 104: judge whether information meets definite condition;
Step 105: if having, neural network algorithm;
Step 106: judged whether finger position;
Step 107:, carry out finger position and extract if having;
Step 108: the finger position of extraction and the transmission information of vision sensor are compared;
Step 109: the Computer Processing comparison information, drive mouse action, control.
With reference to figure 4, in step 101, initial alignment and proofread and correct to adopt five point location methods the steps include: when the startup correction program, the cursor of computing machine successively from the upper left corner-＞upper right corner-＞the screen intermediate point-＞lower left corner-＞lower right corner.When the cursor of computing machine during in each position, the user continues some seconds with the cursor position on the laser alignment screen, and then cursor jumps to aforesaid the next position; In next position, repeat as above to operate until all five points and all finish such operation.After proofreading and correct like this, when finger touch arrived screen, cursor can be followed finger and is positioned under the finger.
In step 103, expert system is judged finger information and identification finger position on the image, comprise total data storehouse, control strategy and production rule, data in the total data storehouse comprise: some posterior infromations and the data that finger had that produce under situation about thinking to graphical analysis in (1) practice, (2) some data messages of finger information in institute's energy representative image in image processing process; Control strategy is the algorithm that how as far as possible reduces wrong identification finger information under various environment, the production principle be one with the judgement of ", just should take some operation " form if satisfy this condition, it contacts and coordinates total data storehouse and control strategy.This expert system in fact be exactly " if a characteristic on the image in the data fit database of that, so it to be considered to may be that finger information enters down one deck screening, if incongruent point then release screening.Through getting conclusion to the end after the screening layer by layer.”
In step 105, neural network algorithm adopts the rudimentary algorithm in the pattern-recognition, be roughly: utilize the information of known finger in the test to carry out training and study to neural network, by these learn to determine network parameter (as implicit node number, weights, hidden node width etc.) thus the structure of definite network; The parameter of network is calculated and adjusted to study then for by some known input/output informations.Along with deeply carrying out of study, these parameters will change on a small quantity round a central value, and these central values are formulated with regard to the structural parameters that can be used as network; Whole learning process roughly can be divided into two stages: the learning process of hidden layer and the learning process of output layer.Wherein Yin Han training process is exactly definite process of the number of hidden nodes and weights, and the weights that the training by output layer can obtain connecting.Wherein: the learning method of hidden layer can adopt the mean cluster method, and the learning method of output layer adopts the gradient descent method.
The mode that neural network in the software and expert system the combine data that 3 transmission come to vision sensor are discerned, to determine the accurate more position of finger.
Real process of the present invention shows as: when finger or finger piece are operated on projection screen 2, vision sensor 1 is filmed the image scene on the projection screen under the complex background 2, and convert digital signal to, the feature of object and judge whether that the user imports or interfere information on the recognition screen; To user's input information, calculate user's finger or physical coordinates and the steering order of other objects on screen, send target location and control information to computing machine 5 subsequently and handle, by corresponding driving software mouse position and control information are controlled in the computing machine 5; The information that will show on the computing machine 5 is still in a conventional manner by the projection on the projector realization projection screen, thereby the present invention can reach the purpose of interactive control.
Specific embodiment of the present invention has been made detailed explanation to content of the present invention, for persons skilled in the art, the any conspicuous change that it is done without departing from the premise in the spirit of the present invention, all constitute to infringement of patent right of the present invention, with corresponding legal responsibilities.
Claims (6)
1, a kind of touch projection screen system comprises: transparent supporting body, projection screen, projector, computing machine is characterized in that:
This system also comprises vision sensor, described vision sensor comprises digital camera, utilizing camera interface circuit, digital signal processor, computer interface circuit, described digital camera links to each other with the utilizing camera interface circuit, described utilizing camera interface circuit also is connected with digital signal processor, and the output signal of described digital signal processor is connected with computing machine by the computer interface circuit;
Described projection screen is installed on the transparent supporting body;
Described vision sensor is arranged on the projection screen and between the projector, the same height of projection screen;
Described vision sensor all is connected with computing machine with projector; And
Include expert system and neural network algorithm in the described computing machine, wherein, described expert system is in order to judge finger information and identification finger position on the image, this expert system comprises the total data storehouse, control strategy and production rule, data comprise in the described total data storehouse: some posterior infromations that finger had that under situation about thinking, produce in the practice and data to graphical analysis and in image processing process can representative image in some data messages of finger information, described control strategy is the algorithm that how as far as possible to reduce wrong identification finger information under various environment, and described production principle is contacted and coordinateed total data storehouse and control strategy; Described neural network algorithm adopts the learning method of mean cluster method as hidden layer, uses the learning method of gradient descent method as output layer.
2, a kind of touch projection screen system as claimed in claim 1 is characterized in that: described vision sensor can be arranged on the same height in the place ahead of projection screen.
3, a kind of touch projection screen system as claimed in claim 1 is characterized in that:
Described digital camera is more than one or one.
4, a kind of touch projection screen system as claimed in claim 1 is characterized in that:
Described projection screen is a polyphenyl olefin(e) acid material.
5, a kind of implementation method based on a kind of touch projection screen system as claimed in claim 1 is characterized in that:
This method comprises the steps:
(1) starts correction;
(2) the projection screen unique point pick up, dimensionality reduction;
(3) EXPERT SYSTEM screening;
(4) judge whether information meets definite condition;
(5) if having, neural network algorithm;
(6) judged whether finger position;
(7), carry out finger position and extract if having;
(8) finger position of extraction and the transmission information of vision sensor are compared;
(9) Computer Processing comparison information drives mouse action, controls.
6, the implementation method of a kind of touch projection screen system as claimed in claim 5 is characterized in that:
Described correcting mode is five point location methods, the cursor that the steps include: computing machine successively from the upper left corner-upper right corner-screen intermediate point-lower left corner-lower right corner, when the cursor of computing machine during in each position, the user aims at cursor position on the screen with laser pen, continue some seconds, jump to the next position Deng cursor,, repeat as above to operate until all 5 and all carry out in next position.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB200510083833XA CN100435075C (en) | 2005-07-14 | 2005-07-14 | Touch projection screen system and its realization |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB200510083833XA CN100435075C (en) | 2005-07-14 | 2005-07-14 | Touch projection screen system and its realization |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1896919A CN1896919A (en) | 2007-01-17 |
| CN100435075C true CN100435075C (en) | 2008-11-19 |
Family
ID=37609454
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB200510083833XA Expired - Fee Related CN100435075C (en) | 2005-07-14 | 2005-07-14 | Touch projection screen system and its realization |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100435075C (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2009043139A (en) * | 2007-08-10 | 2009-02-26 | Mitsubishi Electric Corp | Position detecting device |
| CN101697105B (en) * | 2009-10-26 | 2011-09-14 | 广东威创视讯科技股份有限公司 | Camera type touch detection positioning method and camera type touch detection system |
| CN102346647A (en) * | 2011-09-19 | 2012-02-08 | 盛乐信息技术（上海）有限公司 | Control method and system of projector |
| CN102591531B (en) * | 2011-12-26 | 2014-11-19 | 深圳市巨龙科教高技术股份有限公司 | Electronic whiteboard, coordinate mapping method for same, device |
| CN106681089A (en) * | 2017-03-27 | 2017-05-17 | 奥英光电（苏州）有限公司 | Back laser projection system |
| CN111028494B (en) * | 2019-11-04 | 2021-01-29 | 珠海格力电器股份有限公司 | Virtual remote control method of electrical equipment, computer readable storage medium and intelligent household appliance |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5973672A (en) * | 1996-10-15 | 1999-10-26 | Raytheon Company | Multiple participant interactive interface |
| WO2003056504A1 (en) * | 2001-12-21 | 2003-07-10 | Klaus-Dieter Frank | Interactive projection and input system |
| CN2627570Y (en) * | 2003-05-17 | 2004-07-21 | 中国科学技术大学 | Interaction projecting apparatus |
| EP1524836A1 (en) * | 2003-10-14 | 2005-04-20 | Casio Computer Co., Ltd. | Document camera and document camera system |
-
2005
- 2005-07-14 CN CNB200510083833XA patent/CN100435075C/en not_active Expired - Fee Related
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5973672A (en) * | 1996-10-15 | 1999-10-26 | Raytheon Company | Multiple participant interactive interface |
| WO2003056504A1 (en) * | 2001-12-21 | 2003-07-10 | Klaus-Dieter Frank | Interactive projection and input system |
| CN2627570Y (en) * | 2003-05-17 | 2004-07-21 | 中国科学技术大学 | Interaction projecting apparatus |
| EP1524836A1 (en) * | 2003-10-14 | 2005-04-20 | Casio Computer Co., Ltd. | Document camera and document camera system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN1896919A (en) | 2007-01-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109325454B (en) | A real-time recognition method for static gestures based on YOLOv3 | |
| CN101251784B (en) | Laser Pointer Pointing and Spot Track Recognition Method | |
| Ma et al. | Kinect Sensor‐Based Long‐Distance Hand Gesture Recognition and Fingertip Detection with Depth Information | |
| CN107239790A (en) | A kind of service robot target detection and localization method based on deep learning | |
| CN107197223A (en) | The gestural control method of micro-projection device and projector equipment | |
| CN104777911A (en) | Intelligent interaction method based on holographic technique | |
| CN102622108A (en) | Interactive projecting system and implementation method for same | |
| CN106980365A (en) | The first visual angle dynamic gesture identification method based on depth convolutional neural networks framework | |
| CN106934351B (en) | Gesture recognition method and device and electronic equipment | |
| CN102323868A (en) | Human-computer multi-point interaction method and device based on infrared image | |
| CN110796018A (en) | A Hand Motion Recognition Method Based on Depth Image and Color Image | |
| CN114138121B (en) | User gesture recognition method, device and system, storage medium and computing equipment | |
| CN101110102A (en) | Game scene and character control method based on player's fist | |
| CN100478860C (en) | Electronic plane display positioning system and positioning method | |
| CN106851937A (en) | A kind of method and device of gesture control desk lamp | |
| CN100435075C (en) | Touch projection screen system and its realization | |
| CN102375564A (en) | Method for interacting by adopting optical indicator, optical indicator as well as presentation method and system | |
| CN110502981A (en) | A Gesture Recognition Method Based on Fusion of Color Information and Depth Information | |
| CN114581535A (en) | Method, device, storage medium and equipment for marking key points of user bones in image | |
| CN114327064A (en) | Plotting method, system, equipment and storage medium based on gesture control | |
| CN118340500A (en) | Entity interaction system and method for autism spectrum disorder children | |
| CN101388067B (en) | A method for implanting interactive entertainment trademark advertisements | |
| CN102520794B (en) | Gesture recognition system and method | |
| CN112925470A (en) | Touch control method and system of interactive electronic whiteboard and readable medium | |
| KR101964192B1 (en) | Smart table apparatus for simulation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C17 | Cessation of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20081119 Termination date: 20090814 |