CN201638151U - Device for realizing virtual display and virtual interactive operation - Google Patents
Device for realizing virtual display and virtual interactive operation Download PDFInfo
- Publication number
- CN201638151U CN201638151U CN2010201041148U CN201020104114U CN201638151U CN 201638151 U CN201638151 U CN 201638151U CN 2010201041148 U CN2010201041148 U CN 2010201041148U CN 201020104114 U CN201020104114 U CN 201020104114U CN 201638151 U CN201638151 U CN 201638151U
- Authority
- CN
- China
- Prior art keywords
- signal
- image
- display
- virtual
- circuit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 230000002452 interceptive effect Effects 0.000 title claims abstract description 29
- 239000011521 glass Substances 0.000 claims abstract description 38
- 238000000034 method Methods 0.000 claims abstract description 12
- 230000008569 process Effects 0.000 claims abstract description 6
- 238000012545 processing Methods 0.000 claims description 88
- 230000009466 transformation Effects 0.000 claims description 16
- 238000003384 imaging method Methods 0.000 claims description 8
- 230000003321 amplification Effects 0.000 claims description 7
- 238000009499 grossing Methods 0.000 claims description 7
- 238000003199 nucleic acid amplification method Methods 0.000 claims description 7
- 230000000007 visual effect Effects 0.000 abstract description 6
- 238000005265 energy consumption Methods 0.000 abstract description 4
- 241000699666 Mus <mouse, genus> Species 0.000 description 8
- 238000010586 diagram Methods 0.000 description 6
- 230000000694 effects Effects 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 230000003993 interaction Effects 0.000 description 3
- 238000010009 beating Methods 0.000 description 2
- 239000002131 composite material Substances 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000016776 visual perception Effects 0.000 description 2
- 241000699670 Mus sp. Species 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 210000001525 retina Anatomy 0.000 description 1
Images
Landscapes
- User Interface Of Digital Computer (AREA)
- Position Input By Displaying (AREA)
Abstract
The utility model discloses a device for realizing virtual display and virtual interactive operation, which is applied on mobile equipment and comprises glasses with virtual display and interactive touch operation and finger cots, wherein the glasses are used for being coupled with the finger cots and the mobile equipment to process display signals output by the mobile equipment and generate three-dimensional images for display; real-time signals generated on the finger cots are acquired to be processed and sent to the mobile equipment and the feedback information of the mobile equipment to the finger cots; the finger cots are used for being coupled with the glasses, carrying out operation on virtual input equipment generated in the glasses and transmitting the generated real-time signals to the glasses; and the feedback information from the mobile equipment is received by the glasses and processed. Compared with the prior art, the device is applied on a mobile product, can create the satisfactory and comfortable visual effect and operation experience on the basis without increasing large display and input equipment, and simultaneously can greatly reduce energy consumption.
Description
Technical Field
The utility model relates to a virtual demonstration and virtual interaction technique, specifically speaking especially relates to a realize device of virtual demonstration and virtual interactive operation.
Background
With the rapid development of science and technology, mobile electronic products such as new products of mobile phones, handheld game machines, and internet notebook computers gradually replace the previous personal desktop computers and personal notebook computers due to their characteristics of small size, high operation speed, strong functions, and the like. However, these devices have too small a display screen to allow the consumer to enjoy the use of the device. A large number of consumers have to own both a desktop computer or projector with a large display screen. But it is also very inconvenient to carry such desktop computers or projectors for travel. Moreover, the mobile device has no input device or is too small in size, the input device is inconvenient to use, and even though the mobile device has strong hardware device capacity, the consumer can not use the functions because the consumer does not have a proper input device; meanwhile, if large-screen display is carried out, large-screen hardware equipment and high energy consumption are needed, and the environment is not protected.
SUMMERY OF THE UTILITY MODEL
The utility model aims to solve the technical problem that a realize device of virtual demonstration and virtual interactive operation is provided to solve mobile electronic product display screen undersize such as cell-phone, game machine, notebook computer, can't gain satisfying comfortable visual perception, input device does not have or the volume is too little, can't accomplish the operation to mobile electronic equipment and even the large screen equipment of application also can't solve high energy consumption scheduling problem smoothly freely.
In order to solve the above technical problem, the utility model provides a realize virtual display and virtual interoperation's device is applied to the mobile device, and wherein, the device includes: glasses and finger stalls with virtual display and interactive touch operations, wherein,
the glasses for virtual display and virtual interactive operation are used for being coupled with the finger stalls and the mobile device, processing display signals output by the mobile device, and generating and displaying a stereoscopic image (including virtual input devices such as a mouse and a keyboard); acquiring a real-time signal generated on the finger sleeve, processing the real-time signal, and sending the processed real-time signal to the mobile equipment to realize real-time operation on the mobile equipment; sending the feedback information of the mobile equipment to the finger stall;
the finger stall is used for being coupled with the glasses for virtual display and virtual interactive operation, operating virtual input equipment such as a keyboard, a mouse and a menu generated in the glasses, transmitting a generated real-time signal to the glasses for virtual display and virtual interactive operation, receiving feedback information from the mobile equipment through the glasses for virtual display and virtual interactive operation, processing the feedback information, and generating the feeling of hitting the keyboard and the mouse and using real input equipment.
Realize virtual demonstration and virtual interactive operation's device, wherein, glasses with virtual demonstration and interactive touch operation include: the system comprises a driving interface circuit, a display signal processing circuit, an image signal enhancement circuit, a near-infrared receiver, a virtual LCD display screen and a projector; wherein,
the display signal processing circuit is used for being connected with the projector, the driving interface circuit and the image signal enhancement circuit, receiving a real or pseudo high-resolution image sent by the driving interface circuit or the image signal enhancement circuit, carrying out Fresnel transformation on the image, generating a three-dimensional image for a special object (such as virtual input equipment, a menu and the like) and superposing the three-dimensional image on the image subjected to the Fresnel transformation, and then transmitting the superposed image to the projector;
the projector is used for being connected with the display signal processing circuit and the virtual LCD display screen, receiving the image signal output by the display signal processing circuit after processing, and projecting the image signal onto the virtual LCD display screen;
the virtual LCD display screen is used for being connected with the interface of the projector and displaying the image signal output by the projector on the virtual LCD screen;
the near infrared receiver is connected with the driving interface circuit, receives signals sent by the finger stall and sends the signals processed into three-dimensional coordinates to the driving interface circuit;
the image signal enhancement circuit is used for being connected with the display signal processing circuit and the driving interface circuit, receiving a low-display-resolution display signal sent by the driving interface circuit, carrying out image interpolation amplification and smoothing processing, and then transferring a generated pseudo high-resolution image to the display signal processing circuit;
the driving interface circuit is used for being connected or coupled with the display signal processing circuit, the image signal enhancement circuit, the near infrared receiver, the finger stall and the mobile equipment, judging a resolution mode supported by the mobile equipment, and if the mobile equipment can output a high-resolution display signal, directly transmitting the display signal output by the mobile equipment to the display signal processing circuit; if the mobile equipment can only output a low-resolution display signal, the display signal output by the mobile equipment is sent to an image enhancement circuit for vectorization processing, meanwhile, the signal of the three-dimensional coordinate sent by the near-infrared receiver is compared with the signal of the three-dimensional coordinate received before, the operation intention of a user (such as single or double click of a mouse, keyboard beating and the like) is judged and converted into an operation signal which is sent to the mobile equipment, and the real-time operation of the mobile equipment is realized; and simultaneously sending the feedback information of the mobile equipment to the finger stall.
Realize virtual demonstration and virtual interactive operation's device, wherein, glasses with virtual demonstration and interactive touch operation can also include: the device comprises a driving interface circuit, a display signal processing circuit, an image signal enhancement circuit, a near-infrared receiver and at least two LCD display screens; wherein,
the display signal processing circuit is used for being connected with the LCD display screen, the driving interface circuit and the image signal enhancement circuit, receiving a real or pseudo high-resolution image sent by the driving interface circuit or the image signal enhancement circuit, carrying out Fresnel transformation on the image, generating a three-dimensional image for a special object (such as virtual input equipment, a menu and the like) and superposing the three-dimensional image on the image subjected to the Fresnel transformation, and then transmitting the superposed image to the LCD display screen;
the LCD display screen is used for being connected with the display signal processing circuit, receiving the image signal output by the display signal processing circuit and displaying the image signal on the LCD screen;
the near infrared receiver is connected with the driving interface circuit, receives signals sent by the finger stall and sends the signals processed into three-dimensional coordinates to the driving interface circuit;
the image signal enhancement circuit is used for being connected with the display signal processing circuit and the driving interface circuit, receiving a low-display-resolution display signal sent by the driving interface circuit, carrying out image interpolation amplification and smoothing processing, and then transferring a generated pseudo high-resolution image to the display signal processing circuit;
the driving interface circuit is used for being connected or coupled with the display signal processing circuit, the image signal enhancement circuit, the near infrared receiver, the finger stall and the mobile equipment, judging a resolution mode supported by the mobile equipment, and if the mobile equipment can output a high-resolution display signal, directly transmitting the display signal output by the mobile equipment to the display signal processing circuit; if the mobile equipment can only output a low-resolution display signal, the display signal output by the mobile equipment is sent to an image enhancement circuit for vectorization processing, meanwhile, the signal of the three-dimensional coordinate sent by the near-infrared receiver is compared with the signal of the three-dimensional coordinate received before, the operation intention of a user (such as double-click of a mouse, keyboard beating and the like) is judged and converted into an operation signal which is sent to the mobile equipment, and the real-time operation on the mobile equipment is realized; and simultaneously sending the feedback information of the mobile equipment to the finger stall.
Further wherein the near infrared receiver comprises: the device comprises at least two light-sensitive cameras, a camera signal processing circuit, at least two plastic lenses and at least two near-infrared-transmitting band-pass filters; wherein,
the light-sensitive camera is arranged behind the plastic lens and the band-pass filter, is connected with the camera signal processing circuit, and is used for receiving signals sent by the finger stall and processed by the plastic lens and the band-pass filter, generating images and sending the images to the camera signal processing circuit;
the plastic lens is used for imaging the signal sent by the finger stall on the light-sensitive camera;
the band-pass filter is arranged in front of or behind the plastic lens and used for removing stray light signals in real-time image signals entering the near-infrared receiver and enabling the filtered signals to reach the light-sensitive camera;
the camera signal processing circuit is connected with the driving interface circuit and used for processing the real-time image signal of the near-infrared light source generated by the light-sensitive camera, namely calculating the signal of the three-dimensional coordinate of the real-time image signal of the near-infrared light source relative to the virtual display screen after the imaging processing by utilizing parallax and sending the signal of the three-dimensional coordinate to the driving interface circuit.
Further, wherein, finger stall inside includes: the device comprises a feedback signal receiving circuit, a vibration generating module and a near-infrared signal transmitter; wherein,
the feedback signal receiving circuit is used for being coupled with a driving interface circuit in the glasses and simultaneously connected with the vibration generating module, receiving a feedback operation signal transmitted by the driving interface circuit and transmitting the operation signal to the vibration generating module;
the vibration generating module is connected with the feedback signal receiving circuit and generates vibration to fingers after receiving the feedback operation signal, so that a user has the feeling of using the real input equipment.
The near-infrared signal transmitter is used for being coupled with a near-infrared receiver in the glasses and generating a real-time signal of a near-infrared light source according to the movement of the finger stall, and a light-sensitive camera in the near-infrared receiver performs shooting and processing on the near-infrared light source.
Compared with the prior art, the utility model discloses mainly use on mobile electronic product such as cell-phone, computer or game machine that the display screen is not big enough, can be on the basis that does not increase large-scale display device, create brand-new visual effect. Meanwhile, the input of the user can be operated through virtual input, man-machine interaction is achieved, and virtual touch control is conducted on the machine. Meanwhile, as the device can only read through the glasses, the device also provides a virtual environment for protecting privacy for users, and the device can greatly reduce energy consumption.
Drawings
Fig. 1 is a block diagram illustrating an apparatus for implementing virtual display and virtual interactive operation according to an embodiment of the present invention;
FIG. 2 is a block diagram of a first specific structure of the glasses with virtual display and interactive touch operation in FIG. 1;
fig. 3 is a detailed block diagram of the near-infrared receiver in fig. 2;
FIG. 4 is a block diagram of a second specific structure of the glasses with virtual display and interactive touch operation in FIG. 1;
FIG. 5 is a block diagram of a detailed construction of the finger glove of FIG. 1.
Detailed Description
The main idea of the utility model is to solve the problem that the display screen of the products such as mobile phone, game machine or notebook computer is too small to obtain the display effect on the desktop computer. The following detailed description of the embodiments is not intended to limit the invention.
As shown in fig. 1, for the structural block diagram of the device for implementing virtual display and virtual interactive operation according to the embodiment of the present invention, the device is applied to a mobile device 12 such as a mobile phone, a game machine or a notebook computer, and the device includes: glasses 10 and finger stalls 11 with virtual display and interactive touch operation, wherein,
as shown in fig. 2, a first configuration of eyewear 10 with virtual display and interactive touch operations includes: a driving interface circuit 106, a display signal processing circuit 101, an image signal enhancement circuit 105, a near infrared receiver 104, a virtual LCD display screen 103 and a projector 102; wherein,
a display signal processing circuit 101, which is connected to the projector 102, the driving interface circuit 106 and the image signal enhancement circuit 105, receives the high resolution image from the driving interface circuit 106, performs fresnel transformation on the image, generates a stereoscopic image for a special object (such as a mouse, a menu, a virtual keyboard, etc.) and superimposes the stereoscopic image on the image after the fresnel transformation, and then transmits the superimposed image to the projector 102 for projection on the virtual LCD display screen 103; meanwhile, the vectorized pseudo high-resolution image transmitted by the image signal enhancement circuit 105 is also subjected to fresnel transformation, a stereoscopic image (a three-dimensional image or a 3D image) is generated for a special object (a mouse, a menu, a virtual keyboard and the like) and is superimposed on the image subjected to fresnel transformation, and then the superimposed image signal is transmitted to the projector 102 for projection on the virtual LCD display screen 103;
the Fresnel transformation is adopted in the prior art, is similar to the Fourier transformation and the wavelet transformation, needs a large amount of calculation, can be quickly realized by using hardware supporting parallel calculation, and has the function of enabling a processed image to be a clear large image on a retina when two eyes of a user focus at a certain distance.
The projector 102 is connected with the display signal processing circuit 101 and the virtual LCD display screen 103, receives an image signal output after being processed by the display signal processing circuit 101, and projects the image signal onto the virtual LCD display screen 103; within a certain range, the user can adjust the projection distance of the projector 102. At the same time, the user can also project a virtual input device, such as a mouse, onto the screen by adjusting its response to distance according to arm length or comfort requirements. The user may also choose to project a virtual input device such as a keyboard in front of the virtual LCD display screen 103 to add a three-dimensional visual effect.
And a virtual LCD screen 103 for connecting with the interface of the projector 102 and displaying the image signal output by the projector on the virtual LCD screen.
As shown in fig. 3, the near-infrared receiver 104 is connected to the driving interface circuit 106, and is configured to receive a signal sent by the near-infrared transmitter 112 on the finger stall, and send a signal processed into three-dimensional coordinates to the driving interface circuit 106. The near infrared receiver 104 comprises at least two light-sensitive cameras 1211, a camera signal processing circuit 1212, at least two plastic lenses 1213 and at least two near infrared-transmitting band-pass filters 1214; wherein,
a light-sensitive camera 1211 which is arranged behind the plastic lens 1213 and the band-pass filter 1214 and is connected with the camera signal processing circuit 1212, and is used for receiving the signals which are processed by the plastic lens 1213 and the band-pass filter 1214 and sent by the near-infrared emitter 112 on the finger stall, and sending the received signals to the camera signal processing circuit 1212;
a plastic lens 1213 for imaging the signal emitted by the near-infrared emitter 112 on the finger stall on the light-sensitive camera 1211;
and a band pass filter 1214 installed in front of or behind the plastic lens 1213 (disposed behind the plastic lens 1213 in fig. 3) for removing stray light signals (i.e., signals from sunlight or other light sources) from the real-time signals entering the near-infrared receiver 104 and sending the processed signals to the light-sensitive camera 1211. The use of the bandpass filter 1214 enables accurate acceptance of the signal emitted by the near-infrared emitter 112 on the finger stall without the influence of other stray light, thus enabling the system to sensitively capture small movements of the near-infrared signal source.
A camera signal processing circuit 1212, connected to the driving interface circuit 106, for processing the real-time image signal of the near-infrared light source received by the light-sensitive camera 1211, that is, calculating a signal of a three-dimensional coordinate of the real-time image signal of the near-infrared light source relative to the virtual display screen after the imaging processing by using the parallax, and sending the signal of the three-dimensional coordinate to the driving interface circuit 106;
specifically, the camera signal processing circuit 1212 first performs a digitization process on the real-time image signal of the near-infrared light source after the imaging process, then performs a binarization process on the real-time image signal to obtain a black-and-white image, searches out all the bright spot clusters of the black-and-white image, performs left-and-right pairing on the bright spot clusters by using parallax, calculates a signal of a three-dimensional coordinate corresponding to the virtual display screen by calculating all the left-and-right pairings, and transmits the signal of the three-dimensional coordinate to the driving interface circuit 106.
The image signal enhancement circuit 105 is used for being connected with the display signal processing circuit 101 and the driving interface circuit 106, receiving the low-display-resolution display signal sent by the driving interface circuit 106, performing image interpolation amplification and smoothing processing (both the image interpolation amplification and the smoothing processing belong to the prior art, and in order to ensure the final visual effect, a fractal method, namely a method of extracting characteristic edge vector information firstly, is adopted here), and then transferring the generated pseudo high-resolution image to the display signal processing circuit 101;
the image interpolation enlargement and smoothing process is described by a simple example, for example, if a triangle pattern is only on an image, and if the triangle pattern is enlarged by 100%, the simplest method is to pull the distance between each image point apart, copy each image point into three copies and insert the copies into the right, lower and lower right edges of the original image point, which is the simplest image interpolation enlargement. But this has the disadvantage that any other straight line than the horizontal and vertical lines will be zigzag-shaped. However, if the image is vectorized before the enlargement, i.e. the coordinates of three vertices of the triangle are memorized, only the coordinates of the three vertices are enlarged during the enlargement, and then the three vertices are connected, the enlarged image is still smooth. However, a general image does not include only simple graphics, so vectorization may be difficult. Since the uniform area of the image and the edge of the object have self-similarity to a certain extent, this is very similar to the self-similarity of computer fractal. The fractal method is to extract vector information of characteristic edges in the image by using the point. Therefore, the image information is converted into the transformation coefficient and then compressed by utilizing the self-similarity of the uniform region of the image and the object edge to a certain degree, the conversion is equivalent to vectorization of the original image to a certain degree, and the image after complete vectorization can still keep the definition of details after amplification.
The driving interface circuit 106 is connected or coupled to the display signal processing circuit 101, the image signal enhancement circuit 105, the near-infrared receiver 104, the finger stall 11 and the mobile device 12, determines a resolution mode supported by the mobile device 12, and directly transfers the display signal output by the mobile device 12 to the display signal processing circuit 101 if the mobile device 12 can output a high-resolution display signal; if the mobile device can only output low resolution display signals, the display signals output by the mobile device 12 are sent to the image enhancement circuit 105 for vectorization processing, meanwhile, the signal of the three-dimensional coordinates sent by the near infrared receiver 104 is compared with the signal of the three-dimensional coordinates received before to determine the operation intention of the user (for example, when the finger of the user extends to the back of the displayed LCD display screen, the user can be considered to have pressed a key, and when the finger of the user retracts to the front of the displayed LCD display screen, the user can be considered to have released the key; i.e. we can also understand that the movement track of the finger of the user can be obtained by comparing the calculation result of the current frame with the previous frames to determine the operation intention of the user), and converted into standard operation signals such as key operation, double-click operation, touch operation and the like to be sent to the mobile device 12, and transmits the feedback information of the mobile device 12 to the feedback signal receiving circuit 111 in the finger stall 11 to the finger stall 11.
In addition, as shown in fig. 4, a second structure of the glasses 10 having the virtual display and the interactive touch operation includes: a driving interface circuit 106, a display signal processing circuit 101, an image signal enhancing circuit 105, a near infrared receiver 104, and two LCD (liquid crystal display) display screens 203; wherein,
the display signal processing circuit 101 is further configured to transmit the superimposed image to the LCD screen 203;
and the LCD screen 203 is connected with the display signal processing circuit 101 and is used for receiving and displaying the image signal output by the display signal processing circuit 101 after processing so as to generate the effect of virtual projection.
The LCD display screen 203 or the virtual LCD display screen 103 mentioned in the embodiment of the present invention all support the three-dimensional display mode, and the user can obtain the visual enjoyment of real 3D by displaying the odd frame image and the even frame image of the image signal of the 3D effect output by the projector on the virtual LCD display screen 103 in the glasses 10 or directly imaging on the LCD display screen 203.
In addition to the finger glove 11 comprising a composite material, as shown in fig. 5, the composite material further comprises: a feedback signal receiving circuit 111, a vibration generating module 112 and a near infrared signal transmitter 113; wherein,
a feedback signal receiving circuit 111, which is coupled to the driving interface circuit 106 in the glasses 10, connected to the vibration generating module 112, and configured to receive a feedback operation signal transmitted by the driving interface circuit 106 and send the operation signal to the vibration generating module 112;
and the vibration generating module 112 is connected to the feedback signal receiving circuit 111, and generates vibration to stimulate the finger after receiving the feedback operation signal, so that the user feels that corresponding operations such as key operation, double-click operation, touch operation and the like are generated. For example: the vibration in the vibration generating module 112 is generated by electromagnetic force generated by an electromagnetic coil to excite the finger stall to vibrate or generate an ultrasonic pulse signal of about 30KHz, and the ultrasonic pulse signal is converted into mechanical vibration through a transducer.
The near-infrared signal transmitter 113 is configured to couple with the near-infrared receiver 104 in the glasses 10, generate a real-time signal of the near-infrared light source according to a motion of the finger stall, and two light-sensitive cameras 1211 in the near-infrared receiver 104 perform imaging and processing on the real-time signal.
The mobile device 12 is configured to couple or connect with the driving interface circuit 106 in the glasses 10 having the virtual display and the interactive touch operation, receive a signal input by the driving interface circuit 106 in the glasses 10 having the virtual display and the interactive touch operation for corresponding processing, send an output display signal to the driving interface circuit 106 for processing, and transmit feedback information of the feedback signal receiving circuit 111 in the finger stall 11 to the finger stall 11 through the driving interface circuit 106. Since the mobile device 12 can be a mobile phone, a game machine, a notebook computer, etc., and the processing procedure thereof belongs to the prior art, it will not be described in detail here.
Compared with the prior art, the utility model discloses mainly use on mobile devices such as cell-phone, computer or game machine that the display screen is not big enough, can be on the basis that does not increase large-scale display device, create brand-new visual effect. Meanwhile, the input of the user can be displayed virtually, man-machine interaction is achieved, and virtual touch control is carried out on the machine. While cumbersome input devices such as keyboards and mice can be replaced with extremely lightweight finger gloves and virtual displays.
In addition, because the virtual LCD display can be seen by the user, namely the virtual LCD display screen or the LCD screen is manufactured into a glasses type and is worn in front of the user, the privacy right is protected best when the user enjoys movie pictures, interactive games, mail receiving and sending, financial processing, article writing and the like.
To sum up, the utility model discloses can make small-screen mobile device realize the function of ordinary super large screen computer completely, not only can help the consumer to practice thrift the cost (buy a computer less) but also can easily carry and gain better effect. Due to the fact that the display screen is remarkably enlarged, the requirement that a user needs to keep a sitting posture is removed by adopting virtual display, and the fatigue of glasses, shoulders and the waist of the user can be greatly relieved by replacing a mouse with fingers. Meanwhile, the energy loss and unnecessary large-screen hardware display equipment can be greatly saved, and green and environment-friendly effects are realized.
In addition, although the screen resolution of existing small-screen devices is increasing, it is still far from sufficient even when compared to ordinary pictures, video, and network media. The information quantity of the multimedia source can be fully displayed by adopting the high-resolution virtual LCD display, and the visual perception of a user is greatly improved.
Of course, the present invention may have other embodiments, and those skilled in the art may make various changes and modifications according to the present invention without departing from the spirit and the essence of the present invention, and these changes and modifications should fall within the protection scope of the appended claims.
Claims (5)
1. An apparatus for implementing virtual display and virtual interactive operation, applied to a mobile device, the apparatus comprising: glasses and finger stalls with virtual display and interactive touch operations, wherein,
the glasses for virtual display and virtual interactive operation are used for being coupled with the finger stalls and the mobile equipment, processing the display signals output by the mobile equipment and generating and displaying a three-dimensional image; acquiring a real-time signal generated on the finger stall, processing the real-time signal, sending the processed real-time signal to the mobile equipment, and sending feedback information of the mobile equipment to the finger stall;
the finger stall is used for being coupled with the glasses for virtual display and virtual interactive operation, operating virtual input equipment generated in the glasses and transmitting the generated real-time signal to the glasses; and receiving feedback information from the mobile device through the glasses for processing.
2. The apparatus for enabling virtual display and virtual interoperation according to claim 1, wherein the glasses comprise: the system comprises a driving interface circuit, a display signal processing circuit, an image signal enhancement circuit, a near-infrared receiver, a virtual LCD display screen and a projector; wherein,
the display signal processing circuit is used for being connected with the projector, the driving interface circuit and the image signal enhancement circuit, receiving a true or false high-resolution image sent by the driving interface circuit or the image signal enhancement circuit, carrying out Fresnel transformation on the image, generating a three-dimensional image for a special object, superposing the three-dimensional image on the image subjected to the Fresnel transformation, and then transmitting the superposed image to the projector;
the projector is used for being connected with the display signal processing circuit and the virtual LCD display screen, receiving the image signal output by the display signal processing circuit after processing, and projecting the image signal onto the virtual LCD display screen;
the virtual LCD display screen is used for being connected with the interface of the projector and displaying the image signal output by the projector on the virtual LCD screen;
the near infrared receiver is connected with the driving interface circuit, receives signals sent by the finger stall and sends the signals processed into three-dimensional coordinates to the driving interface circuit;
the image signal enhancement circuit is used for being connected with the display signal processing circuit and the driving interface circuit, receiving the display signal sent by the driving interface circuit, carrying out image interpolation amplification and smoothing processing, and then transferring the generated true or false high-resolution image to the display signal processing circuit;
the driving interface circuit is used for being connected or coupled with the display signal processing circuit, the image signal enhancement circuit, the near infrared receiver, the finger stall and the mobile equipment, judging a resolution mode supported by the mobile equipment, outputting a high-resolution display signal by the mobile equipment, and directly transmitting the display signal output by the mobile equipment to the display signal processing circuit; if the mobile equipment outputs a low-resolution display signal, the display signal output by the mobile equipment is sent to an image enhancement circuit for vectorization processing, meanwhile, a three-dimensional coordinate signal sent by the near-infrared receiver is compared with a previously received three-dimensional coordinate signal, a user operation intention is judged, and the user operation intention is converted into an operation signal to be sent to the mobile equipment; and simultaneously sending the feedback information of the mobile equipment to the finger stall.
3. The apparatus for enabling virtual display and virtual interoperation according to claim 1, wherein the glasses comprise: the device comprises a driving interface circuit, a display signal processing circuit, an image signal enhancement circuit, a near-infrared receiver and at least two LCD display screens; wherein,
the display signal processing circuit is used for being connected with the LCD display screen, the driving interface circuit and the image signal enhancement circuit, receiving a true or false high-resolution image sent by the driving interface circuit or the image signal enhancement circuit, carrying out Fresnel transformation on the image, generating a three-dimensional image for a special object, superposing the three-dimensional image on the image subjected to the Fresnel transformation, and then transmitting the superposed image to the LCD display screen;
the LCD display screen is used for being connected with the display signal processing circuit, receiving the image signal output by the display signal processing circuit and displaying the image signal on the LCD screen;
the near infrared receiver is connected with the driving interface circuit, receives signals sent by the finger stall and sends the signals processed into three-dimensional coordinates to the driving interface circuit;
the image signal enhancement circuit is used for being connected with the display signal processing circuit and the driving interface circuit, receiving the display signal sent by the driving interface circuit, carrying out image interpolation amplification and smoothing processing, and then transferring the generated true or false high-resolution image to the display signal processing circuit;
the driving interface circuit is used for being connected or coupled with the display signal processing circuit, the image signal enhancement circuit, the near infrared receiver, the finger stall and the mobile equipment, judging a resolution mode supported by the mobile equipment, outputting a high-resolution display signal by the mobile equipment, and directly transmitting the display signal output by the mobile equipment to the display signal processing circuit; if the mobile equipment outputs a low-resolution display signal, the display signal output by the mobile equipment is sent to an image enhancement circuit for vectorization processing, meanwhile, a three-dimensional coordinate signal sent by the near-infrared receiver is compared with a previously received three-dimensional coordinate signal, a user operation intention is judged, and the user operation intention is converted into an operation signal to be sent to the mobile equipment; and sending the feedback information of the mobile equipment to the finger stall.
4. The apparatus for implementing virtual display and virtual interoperation according to claim 2 or 3, wherein the near infrared receiver comprises: the device comprises at least two light-sensitive cameras, a camera signal processing circuit, at least two plastic lenses and at least two near-infrared-transmitting band-pass filters; wherein,
the light-sensitive camera is arranged behind the plastic lens and the band-pass filter, is connected with the camera signal processing circuit, and is used for receiving the near-infrared signals sent by the finger stall and processed by the plastic lens and the band-pass filter, generating images and sending the images to the camera signal processing circuit;
the plastic lens is used for imaging the signal sent by the finger stall on the light-sensitive camera;
the band-pass filter is used for being arranged in front of or behind the plastic lens, removing stray light signals in real-time image signals entering the near-infrared receiver and sending the filtered signals to the light-sensitive camera;
the camera signal processing circuit is connected with the driving interface circuit and used for processing real-time image signals of the near-infrared light source generated by the light-sensitive camera and sending the generated signals of the three-dimensional coordinates to the driving interface circuit.
5. The apparatus for enabling virtual display and virtual interoperation according to claim 4, wherein the finger glove internally includes: the device comprises a feedback signal receiving circuit, a vibration generating module and a near-infrared signal transmitter; wherein,
the feedback signal receiving circuit is used for being coupled with a driving interface circuit in the glasses and simultaneously connected with the vibration generating module, receiving a feedback operation signal transmitted by the driving interface circuit and transmitting the operation signal to the vibration generating module;
the vibration generating module is connected with the feedback signal receiving circuit and generates vibration to the finger after receiving the feedback operation signal;
the near-infrared signal transmitter is used for being coupled with a near-infrared receiver in the glasses and generating a real-time signal of a near-infrared light source according to the movement of the finger stall, and the light-sensitive camera in the near-infrared receiver makes a video recording and processes the real-time signal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010201041148U CN201638151U (en) | 2010-01-29 | 2010-01-29 | Device for realizing virtual display and virtual interactive operation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010201041148U CN201638151U (en) | 2010-01-29 | 2010-01-29 | Device for realizing virtual display and virtual interactive operation |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN201638151U true CN201638151U (en) | 2010-11-17 |
Family
ID=43082655
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2010201041148U Expired - Fee Related CN201638151U (en) | 2010-01-29 | 2010-01-29 | Device for realizing virtual display and virtual interactive operation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN201638151U (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102681713A (en) * | 2011-06-15 | 2012-09-19 | 北京京东方光电科技有限公司 | Three-dimensional touch display system and method |
| CN102722327A (en) * | 2012-05-25 | 2012-10-10 | 江汉大学 | Input equipment |
| CN102854984A (en) * | 2012-09-10 | 2013-01-02 | 马青川 | Small audio-video equipment capable of projecting to both eyes directly on basis of finger action capture control |
| CN104679222A (en) * | 2013-11-26 | 2015-06-03 | 深圳先进技术研究院 | Medical office system based on human-computer interaction, medical information sharing system and method |
| CN104750271A (en) * | 2013-12-27 | 2015-07-01 | 深圳富泰宏精密工业有限公司 | Touch fingerstall |
| CN105630168A (en) * | 2015-12-24 | 2016-06-01 | 联想(北京)有限公司 | Information processing method, first electronic device and second electronic device |
| CN108874139A (en) * | 2018-06-20 | 2018-11-23 | 浙江工业大学 | The target exchange method and system of visual focus and hand exercise tracking coordinated drive |
| CN109493670A (en) * | 2018-11-21 | 2019-03-19 | 苏州工业园区职业技术学院 | A kind of electromechanics gas integral production training system |
| CN112216094A (en) * | 2020-10-26 | 2021-01-12 | 深圳乐播科技有限公司 | Screen projection control system and screen projection control method based on remote controller |
-
2010
- 2010-01-29 CN CN2010201041148U patent/CN201638151U/en not_active Expired - Fee Related
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102681713B (en) * | 2011-06-15 | 2015-06-10 | 北京京东方光电科技有限公司 | Three-dimensional touch display system and method |
| CN102681713A (en) * | 2011-06-15 | 2012-09-19 | 北京京东方光电科技有限公司 | Three-dimensional touch display system and method |
| CN102722327A (en) * | 2012-05-25 | 2012-10-10 | 江汉大学 | Input equipment |
| CN102854984A (en) * | 2012-09-10 | 2013-01-02 | 马青川 | Small audio-video equipment capable of projecting to both eyes directly on basis of finger action capture control |
| CN104679222B (en) * | 2013-11-26 | 2018-02-06 | 深圳先进技术研究院 | Medical office system, medical information sharing system and method based on man-machine interaction |
| CN104679222A (en) * | 2013-11-26 | 2015-06-03 | 深圳先进技术研究院 | Medical office system based on human-computer interaction, medical information sharing system and method |
| CN104750271A (en) * | 2013-12-27 | 2015-07-01 | 深圳富泰宏精密工业有限公司 | Touch fingerstall |
| CN105630168A (en) * | 2015-12-24 | 2016-06-01 | 联想(北京)有限公司 | Information processing method, first electronic device and second electronic device |
| CN105630168B (en) * | 2015-12-24 | 2019-09-24 | 联想(北京)有限公司 | A kind of information processing method, the first electronic equipment and the second electronic equipment |
| CN108874139A (en) * | 2018-06-20 | 2018-11-23 | 浙江工业大学 | The target exchange method and system of visual focus and hand exercise tracking coordinated drive |
| CN108874139B (en) * | 2018-06-20 | 2021-02-02 | 浙江工业大学 | Target interaction method and system cooperatively driven by visual focus and hand motion tracking |
| CN109493670A (en) * | 2018-11-21 | 2019-03-19 | 苏州工业园区职业技术学院 | A kind of electromechanics gas integral production training system |
| CN112216094A (en) * | 2020-10-26 | 2021-01-12 | 深圳乐播科技有限公司 | Screen projection control system and screen projection control method based on remote controller |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN201638151U (en) | Device for realizing virtual display and virtual interactive operation | |
| CN105593785B (en) | Stare auxiliary touch-screen input | |
| CN103336575B (en) | The intelligent glasses system of a kind of man-machine interaction and exchange method | |
| WO2010062117A2 (en) | Immersive display system for interacting with three-dimensional content | |
| US20100053151A1 (en) | In-line mediation for manipulating three-dimensional content on a display device | |
| CN102779000B (en) | User interaction system and method | |
| US11816800B2 (en) | Guided consumer experience | |
| US20190384404A1 (en) | Virtual reality | |
| CN107407965A (en) | It is connected to the virtual reality helmet of mobile computing device | |
| US10643579B2 (en) | HMD device and method for controlling same | |
| US20160249043A1 (en) | Three dimensional (3d) glasses, 3d display system and 3d display method | |
| CN111915481B (en) | Image processing method, device, electronic equipment and medium | |
| CN107065197B (en) | Human eye tracking remote rendering real-time display method and system for VR glasses | |
| CN111258420B (en) | Information interaction method, head-mounted device and medium | |
| CN110119260B (en) | Screen display method and terminal | |
| CN106886284A (en) | A kind of Cultural relics in museum interactive system based on Kinect | |
| CN205068298U (en) | Interaction system is wandered to three -dimensional scene | |
| CN204406327U (en) | Based on the limb rehabilitating analog simulation training system of said three-dimensional body sense video camera | |
| CN105472358A (en) | Intelligent terminal about video image processing | |
| CN204990186U (en) | Desktop formula stereoscopic display interaction system | |
| CN105892627A (en) | Virtual augmented reality method and apparatus, and eyeglass or helmet using same | |
| CN107632702A (en) | A holographic projection system and its workflow using light-sensing data gloves | |
| Basu et al. | Ubiquitous collaborative activity virtual environments | |
| CN108205823A (en) | MR holographies vacuum experiences shop and experiential method | |
| CN111240483A (en) | Operation control method, head-mounted device, and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20101117 Termination date: 20130129 |