CN204028887U - A kind of reading of the hand-held based on augmented reality equipment - Google Patents
A kind of reading of the hand-held based on augmented reality equipment Download PDFInfo
- Publication number
- CN204028887U CN204028887U CN201420410347.9U CN201420410347U CN204028887U CN 204028887 U CN204028887 U CN 204028887U CN 201420410347 U CN201420410347 U CN 201420410347U CN 204028887 U CN204028887 U CN 204028887U
- Authority
- CN
- China
- Prior art keywords
- viewing device
- augmented reality
- camera
- handheld viewing
- scene
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 230000003190 augmentative effect Effects 0.000 title claims abstract description 55
- 239000004973 liquid crystal related substance Substances 0.000 claims abstract description 24
- 238000005516 engineering process Methods 0.000 claims description 30
- 238000012545 processing Methods 0.000 claims description 15
- 230000003993 interaction Effects 0.000 claims description 13
- 230000006870 function Effects 0.000 claims description 11
- 238000009877 rendering Methods 0.000 claims description 7
- 230000002452 interceptive effect Effects 0.000 claims description 6
- 230000000295 complement effect Effects 0.000 claims description 3
- 229910044991 metal oxide Inorganic materials 0.000 claims description 3
- 150000004706 metal oxides Chemical class 0.000 claims description 3
- 239000004065 semiconductor Substances 0.000 claims description 3
- 230000000694 effects Effects 0.000 abstract description 17
- 230000004438 eyesight Effects 0.000 abstract description 3
- 210000000697 sensory organ Anatomy 0.000 abstract description 3
- 230000030214 innervation Effects 0.000 abstract 1
- 238000000034 method Methods 0.000 description 21
- 230000000875 corresponding effect Effects 0.000 description 17
- 238000010586 diagram Methods 0.000 description 15
- 230000019771 cognition Effects 0.000 description 4
- 239000000203 mixture Substances 0.000 description 4
- 238000010422 painting Methods 0.000 description 4
- 238000011161 development Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000001953 sensory effect Effects 0.000 description 3
- 230000000638 stimulation Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 241000282320 Panthera leo Species 0.000 description 1
- 241000287181 Sturnus vulgaris Species 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 238000005452 bending Methods 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000004379 myopia Effects 0.000 description 1
- 208000001491 myopia Diseases 0.000 description 1
- 230000035479 physiological effects, processes and functions Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000009978 visual deterioration Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Landscapes
- User Interface Of Digital Computer (AREA)
- Processing Or Creating Images (AREA)
Abstract
The utility model provides a kind of hand-held based on augmented reality reading equipment.This hand-held reading equipment comprises: circular body, and its front is provided with LCD screen, second camera and microphone, and its back side arranges the first camera and loudspeaker; And grip part, be connected with circular body, for grasping hand-held reading equipment.This hand-held reading equipment carries out playing up of three-dimensional virtual scene to the reality scene of the first camera collection, and through liquid crystal screen display reality scene and the mixed reading picture of virtual scene.Compared to prior art, the utility model can generate with reality scene matched, the virtual environment with vision true to nature, the sense of hearing, sense of touch, dynamics sense and innervation etc., realize user and virtual three-dimensional environment directly carries out alternately.Thus, child can obtain more stimulus to the sense organ, improves learning efficiency, teaches through lively activities.
Description
Technical Field
The utility model relates to an Augmented Reality (AR) technical field especially relates to a hand-held type reading equipment based on Augmented Reality technique.
Background
The augmented reality technology is a new technology developed on the basis of virtual reality, and is an important branch of virtual reality research. In summary, the augmented reality technology is to generate virtual objects that do not exist in the real environment by means of computer graphics technology and visualization technology, accurately "embed" the virtual objects into the real environment, then integrate the virtual objects with the real environment through a display device, apply virtual information to the real world, and thus present a new environment with realistic effects to a user, so as to realize the augmented reality. For example, the AR technology can superimpose entity information (such as visual information, sound, taste, or touch) that is originally difficult to experience in a certain time-space range of the real world onto the real world after simulation by scientific technology, so as to be perceived by human senses, thereby achieving a sensory experience beyond reality.
In addition, in the prior art, the teaching aids for children are mainly classified into a traditional class, an innovation class, an entity class, a virtual class, an entertainment class and an education class, and the corresponding mainstream products include an early education machine, a point reading pen, an electronic book/bag, a literacy card, computer education software and the like. The transverse comparison shows that the traditional education toy and teaching aid is low in interestingness and difficult to mobilize the initiative of children; teaching aid operation is played to high-tech education class comparatively complicated, and is higher to user's cognition with control the threshold, does not have fine interactive playing and teaching form of drive family. In addition, most of these teaching products are non-invasive and innovative, and a considerable number of products are copying the same products. On the other hand, with the popularization of tablet computers and smart phones in recent years, many early education software are beginning to pay attention to portable mobile platforms. However, tablet computers are not developed specifically for children, and there are many objections to the sound of playing tablet computers for children in the market, and the focus problems mainly include: 1) because the screen size of the tablet personal computer is relatively small, the visual deterioration or the myopia is easily caused when the tablet personal computer stares at the screen for a long time; 2) when the tablet personal computer is used, the cervical vertebra development can be influenced by bending the neck for a long time to see the tablet personal computer; 3) the children are exposed to the software game too early, so that the pleasure of the real environment game is lacked, and the pleasure of the real environment game is influenced or reduced sometimes; 4) although the traditional interaction mode of using a keyboard or a mouse is changed by a touch tablet computer or a smart phone, the interaction between children and teaching aids still stays on a two-dimensional plane, and the sensory experience degree is low.
Therefore, how to design a handheld reading device organically combines the current augmented reality technology with the traditional teaching aid for children to play and teach through lively activities, so that children naturally link language learning, image cognition and three-dimensional digital models in the reading process. Enhancing sensory stimulation and improving learning efficiency is a subject to be urgently solved by technical personnel in the related field.
SUMMERY OF THE UTILITY MODEL
To the above-mentioned a great deal of defect that panel computer and smart mobile phone among the prior art exist when being applied to children and playing the teaching aid, the utility model provides a novel, based on augmented reality technique hand-held type reading equipment.
An aspect of the utility model provides a hand-held type reading equipment based on augmented reality technique, include:
the round body is provided with a front side and a back side which are oppositely arranged, the front side of the round body is provided with a liquid crystal screen, a second camera and a microphone, and the back side of the round body is provided with a first camera and a loudspeaker; and
a holding part connected with the circular body and used for holding the handheld reading equipment,
the handheld viewing equipment renders a three-dimensional virtual scene of a real scene collected by the first camera, and displays a viewing picture mixed with the real scene and the virtual scene through the liquid crystal screen.
In one embodiment, the lcd has a touch function, and the touch operation is implemented by a resistive, capacitive, infrared scanning or infrared image sensing touch sensor.
In an embodiment of the present invention, the second camera and the microphone are located at a center position of a top end of the circular body, the second camera is configured to collect a real scene on a front side of the circular body, and the microphone is configured to receive voice interaction information of a user.
In one embodiment, the first camera is used for capturing and capturing a real scene on the back side of the circular body, and the first camera is a charge coupled device image sensor or a complementary metal oxide semiconductor image sensor.
In an embodiment of the present invention, the side surface of the circular body further includes a function button for switching between different functions of the handheld viewing device.
In one embodiment, the connection between the circular body and the holding portion further includes a control button.
In one embodiment, the handheld viewing device further includes a brightness sensor for detecting an ambient light intensity of the handheld viewing device, and an auxiliary backlight source for providing an auxiliary backlight when the ambient light intensity is insufficient.
According to the utility model discloses an another aspect provides a hand-held type reading equipment based on augmented reality technique, include:
the video acquisition unit is used for capturing a real scene through the first camera;
the intelligent computing terminal is used for identifying the two-dimensional code in the real scene to obtain corresponding code value information and space position information, then placing a preset virtual scene according to the space position information, and generating a reading picture after the real scene and the virtual scene are mixed;
a voice output unit for outputting voice information corresponding to the virtual scene through a speaker; and
and the liquid crystal screen is in a circular shape and is used for displaying the browsing picture generated by the intelligent computing terminal.
In one embodiment, when the handheld viewing device is moved, the two-dimensional code in the real scene moves, the intelligent computing terminal controls the picture movement in the virtual scene according to the moved two-dimensional code, and the liquid crystal screen outputs the dynamic viewing picture after the handheld viewing device moves.
In one embodiment, the intelligent computing terminal further includes: and the buffer unit is used for backing up code value information and spatial position information corresponding to a plurality of two-dimensional codes before the current frame, and delaying the three-dimensional object motion drive in the virtual scene by corresponding frame number so as to reserve the processing time required by two-dimensional code identification.
In one embodiment, the intelligent computing terminal includes: the network interface is used for acquiring a plurality of augmented reality applications from the Internet and selecting one augmented reality application to execute according to the requirements of a user; and the two-dimension code identification unit is used for automatically tracking and identifying the two-dimension code to obtain the code value information and the spatial position information when a user moves the two-dimension code in the real scene to the shooting range of the first camera.
In one embodiment, the intelligent computing terminal further includes: the virtual scene generating unit is used for inquiring a matched virtual scene according to the spatial position information from the two-dimension code identifying unit, and the virtual real-time rendering unit is used for drawing the inquired virtual scene in real time and displaying the drawn virtual scene and the drawn real scene on the liquid crystal screen in a mixed manner.
In one embodiment, the intelligent computing terminal further includes: and the interaction unit is used for identifying the interactive operation of the human face or the human hand and obtaining the three-dimensional information implicit in the real scene according to the interactive operation so as to directly interact the three-dimensional information and the three-dimensional object in the virtual scene.
In one embodiment, the handheld viewing device includes a circular body and a holding portion, the circular body is provided with the lcd with a touch function, and a connection between the circular body and the holding portion includes a control button.
In one embodiment of the present invention, the center of the top end of the circular body includes a second camera and a microphone, the second camera is used for collecting a real scene on one side of the liquid crystal screen, and the microphone is used for receiving voice interaction information of a user.
In an embodiment of the present invention, the handheld viewing device further includes a brightness sensor and an auxiliary backlight source, where the brightness sensor is configured to detect an ambient light intensity of the handheld viewing device, and the auxiliary backlight source provides an auxiliary backlight when the ambient light intensity is insufficient.
Adopt the utility model discloses a hand-held type reads equipment, the video acquisition unit passes through first camera and catches real scene, and intelligent computing terminal discerns the two-dimensional code in real scene in order to obtain sign indicating number value information and spatial position information, then places predetermined virtual scene according to spatial position information, and generates the reading picture after real scene and virtual scene mix, and the LCD screen that is circular form is used for showing the reading picture that comes from intelligent computing terminal and generate. Compared with the prior art, the utility model discloses utilize intelligent computing terminal to generate one kind with the virtual environment that real scene height matches, have lifelike vision, sense of hearing, sense of touch, dynamics and active etc. can realize that user and virtual three-dimensional environment directly interact. Therefore, children can easily link language learning, image cognition and the three-dimensional digital model together in the learning process, sense organ stimulation of more dimensions is enhanced, learning efficiency is improved, and education is achieved through lively activities.
Drawings
Various aspects of the present invention will become more apparent to the reader after reading the detailed description of the invention with reference to the attached drawings. Wherein,
fig. 1(a) -1 (c) are schematic external outline views of a handheld viewing device based on augmented reality technology according to an embodiment of the present application;
fig. 2 is a schematic structural composition diagram of a handheld viewing device based on augmented reality technology according to another embodiment of the present application;
FIG. 3 illustrates one embodiment of an intelligent computing terminal of the handheld viewing device of FIG. 2;
FIG. 4 illustrates a block flow diagram of a viewing screen for implementing augmented reality using the handheld viewing device of FIG. 3;
FIG. 5 illustrates another embodiment of the intelligent computing terminal of the handheld viewing device of FIG. 2;
FIG. 6 is a block flow diagram of a handheld viewing method based on augmented reality technology according to yet another embodiment of the present application;
fig. 7 is a diagram illustrating an augmented reality effect according to the first embodiment of the handheld viewing method of fig. 6;
fig. 8 is a diagram illustrating an augmented reality effect using the second embodiment of the handheld viewing method of fig. 6;
fig. 9 is a diagram illustrating an augmented reality effect according to a third embodiment of the handheld viewing method of fig. 6; and
fig. 10 is a diagram illustrating an augmented reality effect according to a fourth embodiment of the handheld viewing method of fig. 6.
Detailed Description
In order to make the present disclosure more complete and complete, reference is made to the accompanying drawings, in which like references indicate similar elements, and to the various embodiments of the invention described below. However, it should be understood by those skilled in the art that the examples provided below are not intended to limit the scope of the present invention. In addition, the drawings are only for illustrative purposes and are not drawn to scale.
Embodiments of various aspects of the present invention are described in further detail below with reference to the figures.
Fig. 1(a) -1 (c) are schematic external outline diagrams of a handheld viewing device based on augmented reality technology according to an embodiment of the present application. Fig. 1(a) is a front view of the apparatus, fig. 1(b) is a rear view of the apparatus, and fig. 1(c) is a side view of the apparatus.
Referring to fig. 1(a) -1 (c), the handheld viewing device based on augmented reality of the present invention is similar to the external contour of a magnifying glass, and includes a circular body and a holding portion 4. The grip portion 4 is specially designed to conform to the physiology of children and to facilitate hand-held grasping.
In detail, the front of the circular body is provided with a liquid crystal screen 1, a second camera and a microphone 2. Here, the circular liquid crystal screen can give the user an intuitive feeling of "being in the small and" being in the rare ". This is because the rectangular screen is suitable for development to a wide and wide scene, and the circular screen is suitable for development to a near and deep scene. Compared with the traditional rectangular screen, the corners of the circular screen cannot be captured, and the angle is optional, so that the front view angle interface can be always presented under the action of the sensor. For example, a second camera and a microphone 2 are located at the center of the top end of the body, the second camera (also referred to as a "front camera") collects a real scene on the front side of the body, and the microphone receives voice interaction information of the user. The back of the circular body is provided with a high-definition first camera (also referred to as "main camera") 5 and a speaker 6. The grip 4 is connected to the circular body for the user, especially a child, to grip the reading apparatus. The handheld viewing device renders a three-dimensional virtual scene of a real scene collected by the first camera 5, and displays a viewing picture obtained by mixing the real scene and the virtual scene through the liquid crystal screen 1.
In one embodiment, the lcd 1 has a touch function, and the corresponding touch operation is implemented by a resistive, capacitive, infrared scanning or infrared image sensing touch sensor.
In one embodiment, the first camera 5 captures and captures a real scene on the back side of the circular body, for example, the first camera 5 is a Charge Coupled Device (CCD) image sensor or a Complementary Metal Oxide Semiconductor (CMOS) image sensor.
In addition, a function key 7 is included on the side of the circular body for switching between different functions of the handheld viewing device. Preferably, a control key 3 is further included at the connection position of the circular body and the holding portion 4.
In addition, in order to facilitate the reading and browsing of the device under any light conditions, the present invention may further include a brightness sensor and an auxiliary backlight source (not shown in the figure). An ambient light intensity of the device is detected with a brightness sensor, and an auxiliary backlight is provided when the ambient light intensity is insufficient using an auxiliary backlight.
Fig. 2 is a schematic structural composition diagram of a handheld viewing device based on augmented reality technology according to another embodiment of the present application. Referring to fig. 2, in this embodiment, the handheld viewing device of the present invention includes a video capture unit 10, an intelligent computing terminal 12, a voice output unit 14 and a liquid crystal display 16.
In particular, the video capturing unit 10 is used to capture a real scene through a first camera (such as the main camera 5 of fig. 1). The intelligent computing terminal 12 is coupled to the video capture unit 10, and is configured to identify a two-dimensional code in a captured real scene, obtain code value information and spatial position information corresponding to the two-dimensional code, place a preset matching virtual scene according to the spatial position information, and generate a viewing picture after mixing the real scene and the virtual scene. The voice output unit 14 is coupled to the smart computing terminal 12 for outputting voice information corresponding to the virtual scene through a speaker (such as the speaker 6 of fig. 1). The lcd screen 1 is circular and coupled to the intelligent computing terminal 12 for displaying the viewing pictures generated from the intelligent computing terminal 12.
In one embodiment, when the viewing user, especially a child, moves the handheld viewing device, the two-dimensional code in the real scene moves, the smart computing terminal 12 controls the picture movement in the virtual scene according to the moving two-dimensional code, and the liquid crystal screen 1 outputs the dynamic viewing picture after the handheld viewing device moves.
In addition, thereby the moving speed of avoiding the two-dimensional code is too fast or skew when the shooting angle of first camera is too big leads to the instantaneous failure of two-dimensional code discernment, and then causes the three-dimensional virtual object's that is correlated with the demonstration to take place the stuck phenomenon, the utility model discloses an intelligent computing terminal 12 still includes buffer unit 121. The buffer unit 121 is configured to backup and buffer code value information and spatial position information corresponding to a plurality of two-dimensional codes before a current frame, and delay a three-dimensional virtual object motion driver in a virtual scene by a corresponding frame number to reserve processing time required for two-dimensional code identification. For example, the instantaneous position of the three-dimensional virtual object in the virtual scene is obtained by interpolating the spatial position information of the backed-up two-dimensional codes, so as to greatly improve the moving smoothness of the virtual object.
FIG. 3 illustrates a particular embodiment of the intelligent computing terminal of the handheld viewing device of FIG. 2. Referring to fig. 3, in this embodiment, the intelligent computing terminal 12 further includes a network interface (not shown in the figure), a two-dimensional code recognition unit 123, a virtual scene generation unit 125, and a virtual real-time rendering unit 127.
The network interface is used for acquiring a plurality of augmented reality applications from the Internet and selecting one augmented reality application to execute according to the requirements of a user. When the user moves the two-dimensional code in the real scene to the shooting range of the first camera, the two-dimensional code recognition unit 123 is configured to automatically track and recognize the two-dimensional code, and obtain corresponding code value information and spatial position information. The virtual scene generating unit 125 is coupled to the two-dimensional code recognizing unit 123, and is configured to query a matching virtual scene according to the spatial location information from the two-dimensional code recognizing unit 123. The virtual real-time rendering unit 127 is configured to render the queried virtual scene in real time, and display the rendered virtual scene and the real scene on the liquid crystal screen in a mixed manner.
In a specific embodiment, the intelligent computing terminal 12 further includes an interaction unit 129, configured to recognize an interaction operation of a human face or a human hand, and obtain three-dimensional information implicit in a real scene according to the interaction operation, so that the three-dimensional information is directly interacted with a three-dimensional object in a virtual scene, and the interactive entertainment of the device is improved. For example, the real scene includes books, literacy cards, objects in a science and technology museum or a museum, and environmental images.
In addition, the handheld viewing device may further include a storage unit (not shown in the figure) for storing virtual scene data corresponding to the augmented reality application, so as to implement an augmented reality experience of the device in an offline state.
Fig. 4 is a block flow diagram illustrating a viewing screen for implementing augmented reality using the handheld viewing device of fig. 3.
With reference to fig. 4 and 3, steps S101 and S103 are first executed, and a user obtains a plurality of augmented reality applications through the internet and starts one of the applications. In steps S105 and S107, the first camera starts video capture and capture, the captured and captured real scene is displayed on the screen, and the user freely moves the two-dimensional code of the real scene within the shooting range of the first camera. Next, the two-dimensional code is automatically tracked and recognized as shown in step S109. And finally, executing the step S111, and rendering and displaying the three-dimensional virtual object corresponding to the two-dimensional code on the liquid crystal screen by the system. In addition, the user can also provide three-dimensional information implied by the real scene through interaction, so that the user can directly interact with the virtual three-dimensional object.
FIG. 5 illustrates another embodiment of the intelligent computing terminal of the handheld viewing device of FIG. 2. Referring to fig. 5, in this embodiment, the intelligent computing terminal 12 further includes a main thread (main thread) processing unit 131 and a sub-thread processing unit 133. The main thread processing unit 131 is used for executing program logic operations and rendering operations performed by the intelligent computing terminal 12. The multiple sub-thread processing units 133 are configured to perform image capturing operations and transmit image capturing results back to the main thread processing unit 131. For example, the main thread processing unit 131 first sends an image capture request to the sub-thread processing unit 133, and the sub-thread processing unit 133 performs an image capture operation according to the image capture request and returns the image capture structure to the main thread processing unit 131 for subsequent processing.
Fig. 6 is a block flow diagram illustrating a handheld viewing method based on augmented reality technology according to still another embodiment of the present application.
In the viewing method, referring to fig. 6 and 2, step S21 is first executed to capture a real scene through the first camera by the video capturing unit 10. Then, steps S23 and S25 are executed, and the smart computing terminal 12 identifies the two-dimensional code in the captured real scene to obtain corresponding code value information and spatial position information. And then, placing a preset virtual scene according to the spatial position information, and generating a reading picture mixed with the real scene and the virtual scene. Next, in step S27, the voice output unit 14 outputs voice information corresponding to the virtual scene through the speaker. Finally, step S29 is executed to display the viewing screen generated by the smart computing terminal 12 on the circular liquid crystal display 16.
In one embodiment, the handheld viewing method further comprises the steps of: when the handheld viewing device is moved, the two-dimension code in the real scene moves, the intelligent computing terminal controls the picture movement in the virtual scene according to the moved two-dimension code, and the liquid crystal screen outputs the dynamic viewing picture after the handheld viewing device moves.
In one embodiment, the handheld viewing method further comprises the steps of: the code value information and the space position information corresponding to a plurality of two-dimensional codes before the current frame are backed up, and the delay of the corresponding frame number is carried out on the three-dimensional object motion drive in the virtual scene so as to reserve the processing time required by two-dimensional code identification. For example, the instantaneous position of the three-dimensional object in the virtual scene is obtained by interpolating the spatial position information of the backed-up two-dimensional codes.
Fig. 7 is a diagram illustrating an augmented reality effect according to the first embodiment of the handheld viewing method of fig. 6.
In fig. 7, when the user faces the handheld viewing device to the famous painting of the museum, the main camera of the device captures the famous painting, mixes the preset virtual three-dimensional animation with the real object, and finally, the picture effect that the famous painting can be seen on the circular screen 11 is that the famous painting is converted from a static picture in the original real scene to a mixed dynamic picture.
Fig. 8 is a diagram illustrating an augmented reality effect according to a second embodiment of the handheld viewing method of fig. 6.
In fig. 8, when the user aims the handheld viewing device at a certain area (e.g. egypt) on the globe, the main camera 22 of the device starts capturing and projects a preset three-dimensional virtual animation on the globe, and finally the effect of appearing on the circular screen 21 is that a feature animation (e.g. a character or a lion figure) of the country appears above the area. For example, when a child picks up the "scientific magnifying magic mirror" (i.e., the handheld viewing device) and aims at a certain national plate of the globe, the picture effect presented on the circular screen is that the globe is standing on an image of three-dimensional characters and other information of the traditional clothes of the country, such as famous buildings, historical characters, and the like, and the different types of images can be switched by keys.
Fig. 9 is a diagram illustrating an augmented reality effect according to a third embodiment of the handheld viewing method of fig. 6.
In fig. 9, the user aims the handheld viewing device at a book or a card, the camera 31 of the device starts to work, and the three-dimensional virtual image 32 is projected on the book, and finally, a three-dimensional stereoscopic picture formed by mixing a real scene and a virtual scene appears on the book on the circular screen.
Fig. 10 is a diagram illustrating an augmented reality effect according to a fourth embodiment of the handheld viewing method of fig. 6.
In fig. 10, the user aims the hand-held viewing device at a toy tank in a real scene, the camera of the device starts working, and after the processing of the intelligent computing terminal in the device, the final picture effect that can be seen in a circular screen is that a starship ship attacks the tank, children can use the device to interact with the tank and operate the tank, the combination of virtual and reality is realized through the augmented reality technology, and only the tank gun tube moves to fire, and the starships attacking the tank are knocked down one by one.
Adopt the utility model discloses a hand-held type reads equipment, the video acquisition unit passes through first camera and catches real scene, and intelligent computing terminal discerns the two-dimensional code in real scene in order to obtain sign indicating number value information and spatial position information, then places predetermined virtual scene according to spatial position information, and generates the reading picture after real scene and virtual scene mix, and the LCD screen that is circular form is used for showing the reading picture that comes from intelligent computing terminal and generate. Compared with the prior art, the utility model discloses utilize intelligent computing terminal to generate one kind with the virtual environment that real scene height matches, have lifelike vision, sense of hearing, sense of touch, dynamics and active etc. can realize that user and virtual three-dimensional environment directly interact. Therefore, children can easily link language learning, image cognition and the three-dimensional digital model together in the learning process, sense organ stimulation of more dimensions is enhanced, learning efficiency is improved, and education is achieved through lively activities.
Hereinbefore, specific embodiments of the present invention have been described with reference to the accompanying drawings. However, those skilled in the art will appreciate that various modifications and substitutions can be made to the specific embodiments of the present invention without departing from the spirit and scope of the invention. Such modifications and substitutions are intended to be included within the scope of the present invention as defined by the appended claims.
Claims (16)
1. A handheld viewing device based on augmented reality technology, the handheld viewing device comprising:
the round body is provided with a front side and a back side which are oppositely arranged, the front side of the round body is provided with a liquid crystal screen, a second camera and a microphone, and the back side of the round body is provided with a first camera and a loudspeaker; and
a holding part connected with the circular body and used for holding the handheld reading equipment,
the handheld viewing equipment renders a three-dimensional virtual scene of a real scene collected by the first camera, and displays a viewing picture mixed with the real scene and the virtual scene through the liquid crystal screen.
2. The augmented reality technology-based handheld viewing device of claim 1, wherein the liquid crystal screen has a touch function and the touch operation is implemented by a resistive, capacitive, infrared scanning or infrared image sensing touch sensor.
3. The augmented reality technology-based handheld viewing device of claim 1, wherein the second camera and the microphone are located at a center position of a top end of the circular body, the second camera is used for collecting a real scene on a front side of the circular body, and the microphone is used for receiving voice interaction information of a user.
4. The augmented reality technology-based handheld viewing device of claim 1, wherein the first camera is to capture and capture a real scene of a backside of the circular body,
the first camera is a charge coupled device image sensor or a complementary metal oxide semiconductor image sensor.
5. The augmented reality technology-based handheld viewing device of claim 1, wherein the side of the circular body further comprises a function button for switching between different functions of the handheld viewing device.
6. The augmented reality technology-based handheld viewing device of claim 1, wherein a connection between the circular body and the holding portion further comprises a control button.
7. The augmented reality based handheld viewing device of claim 1, further comprising a brightness sensor and an auxiliary backlight source,
the brightness sensor is used for detecting the intensity of the environment light of the handheld viewing device, and the auxiliary backlight source provides auxiliary backlight when the intensity of the environment light is insufficient.
8. A handheld viewing device based on augmented reality technology, the handheld viewing device further comprising:
the video acquisition unit is used for capturing a real scene through the first camera;
the intelligent computing terminal is used for identifying the two-dimensional code in the real scene to obtain corresponding code value information and spatial position information, then placing a preset virtual scene according to the spatial position information, and generating a reading picture after the real scene and the virtual scene are mixed;
a voice output unit for outputting a voice corresponding to the virtual scene through a speaker
The voice information of (2); and
and the liquid crystal screen is in a circular shape and is used for displaying the browsing picture generated by the intelligent computing terminal.
9. The augmented reality technology-based handheld viewing device of claim 8, wherein the two-dimensional code in the real scene moves when the handheld viewing device is moved, the smart computing terminal controls the picture movement in the virtual scene according to the moving two-dimensional code, and the liquid crystal screen outputs a dynamic viewing picture after the handheld viewing device moves.
10. The augmented reality technology-based handheld viewing device of claim 9, wherein the smart computing terminal further comprises:
and the buffer unit is used for backing up code value information and spatial position information corresponding to a plurality of two-dimensional codes before the current frame, and delaying the three-dimensional object motion drive in the virtual scene by corresponding frame number so as to reserve the processing time required by two-dimensional code identification.
11. The augmented reality technology-based handheld viewing device of claim 8, wherein the smart computing terminal comprises:
the network interface is used for acquiring a plurality of augmented reality applications from the Internet and selecting one augmented reality application to execute according to the requirements of a user; and
and the two-dimension code identification unit is used for automatically tracking and identifying the two-dimension code to obtain the code value information and the spatial position information when a user moves the two-dimension code in the real scene to the shooting range of the first camera.
12. The augmented reality technology-based handheld viewing device of claim 11, wherein the smart computing terminal further comprises:
a virtual scene generating unit for inquiring the matched virtual scene according to the spatial position information from the two-dimensional code identifying unit, an
And the virtual real-time rendering unit is used for rendering the virtual scene obtained by query in real time and displaying the rendered virtual scene and the real scene on the liquid crystal screen in a mixed manner.
13. The augmented reality technology-based handheld viewing device of claim 12, wherein the smart computing terminal further comprises:
and the interaction unit is used for identifying the interactive operation of the human face or the human hand and obtaining the three-dimensional information implicit in the real scene according to the interactive operation so as to directly interact the three-dimensional information and the three-dimensional object in the virtual scene.
14. The augmented reality technology-based handheld viewing device of claim 8, wherein the handheld viewing device comprises a circular body and a holding portion, the circular body is provided with the liquid crystal screen with a touch function, and a connection between the circular body and the holding portion comprises a control button.
15. The augmented reality technology-based handheld viewing device of claim 14, wherein the top center of the circular body comprises a second camera and a microphone, the second camera is used for capturing a real scene on one side of the liquid crystal screen, and the microphone is used for receiving voice interaction information of a user.
16. The augmented reality based handheld viewing device of claim 8, further comprising a brightness sensor and an auxiliary backlight source,
the brightness sensor is used for detecting the intensity of the environment light of the handheld viewing device, and the auxiliary backlight source provides auxiliary backlight when the intensity of the environment light is insufficient.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201420410347.9U CN204028887U (en) | 2014-07-24 | 2014-07-24 | A kind of reading of the hand-held based on augmented reality equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201420410347.9U CN204028887U (en) | 2014-07-24 | 2014-07-24 | A kind of reading of the hand-held based on augmented reality equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN204028887U true CN204028887U (en) | 2014-12-17 |
Family
ID=52068724
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201420410347.9U Expired - Fee Related CN204028887U (en) | 2014-07-24 | 2014-07-24 | A kind of reading of the hand-held based on augmented reality equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN204028887U (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104102412A (en) * | 2014-07-24 | 2014-10-15 | 央数文化(上海)股份有限公司 | Augmented reality technology-based handheld reading equipment and reading method thereof |
| CN106340213A (en) * | 2016-08-19 | 2017-01-18 | 苏州七彩部落网络科技有限公司 | Method and device for realizing assisted education through AR |
| CN107102726A (en) * | 2017-03-14 | 2017-08-29 | 深圳市吉美文化科技有限公司 | A kind of preschool education system based on AR |
| CN107423377A (en) * | 2017-07-11 | 2017-12-01 | 河南书网教育科技股份有限公司 | Interactive children's book equipped directory system and method |
| CN108136641A (en) * | 2015-10-30 | 2018-06-08 | 克劳斯玛菲科技有限公司 | Plastic-injection moulding machine at least one video camera |
| WO2019205283A1 (en) * | 2018-04-23 | 2019-10-31 | 太平洋未来科技（深圳）有限公司 | Infrared-based ar imaging method, system, and electronic device |
| CN111031306A (en) * | 2019-11-27 | 2020-04-17 | 张树坤 | AR is discernment location bottom plate equipment for display device |
-
2014
- 2014-07-24 CN CN201420410347.9U patent/CN204028887U/en not_active Expired - Fee Related
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104102412A (en) * | 2014-07-24 | 2014-10-15 | 央数文化(上海)股份有限公司 | Augmented reality technology-based handheld reading equipment and reading method thereof |
| CN108136641A (en) * | 2015-10-30 | 2018-06-08 | 克劳斯玛菲科技有限公司 | Plastic-injection moulding machine at least one video camera |
| CN108136641B (en) * | 2015-10-30 | 2020-08-25 | 克劳斯玛菲科技有限公司 | Plastic injection molding machine with at least one camera |
| CN106340213A (en) * | 2016-08-19 | 2017-01-18 | 苏州七彩部落网络科技有限公司 | Method and device for realizing assisted education through AR |
| CN107102726A (en) * | 2017-03-14 | 2017-08-29 | 深圳市吉美文化科技有限公司 | A kind of preschool education system based on AR |
| CN107423377A (en) * | 2017-07-11 | 2017-12-01 | 河南书网教育科技股份有限公司 | Interactive children's book equipped directory system and method |
| WO2019205283A1 (en) * | 2018-04-23 | 2019-10-31 | 太平洋未来科技（深圳）有限公司 | Infrared-based ar imaging method, system, and electronic device |
| CN111031306A (en) * | 2019-11-27 | 2020-04-17 | 张树坤 | AR is discernment location bottom plate equipment for display device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104102412B (en) | A kind of hand-held reading device and method thereof based on augmented reality | |
| CN204028887U (en) | A kind of reading of the hand-held based on augmented reality equipment | |
| US20180197345A1 (en) | Augmented reality technology-based handheld viewing device and method thereof | |
| CN109976519B (en) | Interactive display device based on augmented reality and interactive display method thereof | |
| CN106383587B (en) | Augmented reality scene generation method, device and equipment | |
| US8866848B2 (en) | Image processing device, control method for an image processing device, program, and information storage medium | |
| CN106355153B (en) | A kind of virtual objects display methods, device and system based on augmented reality | |
| JP5791433B2 (en) | Information processing program, information processing system, information processing apparatus, and information processing method | |
| US20130234934A1 (en) | Three-Dimensional Collaboration | |
| CN104243962A (en) | Augmented reality head-mounted electronic device and method for generating augmented reality | |
| CN106023692A (en) | AR interest learning system and method based on entertainment interaction | |
| WO2015000286A1 (en) | Three-dimensional interactive learning system and method based on augmented reality | |
| CN110568923A (en) | unity 3D-based virtual reality interaction method, device, equipment and storage medium | |
| EP2051208A2 (en) | Generating an asset for interactive entertainment using digital image capture | |
| JP2015001875A (en) | Image processing apparatus, image processing method, program, print medium, and print-media set | |
| CN108829250A (en) | A kind of object interaction display method based on augmented reality AR | |
| CN106600669A (en) | Device based on variable-color fluorescent drawing board and augmented reality, and operation method | |
| CN110096144A (en) | A kind of interaction holographic projection methods and system based on three-dimensional reconstruction | |
| CN112905014A (en) | Interaction method and device in AR scene, electronic equipment and storage medium | |
| CN115454256A (en) | A digital oath tablet device | |
| TW201222476A (en) | Image processing system and method thereof, computer readable storage media and computer program product | |
| CN114299263A (en) | Display method and device for augmented reality AR scene | |
| CN113470190A (en) | Scene display method and device, equipment, vehicle and computer readable storage medium | |
| CN111918114A (en) | Image display method, image display device, display equipment and computer readable storage medium | |
| US20200184675A1 (en) | Positioning Method and Reality Presenting Device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20141217 |