CN102411854A - Classroom teaching mixing technology application system based on enhanced reality and method thereof - Google Patents
Classroom teaching mixing technology application system based on enhanced reality and method thereof Download PDFInfo
- Publication number
- CN102411854A CN102411854A CN2011102554287A CN201110255428A CN102411854A CN 102411854 A CN102411854 A CN 102411854A CN 2011102554287 A CN2011102554287 A CN 2011102554287A CN 201110255428 A CN201110255428 A CN 201110255428A CN 102411854 A CN102411854 A CN 102411854A
- Authority
- CN
- China
- Prior art keywords
- image
- mark
- augmented reality
- technology application
- hybrid technology
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000005516 engineering process Methods 0.000 title claims abstract description 48
- 238000000034 method Methods 0.000 title claims abstract description 27
- 238000012545 processing Methods 0.000 claims abstract description 40
- 238000004458 analytical method Methods 0.000 claims abstract description 25
- 230000003190 augmentative effect Effects 0.000 claims description 46
- 238000002372 labelling Methods 0.000 claims description 11
- 239000011159 matrix material Substances 0.000 claims description 11
- 230000008569 process Effects 0.000 claims description 11
- 230000007704 transition Effects 0.000 claims description 7
- 230000000694 effects Effects 0.000 claims description 6
- 239000000463 material Substances 0.000 claims description 6
- 230000000295 complement effect Effects 0.000 claims description 5
- 238000004364 calculation method Methods 0.000 claims description 4
- 238000006073 displacement reaction Methods 0.000 claims description 2
- 238000012544 monitoring process Methods 0.000 claims description 2
- 230000003993 interaction Effects 0.000 abstract description 14
- 230000002452 interceptive effect Effects 0.000 description 14
- 238000010586 diagram Methods 0.000 description 10
- 230000006870 function Effects 0.000 description 6
- 230000008878 coupling Effects 0.000 description 5
- 238000010168 coupling process Methods 0.000 description 5
- 238000005859 coupling reaction Methods 0.000 description 5
- 239000003550 marker Substances 0.000 description 5
- 238000013461 design Methods 0.000 description 4
- 239000000284 extract Substances 0.000 description 4
- 239000012467 final product Substances 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000010191 image analysis Methods 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 241000272525 Anas platyrhynchos Species 0.000 description 1
- HUTDUHSNJYTCAR-UHFFFAOYSA-N ancymidol Chemical compound C1=CC(OC)=CC=C1C(O)(C=1C=NC=NC=1)C1CC1 HUTDUHSNJYTCAR-UHFFFAOYSA-N 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000001149 cognitive effect Effects 0.000 description 1
- 230000000052 comparative effect Effects 0.000 description 1
- RKTYLMNFRDHKIL-UHFFFAOYSA-N copper;5,10,15,20-tetraphenylporphyrin-22,24-diide Chemical compound [Cu+2].C1=CC(C(=C2C=CC([N-]2)=C(C=2C=CC=CC=2)C=2C=CC(N=2)=C(C=2C=CC=CC=2)C2=CC=C3[N-]2)C=2C=CC=CC=2)=NC1=C3C1=CC=CC=C1 RKTYLMNFRDHKIL-UHFFFAOYSA-N 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000001351 cycling effect Effects 0.000 description 1
- 230000002950 deficient Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000008451 emotion Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000035800 maturation Effects 0.000 description 1
- 238000010606 normalization Methods 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000001151 other effect Effects 0.000 description 1
- 239000002245 particle Substances 0.000 description 1
- 238000007639 printing Methods 0.000 description 1
- 239000000047 product Substances 0.000 description 1
- 230000001915 proofreading effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Landscapes
- Electrically Operated Instructional Devices (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention relates to a classroom teaching mixing technology application system based on enhanced reality and a method thereof. The system comprises that: an object printed with a marked surface; an image acquisition device used for acquiring an image of the object in a classroom environment; an image processing module used for processing and analyzing the acquired image; an image positioning module used for analyzing and calculating a coordinate of an identified mark in the acquired image; an image generation module used for placing a virtual object corresponding to the identified mark at a coordinate position of the mark in the image; a data statistics and analysis module used for counting and analyzing answer content; a display device used for displaying an image which is generated finally or a data statistics analysis result. According to the system and the method in the invention, a plurality of interaction modes in teaching can be realized, compared with a present classroom interaction feedback system, realization cost and needed expense of the system in the invention are obviously reduced, and flexibility of usage is substantially raised.
Description
Technical field
The invention belongs to computing machine augmented reality technology and the mixing application of interaction technique in classroom instruction, be specifically related to a kind of classroom instruction hybrid technology application system and method based on augmented reality.
Background technology
Traditional classroom story teaching is normally carried out with the form of books and video-tape or lantern slide, and the means of education are more single.Though use video-tape or lantern slide, with respect to the books teaching, the standardization level in classroom has obtained certain raising, have no after the interactive broadcast, and be main still with teacher's instruction, still rest on the one-way transmission stage of information.This teaching is to the operation of students ability, and the culture effect of aspects such as social quality, emotion will is very little.Because traditional form of teaching is interactive very poor, unilaterally lecture by the teacher, make a lot of students lose learning interest.Institute gains knowledge and can not apply in a flexible way, and also just can't change ability into.Because its one-side teaching character causes highly relying on teacher in the teaching process, make quality of instruction stable inadequately.
Existing classroom interaction feedback system generally is through electronics carrier (like PDA, mobile phone or telepilot), lets all students in the classroom can interactive feed back to teacher's a kind of teaching application system.Form by teacher's telepilot, student's telepilot (everyone), receiver and supporting software etc.It can test classroom instruction, classroom, vote, ludic activity, guess that learning teaching assessment etc. organically combines unexpectedly; On the basis in existing most of classroom " projector of a computer "; Both can realize the irrealizable numerical digit interactive teaching in traditional classroom, and can correct, add up and generate various forms etc. again automatically.For example, and the interactive feedback system of ChinaIRS (China Interactive Response System, be called for short: ChinaIRS), perhaps other like products.
Though existing classroom interaction feedback system has changed traditional " force-fed duck " formula teaching pattern, highlight the interactive flexibly characteristic of classroom teachers and students; The input cost of its hardware facility is higher relatively; Teacher and each student need distribute an electronic romote-controller, receive and treating apparatus the function singleness of these hardware facilities but also corresponding signal will be set; Form fix can't be brought classroom effect more flexibly.
Summary of the invention
The objective of the invention is to defective to traditional teaching way and existing classroom interaction feedback system; A kind of classroom instruction hybrid technology application system and method based on augmented reality is provided; Improve the interactive of classroom instruction; Make the student in being rich in the teaching environment of temperament and interest, strengthen understanding and interest knowledge.
Technical scheme of the present invention is following: a kind of classroom instruction hybrid technology application system based on augmented reality comprises:
Be printed on the object of index face, place classroom environment, print the image of index face can be by effective collection and identification;
Image modalities is used for gathering the said image that is printed on the object of index face at classroom environment, and the image that collects is transferred to computing machine;
Image processing module is used for the image that collects is handled and analyzed, and obtains the mark that is complementary with template in the image, and discerns the implication of this mark representative;
The image locating module is used for the coordinate that is marked at the image that collects that analytical calculation is discerned;
The image generation module is used for the mark corresponding virtual object of being discerned is placed the coordinate position of this mark of image, and merges mutually with true environment in the image;
Data statistics and analysis module, the answer content that is used for the student that the question and answer link in teaching identifies image processing module is carried out statistics and analysis;
Display device is used for image or data statistic analysis result that final virtual objects that generates of show image generation module and true environment combine together.
Further; Wherein, there is high-contrast in aforesaid classroom instruction hybrid technology application system based on augmented reality between mark in the described object that is printed on index face and the background color; Preferred version is the artwork master code labeling, and the artwork master code labeling is positioned at identified areas; Described identified areas is a border figure with reservation shape, Yi Bian preferred scheme is for having the square boundary frame of breach.
Further, the implication of the mark representative in the described object that is printed on index face also comprises following information: pupilage, answer content.
Further, also comprise the option content of question and answer and/or the direct performance information of pupilage on the described object that is printed on index face.
Further, the described object that is printed on index face is stationary state or motion state.
Further, aforesaid classroom instruction hybrid technology application system based on augmented reality, wherein, described image modalities is camera or other camera heads; Computing machine is provided with the interface module suitable with image modalities.
Further, comprise one or more objects that are printed on index face in the image of described image modalities collection.
Further; Aforesaid classroom instruction hybrid technology application system based on augmented reality, wherein, described image processing module carries out data processing to every frame image of image modalities input; Utilize the identified areas that is printed on the object of index face in the image outline search technique identification image; Image in the identified areas is analyzed, and obtains the picture material that the pixel of pixel and template matches, and confirms the information of this picture material representative.
Further, aforesaid classroom instruction hybrid technology application system based on augmented reality, wherein, described image locating module carries out the calculating of three-dimensional coordinate to the mark in every frame image; And calculate transition matrix according to the unique point of mark.
Further; Aforesaid classroom instruction hybrid technology application system based on augmented reality; Wherein, described image generation module is put into dummy object in the three-dimensional system of coordinate at mark place through transition matrix according to the three-dimensional coordinate of the mark of image locating module calculating.
Further; Aforesaid classroom instruction hybrid technology application system based on augmented reality; Wherein, described data statistics and analysis module are added up the answer result according to pupilage and answer content that image processing module identifies, and the accuracy of each student and per pass topic is analyzed; Generate the answer honor roll, flow to display device and show.
Further, aforesaid classroom instruction hybrid technology application system based on augmented reality, wherein, described display device is various electronic consoles or screen, or multimedia overhead projector equipment, computing machine is provided with the interface module suitable with display device.
Further, described display device is the miniature digital projector integrated with camera, with the image projecting that finally generates on the curtain or body of wall at camera rear.
A kind of classroom instruction hybrid technology application process based on augmented reality comprises:
Gather the image in the classroom environment through image modalities, comprise the object that at least one is printed on index face in the image of being gathered;
Through image processing module the image of gathering is handled, obtained being printed on the marking image in the object of index face, and marking image and template are complementary, discern the implication of this mark representative;
Calculate the coordinate of being discerned in the image that collects that is marked at;
The mark corresponding virtual object of being discerned is placed the coordinate position of this mark of image, and merge mutually with true environment in the image;
If the implication of mark representative comprises the information of pupilage, answer content, the student's that image processing module is identified answer content is carried out statistics and analysis;
Show the image that final virtual objects that generates and true environment combine together through display device.
Further; Aforesaid classroom instruction hybrid technology application process based on augmented reality, wherein, the information acquisition card that the described object that is printed on index face is held for the student; The student is through moving the information acquisition card in the hand; The mark of the information acquisition card in the image that image modalities gathers is subjected to displacement, thereby the coordinate position of mark corresponding virtual object is changed, form the effect that virtual objects moves.
Further; Aforesaid classroom instruction hybrid technology application process based on augmented reality; Wherein, the information acquisition card that the described object that is printed on index face is held for the student also comprises the option content of question and answer and/or the direct performance information of pupilage on the information acquisition card; The student shows the corresponding information acquisition card of selected answer according to the content of question-and-answer problem, and by the marking image on the image modalities Information Monitoring capture card.
Beneficial effect of the present invention is following: the tracking mode that is based on artificial target's thing that the present invention adopts on the image tracking technique, be fit to very much be applied to teaching pattern, and the student need not dress HMD, can be free movable, free mutual.Aspect the hardware realization; Only need a camera be installed in the computer front and get final product, the student only need hold the card of simple material, and this card is the information acquisition card of passive and wireless; Image recognition technology through maturation is handled and is analyzed the marking image on the card; Various interaction modes in just can realizing imparting knowledge to students, it is embodied as this and compares obvious reduction with funds in need with existing classroom interaction feedback system, but the dirigibility of using significantly improves.In the middle of teaching practice, the present invention has embodied following significant advantage:
(1) with the augmented reality technology as teaching aid, can make the learner in virtual and real environment, carry out interaction glibly;
(2) with the augmented reality technology as teaching aid, with producing a kind of new teaching and learning strategy, under this pattern,, also can carry out interactive learning even the student has no the computer experience;
(3) learner can be immersed in learning content, has changed the learner only in the face of the traditional mode of learning of static text.
Description of drawings
Fig. 1 is a kind of embodiment synoptic diagram based on the classroom instruction hybrid technology application system of augmented reality;
Fig. 2 is the another kind of embodiment synoptic diagram based on the classroom instruction hybrid technology application system of augmented reality;
Fig. 3 is a kind of pattern synoptic diagram of information acquisition card in the embodiment;
Fig. 4 is the another kind of pattern synoptic diagram of information acquisition card in the embodiment;
Fig. 5 is the synoptic diagram of an instantiation of image processing, location and generative process;
Fig. 6 is that sign, the angle point of figure in the embodiment extracts the method flow diagram that quadrilateral detects;
Fig. 7 is a kind of teaching scene synoptic diagram of the specific embodiment of the invention;
Fig. 8 is the another kind teaching scene synoptic diagram of the specific embodiment of the invention.
Embodiment
Below in conjunction with accompanying drawing and embodiment the present invention is carried out detailed explanation.
The invention discloses a kind of classroom instruction hybrid technology based on augmented reality uses; The presentation mode that is based on display device that adopts; Industrial camera is used for augmented reality environment; And, createed a new teaching pattern that merges the augmented reality environment of real world and virtual reality through human-computer interaction technology optimization performance and efficient.
As shown in Figure 1, the classroom instruction hybrid technology application system based on augmented reality comprises:
Be printed on the object 1 of index face, place classroom environment, print the image of index face can be by effective collection and identification;
Image locating module 32 is used for the coordinate that is marked at the image that collects that analytical calculation is discerned;
Data statistics and analysis module 34, the answer content that is used for the student that the question and answer link in teaching identifies image processing module is carried out statistics and analysis;
Display device 4 is used for image or data statistic analysis result that final virtual objects that generates of show image generation module and true environment combine together.
In this embodiment, be printed on index face to as if a kind of information acquisition card of passive and wireless, can be papery or other simple material, with low cost, can be when need using at any time print and generate through printing equipment.Key is to include tangible identifiable marker on the information acquisition card.Information acquisition card is held by the student, in the classroom instruction process, uses at any time according to the interactive needs of curricula, and guarantees by in the successful collection entering classrooms image of image modalities.On the other hand; The object that is printed on index face is not limited to the card held by the student; Also can be arranged on some fixture in the classroom environment, after image modalities collects its mark, equally can be through handling and calculating; On the position of this mark corresponding image, produce the dummy object of any needs, thereby make up more rich and varied image environment and show through display device.The object that is printed on index face can be stationary state, also can be motion state; In same classroom instruction scene, both can be one and use separately, also can be a plurality of uses simultaneously, have very strong application flexibility.
Should there be high-contrast between mark in the described object that is printed on index face and the background color, so that the processing of image.Preferred version is the artwork master code labeling, preferably is labeled as black, and its background is a white, and the artwork master code labeling is positioned at identified areas.Described identified areas is a border figure with reservation shape; So that the position at the good identified region of software place; Preferred scheme is preferably square framework for having the square boundary frame of breach on one side, on a limit of square framework, is provided with breach; This breach has destroyed the symmetry on border, thereby increases tagged diversity.
The object that is printed on index face in this embodiment is the form of information acquisition card, and the mark of identified areas is a kind of artwork master code labeling of two dimension on the card.In general the implication of mark comprises following one or more information: virtual objects, pupilage, answer content.These corresponding information are all set in computer software in advance, and, also comprise in the image processing module of computing machine underlined standard form so that carry out the coupling of image in the image processing.
A kind of style design of information acquisition card is as shown in Figure 3, only comprises the artwork master code labeling that is positioned at identified areas.This information acquisition card generally is used for classroom instruction role's the use of playing the part of; The student holds an information acquisition card, after the image of card marked is effectively gathered, treatedly on the relative position of image, generates this mark corresponding virtual object with calculating; Like a kind of cartoon character; The student makes that through the mobile message capture card position of mark changes in the image, thereby the coordinate of virtual objects is changed in time, produces the visual effect such as the cartoon character motion on the output display unit.Shift out the scope of image collection when information acquisition card after, the virtual objects on the display image just disappears automatically.That is to say that the student can move through the cartoon character that simple manually card is controlled in the image frame flexibly, thereby makes the environment of teaching and atmosphere become more active, and is interactive stronger.
The another kind of style design of information acquisition card is as shown in Figure 4, comprises the artwork master code labeling that is positioned at identified areas, simultaneously, also comprises the option content (A in the diagram) of question and answer, and the direct performance information of pupilage (student number, class, name).The scope of application of this information acquisition card is wider relatively, and the as above the same use of playing the part of as role in the classroom instruction of example on the one hand can also be used as the answer sheet of classroom question and answer on the other hand.The mark of this information acquisition card also must comprise following information: pupilage, answer content except can corresponding a kind of virtual objects.In the question and answer link of classroom instruction; Each student has the number of options information corresponding capture card with problem; For example 4, represent A, B, C, D respectively, the implication of the mark representative on each information acquisition card is set in the software of computing machine in advance.To the option of a problem, student's answer card that oneself is selected lifts, by the image modalities collection; After image processing module obtains concrete image, through with the coupling of template, confirm according to the implication that mark characterized whether each student's answer choice correct; Then, can carry out statistics and analysis, generate statistics student's answer content; For example form the answer honor roll, and show.Simultaneously, can also generate corresponding virtual objects, be presented at the position of the information acquisition card marked in student's hand of real image, to strengthen the interest of teaching question and answer according to the result of answer.
The present invention does not have too strict requirement for image modalities, supports camera or other camera heads on most of markets; Computing machine is provided with the interface module suitable with image modalities.Image modalities need be gathered classroom instruction real scene image clearly, preferably has flexibly focus function automatically.
The present invention is accomplished by computer software with relevant computing the processing of image, and this software also has the required operation pages of teaching simultaneously, shows various option of operation and function.For the back-end data processing section, software comprises image processing module, image locating module, image generation module, data statistics and analysis module.
Image processing module carries out data processing to every frame image of image modalities input, and the processing of image should be very ripe prior art.For example, at first image is carried out binary conversion treatment,, therefore, help the search and the identification of mark after the binary conversion treatment because the mark of identified areas is a kind of artwork master code labeling of two dimension on the card.Next, in the image the underlined zone that possibly exist search for, can utilize the identified areas in the present general image profile search technique recognition image.In the present embodiment,, and have corresponding 8 unique points, so just think that this is the candidate of mark if search the square that meets identified region.After obtaining the candidate of mark; Extract the content of mark; Utilize ripe two dimensional image analysis technology that the marking image in the identified areas is analyzed, if the pixel of pixel and template matches, then proof has found the black and white mark that needs; Through the mark corresponding informance that computer-internal is provided with in advance, just can confirm the concrete implication information of this marking image content representative.In the teaching scene, the pairing information of mark is generally the virtual objects relevant with the content of courses, or the answer of classroom question and answer, and student's identity.These information are all confirmed in image processing module, and are used in order to the location generation of image or the statistical study of data.
As shown in Figure 5; After image processing module is accomplished the coupling of processing and mark to image; The image locating module carries out the calculating of three-dimensional coordinate to the mark in every frame image; And calculate transition matrix according to the unique point of mark, the value of this transition matrix is used for dummy object is rendered to the three-dimensional system of coordinate at black and white mark place.
As a rule, there are two kinds of methods the position of object dimensional coordinate in the Computer Analysis image, and a kind of is as telltale mark with black and white sign (Marker); The algorithm computation amount that this identification needs is fewer; Advanced algorithm is comparative maturity also, but needs sign, could locate.Another kind is as common picture, and as telltale mark, a large amount of calculated amount of this algorithm requirements computing machine also exists the bigger error of calculation simultaneously, so algorithm is not very ripe, also is the technique direction of studying present stage.Therefore, the present invention still uses the black and white sign, as the basic algorithm of augmented reality.The idiographic flow of algorithm can be with reference to the last listed list of references [1] " calibration for a video-based augmented reality conferencing system. " of this paper.Following brief account is following:
1. sign, angle point extract quadrilateral and detect
As shown in Figure 6, at first adopt the method for fixed threshold, image is carried out two-value cut apart.The application of considering tracker mainly is that light environment is more stable indoor, adopts dynamic threshold, or the separation mode of multiple threshold value.Next, bianry image is carried out connected domain extract, the connected domain less to area directly given up, and so just improved efficiency of algorithm.
2. mark identification
After obtaining quadrilateral, enter into the cognitive phase of mark.At first, need the quadrilateral on the screen be carried out inverse transformation, obtain the normalization square.Corresponding according to volume coordinate with four groups of points of the plane of delineation, can be in the hope of homography matrix H.Do not consider earlier the direction of mark, utilize that tetragonal upper left point is first point on the image that marker detection partly obtains, corresponding, clockwise successively with the left upper apex of the template image of hypothesis, with 4 correspondences respectively, can try to achieve homography matrix H.Carry out the screen quadrilateral to the foursquare correction of standardization by H,, get on it the square of proofreading and correct, down, a left side, right four possible code areas are a side of 1111, are the principal direction of mark, simultaneously, and obtain the code of this mark correspondence.After having confirmed the corresponding code of mark, the template image that has same code in image in the middle part of the mark and the mark storehouse is carried out template matches, confirm mark.
3. the tracking of mark
After marker is confirmed, can confirm to follow the trail of with four angle points, obtain world coordinate system and sign coordinate system and camera coordinate system and sign coordinate system.When directly from image, obtaining the failure of square mark; System will get into the tracking mode of mark; MXRToolkit realizes the tracking to mark through the corners Matching of image; This algorithm obtains the initial position of angle point through the corresponding homography matrix of previous frame image, and search arest neighbors angle point upgrades current corner location in present image; And then reject the point of matching error through the method for RANSAC list of references [2] " a paradigm for model fitting with applications to image analysis and automated cartography. ", obtain new homography matrix.
The image generation module is put into dummy object in the three-dimensional system of coordinate at mark place through transition matrix according to the three-dimensional coordinate of the mark of image locating module calculating.As shown in Figure 5, according to the three-dimensional coordinate of mark, with virtual objects--teapot is placed into the coordinate position of mark.Select the recreation render engine of torque3D in the present embodiment, be placed into virtual object among the real image.Because dummy object has static and dynamic; So in real world, can have an X-rayed, dummy object is controlled in rotation; And embody the alternant way of the image of all angles through nature, this all is the function that present torque3D recreation render engine can be realized fully.Add that particle, effect such as audio-visual can let the user stay deep impression.
In addition; Operation for question and answer link in the classroom instruction; Image processing module is transferred to data statistics and analysis module with pupilage that comprises in the mark of being discerned and answer content information, and data statistics and analysis module are added up the answer result according to pupilage and answer content that image processing module identifies, and the accuracy of each student and per pass topic is analyzed; Generate the answer honor roll, flow to display device and show.These functions are worked out in software in advance, in conjunction with corresponding interface operation, can be low-cost, and convenient, flexible realization classroom question and answer interactive teaching, compare the existing classroom interaction feedback system of equipment electronic romote-controller that needs and have extremely strong superiority.
Display device of the present invention can be various electronic consoles or screen; Or multimedia overhead projector equipment; These facilities can come according to the actual conditions of classroom environment to select arbitrarily fully, just can be convenient to use as long as computing machine is provided with the suitable interface module of display device.In order better to embody portable characteristics of the present invention; And superiority flexible and convenient to use; The present invention provides a kind of structure more reasonable in instantiation; The mentality of designing of the display device that adaptability is stronger helps, condition relatively poor area realization of the present invention interactive mode teaching pattern simple and crude at any facility.As shown in Figure 2, the display device that provides among this embodiment is a kind of and the integrated miniature digital projector 5 of camera (image modalities 2), and computing machine 3 adopts portable notebook computers, and whole teaching software all is installed in the notebook computer.The integration mode of this hardware just makes that classroom instruction hybrid technology application system of the present invention can be able to use arbitrarily in any environment.The teacher only need distribute the information acquisition card (being printed on the object 1 of index face) of papery to the student, and this card can be printed at any time and be convenient to and carry.Before the teaching beginning, the preliminary work that need do is exactly in the software of computer, the information of necessity to be set, and classmates hold also can the identified information capture card by the computer predefined.In the classroom instruction; In needs, open camera 2 and micro projector 5; With image projecting on the curtain 6 or body of wall at camera rear; Software in the operation computer, image processing module 31, image locating module 32, image generation module 33, data statistics and analysis module 34 will be handled and computing automatically, thereby realize the scene interaction of various teaching processes.It is thus clear that; The present invention need not be provided with any specialized equipment in the classroom in concrete the realization; All hardware units only need the teacher to carry to get final product, and are distributed to student's also card papery, cheap just, do not worry in use can being damaged; Need not carry out any prior training yet, be highly suitable for young student and use the student.
Below in conjunction with concrete teaching classroom scene, the application of technical scheme of the present invention is further described.
Instance 1-reads aloud part in the classroom
The present invention has designed the interface of reading aloud part in the Software Operation interface, the teacher selects to operate reading aloud part, can eject the button of reading aloud paragraph in the interface menu, supplies the teacher to select which paragraph is read aloud.After having selected concrete paragraph, the output interface of display device can enter into and read aloud the three-dimensional model scene of paragraph coupling, and is as shown in Figure 7.At this moment; Participation is read aloud interactive student and is held information acquisition card; Camera collection through a series of processing and the calculating of the image processing module in the computer software, image locating module, image generation module, is rendered to the position that the mark of its information acquisition card in the image belongs to the corresponding cartoon character of role of reading aloud that each classmate plays the part of behind the image in classroom; Like this, virtual objects just merges with the actual teaching environment.In Fig. 6; Three classmates' information acquisition card is just corresponding three cartoon characters on the screen; In the time of each classmate's mobile message capture card; Image processing module is through to the processing of each frame image, makes the image locating module can confirm the three-dimensional coordinate position of mark at any time and on the continually varying position, throws in virtual image, and the pairing three-dimensional cartoon image of mark will be moved simultaneously.Be accompanied by reading aloud of role, the student utilizes corresponding three-dimensional cartoon role and the scene interaction of information acquisition card operation in the hand.The three-dimensional cartoon image shows as on the ground that stands in scene, is marked in the screen through the information acquisition card black and white to move up and down, thus the motion all around in scene of operation cartoon character.Meanwhile, recording function is provided also in the software interface, has been provided with like the upper right corner of Fig. 7 and records button, whole process that can the students'operation cartoon character be moved and dubbing of reading aloud record, and play at any time in order to follow-up.Return like need, then can select the return push-button in the software interface upper left corner, make program turn back to the previous menu interface.
Instance 2-classroom question and answer part
The present invention has designed the interface of question and answer parts in the Software Operation interface; The teacher selects question and answer are partly operated; Can eject the button of question and answer paragraph in the interface menu, the teacher arbitrarily clicks wherein a section of question and answer interface, and the interface will enter into the current scene with the paragraph coupling.As shown in Figure 8, at this moment, generally hold four information acquisition card in student's the hand; The design form of information acquisition card can be as shown in Figure 4; Comprise an artwork master code labeling, simultaneously, also comprise the option content (A in the diagram) of question and answer; And the direct performance information of pupilage (student number, class, name), four cards are respectively the option of A, B, C, D.Corresponding to each information acquisition card; Black and white mark above it all will comprise the implication of this two aspect of answer content and pupilage at least; These implication information are provided with in computer software in advance, to guarantee the image information matched accuracy.According to system problem, students utilizes the mark of the information acquisition card in the hand and question-and-answer problem to carry out interaction.Because; The mark that A, B, C, four options of D all can be arranged in each child's hand; According to determined answer, can through image processing module the implication of mark representative be discerned by camera collection as long as in the answer term of validity, lift corresponding answer mark.Result after the identification can be transferred into data statistics and analysis module, and each student or per pass questions answer situation are carried out statistics and analysis.The teacher can use the click interface, carries out the question and answer of next topic, and the question and answer link with all exercise questions of front the same manner cycling can eject new interface at last---the answer honor roll.In honor roll, can check the statistics as a result of per pass exercise question, comprise correct, answer mistake and invalid.Screenshot capture when can also check statistics.As want to return, the return push-button of then clicking in the interface gets final product.In addition; In the question and answer link of classroom; Image locating module in the native system software and image generation module can generate corresponding virtual objects equally according to the design of prior program and render to the mark position on the screen; The image of one " √ " or " X " can appear according to the correctness of student's answer in the mark position like information acquisition card in the image among Fig. 8, and can cooperate other effect, makes the teaching atmosphere of classroom question and answer more active.
Obviously, those skilled in the art can carry out various changes and modification to the present invention and not break away from the spirit and scope of the present invention.Like this, belong within the scope of claim of the present invention and equivalent technology thereof if of the present invention these are revised with modification, then the present invention also is intended to comprise these changes and modification interior.
List of references:
[1]Kato?H.and?BillinghurstM..Marker?tracking?and?hmd?calibration?for?a?video-based?augmented?reality?conferencing?system.In?IWAR’99：Proceedings?of?the?2nd?IEEE?and?ACM?International?Workshop?on?Augmented?Reality，page?85，Washington，DC，USA，1999.IEEE?Computer?Society.
[2]M.A.Fischler?and?R.C.Bolles.Random?sample?consensus：a?paradigm?for?model?fitting?with?applications?to?image?analysis?and?automated?cartography.Commun.ACM，24(6)：381-395，1981.
Claims (19)
1. classroom instruction hybrid technology application system based on augmented reality comprises:
Be printed on the object of index face, place classroom environment, print the image of index face can be by effective collection and identification;
Image modalities is used for gathering the said image that is printed on the object of index face at classroom environment, and the image that collects is transferred to computing machine;
Image processing module is used for the image that collects is handled and analyzed, and obtains the mark that is complementary with template in the image, and discerns the implication of this mark representative;
The image locating module is used for the coordinate that is marked at the image that collects that analytical calculation is discerned;
The image generation module is used for the mark corresponding virtual object of being discerned is placed the coordinate position of this mark of image, and merges mutually with true environment in the image;
Data statistics and analysis module, the answer content that is used for the student that the question and answer link in teaching identifies image processing module is carried out statistics and analysis;
Display device is used for image or data statistic analysis result that final virtual objects that generates of show image generation module and true environment combine together.
2. the classroom instruction hybrid technology application system based on augmented reality according to claim 1 is characterized in that: have high-contrast between mark in the described object that is printed on index face and the background color.
3. the classroom instruction hybrid technology application system based on augmented reality according to claim 2 is characterized in that: be labeled as the artwork master code labeling in the described object that is printed on index face, the artwork master code labeling is positioned at identified areas.
4. the classroom instruction hybrid technology application system based on augmented reality according to claim 3 is characterized in that: described identified areas is a border figure with reservation shape.
5. the classroom instruction hybrid technology application system based on augmented reality according to claim 4 is characterized in that: Yi Bian described identified areas is for having the square boundary frame of breach.
6. according to any described classroom instruction hybrid technology application system based on augmented reality among the claim 1-5, it is characterized in that: the implication that the described mark that is printed on the object of index face is represented also comprises following information: pupilage, answer content.
7. according to claim 2 or 3 described classroom instruction hybrid technology application systems, it is characterized in that: also comprise the option content of question and answer and/or the direct performance information of pupilage on the described object that is printed on index face based on augmented reality.
8. the classroom instruction hybrid technology application system based on augmented reality according to claim 1 is characterized in that: the described object that is printed on index face is stationary state or motion state.
9. the classroom instruction hybrid technology application system based on augmented reality according to claim 1 is characterized in that: described image modalities is camera or other camera heads; Computing machine is provided with the interface module suitable with image modalities.
10. the classroom instruction hybrid technology application system based on augmented reality according to claim 9 is characterized in that: comprise one or more objects that are printed on index face in the image of described image modalities collection.
11. the classroom instruction hybrid technology application system based on augmented reality according to claim 1; It is characterized in that: described image processing module carries out data processing to every frame image of image modalities input; Utilize the identified areas that is printed on the object of index face in the image outline search technique identification image; Image in the identified areas is analyzed, and obtains the picture material that the pixel of pixel and template matches, and confirms the information of this picture material representative.
12. the classroom instruction hybrid technology application system based on augmented reality according to claim 1 is characterized in that: described image locating module carries out the calculating of three-dimensional coordinate to the mark in every frame image; And calculate transition matrix according to the unique point of mark.
13. the classroom instruction hybrid technology application system based on augmented reality according to claim 12; It is characterized in that: described image generation module is put into dummy object in the three-dimensional system of coordinate at mark place through transition matrix according to the three-dimensional coordinate of the mark of image locating module calculating.
14. the classroom instruction hybrid technology application system based on augmented reality according to claim 6; It is characterized in that: described data statistics and analysis module are added up the answer result according to pupilage and answer content that image processing module identifies; Accuracy to each student and per pass topic is analyzed; Generate the answer honor roll, flow to display device and show.
15. the classroom instruction hybrid technology application system based on augmented reality according to claim 1; It is characterized in that: described display device is various electronic consoles or screen; Or multimedia overhead projector equipment, computing machine is provided with the interface module suitable with display device.
16. the classroom instruction hybrid technology application system based on augmented reality according to claim 15; It is characterized in that: described display device is the miniature digital projector integrated with camera, with the image projecting that finally generates on the curtain or body of wall at camera rear.
17. the classroom instruction hybrid technology application process based on augmented reality comprises:
Gather the image in the classroom environment through image modalities, comprise the object that at least one is printed on index face in the image of being gathered;
Through image processing module the image of gathering is handled, obtained being printed on the marking image in the object of index face, and marking image and template are complementary, discern the implication of this mark representative;
Calculate the coordinate of being discerned in the image that collects that is marked at;
The mark corresponding virtual object of being discerned is placed the coordinate position of this mark of image, and merge mutually with true environment in the image;
If the implication of mark representative comprises the information of pupilage, answer content, the student's that image processing module is identified answer content is carried out statistics and analysis;
Show the image that final virtual objects that generates and true environment combine together, perhaps data statistic analysis result through display device.
18. the classroom instruction hybrid technology application process based on augmented reality according to claim 17; It is characterized in that: the information acquisition card that the described object that is printed on index face is held for the student; The student is through moving the information acquisition card in the hand; The mark of the information acquisition card in the image that image modalities gathers is subjected to displacement, thereby the coordinate position of mark corresponding virtual object is changed, form the effect that virtual objects moves.
19. the classroom instruction hybrid technology application process based on augmented reality according to claim 17; It is characterized in that: the information acquisition card that the described object that is printed on index face is held for the student; Also comprise the option content of question and answer and/or the direct performance information of pupilage on the information acquisition card; The student shows the corresponding information acquisition card of selected answer according to the content of question-and-answer problem, and by the marking image on the image modalities Information Monitoring capture card.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110255428.7A CN102411854B (en) | 2011-09-01 | 2011-09-01 | Application system and method of mixed technology in classroom teaching based on augmented reality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110255428.7A CN102411854B (en) | 2011-09-01 | 2011-09-01 | Application system and method of mixed technology in classroom teaching based on augmented reality |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102411854A true CN102411854A (en) | 2012-04-11 |
| CN102411854B CN102411854B (en) | 2014-01-29 |
Family
ID=45913914
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110255428.7A Active CN102411854B (en) | 2011-09-01 | 2011-09-01 | Application system and method of mixed technology in classroom teaching based on augmented reality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102411854B (en) |
Cited By (40)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102902710A (en) * | 2012-08-08 | 2013-01-30 | 成都理想境界科技有限公司 | Bar code-based augmented reality method and system, and mobile terminal |
| CN103035135A (en) * | 2012-11-27 | 2013-04-10 | 北京航空航天大学 | Children cognitive system based on augment reality technology and cognitive method |
| CN103366610A (en) * | 2013-07-03 | 2013-10-23 | 熊剑明 | Augmented-reality-based three-dimensional interactive learning system and method |
| CN103391400A (en) * | 2012-05-11 | 2013-11-13 | 索尼电脑娱乐欧洲有限公司 | Method and system for augmented reality |
| CN103513753A (en) * | 2012-06-18 | 2014-01-15 | 联想(北京)有限公司 | Information processing method and electronic device |
| WO2014019498A1 (en) * | 2012-08-01 | 2014-02-06 | 成都理想境界科技有限公司 | Video playing method and system based on augmented reality technology and mobile terminal |
| WO2015062205A1 (en) * | 2013-10-29 | 2015-05-07 | 中兴通讯股份有限公司 | Teaching method and system |
| CN104732826A (en) * | 2015-03-27 | 2015-06-24 | 宋晓宇 | Augmented reality (AR) interactive teaching material and teaching resource cloud platform |
| CN105139696A (en) * | 2014-09-30 | 2015-12-09 | 张启熙 | Mobile terminal early childhood education system and method based on mirror reflection and image recognition technology |
| CN105430311A (en) * | 2015-11-16 | 2016-03-23 | 上海尚镜信息科技有限公司 | Infrared tracking projecting system and method |
| CN105981076A (en) * | 2013-11-05 | 2016-09-28 | 微软技术许可有限责任公司 | Construction of synthetic augmented reality environment |
| CN106056109A (en) * | 2016-07-30 | 2016-10-26 | 深圳市寒武纪智能科技有限公司 | Storytelling robot based on computer vision |
| CN106128196A (en) * | 2016-08-11 | 2016-11-16 | 四川华迪信息技术有限公司 | E-Learning system based on augmented reality and virtual reality and its implementation |
| CN106530858A (en) * | 2016-12-30 | 2017-03-22 | 武汉市马里欧网络有限公司 | AR-based Children's English learning system and method |
| CN106780680A (en) * | 2016-11-28 | 2017-05-31 | 幻想现实（北京）科技有限公司 | Three-dimensional animation generation method, terminal and system based on augmented reality |
| CN107111894A (en) * | 2014-09-08 | 2017-08-29 | 西姆克斯有限责任公司 | For specialty and the augmented reality simulator of education and training |
| CN107185245A (en) * | 2017-05-31 | 2017-09-22 | 武汉秀宝软件有限公司 | A kind of actual situation synchronous display method and system based on SLAM technologies |
| CN107291441A (en) * | 2016-04-12 | 2017-10-24 | 智捷有限公司 | Method for education learning and computer program product thereof |
| CN107392961A (en) * | 2017-06-16 | 2017-11-24 | 华勤通讯技术有限公司 | Space-location method and device based on augmented reality |
| CN107705645A (en) * | 2017-09-01 | 2018-02-16 | 合肥迅大信息技术有限公司 | Teaching auxiliary system based on augmented reality |
| CN107742266A (en) * | 2017-11-02 | 2018-02-27 | 北京善学云科技有限公司 | A kind of tutoring system based on augmented reality |
| CN107977594A (en) * | 2016-10-25 | 2018-05-01 | 深圳市寒武纪智能科技有限公司 | A kind of interactive robot and its method of telling a story |
| CN108062736A (en) * | 2017-12-22 | 2018-05-22 | 广东泓钊教育科技有限公司 | A safety education method and platform |
| CN108492017A (en) * | 2018-03-14 | 2018-09-04 | 河海大学常州校区 | A kind of product quality information transmission method based on augmented reality |
| CN108492632A (en) * | 2018-03-23 | 2018-09-04 | 四川科华天府科技有限公司 | A kind of Teaching System based on situated teaching |
| WO2018209878A1 (en) * | 2017-05-17 | 2018-11-22 | 广州视源电子科技股份有限公司 | Position indication method, operation device for position indication, and display system |
| CN109003139A (en) * | 2018-07-25 | 2018-12-14 | 济南奥维信息科技有限公司济宁分公司 | A kind of Cultural Square system and method for supporting intelligent interaction |
| CN109754644A (en) * | 2017-11-06 | 2019-05-14 | 彼乐智慧科技（北京）有限公司 | A teaching method and system based on augmented reality technology |
| CN110119195A (en) * | 2018-02-06 | 2019-08-13 | 广东虚拟现实科技有限公司 | Visual interactive device and marker |
| CN110119194A (en) * | 2018-02-06 | 2019-08-13 | 广东虚拟现实科技有限公司 | Virtual scene processing method, device, interactive system, head-wearing display device, visual interactive device and computer-readable medium |
| CN110119190A (en) * | 2018-02-06 | 2019-08-13 | 广东虚拟现实科技有限公司 | Localization method, device, recognition and tracking system and computer-readable medium |
| CN110223202A (en) * | 2018-03-01 | 2019-09-10 | 彼乐智慧科技（北京）有限公司 | A kind of method and system of teaching stage property identification and scoring |
| CN110647301A (en) * | 2018-06-27 | 2020-01-03 | 光宝电子(广州)有限公司 | Augmented reality system and image display method thereof |
| CN110688005A (en) * | 2019-09-11 | 2020-01-14 | 塔普翊海（上海）智能科技有限公司 | Mixed reality teaching environment, teacher and teaching aid interaction system and interaction method |
| CN111050128A (en) * | 2019-12-04 | 2020-04-21 | 广东康云科技有限公司 | Video fusion method, system, device and storage medium based on outdoor scene |
| CN113206987A (en) * | 2021-05-06 | 2021-08-03 | 北京有竹居网络技术有限公司 | Method, device and terminal for projection display and non-transitory storage medium |
| US11209969B2 (en) | 2008-11-19 | 2021-12-28 | Apple Inc. | Techniques for manipulating panoramas |
| CN114495599A (en) * | 2022-01-25 | 2022-05-13 | 广东工业大学 | A teaching guidance system based on virtual reality technology |
| CN114581835A (en) * | 2022-03-10 | 2022-06-03 | 山东大学 | Intelligent video teaching method and system for realizing motion recognition |
| CN114861695A (en) * | 2022-05-17 | 2022-08-05 | 南京听说科技有限公司 | Aruco-based intelligent answer code identification method and intelligent classroom system |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108877340A (en) * | 2018-07-13 | 2018-11-23 | 李冬兰 | A kind of intelligent English assistant learning system based on augmented reality |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH05100617A (en) * | 1991-10-09 | 1993-04-23 | Nec Corp | Cai system |
| CN101923791A (en) * | 2010-05-31 | 2010-12-22 | 华中师范大学 | A Chinese Character Learning Method Using Augmented Reality Technology Combined with Plane Reading Materials |
| CN101976463A (en) * | 2010-11-03 | 2011-02-16 | 北京师范大学 | Manufacturing method of virtual reality interactive stereoscopic book |
| CN102110379A (en) * | 2011-02-22 | 2011-06-29 | 黄振强 | Multimedia reading matter giving readers enhanced feeling of reality |
| TWM407458U (en) * | 2010-11-25 | 2011-07-11 | Univ Kun Shan | Interactive question-and-answer teaching materials which utilize augmented reality technology |
-
2011
- 2011-09-01 CN CN201110255428.7A patent/CN102411854B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH05100617A (en) * | 1991-10-09 | 1993-04-23 | Nec Corp | Cai system |
| CN101923791A (en) * | 2010-05-31 | 2010-12-22 | 华中师范大学 | A Chinese Character Learning Method Using Augmented Reality Technology Combined with Plane Reading Materials |
| CN101976463A (en) * | 2010-11-03 | 2011-02-16 | 北京师范大学 | Manufacturing method of virtual reality interactive stereoscopic book |
| TWM407458U (en) * | 2010-11-25 | 2011-07-11 | Univ Kun Shan | Interactive question-and-answer teaching materials which utilize augmented reality technology |
| CN102110379A (en) * | 2011-02-22 | 2011-06-29 | 黄振强 | Multimedia reading matter giving readers enhanced feeling of reality |
Cited By (53)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11209969B2 (en) | 2008-11-19 | 2021-12-28 | Apple Inc. | Techniques for manipulating panoramas |
| CN103391400B (en) * | 2012-05-11 | 2018-01-02 | 索尼互动娱乐欧洲有限公司 | Method and system for the sense of reality of enhancing |
| CN103391400A (en) * | 2012-05-11 | 2013-11-13 | 索尼电脑娱乐欧洲有限公司 | Method and system for augmented reality |
| CN103513753B (en) * | 2012-06-18 | 2017-06-27 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CN103513753A (en) * | 2012-06-18 | 2014-01-15 | 联想(北京)有限公司 | Information processing method and electronic device |
| US9384588B2 (en) | 2012-08-01 | 2016-07-05 | Chengdu Idealsee Technology Co., Ltd. | Video playing method and system based on augmented reality technology and mobile terminal |
| WO2014019498A1 (en) * | 2012-08-01 | 2014-02-06 | 成都理想境界科技有限公司 | Video playing method and system based on augmented reality technology and mobile terminal |
| CN102902710A (en) * | 2012-08-08 | 2013-01-30 | 成都理想境界科技有限公司 | Bar code-based augmented reality method and system, and mobile terminal |
| CN103035135A (en) * | 2012-11-27 | 2013-04-10 | 北京航空航天大学 | Children cognitive system based on augment reality technology and cognitive method |
| CN103035135B (en) * | 2012-11-27 | 2014-12-10 | 北京航空航天大学 | Children cognitive system based on augment reality technology and cognitive method |
| CN103366610B (en) * | 2013-07-03 | 2015-07-22 | 央数文化(上海)股份有限公司 | Augmented-reality-based three-dimensional interactive learning system and method |
| CN103366610A (en) * | 2013-07-03 | 2013-10-23 | 熊剑明 | Augmented-reality-based three-dimensional interactive learning system and method |
| WO2015062205A1 (en) * | 2013-10-29 | 2015-05-07 | 中兴通讯股份有限公司 | Teaching method and system |
| CN105981076B (en) * | 2013-11-05 | 2018-12-18 | 微软技术许可有限责任公司 | Synthesize the construction of augmented reality environment |
| CN105981076A (en) * | 2013-11-05 | 2016-09-28 | 微软技术许可有限责任公司 | Construction of synthetic augmented reality environment |
| CN107111894A (en) * | 2014-09-08 | 2017-08-29 | 西姆克斯有限责任公司 | For specialty and the augmented reality simulator of education and training |
| CN105139696A (en) * | 2014-09-30 | 2015-12-09 | 张启熙 | Mobile terminal early childhood education system and method based on mirror reflection and image recognition technology |
| CN104732826A (en) * | 2015-03-27 | 2015-06-24 | 宋晓宇 | Augmented reality (AR) interactive teaching material and teaching resource cloud platform |
| CN105430311A (en) * | 2015-11-16 | 2016-03-23 | 上海尚镜信息科技有限公司 | Infrared tracking projecting system and method |
| CN107291441A (en) * | 2016-04-12 | 2017-10-24 | 智捷有限公司 | Method for education learning and computer program product thereof |
| CN106056109A (en) * | 2016-07-30 | 2016-10-26 | 深圳市寒武纪智能科技有限公司 | Storytelling robot based on computer vision |
| CN106128196A (en) * | 2016-08-11 | 2016-11-16 | 四川华迪信息技术有限公司 | E-Learning system based on augmented reality and virtual reality and its implementation |
| CN107977594A (en) * | 2016-10-25 | 2018-05-01 | 深圳市寒武纪智能科技有限公司 | A kind of interactive robot and its method of telling a story |
| CN106780680A (en) * | 2016-11-28 | 2017-05-31 | 幻想现实（北京）科技有限公司 | Three-dimensional animation generation method, terminal and system based on augmented reality |
| CN106530858A (en) * | 2016-12-30 | 2017-03-22 | 武汉市马里欧网络有限公司 | AR-based Children's English learning system and method |
| WO2018209878A1 (en) * | 2017-05-17 | 2018-11-22 | 广州视源电子科技股份有限公司 | Position indication method, operation device for position indication, and display system |
| CN107185245A (en) * | 2017-05-31 | 2017-09-22 | 武汉秀宝软件有限公司 | A kind of actual situation synchronous display method and system based on SLAM technologies |
| CN107392961A (en) * | 2017-06-16 | 2017-11-24 | 华勤通讯技术有限公司 | Space-location method and device based on augmented reality |
| US10997745B2 (en) | 2017-06-16 | 2021-05-04 | Huaqin Technology Co., Ltd. | Augmented reality based method and apparatus for spatial positioning |
| CN107392961B (en) * | 2017-06-16 | 2019-12-06 | 华勤通讯技术有限公司 | space positioning method and device based on augmented reality |
| WO2018227900A1 (en) * | 2017-06-16 | 2018-12-20 | 华勤通讯技术有限公司 | Augmented reality-based spatial positioning method and apparatus |
| CN107705645A (en) * | 2017-09-01 | 2018-02-16 | 合肥迅大信息技术有限公司 | Teaching auxiliary system based on augmented reality |
| CN107742266A (en) * | 2017-11-02 | 2018-02-27 | 北京善学云科技有限公司 | A kind of tutoring system based on augmented reality |
| CN109754644A (en) * | 2017-11-06 | 2019-05-14 | 彼乐智慧科技（北京）有限公司 | A teaching method and system based on augmented reality technology |
| CN108062736A (en) * | 2017-12-22 | 2018-05-22 | 广东泓钊教育科技有限公司 | A safety education method and platform |
| CN110119195A (en) * | 2018-02-06 | 2019-08-13 | 广东虚拟现实科技有限公司 | Visual interactive device and marker |
| CN110119194A (en) * | 2018-02-06 | 2019-08-13 | 广东虚拟现实科技有限公司 | Virtual scene processing method, device, interactive system, head-wearing display device, visual interactive device and computer-readable medium |
| CN110119190A (en) * | 2018-02-06 | 2019-08-13 | 广东虚拟现实科技有限公司 | Localization method, device, recognition and tracking system and computer-readable medium |
| CN110223202B (en) * | 2018-03-01 | 2021-08-24 | 北京小红果文化科技有限公司 | A method and system for identifying and grading teaching props |
| CN110223202A (en) * | 2018-03-01 | 2019-09-10 | 彼乐智慧科技（北京）有限公司 | A kind of method and system of teaching stage property identification and scoring |
| CN108492017A (en) * | 2018-03-14 | 2018-09-04 | 河海大学常州校区 | A kind of product quality information transmission method based on augmented reality |
| CN108492017B (en) * | 2018-03-14 | 2021-12-10 | 河海大学常州校区 | Product quality information transmission method based on augmented reality |
| CN108492632A (en) * | 2018-03-23 | 2018-09-04 | 四川科华天府科技有限公司 | A kind of Teaching System based on situated teaching |
| CN110647301A (en) * | 2018-06-27 | 2020-01-03 | 光宝电子(广州)有限公司 | Augmented reality system and image display method thereof |
| CN110647301B (en) * | 2018-06-27 | 2023-08-08 | 光宝电子(广州)有限公司 | Augmented reality system and image display method thereof |
| CN109003139A (en) * | 2018-07-25 | 2018-12-14 | 济南奥维信息科技有限公司济宁分公司 | A kind of Cultural Square system and method for supporting intelligent interaction |
| CN110688005A (en) * | 2019-09-11 | 2020-01-14 | 塔普翊海（上海）智能科技有限公司 | Mixed reality teaching environment, teacher and teaching aid interaction system and interaction method |
| CN111050128A (en) * | 2019-12-04 | 2020-04-21 | 广东康云科技有限公司 | Video fusion method, system, device and storage medium based on outdoor scene |
| CN113206987A (en) * | 2021-05-06 | 2021-08-03 | 北京有竹居网络技术有限公司 | Method, device and terminal for projection display and non-transitory storage medium |
| CN113206987B (en) * | 2021-05-06 | 2023-01-24 | 北京有竹居网络技术有限公司 | Projection display method, device, terminal and non-transitory storage medium |
| CN114495599A (en) * | 2022-01-25 | 2022-05-13 | 广东工业大学 | A teaching guidance system based on virtual reality technology |
| CN114581835A (en) * | 2022-03-10 | 2022-06-03 | 山东大学 | Intelligent video teaching method and system for realizing motion recognition |
| CN114861695A (en) * | 2022-05-17 | 2022-08-05 | 南京听说科技有限公司 | Aruco-based intelligent answer code identification method and intelligent classroom system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102411854B (en) | 2014-01-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102411854A (en) | Classroom teaching mixing technology application system based on enhanced reality and method thereof | |
| CN205334563U (en) | Student classroom participation detecting system | |
| US8358320B2 (en) | Interactive transcription system and method | |
| CN103679204A (en) | Image identification and creation application system and method based on intelligent mobile device platform | |
| KR101700317B1 (en) | System, method and computer readable recording medium for managing an education using a smart pen based on a dot code | |
| KR101998037B1 (en) | Method and Smart device for matching character type with user based augmented reality | |
| US20140040928A1 (en) | Audience polling system | |
| CN105070113A (en) | Healthy multimedia teaching system | |
| CN102568268A (en) | Interaction system based on click-reading technology, and implementation method for interaction system | |
| Zabulis et al. | Multicamera human detection and tracking supporting natural interaction with large-scale displays | |
| Alcañiz et al. | Augmented reality technology for education | |
| CN115223179A (en) | Classroom teaching data processing method and system based on answer codes | |
| CN112200230A (en) | A training board identification method, device and robot | |
| CN112309207A (en) | Virtual-real fusion experiment platform and method for horizontal projectile motion | |
| Emerson et al. | Investigating visitor engagement in interactive science museum exhibits with multimodal Bayesian hierarchical models | |
| Thiengtham et al. | Improve template matching method in mobile augmented reality for thai alphabet learning | |
| WO2022166039A1 (en) | Magnetic card-based chinese character combination interactive learning system and method | |
| CN107424169A (en) | Orientation of student method and device | |
| Margetis et al. | A smart environment for augmented learning through physical books | |
| CN111860294A (en) | Face capture equipment convenient to trail | |
| Gain | Using poll sheets and computer vision as an inexpensive alternative to clickers | |
| CN107831894A (en) | It is a kind of suitable for mobile terminal every empty-handed gesture writing on the blackboard method | |
| CN104240361A (en) | Field voting system based on camera device and graphic cards | |
| CN116434253A (en) | Image processing method, device, equipment, storage medium and product | |
| Matsuda | Abacus manipulation understanding by behavior sensing utilizing document camera as a sensor |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| ASS | Succession or assignment of patent right |
Owner name: MAINBO EDUCATION TECHNOLOGY CO., LTD. Free format text: FORMER OWNER: BEIJING TRANSMISSION NEW MEDIA TECHNOLOGY CO., LTD. Effective date: 20131218 |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20131218 Address after: Linquan street Suzhou City Industrial Park, 215000 Jiangsu province No. 399 Southeast University Wenchang hospital room 407 Applicant after: Suzhou Dream Man Software Technology Co.,Ltd. Applicant after: Mainbo Education Technology Co., Ltd. Address before: Linquan street Suzhou City Industrial Park, 215000 Jiangsu province No. 399 Southeast University Wenchang hospital room 407 Applicant before: Suzhou Dream Man Software Technology Co.,Ltd. Applicant before: Beijing Transmission New Media Technology Co.,Ltd. |
|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C56 | Change in the name or address of the patentee | ||
| CP01 | Change in the name or title of a patent holder |
Address after: Linquan street Suzhou City Industrial Park, 215000 Jiangsu province No. 399 Southeast University Wenchang hospital room 407 Patentee after: Suzhou Dream Man Software Technology Co.,Ltd. Patentee after: MAINBO EDUCATION TECHNOLOGY CO., LTD. Address before: Linquan street Suzhou City Industrial Park, 215000 Jiangsu province No. 399 Southeast University Wenchang hospital room 407 Patentee before: Suzhou Dream Man Software Technology Co.,Ltd. Patentee before: Mainbo Education Technology Co., Ltd. |