CN103049728B - Based on the augmented reality method of Quick Response Code, system and terminal - Google Patents
Based on the augmented reality method of Quick Response Code, system and terminal Download PDFInfo
- Publication number
- CN103049728B CN103049728B CN201210586767.8A CN201210586767A CN103049728B CN 103049728 B CN103049728 B CN 103049728B CN 201210586767 A CN201210586767 A CN 201210586767A CN 103049728 B CN103049728 B CN 103049728B
- Authority
- CN
- China
- Prior art keywords
- quick response
- response code
- code
- image
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000003190 augmentative effect Effects 0.000 title claims abstract description 34
- 238000000034 method Methods 0.000 title claims abstract description 23
- 239000011159 matrix material Substances 0.000 claims abstract description 33
- 238000001514 detection method Methods 0.000 claims abstract description 14
- 238000009877 rendering Methods 0.000 claims description 8
- 239000000284 extract Substances 0.000 claims description 7
- 230000005540 biological transmission Effects 0.000 abstract description 3
- 238000000605 extraction Methods 0.000 abstract 1
- 238000010586 diagram Methods 0.000 description 5
- 230000000694 effects Effects 0.000 description 2
- 230000004927 fusion Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000007596 consolidation process Methods 0.000 description 1
- 239000003550 marker Substances 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Landscapes
- User Interface Of Digital Computer (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a kind of augmented reality method based on Quick Response Code, using Quick Response Code as the identification in augmented reality system and positioning mark, Quick Response Code in real scene image is decoded and directly generates the consistent Quick Response Code front elevation of code system with it with re-encoding, respectively corresponding Corner Detection and extraction are carried out to the positioning module region of the image in 2 D code in the positioning module region of Quick Response Code front elevation and scene image, during to calculate homography matrix, accordingly, the invention also discloses the augmented reality system based on Quick Response Code and mobile terminal, both broken in traditional augmented reality application, the limitation that corresponding sample image just can carry out tracking and matching must be prestored in a database, turn avoid use legacy identification thing time to remote server template query with mate step, the system response delay because network transmission problems causes can be reduced, save the network traffic of user.
Description
Technical field
The present invention relates to mobile augmented reality field, particularly relate to a kind of augmented reality method based on Quick Response Code, system and mobile terminal.
Background technology
Quick Response Code is also known as two-dimensional bar code, record data symbol information at plane (on two-dimensional directional) the chequered with black and white figure that distributes according to certain rules with certain specific geometric figure, it is ingenious " 0 ", " 1 " bit stream concept utilizing formation computer-internal logical foundations on coding, and the geometrical body using several corresponding with scale-of-two is to represent word numerical information.
In recent years, Quick Response Code is widely applied, the Mobile solution being specifically designed to scanning recognition Quick Response Code on the market emerges in an endless stream, but after these application scanning Quick Response Codes, all directly present the Word message or the resource link such as video, webpage network address that obtain after Quick Response Code is resolved, use and dazzle not.
While Quick Response Code use is more and more general, augmented reality (AR, AugumentedReality) start slowly to enter public view, its core is added to by virtual information in scene that true environment presents in real time, utilize virtual information to supplement real scene, strengthen, allow virtual information synchronously show in real world.In existing augmented reality, virtual information be realized to be added on real scene, the relative position relation between video camera and real scene must be calculated, namely carry out registration by real scene image and sample image, obtain homography matrix.Therefore for existing augmented reality, if mobile terminal or augmented reality server end do not store the sample image of certain real scene or the characteristic point information of this sample image, then the fusion of virtual information and this real scene cannot be realized.
Summary of the invention
The object of this invention is to provide a kind of augmented reality method based on Quick Response Code, system and mobile terminal, when there is no sample image, the Quick Response Code front elevation consistent with the Quick Response Code code system in scene image is generated by Quick Response Code and recompile in decoding scene image, and corresponding Corner Detection is carried out in the positioning module region of image in 2 D code in the scene image of to catch positioning module region and the photographing module of Quick Response Code front elevation, calculate homography matrix, realize the certain deviation position in real scene Quick Response Code position or Quick Response Code, present the video that Quick Response Code is relevant, image, text, the multimedia messages of 3D model.
In order to realize foregoing invention object, the invention provides a kind of augmented reality method based on Quick Response Code, comprising:
Photographing module catches the real scene image containing Quick Response Code;
Quick Response Code in scanning scene image, and Quick Response Code is decoded, obtain the coded message of Quick Response Code, described coded message comprises: code system and resource information;
According to the coded message of Quick Response Code, encode by code system identical with it, generate the Quick Response Code front elevation consistent with the Quick Response Code code system in scene image; Resolve described resource information, to obtain virtual information corresponding to Quick Response Code simultaneously;
Corner Detection is carried out in the positioning module region of the image in 2 D code in the scene image of catching positioning module region and the photographing module of Quick Response Code front elevation respectively, and by same sequence, the angle point that the two extracts is sorted respectively, make the two upper angle point one_to_one corresponding extracted;
According to the coordinate figure of the two upper corresponding angle point extracted described, calculate homography matrix;
According to homography matrix, the certain deviation position of Quick Response Code position or Quick Response Code in real scene, plays up and virtual information corresponding with Quick Response Code described in output display.
Preferably, when resolve described resource information obtain be content of text time, content of text is played up as texture; Be resource URI when what resolve that described resource information obtains, then access this URI and obtain virtual information, and load according to virtual information type predetermined manner.
Preferably, described virtual information type comprises: one or more in video, image, text, 3D model.
Preferably, the Quick Response Code in described real scene image is the one in conventional QR Quick Response Code, conventional DataMatrix Quick Response Code, customization QR Quick Response Code, customization DataMatrix Quick Response Code; Wherein, customization QR Quick Response Code or the resource information customized in DataMatrix Quick Response Code comprise one or more in resource identifier, resource type, resource loading interface dimensions, rendering position drift rate.
Wherein, the positioning module region of the image in 2 D code in the scene image of catch positioning module region and the photographing module of Quick Response Code front elevation also comprises: according to the positioning module region of the image in 2 D code in the scene image that positioning module region and the photographing module of code system determination Quick Response Code front elevation are caught before carrying out Corner Detection.
Accordingly, present invention also offers a kind of augmented reality system based on Quick Response Code, comprising:
Photographing module, for catching the real scene image containing Quick Response Code;
Quick Response Code decoder module, for scanning the Quick Response Code in scene image, and decodes to Quick Response Code, and obtain the coded message of Quick Response Code, described coded message comprises: code system, version and resource information;
Quick Response Code coding module, for the coded message parsed according to described Quick Response Code decoder module, encodes by code system identical with it, generates the Quick Response Code front elevation consistent with the Quick Response Code code system in scene image;
Source obtaining module, for resolving the resource information in described coded message, to obtain virtual information corresponding to Quick Response Code;
Angle point grid module, Corner Detection is carried out in positioning module region for the image in 2 D code in the scene image of catching positioning module region and the photographing module of Quick Response Code front elevation, and by same sequence, the angle point that the two extracts is sorted respectively, make the two upper angle point one_to_one corresponding extracted;
Homography matrix computing module, the coordinate figure of the corresponding angle point of the said two devices for extracting according to angle point grid module, calculates homography matrix;
Play up display module, for according to homography matrix, the certain deviation position of Quick Response Code position or Quick Response Code in real scene, plays up and virtual information corresponding with Quick Response Code described in output display.
Preferably, described system also comprises: locating module, for the positioning module region of the image in 2 D code in the scene image that the positioning module region of code system determination Quick Response Code front elevation that parses according to Quick Response Code decoder module and photographing module are caught.
Preferably, the Quick Response Code in described real scene image is the one in conventional QR Quick Response Code, conventional DataMatrix Quick Response Code, customization QR Quick Response Code, customization DataMatrix Quick Response Code; Wherein, customization QR Quick Response Code or the resource information customized in DataMatrix Quick Response Code comprise one or more in resource identifier, resource type, resource loading interface dimensions, rendering position drift rate.
Preferably, when described source obtaining module resolve that described resource information obtains be content of text time, content of text is played up as texture; And be resource URI when what resolve that described resource information obtains, then access this URI and obtain virtual information, and load according to virtual information type predetermined manner, described virtual information type comprises: one or more in video, image, text, 3D model.
Accordingly, present invention also offers a kind of mobile terminal, described mobile terminal comprises the above-mentioned augmented reality system based on Quick Response Code.
Compared with prior art, the present invention has following beneficial effect:
1, the present invention is directly by the Quick Response Code decoding in scene image and re-encoding, regenerate the Quick Response Code front elevation consistent with Quick Response Code in scene image, the Quick Response Code positioning module region generated due to same code system is identical, Corner Detection is carried out in the positioning module region of the image in 2 D code in the scene image of therefore catching positioning module region and the photographing module of Quick Response Code front elevation respectively, homography matrix can be calculated, do not need to store Quick Response Code sample image in database, all applicable to random two-dimensional code, break in traditional augmented reality application, the limitation that corresponding sample image just can carry out tracking and matching must be prestored in a database.
2, the present invention is when calculating homography matrix, carry out Corner Detection by means of only to positioning module region, fault-tolerant ability is strong, such as, during Quick Response Code re-encoding generation data encoding mistake, do not affect the calculating of homography matrix, have the situation of small icon can be suitable in the middle of Quick Response Code in addition yet.
3, the present invention is not owing to needing sample image, therefore avoid from the inquiry of remote server with mate step, the system response delay because network transmission problems causes can be reduced, save the network traffic of user.
4, the degree of depth of the present invention excavates Quick Response Code as the application potential of information entry, makes the relevant information of Quick Response Code, resource present to user with more lively form.
Accompanying drawing explanation
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, be briefly described to the accompanying drawing used required in embodiment or description of the prior art below, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to these accompanying drawings:
Fig. 1 is the augmented reality method flow schematic diagram of the embodiment of the present invention based on Quick Response Code;
Fig. 2 is the process and the effect schematic diagram that carry out virtual information superposition according to Fig. 1 method;
Fig. 3 is QR Quick Response Code and DataMatrix Quick Response Code positioning module position view;
Fig. 4 is that QR Quick Response Code and DataMatrix Quick Response Code are according to positioning module determination positive dirction schematic diagram;
Fig. 5 is the QR Quick Response Code schematic diagram that centre has small icon.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, be clearly and completely described the technical scheme in the embodiment of the present invention, obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtained under creative work prerequisite, belong to the scope of protection of the invention.
Those skilled in the art should know: in augmented reality process, are superimposed upon accurately on target object by virtual information, need to calculate the attitude of video camera, determine that the coordinate from target object is tied to the homography matrix of image coordinate system.
Present inventor finds, existing augmented reality is all generally carry out registration by real scene image and sample image, obtains homography matrix.This mode requires the image to carrying out augmented reality, its sample image for registration must be stored at mobile terminal or server end, if mobile terminal or augmented reality server end do not store the sample image of certain real scene or the characteristic point information of this sample image, then cannot realize the fusion of virtual information and this real scene, the popularization of augmented reality limit by sample image.In addition sample image be stored in mobile terminal can occupied terminal storage space, and can not the storage of satisfying magnanimity marker; And if sample image is stored in remote server, the retrieval of sample image with download and delay system can respond and waste the network traffic of user.
Present inventor finds, Quick Response Code has ease for use and popularization, and Quick Response Code is as information entry, can be generated by any information, it can carry the URI of any one section of text or any cost, and the most important is: can generate the Quick Response Code front elevation consistent with Quick Response Code code system before according to identical code system recompile again after Quick Response Code decoding.Feature point tracking can be carried out with the Quick Response Code front elevation generated after decoding re-encoding as sample image and the Quick Response Code in scene to mate, calculate homography matrix.
But in actual life, we can find Quick Response Code as shown in Figure 5, a small icon is had to block the central area of Quick Response Code in the middle of it, although Quick Response Code has error correcting capability, can be correctly decoded when having small icon blocks certain area, and then coding generates the Quick Response Code front elevation comprising data consistent with former Quick Response Code, but can not exist in this front elevation and block small icon in former Quick Response Code, if now carry out full figure feature point tracking with the Quick Response Code front elevation generated with the Quick Response Code in scene to mate, calculate homography matrix, error may be produced, make virtual information can not on the Quick Response Code be added in scene image of entirely accurate.
Therefore, technical solution of the present invention is not carried out feature point tracking to the Quick Response Code front elevation generated with the Quick Response Code in scene and is mated, and Corner Detection is carried out to calculate homography matrix in the positioning module region that have chosen the image in 2 D code in the scene image of catching at positioning module region and the photographing module of Quick Response Code front elevation.The positioning module of described Quick Response Code, figure is resembled also referred to as seeking, such as, in QR Quick Response Code, seek and resemble figure and comprise three identical position sensing figures, lay respectively at the upper left corner of symbol, the upper right corner and the lower left corner, as shown in Fig. 3 QR Quick Response Code, each position sensing figure can be regarded as and is made up of 3 overlapping concentric squares, and they are respectively 7 × 7 dark modules, 5 × 5 shallow modules and 3 × 3 dark modules.
Introduce the present invention in detail below in conjunction with accompanying drawing and introduce scheme.
See Fig. 1, Fig. 2, for the embodiment of the present invention is based on the augmented reality method flow schematic diagram of Quick Response Code, comprise following S101 ~ S106 step:
S101: photographing module catches the real scene image containing Quick Response Code, described Quick Response Code can be conventional Quick Response Code, also can be customization of two-dimension code, conventional Quick Response Code refers to the network Quick Response Code comprising a text field or URI link in resource information, customization of two-dimension code refers to that its resource information comprises resource identifier, resource type, resource load in some other configuration information such as interface dimensions, rendering position drift rate one or more;
S102: the Quick Response Code in scanning scene image, and Quick Response Code is decoded, obtain the coded message of Quick Response Code, described coded message comprises: code system and resource information, and described resource information refers to the relevant information that scanning Quick Response Code obtains;
S103: according to the coded message of Quick Response Code, encodes with code system identical with it and version, generates the Quick Response Code front elevation consistent with the Quick Response Code code system in scene image; Resolve described resource information, to obtain virtual information corresponding to Quick Response Code, the resource information that Quick Response Code is corresponding may be text message, may be also resource URI simultaneously, and when for resource URI, access UIR address, obtains the virtual information content that URI is corresponding;
S104: Corner Detection is carried out in the positioning module region of the image in 2 D code in the scene image of catching positioning module region and the photographing module of Quick Response Code front elevation respectively, and by same sequence, the angle point that the two extracts is sorted respectively, make the two upper angle point one_to_one corresponding extracted, at least extract 4 groups of corresponding angle points when calculating homography matrix, get a little more, result of calculation is more accurate;
Wherein, the determination in the positioning module region of Quick Response Code is determined according to code system, positioning module is all identical for the Quick Response Code of code system different editions different pieces of information of the same race, using the positioning module of image in 2 D code as region of interest ROI, carry out FAST, Harris, Shi-Thomas isocenter and detect.Because positioning module position in image in 2 D code of Quick Response Code is fixed, the positioning module of Quick Response Code can be utilized to calculate the principal direction of image in 2 D code, the angle point race that ROI region detects is sorted, to arrange all angle points according to clockwise or sequence counter-clockwise from principal direction.Ensure when calculating homography matrix, image in 2 D code and each angle point one_to_one corresponding of its front elevation.The module area schematic of QR Quick Response Code, DataMatrix Quick Response Code is respectively see Fig. 3, Fig. 4, Fig. 4 shows how by the principal direction of module region decision image in 2 D code, the angle point pointwise that ROI region detects is sorted, to arrange all angle points according to clockwise or sequence counter-clockwise from principal direction, to ensure when calculating homography matrix, image in 2 D code and each angle point one_to_one corresponding of its front elevation.
S105: according to the coordinate figure of the two upper corresponding angle point extracted described, calculate homography matrix;
Quick Response Code in real scene is planar object, that define a world coordinate system, the Quick Response Code front elevation generated through decoding re-encoding belongs to image coordinate system, 4 angle points are extracted in the positioning module region of the image in 2 D code in the scene image of catching for positioning module region and the photographing module respectively at Quick Response Code front elevation respectively, the coordinate that the coordinate of these four angle points on world coordinate system and image coordinate are fastened can be set up following corresponding relation:
Wherein, (u, v) represents the image coordinate of angle point, (x
m, y
m, z
m) represent the coordinate of angle point on world coordinate system, be known parameters, H represents homography matrix to be calculated.
S106: according to homography matrix, the certain deviation position of Quick Response Code position or Quick Response Code in real scene, plays up and virtual information corresponding with Quick Response Code described in output display.
In this step, if Quick Response Code is conventional Quick Response Code, be directly added to virtual information Quick Response Code position; And if Quick Response Code is customization of two-dimension code, sets resource in its resource information and load interface dimensions, rendering position drift rate etc., be then presented at folded for virtual information apart from setting deviation post place, target location according to the size set and drift rate.
In this step, when resolve described resource information obtain be content of text time, content of text is played up as texture; Resource URI when what resolve that described resource information obtains, then access this URI and obtain virtual information, and load according to virtual information type predetermined manner, described virtual information type comprises: one or more in video, image, text, 3D model, such as: when virtual information is text message, content of text is directly played up as texture; When virtual information is 3D model, need first to resolve 3D model; When virtual information is video information, needs first to decode to video, using each for video two field picture as texture, be mapped on described 3D model by sequence frame by frame, carry out video loading and play up.
Embodiment of the present invention method, because positioning module is all identical for the Quick Response Code of code system different editions different pieces of information of the same race, therefore the embodiment of the present invention only carries out Corner Detection to positioning module region, fault-tolerant ability is strong, such as during Quick Response Code re-encoding generation data encoding mistake, do not affect the calculating of homography matrix, have the situation of small icon also can be suitable in the middle of Quick Response Code in addition, there is the Quick Response Code of small icon this centre of such as Fig. 5.
The invention allows for a kind of augmented reality system based on Quick Response Code, comprising: photographing module, Quick Response Code decoder module, Quick Response Code coding module, source obtaining module, angle point grid module, homography matrix computing module and play up display module, wherein:
Described photographing module, for catching the real scene image containing Quick Response Code;
Described Quick Response Code decoder module, for scanning the Quick Response Code in scene image, and decodes to Quick Response Code, and obtain the coded message of Quick Response Code, described coded message comprises: code system, version and resource information;
Described Quick Response Code coding module, for the coded message parsed according to described Quick Response Code decoder module, encodes with code system identical with it and version, generates the Quick Response Code front elevation consistent with the Quick Response Code code system in scene image;
Described source obtaining module, for resolving the resource information in described coded message, to obtain virtual information corresponding to Quick Response Code;
Described angle point grid module, Corner Detection is carried out in positioning module region for the image in 2 D code in the scene image of catching positioning module region and the photographing module of Quick Response Code front elevation, and by same sequence, the angle point that the two extracts is sorted respectively, make the two upper angle point one_to_one corresponding extracted;
Described homography matrix computing module, the coordinate figure of the corresponding angle point of the said two devices for extracting according to angle point grid module, calculates homography matrix;
Describedly play up display module, for according to homography matrix, the certain deviation position of Quick Response Code position or Quick Response Code in real scene, play up and virtual information corresponding with Quick Response Code described in output display, when described source obtaining module resolve that described resource information obtains be content of text time, content of text is played up as texture; And be resource URI when what resolve that described resource information obtains, then access this URI and obtain virtual information, and load according to virtual information type predetermined manner, described virtual information type comprises: one or more in video, image, text, 3D model.
Wherein, described system also comprises locating module, for the positioning module region of the image in 2 D code in the scene image that the positioning module region of code system determination Quick Response Code front elevation that parses according to Quick Response Code decoder module and photographing module are caught, so that described angle point grid module carries out angle point grid accurately.
Because the present embodiment is based on the augmented reality system of Quick Response Code, be and execute the routine system corresponding based on the augmented reality method of Quick Response Code above, therefore do not do too detailed repeating to it, detail feature is see describing above.
Method and system in the embodiment of the present invention, to QR Quick Response Code, that DataMatrix Quick Response Code carries out augmented reality effect is better, Quick Response Code can be conventional QR Quick Response Code, conventional DataMatrix Quick Response Code in addition, also can be customization QR Quick Response Code, customization DataMatrix Quick Response Code.
So-called conventional QR Quick Response Code, conventional DataMatrix Quick Response Code refer to that Quick Response Code derives from internet, and the resource information comprised in it is generally a character string, such as, be the URI of one section of text or Quick Response Code related resource.
So-called customization QR Quick Response Code or customization DataMatrix refer to, according to the resource identification that certain consolidation form is formed, the resource information namely in Quick Response Code comprises resource identifier, resource type, resource load in some other configuration information such as interface dimensions, rendering position drift rate one or more.Such as, ID:xxx_URI:xxx_TYPE:xxx_WIDTH:xxx_HEIGHT:xxx_OFFSET:xxx, (this address may at remote server to determine resource address by ID and URI, also may be local in client), can be pre-set the load mode (load mode of picture, text, audio frequency, video and 3D model is different) of related resource by resource type, other configuration informations include resource and load the skew etc. relative to Quick Response Code of the size at interface and rendering position.
The invention allows for a kind of mobile terminal, described mobile terminal comprises the above-mentioned augmented reality system based on Quick Response Code.
The present invention is using Quick Response Code as the identification in augmented reality system and positioning mark, Quick Response Code front elevation is directly generated by the decoding of Quick Response Code and re-encoding, from the corresponding angle point of the positioning module extracted region of the two, for the calculating of homography matrix, both broken in traditional augmented reality application, the limitation that corresponding sample image just can carry out tracking and matching must be prestored in a database, turn avoid use legacy identification thing time to remote server template query with mate step, the system response delay because network transmission problems causes can be reduced, save the network traffic of user.
All features disclosed in this instructions, or the step in disclosed all methods or process, except mutually exclusive feature and/or step, all can combine by any way.
Arbitrary feature disclosed in this instructions (comprising any accessory claim, summary and accompanying drawing), unless specifically stated otherwise, all can be replaced by other equivalences or the alternative features with similar object.That is, unless specifically stated otherwise, each feature is an example in a series of equivalence or similar characteristics.
The present invention is not limited to aforesaid embodiment.The present invention expands to any new feature of disclosing in this manual or any combination newly, and the step of the arbitrary new method disclosed or process or any combination newly.
Claims (10)
1., based on an augmented reality method for Quick Response Code, it is characterized in that, comprising:
Photographing module catches the real scene image containing Quick Response Code;
Quick Response Code in scanning scene image, and Quick Response Code is decoded, obtain the coded message of Quick Response Code, described coded message comprises: code system and resource information;
According to the coded message of Quick Response Code, encode by code system identical with it, generate the Quick Response Code front elevation consistent with the Quick Response Code code system in scene image; Resolve described resource information, to obtain virtual information corresponding to Quick Response Code simultaneously;
Corner Detection is carried out in the positioning module region of the image in 2 D code in the scene image of catching positioning module region and the photographing module of Quick Response Code front elevation respectively, and by same sequence, the angle point that the two extracts is sorted respectively, make the two upper angle point one_to_one corresponding extracted;
According to the coordinate figure of the two upper corresponding angle point extracted described, calculate homography matrix;
According to homography matrix, the certain deviation position of Quick Response Code position or Quick Response Code in real scene image, plays up the virtual information that also output display is corresponding with Quick Response Code.
2. the method for claim 1, is characterized in that:
When resolve described resource information obtain be content of text time, content of text is played up as texture;
Be resource URI when what resolve that described resource information obtains, then access this URI and obtain virtual information, and load according to virtual information type predetermined manner.
3. method as claimed in claim 2, is characterized in that: described virtual information type comprises: one or more in video, image, text, 3D model.
4. method as claimed any one in claims 1 to 3, is characterized in that:
Quick Response Code in described real scene image is the one in conventional QR Quick Response Code, conventional DataMatrix Quick Response Code, customization QR Quick Response Code, customization DataMatrix Quick Response Code;
Resource information in customization QR Quick Response Code or customization DataMatrix Quick Response Code comprises resource identifier, resource type, resource load in interface dimensions, rendering position drift rate one or more.
5. as claimed any one in claims 1 to 3 method, is characterized in that, the positioning module region of the image in 2 D code in described scene image of catching positioning module region and the photographing module of Quick Response Code front elevation also comprises before carrying out Corner Detection:
According to the positioning module region of the image in 2 D code in the scene image that positioning module region and the photographing module of code system determination Quick Response Code front elevation are caught.
6., based on an augmented reality system for Quick Response Code, it is characterized in that, comprising:
Photographing module, for catching the real scene image containing Quick Response Code;
Quick Response Code decoder module, for scanning the Quick Response Code in scene image, and decodes to Quick Response Code, and obtain the coded message of Quick Response Code, described coded message comprises: code system, version and resource information;
Quick Response Code coding module, for the coded message parsed according to described Quick Response Code decoder module, encodes by code system identical with it, generates the Quick Response Code front elevation consistent with the Quick Response Code code system in scene image;
Source obtaining module, for resolving the resource information in described coded message, to obtain virtual information corresponding to Quick Response Code;
Angle point grid module, Corner Detection is carried out in positioning module region for the image in 2 D code in the scene image of catching positioning module region and the photographing module of Quick Response Code front elevation, and by same sequence, the angle point that the two extracts is sorted respectively, make the two upper angle point one_to_one corresponding extracted;
Homography matrix computing module, the coordinate figure of the corresponding angle point of the said two devices for extracting according to angle point grid module, calculates homography matrix;
Play up display module, for according to homography matrix, the certain deviation position of Quick Response Code position or Quick Response Code in real scene image, plays up and the output display virtual information corresponding with Quick Response Code.
7. system as claimed in claim 6, it is characterized in that, described system also comprises:
Locating module, for the positioning module region of the image in 2 D code in the scene image that the positioning module region of code system determination Quick Response Code front elevation that parses according to Quick Response Code decoder module and photographing module are caught.
8. system as claimed in claims 6 or 7, is characterized in that:
Quick Response Code in described real scene image is the one in conventional QR Quick Response Code, conventional DataMatrix Quick Response Code, customization QR Quick Response Code, customization DataMatrix Quick Response Code;
Resource information in customization QR Quick Response Code or customization DataMatrix Quick Response Code comprises resource identifier, resource type, resource load in interface dimensions, rendering position drift rate one or more.
9. system as claimed in claims 6 or 7, is characterized in that,
When described source obtaining module resolve that described resource information obtains be content of text time, content of text is played up as texture; And be resource URI when what resolve that described resource information obtains, then access this URI and obtain virtual information, and load according to virtual information type predetermined manner, described virtual information type comprises: one or more in video, image, text, 3D model.
10. a mobile terminal, is characterized in that, described mobile terminal comprises the augmented reality system based on Quick Response Code according to any one of claim 6 to 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210586767.8A CN103049728B (en) | 2012-12-30 | 2012-12-30 | Based on the augmented reality method of Quick Response Code, system and terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210586767.8A CN103049728B (en) | 2012-12-30 | 2012-12-30 | Based on the augmented reality method of Quick Response Code, system and terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103049728A CN103049728A (en) | 2013-04-17 |
| CN103049728B true CN103049728B (en) | 2016-02-03 |
Family
ID=48062361
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210586767.8A Active CN103049728B (en) | 2012-12-30 | 2012-12-30 | Based on the augmented reality method of Quick Response Code, system and terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103049728B (en) |
Families Citing this family (37)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103544724A (en) * | 2013-05-27 | 2014-01-29 | 华夏动漫集团有限公司 | A system and method for realizing virtual animation characters on a mobile smart terminal by using augmented reality and card recognition technology |
| CN104143105A (en) * | 2013-09-22 | 2014-11-12 | 腾讯科技（深圳）有限公司 | Graph recognition method, device and system and terminal device |
| CN103530590B (en) * | 2013-10-19 | 2016-02-24 | 高韬 | DPM Quick Response Code recognition system |
| CN103561065B (en) * | 2013-10-22 | 2017-05-24 | 深圳市优逸电子科技有限公司 | System and method for achieving 3D virtual advertisement with mobile terminal |
| CN104270577A (en) * | 2014-08-22 | 2015-01-07 | 北京德馨同创科技发展有限责任公司 | Image processing method and device for mobile intelligent terminal |
| CN104463412A (en) * | 2014-10-29 | 2015-03-25 | 中冶天工集团有限公司 | Method for carrying out kiln project technical disclosure by utilization of two-dimension codes |
| CN104504155B (en) * | 2015-01-15 | 2018-06-08 | 刘畅 | A kind of data capture method and system based on picture search |
| CN104504402A (en) * | 2015-01-15 | 2015-04-08 | 刘畅 | Data processing method and system based on image search |
| JP6628516B2 (en) * | 2015-07-30 | 2020-01-08 | 株式会社きもと | Information providing system and computer program |
| CN105787534B (en) * | 2016-02-29 | 2018-07-10 | 上海导伦达信息科技有限公司 | Quick Response Code and the identification of AR digital contents are merged with study and with augmented reality implementation method |
| CN111291584B (en) * | 2016-07-22 | 2023-05-02 | 创新先进技术有限公司 | Method and system for identifying two-dimensional code position |
| CN107767355A (en) * | 2016-08-18 | 2018-03-06 | 深圳市劲嘉数媒科技有限公司 | The method and apparatus of image enhaucament reality |
| CN106372144A (en) * | 2016-08-26 | 2017-02-01 | 江西科骏实业有限公司 | Two-dimensional code processing apparatus and method |
| CN106339488B (en) * | 2016-08-30 | 2019-08-30 | 西安小光子网络科技有限公司 | A kind of virtual facility insertion customization implementation method based on optical label |
| CN106408667B (en) * | 2016-08-30 | 2019-03-05 | 西安小光子网络科技有限公司 | Customization practical method based on optical label |
| CN106446883B (en) * | 2016-08-30 | 2019-06-18 | 西安小光子网络科技有限公司 | Scene reconstruction method based on optical label |
| CN106408666B (en) * | 2016-08-31 | 2019-06-21 | 重庆玩艺互动科技有限公司 | Mixed reality reality border demenstration method |
| CN106340056B (en) * | 2016-09-07 | 2019-06-18 | 讯飞幻境(北京)科技有限公司 | A kind of panorama rendering method and device |
| CN106683196A (en) * | 2016-12-30 | 2017-05-17 | 上海悦会信息科技有限公司 | Display method and system of augmented reality, and smart terminal |
| CN107358656A (en) * | 2017-06-16 | 2017-11-17 | 珠海金山网络游戏科技有限公司 | The AR processing systems and its processing method of a kind of 3d gaming |
| CN108305291B (en) * | 2018-01-08 | 2022-02-01 | 武汉大学 | Monocular vision positioning and attitude determination method utilizing wall advertisement containing positioning two-dimensional code |
| CN109493349B (en) * | 2018-11-05 | 2021-10-29 | 中科海微(北京)科技有限公司 | Image feature processing module, augmented reality equipment and corner detection method |
| CN111199583B (en) * | 2018-11-16 | 2023-05-16 | 广东虚拟现实科技有限公司 | Virtual content display method and device, terminal equipment and storage medium |
| CN110009615B (en) * | 2019-03-31 | 2020-06-19 | 深圳大学 | Image corner detection method and detection device |
| CN110211243B (en) * | 2019-06-06 | 2023-12-01 | 北京悉见科技有限公司 | AR equipment and entity labeling method thereof |
| CN112509402A (en) * | 2019-08-26 | 2021-03-16 | 北京广益三文教育科技有限公司 | Establishment, issue and anti-counterfeiting method of competitive question bank based on three-dimensional teaching materials and teaching system thereof |
| CN112783316A (en) * | 2019-11-08 | 2021-05-11 | 浙江商汤科技开发有限公司 | Augmented reality-based control method and apparatus, electronic device, and storage medium |
| CN111179427A (en) * | 2019-12-24 | 2020-05-19 | 深圳市优必选科技股份有限公司 | Autonomous mobile device, control method thereof, and computer-readable storage medium |
| CN112560606B (en) * | 2020-12-02 | 2024-04-16 | 北京经纬恒润科技股份有限公司 | Trailer angle identification method and device |
| CN112506463A (en) * | 2020-12-04 | 2021-03-16 | 歌尔光学科技有限公司 | Display method, device and equipment based on head-mounted equipment |
| CN112764531A (en) * | 2020-12-30 | 2021-05-07 | 中国人民解放军32181部队 | Augmented reality ammunition identification method |
| CN113051953B (en) * | 2021-04-08 | 2024-11-26 | 广州百视信通智能科技有限公司 | AR virtual product display method based on QR code positioning |
| CN114663517B (en) * | 2022-02-07 | 2024-07-26 | 哈尔滨工业大学 | Simulation target posture acquisition method, target capture method and device based on MBDyn simulation, and aerospace on-orbit target capture method |
| CN115170646A (en) * | 2022-05-30 | 2022-10-11 | 清华大学 | Target tracking method and system and robot |
| CN117635879A (en) * | 2022-08-17 | 2024-03-01 | 北京字跳网络技术有限公司 | Image processing methods and devices |
| CN116502660B (en) * | 2023-06-27 | 2023-08-18 | 人民卫生电子音像出版社有限公司 | Digital resource application method and system based on two-dimension code |
| CN117094343B (en) * | 2023-10-19 | 2023-12-29 | 成都新西旺自动化科技有限公司 | QR code decoding system and method |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102497331A (en) * | 2011-12-16 | 2012-06-13 | 王博 | Information providing method and device |
| CN102799883A (en) * | 2012-06-29 | 2012-11-28 | 广州中国科学院先进技术研究所 | Method and device for extracting movement target from video image |
| CN102800065A (en) * | 2012-07-13 | 2012-11-28 | 苏州梦想人软件科技有限公司 | Augmented reality equipment and method based on two-dimensional code identification and tracking |
| CN102821323A (en) * | 2012-08-01 | 2012-12-12 | 成都理想境界科技有限公司 | Video playing method, video playing system and mobile terminal based on augmented reality technique |
| US20120327117A1 (en) * | 2011-06-23 | 2012-12-27 | Limitless Computing, Inc. | Digitally encoded marker-based augmented reality (ar) |
-
2012
- 2012-12-30 CN CN201210586767.8A patent/CN103049728B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120327117A1 (en) * | 2011-06-23 | 2012-12-27 | Limitless Computing, Inc. | Digitally encoded marker-based augmented reality (ar) |
| CN102497331A (en) * | 2011-12-16 | 2012-06-13 | 王博 | Information providing method and device |
| CN102799883A (en) * | 2012-06-29 | 2012-11-28 | 广州中国科学院先进技术研究所 | Method and device for extracting movement target from video image |
| CN102800065A (en) * | 2012-07-13 | 2012-11-28 | 苏州梦想人软件科技有限公司 | Augmented reality equipment and method based on two-dimensional code identification and tracking |
| CN102821323A (en) * | 2012-08-01 | 2012-12-12 | 成都理想境界科技有限公司 | Video playing method, video playing system and mobile terminal based on augmented reality technique |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103049728A (en) | 2013-04-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103049728B (en) | Based on the augmented reality method of Quick Response Code, system and terminal | |
| CN103049729B (en) | Based on the augmented reality method of Quick Response Code, system and terminal | |
| KR102104219B1 (en) | Method and system for recognizing location information in 2D code | |
| CN103927934B (en) | Closed fence drawing method and system | |
| CN108491897B (en) | Information identification method, server, client and system | |
| CN105718979B (en) | A method of generating two-dimension code image | |
| CN102800065A (en) | Augmented reality equipment and method based on two-dimensional code identification and tracking | |
| WO2017167159A1 (en) | Image positioning method and device | |
| CN102929969A (en) | Real-time searching and combining technology of mobile end three-dimensional city model based on Internet | |
| CN110647956B (en) | Invoice information extraction method combining two-dimension code recognition | |
| CN109977718A (en) | A kind of method and apparatus of two dimensional code for identification | |
| CN101908128B (en) | Aztec Code bar code decoding chip and decoding method thereof | |
| WO2014173190A1 (en) | Method, apparatus and system for obtaining location information | |
| CN103929669A (en) | Interactive video generator, player, generating method and playing method | |
| KR101427715B1 (en) | Apparatus and method for recognizing quick response code | |
| CN113724163A (en) | Image correction method, device, equipment and medium based on neural network | |
| Ruban et al. | The model and the method for forming a mosaic sustainable marker of augmented reality | |
| CN101609372B (en) | Two-dimensional point code, its decoding device and method | |
| CN106372144A (en) | Two-dimensional code processing apparatus and method | |
| US12020114B1 (en) | Real-time comprehensive quick response (“QR”) code testing for reliable scanning | |
| CN111353007B (en) | Geographic element pickup method, coding method and device based on vector slicing and electronic equipment | |
| CN105664490A (en) | Method and system for realizing game interaction | |
| KR20100085887A (en) | Apparatus and method of guiding woodland path based on qr code | |
| WO2024113874A1 (en) | Encoding method and decoding method for annular 2-dimensional bar code | |
| US9235604B2 (en) | Method, apparatus and system for obtaining location information |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |