CN106355153B - A kind of virtual objects display methods, device and system based on augmented reality - Google Patents
A kind of virtual objects display methods, device and system based on augmented reality Download PDFInfo
- Publication number
- CN106355153B CN106355153B CN201610782308.5A CN201610782308A CN106355153B CN 106355153 B CN106355153 B CN 106355153B CN 201610782308 A CN201610782308 A CN 201610782308A CN 106355153 B CN106355153 B CN 106355153B
- Authority
- CN
- China
- Prior art keywords
- image
- virtual objects
- marker
- template
- database
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Multimedia (AREA)
- Processing Or Creating Images (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The virtual objects display device based on augmented reality that the invention discloses a kind of, resides in the mobile terminal with camera and display screen, which includes: image capture module, suitable for capturing the image under current real scene comprising marker via camera；Position acquisition module, suitable for obtaining current geographical location information；Characteristic extracting module is suitable for carrying out feature detection to captured image, extracts the characteristic point of marker in image；Object matching module, suitable for the characteristic point according to extraction, determine in the database be associated with the geographical location information of acquisition, the image template comprising marker；It is further adapted for obtaining the corresponding virtual objects of image template；Object display module to obtain corresponding virtual scene, and shows virtual scene via display screen suitable for being superimposed the image under current real scene with the virtual objects of acquisition.The invention also discloses corresponding method and systems.
Description
Technical field
The present invention relates to mobile augmented reality technical fields more particularly to a kind of virtual objects based on augmented reality to show
Method, apparatus and system.
Background technique
Augmented reality (Augmented Reality, abbreviation AR) technology is grown up on the basis of virtual reality technology
A kind of emerging computer application and human-computer interaction technology.AR system based on early stage framework limits the motion range of user,
It can not be applied to outdoor environment.With maturation and the development of intelligent terminal, development of Mobile Internet technology, much using image recognition as base
The mobile Internet AR application of plinth starts to emerge in large numbers, mobile augmented reality system requirements user's body-worn portable computing of early stage
Mechanical, electrical source, Helmet Mounted Display, video camera etc..Such systems bulky is heavy, cost is high, is not easy to carry and safeguard for a long time.
The rise of small handheld mobile device (such as palm PC PDA, intelligent mobile terminal) is the development of mobile augmented reality system
Technological approaches is provided, so that the augmented reality run on the mobile apparatus occur applies (AR Application).It is conventional
Ground, it is mobile increase practical application and be based only on a kind of black and white label or mark get one simply by mobile terminal camera
Virtual image.
Actual situation superposition can interacting therefore, it is necessary to one kind, supporting multi-mode, the more true virtual objects of sensory experience are aobvious
Show scheme.
Summary of the invention
For this purpose, the present invention provides a kind of method, equipment and system, it is existing above to try hard to solve or at least alleviate
At least one problem.
According to an aspect of the invention, there is provided a kind of virtual objects display methods based on augmented reality, comprising: warp
The image under current real scene comprising marker is captured by camera；Obtain current geographical location information；To the figure of capture
As carrying out feature detection, the characteristic point of marker in image is extracted；According to the characteristic point of extraction, determines and obtain in the database
Geographical location information association, the image template comprising marker；Obtain the corresponding virtual objects of image template, the virtual objects
For one in video, audio, text, two dimensional image and threedimensional model；By the void of image and acquisition under current real scene
Quasi- object superposition, to obtain corresponding virtual scene, and shows the virtual scene via display screen.
Optionally, in the method according to the invention, it determines in the database and is associated with, wraps with the geographical location information obtained
The step of image template containing marker includes: to compare the characteristic point of the marker of extraction and the characteristic point of image template
It is right；If extract characteristic point and image template Feature Points Matching quantity be more than threshold value, it is determined that the image template be comprising
The image template of marker.
Optionally, in the method according to the invention, the virtual objects of image and acquisition under current real scene are folded
The step of adding includes: the ARGB parameter according to setting, transparency process is carried out to the background of marker, so that virtual objects can
It is superimposed with the image seamless under current real scene.
It optionally, in the method according to the invention, will be under current real scene when virtual objects are threedimensional model
Image is superimposed with the virtual objects of acquisition, and to obtain corresponding virtual scene the step of includes: will be current via unity3D engine
Image under real scene is superimposed with the virtual objects of acquisition, obtains corresponding virtual scene.
Optionally, in the method according to the invention, further comprise the steps of: by under real scene include marker image mould
Version and the characteristic point for carrying out marker in the image template extracted after feature detection to the image template are uploaded to database；On
Associated geographical location information and the corresponding virtual objects of image template are passed to database.
Optionally, in the method according to the invention, further comprise the steps of: detection subsequent is via camera captured image
It is no that there are alternative events；If so, triggering corresponding interactive operation, the alternative events include static gesture, dynamic gesture, screening
Gear movement and eye motion, corresponding interactive operation are the dynamic change of virtual objects.
Optionally, in the method according to the invention, subsequent whether there is via camera captured image is detected to interact
The step of event include: when detect it is subsequent there is specified region via camera captured image and be blocked, determine to exist and hide
The alternative events of gear movement；The step of dynamic change of the triggering virtual objects include: remove be blocked in image it is specified
Region, and the interactive operation of corresponding, to display the virtual objects of image after removing specified region is obtained in the database；It holds
The row interactive operation.
Optionally, in the method according to the invention, it further comprises the steps of: in setting removal image template in the database not
The corresponding interactive operation of different images generated behind same specified region.
According to another aspect of the present invention, a kind of virtual objects display device based on augmented reality is provided, is resided in
In mobile terminal with camera and display screen, which includes: image capture module, is suitable for capturing via camera current
It include the image of marker, position acquisition module, suitable for obtaining current geographical location information under real scene；Feature extraction mould
Block is suitable for carrying out feature detection to captured image, extracts the characteristic point of marker in image；Object matching module is suitable for root
According to the characteristic point of extraction, determine in the database be associated with the geographical location information of acquisition, the image mould comprising the marker
Version；It is further adapted for obtaining the corresponding virtual objects of image template, virtual objects are video, audio, text, two dimensional image and three-dimensional mould
One in type；Object display module, suitable for the image under current real scene to be superimposed with the virtual objects of acquisition, to obtain
Corresponding virtual scene；It is further adapted for the virtual scene shown via display screen.
Optionally, in a device in accordance with the invention, object matching module is further adapted for the characteristic point for the marker that will be extracted
It is compared with the characteristic point of image template；If the quantity of the Feature Points Matching of the characteristic point and image template extracted is more than threshold
Value, it is determined that the image template is the image template comprising marker.
Optionally, in a device in accordance with the invention, object display module is further adapted for the ARGB parameter according to setting, to mark
The background for knowing object carries out transparency process, so that virtual objects can be superimposed with the image seamless under current real scene.
Optionally, in a device in accordance with the invention, when virtual objects are threedimensional model, object display module is further adapted for
The image under current real scene is superimposed with the virtual objects of acquisition via unity3D engine, obtains corresponding virtual scene.
Optionally, in a device in accordance with the invention, further include template setup module, be suitable for including mark under real scene
Know the image template of object and the image template is carried out in the image template extracted after feature detection in the characteristic point of marker
Reach database；It is further adapted for uploading associated geographical location information and the corresponding virtual objects of image template to database.
Optionally, in a device in accordance with the invention, further include interactive module, be adapted to detect for subsequent capturing via camera
Image whether there is alternative events, if so, trigger the corresponding interactive operation of the alternative events, alternative events include static hand
Gesture, dynamic gesture block movement and eye motion, and corresponding interactive operation is the dynamic change of virtual objects.
Optionally, in a device in accordance with the invention, interactive module is further adapted for subsequent capturing via camera when detecting
Image there is specified region and be blocked, determine the alternative events for existing and blocking movement；It is further adapted for removing and is blocked in image
Specified region, and the interaction behaviour of corresponding, to display the virtual objects of image after removing specified region is obtained in the database
Make；It is further adapted for executing the interactive operation.
Optionally, in a device in accordance with the invention, template setup module is further adapted for that removal image is arranged in the database
The corresponding interactive operation of different images generated behind different specified regions in template.
According to the present invention there are one aspects, provide a kind of virtual objects display system based on augmented reality, wrap
Include: virtual objects display device according to the present invention and database, the database are suitable for storage image template and image mould
The corresponding virtual objects of version.
Virtual objects displaying scheme according to the present invention is by extracting characteristic point to captured image, and according to characteristic point
It with corresponding virtual objects and shows, precisely, delay is smaller, while the diversification of virtual objects can be supplied to user more for identification
Well more lively sensory experience.Wherein, transparency process is carried out to marker background by setting ARGB parameter, it is ensured that
Virtual objects can be superimposed with the image seamless under real scene.Further, it is triggered by a plurality of types of alternative events
Corresponding interactive operation is executed, it is not only easy to operate, but also realize the interaction between user and virtual objects, better user experience.
Detailed description of the invention
To the accomplishment of the foregoing and related purposes, certain illustrative sides are described herein in conjunction with following description and drawings
Face, these aspects indicate the various modes that can practice principles disclosed herein, and all aspects and its equivalent aspect
It is intended to fall in the range of theme claimed.Read following detailed description in conjunction with the accompanying drawings, the disclosure it is above-mentioned
And other purposes, feature and advantage will be apparent.Throughout the disclosure, identical appended drawing reference generally refers to identical
Component or element.
Fig. 1 shows the virtual objects display system based on augmented reality of an illustrative embodiments according to the present invention
The structural block diagram of system 100；
Fig. 2 shows the virtual objects based on augmented reality of an illustrative embodiments according to the present invention to show dress
The structural block diagram set；
Fig. 3 shows the signal of an image comprising marker of an illustrative embodiments according to the present invention
Figure,
Fig. 4 shows the schematic diagram that camera captures the virtual objects shown after image shown in Fig. 3；
Fig. 5 shows the signal of an image comprising marker of another illustrative embodiments according to the present invention
Figure；
Fig. 6 shows the schematic diagram that camera captures the virtual objects shown after image shown in Fig. 5；
Fig. 7 shows the signal of an image comprising marker of another illustrative embodiments according to the present invention
Figure；
Fig. 8 shows the schematic diagram that camera captures the virtual objects shown after image shown in Fig. 7；
Fig. 9 show an illustrative embodiments according to the present invention be divided into multiple specified regions comprising mark
The schematic diagram of the image of object；And
Figure 10 shows the virtual objects display side based on augmented reality according to one exemplary embodiment
The flow chart of method 400.
Specific embodiment
Exemplary embodiments of the present disclosure are described in more detail below with reference to accompanying drawings.Although showing the disclosure in attached drawing
Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth here
It is limited.On the contrary, these embodiments are provided to facilitate a more thoroughly understanding of the present invention, and can be by the scope of the present disclosure
It is fully disclosed to those skilled in the art.
Fig. 1 shows the virtual objects display system based on augmented reality according to one exemplary embodiment
100 structural block diagram.As shown in Figure 1, system 100 may include 200 sum number of virtual objects display device based on augmented reality
According to library 300.Virtual objects display device 200 based on augmented reality generally resides on the mobile end with camera and display screen
In end, and connected by network and database 300.Database 300 is stored with image template and image template is corresponding virtual
Object can be to the image mould of 300 match query of database after virtual objects display device 200 captures image via camera
Version and virtual objects, and virtual objects are shown via display screen.Here virtual objects can be video, audio,
One in text, two dimensional image and threedimensional model.
Fig. 2 shows the virtual objects display devices based on augmented reality according to one exemplary embodiment
200 structural block diagram.As shown in Fig. 2, virtual objects display device 200 may include image capture module 210, position acquisition mould
Block 220, characteristic extracting module 230, object matching module 240 and object display module 250.
Firstly, image capture module 210 captures the image under current real scene comprising marker via camera.Specifically
The camera on ground, the mobile terminal that image capture module 210 can call its resident is absorbed, and includes under current real scene
The image of marker can absorb the electronic equipment screen (computer display screen, hand that show marker that are powered by camera
Machine display screen etc.) obtain, can also by camera absorb entity be printed with marker article (generally flat objects,
Such as card, disk, poster etc.) obtain, can also by camera absorb entity marker (such as entity spectacle frame,
Spectacle case etc.) it obtains.Wherein marker is corresponding with subsequent need virtual objects to be shown and has enough characteristic points, can
To be image that virtual three-dimensional model generates on projecting direction, it is also possible to virtual two-dimensional image, can also be bar code (one
Tie up bar code, two-dimensional bar etc.), it can also be the article of entity.In one embodiment, marker is the spectacle frame of entity
Or spectacle case, corresponding virtual objects are the video for introducing this glasses.
Meanwhile position acquisition module 220 obtains the geographical location information of user, geographical location letter by LBS or GPS
Breath indicates user, that is, geographical location locating for the mobile terminal be resident of virtual objects display device 200, and including longitude and latitude
Degree.
Characteristic extracting module 230 is connect with image capture module 210, is suitable for carrying out feature detection to captured image, be mentioned
Take the characteristic point of marker in image.The characteristic point extracted usually reflects the feature of marker.Specifically, if marker
For the image of non-bar code, the pixel in image can be traversed, obtain wherein color difference and be greater than or equal to default color difference
The pixel of threshold value is then obtained according to preset reference position every using these pixels as the characteristic point of captured image
The coordinate of a characteristic point.Wherein, reference position can be the central pixel point of captured image, in the coordinate for obtaining characteristic point
When, a coordinate system can be established according to central pixel point, the relative position according to characteristic point and central pixel point, so that it may obtain
Obtain coordinate of the characteristic point based on the coordinate system.If captured image is two-dimensional bar, can be according to preset resolution ratio to two
It ties up bar code and carries out cutting, segment is obtained, for example, two-dimensional bar is cut into 20 parts in transverse direction and vertical section.Due to two dimension
Bar code is made of color lump, therefore, using the central point of two-dimensional bar as origin, is established coordinate system, is obtained segment base
It will be two-dimentional using the affiliated segment in the side of color lump in two-dimensional bar as the characteristic point of two-dimensional bar in the coordinate of the coordinate system
The coordinate of the affiliated segment in the side of the color lump of bar code, the coordinate of the characteristic point as two-dimensional bar.In one embodiment, should
Module can pass through Metaio, D ' tools such as fusion and Vuforia engine realize.
Object matching module 240 is connect with characteristic extracting module 230 and position acquisition module 220 respectively, is suitable for and data
Library 300 is communicated, in database 300 determine with acquisition geographical location information be associated with, the image comprising above-mentioned marker
Template.Specifically, first the associated image mould of the geographical location information is found in search to object matching module 240 in database 300
Version, then the characteristic point of the marker of extraction is compared with the characteristic point of image template.If the characteristic point and image extracted
The quantity of the Feature Points Matching of template is more than threshold value, it is determined that the image template is the image template comprising above-mentioned marker.
Here, image template and corresponding incidence relation are arranged in advance and are stored in database 300.In a reality
It applies in example, virtual objects display device 200 can also include template setup module 260, and template setup module 260 can will be true
Under scene include the image template of above-mentioned marker and the image template is carried out in the image template extracted after feature detection
The characteristic point of marker is uploaded to database 300, can also be corresponding by associated geographical location information and the image template
Virtual objects are uploaded to the storage of database 300.Specifically, template setup module 260 can also be by Vuforia engine come real
It is existing,
It determines and is associated with, after the image template comprising above-mentioned marker with the geographical location information obtained, object matching mould
Block 240 can obtain the corresponding virtual objects of image template in database 300, can also be according to the characteristic point of above-mentioned image
Posture assessment is carried out, and determines its position, then calculates transformation matrix, to make former from the above-mentioned central pixel point with image
The screen coordinate system of coordinate system and display screen that point is established establishes mapping relations, is shown on a display screen according to this transformation in this way
Image can achieve the effect that the image be attached to mark object image on.Meanwhile object display module can also be according to setting
The ARGB parameter (such as numerical value that corresponding Alpha transparent channel, the channel Red, the channel Green, the channel Blue is arranged) set is right
The background of marker carries out transparency process, so that successor virtual object can be folded with the image seamless under current real scene
Add, is experienced to the truer more lively perception of user.
Object display module 250 is connect with object matching module 250, suitable for by under current real scene image and acquisition
Virtual objects superposition, to obtain corresponding virtual scene, the virtual scene finally shown.Specifically, object shows mould
The virtual objects that block 250 can will acquire are drawn out according to above-mentioned calculated transformation matrix, finally by virtual objects with take the photograph
As head obtain real scene under image superposition show on a display screen.
In one embodiment, when virtual objects are threedimensional model, object display module 250 can pass through Unity3D
Engine realizes, Unity 3D can will directly rendering uses after the file download to mobile terminal of virtual objects, to improve
The formation speed of virtual scene.Specifically, in Unity 3D, an augmented reality phase is added in Hierarchy panel first
Then the virtual objects of marker and threedimensional model are imported, its position and view are adjusted in Scene panel by machine AR Camera
Angle, it is ensured that it folds real scene and dummy object by virtual camera all under the visual angle of augmented reality camera AR Camera
Add up, and as needed appropriate adjustment its three-dimensional space posture information.
For example, Fig. 3 shows the schematic diagram of an image comprising marker, virtual objects display device 200 is by taking the photograph
As head capture this include marker image, the corresponding virtual objects of the marker are shown by display screen --- three dimensional character mould
Type, as shown in Figure 4.
In another example Fig. 5 shows the schematic diagram that another includes the image of marker, virtual objects display device 200 is logical
Cross camera and capture the image that this includes marker, the corresponding virtual objects of the marker are shown by display screen --- video,
As shown in Figure 6.
In another example Fig. 7 shows the schematic diagram that another includes the image of marker, virtual objects display device 200 is logical
Cross camera and capture the image that this includes marker, the corresponding virtual objects of the marker are shown by display screen --- video,
As shown in Figure 8.
In addition, virtual objects display device 200 can also include interactive module 270, it is adapted to detect for subsequent via camera
Captured image whether there is alternative events, if so, triggering corresponding interactive operation.Alternative events may include static hand
Gesture, dynamic gesture and movement is blocked, corresponding interactive operation is the dynamic change of corresponding virtual objects, can be to play sound
Frequently, play video, threedimensional model rotation, execute animation, jump to website etc..
Wherein, static gesture, also referred to as hand posture, refer to the arm of a certain moment static state, the shape of palm or finger,
Posture, by camera obtain image recognition go out gesture data in do not include continuous time series information, this kind of gesture one
As identified with based on the method that characteristics of image clusters.Dynamic gesture then refers to arm, palm within one continuous time
Or the attitudes vibration or movement routine of finger, include the space characteristics changed over time in gesture data, can indicate well
Space path gesture.Side of the dynamic gesture usually using hidden Markov model-based on dynamic time warping and compression time axis
Method identified, and including time serial message.Interactive module 270 can accordingly be allowed by lasting movement, the variation of gesture
Threedimensional model follows gesture to change.
Movement is blocked, then refers in camera captured image that there is specified region is blocked.Specifically, if interactive module
270 detect that camera captured image has the alternative events for blocking movement, then remove the specified region being blocked in image,
And the interactive operation of corresponding, to display the virtual objects of image after removing specified region is obtained in database 300, then
Execute the interactive operation.
For example, Fig. 9 shows the schematic diagram for being divided into the image comprising marker in multiple specified regions, such as Fig. 9 institute
Show, image is divided into the more specified regions ABCDEF, and after blocking a-quadrant with hand, interactive module 270 obtains removal a-quadrant
Image afterwards, the corresponding actions in the database 300 of acquisition are to execute to play next song, and execute.When blocking the area B with hand
Behind domain, interactive module 270 obtains the image after removal B area, and the corresponding actions in the database 300 of acquisition are to execute to play
One first song, and execute.After blocking the region D with hand, interactive module 270 obtains the image behind the removal region D, the data of acquisition
Corresponding actions in library 300 are to execute amplification of volume, and execute.After blocking the region C with hand, interactive module 270 obtains removal C
Image behind region, the corresponding actions in the database 300 of acquisition are to reduce volume, and execute.It can be in shielded image
Combination zone (such as AB combination zone, AD combination zone or ABCD combination zone etc.), thereby executing different interaction behaviour
Make.
In one embodiment, interactive action can also include eye motion, by the front camera in mobile terminal,
User's eyes image is captured, eye feature is extracted, and according to eye feature so that it is determined that eyeball position, the eyeball position is for sentencing
Determine the direction and goal that human eye is watched attentively, the interactive operation of corresponding triggering can be to move virtual objects toward the direction that human eye is watched attentively
It is dynamic.
These alternative events and its corresponding operation equally can be stored in advance in database 300.Specifically, template
Different alternative events and its corresponding interactive operation, such as removal figure can be arranged in setup module 260 in database 300
As the corresponding interactive operation of different images generated behind specified region different in template.
To sum up, it by extracting characteristic point to captured image, and according to the corresponding virtual objects of Feature Points Matching and shows,
Precisely, delay is smaller for identification, while the diversification of virtual objects can be supplied to the more preferably more lively sensory experience of user.Into one
Step ground is triggered by a plurality of types of alternative events and executes corresponding interactive operation, not only easy to operate, but realize user with
Interaction between virtual objects, better user experience.
Figure 10 shows the virtual objects display side based on augmented reality according to one exemplary embodiment
The flow chart of method 400.As shown in figure 8, method 400 starts from step S410, it is current true via camera capture in step S410
It include the image of marker under real field scape.Meanwhile in the step s 420, current geographical location information is obtained.
Then, in step S430, feature detection is carried out to captured image, extracts the characteristic point of marker in image.
In step S440, according to the characteristic point of extraction, determines be associated with the geographical location information obtained, comprising the mark in the database
Know the image template of object.Specifically, the characteristic point of the marker of extraction is compared with the characteristic point of image template, if extracting
Characteristic point and image template Feature Points Matching quantity be more than threshold value, it is determined that the image template be include the marker
Image template.
After determining image template, in step S450, the corresponding virtual objects of image template are obtained, wherein virtual objects are
One in video, audio, text, two dimensional image and threedimensional model.
Finally in step S460, the image under current real scene is superimposed with the virtual objects of acquisition, to obtain phase
The virtual scene answered, and the virtual scene is shown via display screen.It, can be via when virtual objects are threedimensional model
Image under current real scene is superimposed by unity3D engine with the virtual objects of acquisition, obtains corresponding virtual scene.Into one
The step of walking ground, the image under current real scene is superimposed with the virtual objects of acquisition may include: the ARGB according to setting
Parameter (such as numerical value that corresponding Alpha transparent channel, the channel Red, the channel Green, the channel Blue are set), to marker
Background carries out transparency process, so that virtual objects can be superimposed with the image seamless under current real scene.
Above-mentioned image template and corresponding virtual objects, which are realized, to be stored in database profession.Therefore, method 400 may be used also
Comprising steps of being extracted by the image template under real scene comprising marker and after carrying out feature detection to the image template
Image template in the characteristic point of marker be uploaded to database, upload associated geographical location information and the image template pair
The virtual objects answered are to database.
In addition, method 400 can be comprising steps of detection is subsequent to whether there is interaction thing via camera captured image
Part；If so, triggering corresponding interactive operation, wherein alternative events include static gesture, dynamic gesture, block movement and eye
Portion's movement, corresponding interactive operation are the dynamic change of virtual objects.Wherein, when detect it is subsequent via camera capture figure
It is blocked as there is specified region, it is determined that there are the alternative events for blocking movement, removes the specified region being blocked in image,
And the interactive operation of corresponding, to display the virtual objects of image after removing specified region is obtained in the database, executing should
Interactive operation.
Correspondingly, method 400 can be comprising steps of be arranged different alternative events and its is right in database 300
The corresponding interactive operation of different images generated behind different specified regions in the interactive operation answered, such as removal image template.
Illustrating specifically retouching for the principle of the virtual objects display system 100 based on augmented reality in conjunction with FIG. 1 to FIG. 9 above
It states and the respective handling in each step is explained in detail, no longer duplicate contents are repeated here.
It should be appreciated that in order to simplify the disclosure and help to understand one or more of the various inventive aspects, it is right above
In the description of exemplary embodiment of the present invention, each feature of the invention be grouped together into sometimes single embodiment, figure or
In person's descriptions thereof.However, the disclosed method should not be interpreted as reflecting the following intention: i.e. claimed hair
Bright requirement is than feature more features expressly recited in each claim.More precisely, as the following claims
As book reflects, inventive aspect is all features less than single embodiment disclosed above.Therefore, it then follows specific real
Thus the claims for applying mode are expressly incorporated in the specific embodiment, wherein each claim itself is used as this hair
Bright separate embodiments.
Those skilled in the art should understand that the module of the equipment in example disclosed herein or unit or groups
Part can be arranged in equipment as depicted in this embodiment, or alternatively can be positioned at and the equipment in the example
In different one or more equipment.Module in aforementioned exemplary can be combined into a module or furthermore be segmented into multiple
Submodule.
Those skilled in the art will understand that can be carried out adaptively to the module in the equipment in embodiment
Change and they are arranged in one or more devices different from this embodiment.It can be the module or list in embodiment
Member or component are combined into a module or unit or component, and furthermore they can be divided into multiple submodule or subelement or
Sub-component.Other than such feature and/or at least some of process or unit exclude each other, it can use any
Combination is to all features disclosed in this specification (including adjoint claim, abstract and attached drawing) and so disclosed
All process or units of what method or apparatus are combined.Unless expressly stated otherwise, this specification is (including adjoint power
Benefit require, abstract and attached drawing) disclosed in each feature can carry out generation with an alternative feature that provides the same, equivalent, or similar purpose
It replaces.
The invention also includes: it is subsequent via camera shooting to further comprise the steps of: detection by A6, the method as described in any one of A1-5
Head captured image whether there is alternative events；If so, triggering corresponding interactive operation, the alternative events include static hand
Gesture, dynamic gesture block movement and eye motion, and corresponding interactive operation is the dynamic change of virtual objects.A7, such as A6 institute
The method stated, described detection subsequent the step of whether there is alternative events via camera captured image includes: to work as to detect
It is subsequent to be blocked via camera captured image in the presence of specified region, determine the alternative events for existing and blocking movement；The touching
The step of sending out the dynamic change of virtual objects includes: the specified region for removing and being blocked in image, and obtains go in the database
Except the image behind specified region is corresponding, the interactive operation to the virtual objects of display；Execute the interactive operation.A8, such as A7
The method further comprises the steps of: the difference generated behind specified region different in setting removal image template in the database
The corresponding interactive operation of image.
B13, the device as described in any one of B9-12 further include template setup module, suitable for that will include under real scene
The image template of the marker and the spy that marker in the image template extracted after feature detection is carried out to the image template
Sign point is uploaded to database；It is further adapted for uploading associated geographical location information and the corresponding virtual objects of image template to number
According to library.B14, the device as described in any one of B9-13, further include interactive module, are adapted to detect for subsequent capturing via camera
Image whether there is alternative events, if so, triggering the corresponding interactive operation of the alternative events, the alternative events include quiet
State gesture, dynamic gesture block movement and eye motion, and corresponding interactive operation is the dynamic change of virtual objects.B15,
Device as described in B14, the interactive module are further adapted for detect subsequent via the specified area of camera captured image presence
Domain is blocked, and determines the alternative events for existing and blocking movement；It is further adapted for removing the specified region being blocked in image, and in data
The interactive operation of corresponding, to display the virtual objects of image after removing specified region is obtained in library；It is further adapted for described in execution
Interactive operation.B16, the method as described in B15, the template setup module are further adapted for that removal image template is arranged in the database
The corresponding interactive operation of different images generated behind middle different specified region.
In addition, it will be appreciated by those of skill in the art that although some embodiments described herein include other embodiments
In included certain features rather than other feature, but the combination of the feature of different embodiments mean it is of the invention
Within the scope of and form different embodiments.For example, in the following claims, embodiment claimed is appointed
Meaning one of can in any combination mode come using.
In addition, be described as herein can be by the processor of computer system or by executing by some in the embodiment
The combination of method or method element that other devices of the function are implemented.Therefore, have for implementing the method or method
The processor of the necessary instruction of element forms the device for implementing this method or method element.In addition, Installation practice
Element described in this is the example of following device: the device be used for implement as in order to implement the purpose of the invention element performed by
Function.
As used in this, unless specifically stated, come using ordinal number " first ", " second ", " third " etc.
Description plain objects, which are merely representative of, is related to the different instances of similar object, and is not intended to imply that the object being described in this way must
Must have the time it is upper, spatially, sequence aspect or given sequence in any other manner.
Although the embodiment according to limited quantity describes the present invention, above description, the art are benefited from
It is interior it is clear for the skilled person that in the scope of the present invention thus described, it can be envisaged that other embodiments.Additionally, it should be noted that
Language used in this specification primarily to readable and introduction purpose and select, rather than in order to explain or limit
Determine subject of the present invention and selects.Therefore, without departing from the scope and spirit of the appended claims, for this
Many modifications and changes are obvious for the those of ordinary skill of technical field.For the scope of the present invention, to this
Invent done disclosure be it is illustrative and not restrictive, it is intended that the scope of the present invention be defined by the claims appended hereto.
Claims (13)
1. a kind of virtual objects display methods based on augmented reality, comprising:
The image under current real scene comprising marker is captured via camera；
Obtain current geographical location information；
Feature detection is carried out to captured image, extracts the characteristic point of marker in image；
According to the characteristic point of extraction, determines be associated with, with the geographical location information obtained comprising the marker in the database
Image template；
The corresponding virtual objects of described image template are obtained, the virtual objects are video, audio, text, two dimensional image and three
One in dimension module；
Image under current real scene is superimposed with the virtual objects of acquisition, to obtain corresponding virtual scene, and via aobvious
Display screen shows the virtual scene；
Detect it is subsequent via camera captured image with the presence or absence of alternative events；
If so, trigger corresponding interactive operation, the alternative events include static gesture, dynamic gesture, block movement and
Eye motion, corresponding interactive operation are the dynamic change of virtual objects, the alternative events and its corresponding interactive operation
It is previously stored in database；Wherein
When detecting subsequent there is specified region via camera captured image and be blocked, it is determined that there is the friendship for blocking movement
Mutual event；The specified region that is blocked in removal image, and obtain in the database the image after removing specified region it is corresponding,
Interactive operation to the virtual objects of display executes the interactive operation.
2. the method as described in claim 1, described determine in the database is associated with, comprising institute with the geographical location information obtained
The step of stating the image template of marker include:
The characteristic point of the marker of extraction is compared with the characteristic point of image template；
If extract characteristic point and image template Feature Points Matching quantity be more than threshold value, it is determined that the image template be comprising
The image template of the marker.
3. method according to claim 1 or 2, the image by under current real scene is superimposed with the virtual objects of acquisition
The step of include:
According to the ARGB parameter of setting, transparency process is carried out to the background of marker, so as to virtual objects can with it is current true
Image seamless superposition under real field scape.
4. method as claimed in claim 3, when the virtual objects are threedimensional model, it is described will be under current real scene
Image is superimposed with the virtual objects of acquisition, and to obtain corresponding virtual scene the step of includes:
The image under current real scene is superimposed with the virtual objects of acquisition via unity3D engine, is obtained corresponding virtual
Scene.
5. the method as described in claim 1 further comprises the steps of:
It under real scene will include the image template of the marker and extracted after carrying out feature detection to the image template
The characteristic point of marker is uploaded to database in image template；
Associated geographical location information and the corresponding virtual objects of image template are uploaded to database.
6. the method as described in claim 1 further comprises the steps of:
The corresponding interactive operation of different images generated behind specified region different in setting removal image template in the database.
7. a kind of virtual objects display device based on augmented reality, resides in the mobile terminal with camera and display screen
In, described device includes:
Image capture module, suitable for capturing the image under current real scene comprising marker via camera,
Position acquisition module, suitable for obtaining current geographical location information；
Characteristic extracting module is suitable for carrying out feature detection to captured image, extracts the characteristic point of marker in image；
Object matching module, suitable for the characteristic point according to extraction, determine in the database be associated with the geographical location information of acquisition,
Image template comprising the marker；It is further adapted for obtaining the corresponding virtual objects of described image template, the virtual objects are
One in video, audio, text, two dimensional image and threedimensional model；
Object display module, it is corresponding to obtain suitable for the image under current real scene to be superimposed with the virtual objects of acquisition
Virtual scene；It is further adapted for the virtual scene shown via display screen；And
Interactive module, be adapted to detect for it is subsequent via camera captured image with the presence or absence of alternative events, if so, triggering the friendship
The corresponding interactive operation of mutual event, the alternative events include static gesture, dynamic gesture, block movement and eye motion,
Corresponding interactive operation is the dynamic change of virtual objects, and the alternative events and its corresponding interactive operation are previously stored in
In database；Wherein
When detecting subsequent there is specified region via camera captured image and be blocked, it is determined that there is the friendship for blocking movement
Mutual event；The specified region that is blocked in removal image, and obtain in the database the image after removing specified region it is corresponding,
Interactive operation to the virtual objects of display executes the interactive operation.
8. device as claimed in claim 7, the object matching module is further adapted for the characteristic point and figure for the marker that will be extracted
As the characteristic point of template is compared；If the quantity of the Feature Points Matching of the characteristic point and image template extracted is more than threshold value,
Determine that the image template is the image template comprising the marker.
9. device as claimed in claim 7 or 8, the object display module is further adapted for the ARGB parameter according to setting, to mark
The background for knowing object carries out transparency process, so that virtual objects can be superimposed with the image seamless under current real scene.
10. device as claimed in claim 9, when the virtual objects are threedimensional model, the object display module is also suitable
In being superimposed the image under current real scene with the virtual objects of acquisition via unity3D engine, corresponding virtual field is obtained
Scape.
11. device as claimed in claim 7 further includes template setup module, it is suitable for including the mark under real scene
The image template of object and the characteristic point for carrying out marker in the image template extracted after feature detection to the image template upload
To database；It is further adapted for uploading associated geographical location information and the corresponding virtual objects of image template to database.
12. device as claimed in claim 11, the template setup module is further adapted for that removal image mould is arranged in the database
The corresponding interactive operation of different images generated behind different specified regions in version.
13. a kind of virtual objects display system based on augmented reality, comprising:
Device as described in any one of claim 7-12, and
Database is suitable for storage image template and the corresponding virtual objects of image template.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610782308.5A CN106355153B (en) | 2016-08-31 | 2016-08-31 | A kind of virtual objects display methods, device and system based on augmented reality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610782308.5A CN106355153B (en) | 2016-08-31 | 2016-08-31 | A kind of virtual objects display methods, device and system based on augmented reality |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106355153A CN106355153A (en) | 2017-01-25 |
| CN106355153B true CN106355153B (en) | 2019-10-18 |
Family
ID=57857476
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610782308.5A Active CN106355153B (en) | 2016-08-31 | 2016-08-31 | A kind of virtual objects display methods, device and system based on augmented reality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106355153B (en) |
Families Citing this family (55)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107092347B (en) * | 2017-03-10 | 2020-06-09 | 深圳市博乐信息技术有限公司 | Augmented reality interaction system and image processing method |
| CN106984043B (en) * | 2017-03-24 | 2020-08-07 | 武汉秀宝软件有限公司 | Data synchronization method and system for multiplayer battle game |
| CN107084740B (en) * | 2017-03-27 | 2020-07-03 | 宇龙计算机通信科技(深圳)有限公司 | Navigation method and device |
| CN109213885A (en) * | 2017-06-29 | 2019-01-15 | 深圳市掌网科技股份有限公司 | Car show method and system based on augmented reality |
| CN109213728A (en) * | 2017-06-29 | 2019-01-15 | 深圳市掌网科技股份有限公司 | Cultural relic exhibition method and system based on augmented reality |
| CN107516099B (en) * | 2017-08-21 | 2022-11-29 | 腾讯科技（深圳）有限公司 | Method and device for detecting marked picture and computer readable storage medium |
| CN109427219B (en) * | 2017-08-29 | 2021-04-27 | 深圳市掌网科技股份有限公司 | Disaster prevention learning method and device based on augmented reality education scene conversion model |
| CN109427096A (en) * | 2017-08-29 | 2019-03-05 | 深圳市掌网科技股份有限公司 | A kind of automatic guide method and system based on augmented reality |
| CN107596683B (en) * | 2017-09-25 | 2021-03-12 | 晋江市博感电子科技有限公司 | Virtual amusement method, device and system for baby carrier based on augmented reality |
| CN107808416A (en) * | 2017-09-29 | 2018-03-16 | 北京金山安全软件有限公司 | Image processing method, image display method, image processing device, image display device, electronic equipment and storage medium |
| CN107590484A (en) * | 2017-09-29 | 2018-01-16 | 百度在线网络技术（北京）有限公司 | Method and apparatus for information to be presented |
| CN108022301B (en) * | 2017-11-23 | 2020-05-19 | 腾讯科技（上海）有限公司 | Image processing method and device and storage medium |
| CN108038911B (en) * | 2017-11-27 | 2022-03-11 | 广西南宁聚象数字科技有限公司 | Holographic imaging control method based on AR technology |
| CN109840947B (en) * | 2017-11-28 | 2023-05-09 | 广州腾讯科技有限公司 | Implementation method, device, equipment and storage medium of augmented reality scene |
| CN109839105A (en) * | 2017-11-29 | 2019-06-04 | 深圳市掌网科技股份有限公司 | A kind of position navigation methods and systems based on augmented reality |
| CN107918956A (en) * | 2017-12-01 | 2018-04-17 | 广州市动景计算机科技有限公司 | Processing method, device and the electronic equipment of augmented reality |
| CN108038916B (en) * | 2017-12-27 | 2022-12-02 | 上海徕尼智能科技有限公司 | Augmented reality display method |
| CN109993594A (en) * | 2017-12-29 | 2019-07-09 | 苏宁云商集团股份有限公司 | 3D and AR the switching methods of exhibiting and device of goods model |
| CN107948327B (en) * | 2018-01-02 | 2021-08-06 | 中国银行股份有限公司 | A data processing method, device and system based on business training |
| CN108346458A (en) * | 2018-01-11 | 2018-07-31 | 余军辉 | Medical teaching AR capture overlapping systems |
| CN108093239A (en) * | 2018-02-07 | 2018-05-29 | 盎锐（上海）信息科技有限公司 | Data processing method and panoramic shooting system based on single camera terminal |
| CN108346179B (en) * | 2018-02-11 | 2021-08-03 | 北京小米移动软件有限公司 | AR device display method and device |
| KR20190101620A (en) * | 2018-02-23 | 2019-09-02 | 주식회사 로로아트플랜 | Moving trick art implement method using augmented reality technology |
| CN108537149B (en) * | 2018-03-26 | 2020-06-02 | Oppo广东移动通信有限公司 | Image processing method, image processing device, storage medium and electronic equipment |
| CN110322565A (en) * | 2018-03-30 | 2019-10-11 | 深圳市掌网科技股份有限公司 | A kind of image processing method and device |
| CN110515451A (en) * | 2018-05-21 | 2019-11-29 | 海尔数字科技（上海）有限公司 | A kind of product information rendering method, device, equipment, medium and packing material |
| CN108829250A (en) * | 2018-06-04 | 2018-11-16 | 苏州市职业大学 | A kind of object interaction display method based on augmented reality AR |
| CN108932055B (en) * | 2018-06-04 | 2021-08-24 | 杭州艺手工网络科技有限公司 | Method and equipment for enhancing reality content |
| CN108961375A (en) * | 2018-06-20 | 2018-12-07 | 腾讯科技（深圳）有限公司 | A kind of method and device generating 3-D image according to two dimensional image |
| CN109050401B (en) * | 2018-07-09 | 2020-08-21 | 三星电子（中国）研发中心 | Augmented reality driving display method and device |
| CN110794950A (en) * | 2018-08-01 | 2020-02-14 | 深圳先进技术研究院 | Data monitoring experiment method and device, terminal equipment and storage medium |
| CN110837764B (en) * | 2018-08-17 | 2022-11-15 | 广东虚拟现实科技有限公司 | Image processing method, device, electronic device and visual interaction system |
| CN110858134B (en) * | 2018-08-22 | 2023-04-28 | 阿里巴巴集团控股有限公司 | Data, display processing method and device, electronic equipment and storage medium |
| CN111191492B (en) * | 2018-11-15 | 2024-07-02 | 北京三星通信技术研究有限公司 | Information estimation, model retrieval and model alignment methods and devices |
| CN109636918A (en) * | 2018-11-20 | 2019-04-16 | 上海玄彩美科网络科技有限公司 | A kind of method and apparatus that AR is shown |
| CN109741438B (en) * | 2018-11-23 | 2023-01-06 | 重庆灵翎互娱科技有限公司 | Three-dimensional face modeling method, device, equipment and medium |
| CN109379551B (en) * | 2018-11-26 | 2021-05-18 | 京东方科技集团股份有限公司 | Enhanced content display method, processing method, display device and processing device |
| CN109545003B (en) * | 2018-12-24 | 2022-05-03 | 北京卡路里信息技术有限公司 | Display method, display device, terminal equipment and storage medium |
| CN110232743A (en) * | 2019-06-11 | 2019-09-13 | 珠海格力电器股份有限公司 | Method and device for displaying articles through augmented reality technology |
| CN110675310B (en) * | 2019-07-02 | 2020-10-02 | 北京达佳互联信息技术有限公司 | Video processing method, device, electronic device and storage medium |
| CN110675504B (en) * | 2019-09-24 | 2023-07-18 | 上海友福文化艺术有限公司 | Augmented reality system and method |
| CN110837299A (en) * | 2019-11-11 | 2020-02-25 | 上海萃钛智能科技有限公司 | Activity management intelligent device, system and method |
| CN110930773A (en) * | 2019-11-20 | 2020-03-27 | 深圳前海维度新科有限公司 | Intelligent blackboard with augmented reality teaching function |
| CN110856033B (en) * | 2019-12-05 | 2021-12-10 | 米哈游科技（上海）有限公司 | Object display method, device, terminal and storage medium |
| CN111179435B (en) * | 2019-12-24 | 2024-02-06 | Oppo广东移动通信有限公司 | Augmented reality processing method and device, system, storage medium and electronic equipment |
| CN111240476B (en) * | 2020-01-06 | 2021-06-08 | 腾讯科技（深圳）有限公司 | Interaction method and device based on augmented reality, storage medium and computer equipment |
| CN111274910B (en) * | 2020-01-16 | 2024-01-30 | 腾讯科技（深圳）有限公司 | Scene interaction method, device and electronic equipment |
| CN111162840B (en) * | 2020-04-02 | 2020-09-29 | 北京外号信息技术有限公司 | Method and system for setting virtual objects around an optical communication device |
| CN111580652B (en) * | 2020-05-06 | 2024-01-16 | Oppo广东移动通信有限公司 | Video playback control method, device, augmented reality device and storage medium |
| CN111815780A (en) * | 2020-06-30 | 2020-10-23 | 北京市商汤科技开发有限公司 | Display method, display device, equipment and computer readable storage medium |
| CN112070901A (en) * | 2020-07-21 | 2020-12-11 | 马小淞 | A garden AR scene construction method, device, storage medium and terminal |
| CN112070907A (en) * | 2020-08-31 | 2020-12-11 | 北京市商汤科技开发有限公司 | Augmented reality system and augmented reality data generation method and device |
| CN114255258B (en) * | 2021-11-08 | 2025-11-14 | 优酷文化科技(北京)有限公司 | Methods for object implantation in multi-degree-of-freedom video, electronic devices and storage media |
| CN114967914A (en) * | 2022-05-13 | 2022-08-30 | 上海商汤智能科技有限公司 | Virtual display method, device, equipment and storage medium |
| CN115187759A (en) * | 2022-07-05 | 2022-10-14 | 北京字跳网络技术有限公司 | Special effect making method, device, equipment, storage medium and program product |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105491365A (en) * | 2015-11-25 | 2016-04-13 | 罗军 | Image processing method, device and system based on mobile terminal |
| CN105653036A (en) * | 2015-12-31 | 2016-06-08 | 深圳市路通网络技术有限公司 | Scrawling augmented reality method and system |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP6075110B2 (en) * | 2013-02-21 | 2017-02-08 | 富士通株式会社 | Image processing apparatus, image processing method, and image processing program |
| CN104134229A (en) * | 2014-08-08 | 2014-11-05 | 李成 | Real-time interaction reality augmenting system and method |
| CN105869216A (en) * | 2016-03-29 | 2016-08-17 | 腾讯科技（深圳）有限公司 | Method and apparatus for presenting object target |
| CN105844714A (en) * | 2016-04-12 | 2016-08-10 | 广州凡拓数字创意科技股份有限公司 | Augmented reality based scenario display method and system |
-
2016
- 2016-08-31 CN CN201610782308.5A patent/CN106355153B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105491365A (en) * | 2015-11-25 | 2016-04-13 | 罗军 | Image processing method, device and system based on mobile terminal |
| CN105653036A (en) * | 2015-12-31 | 2016-06-08 | 深圳市路通网络技术有限公司 | Scrawling augmented reality method and system |
Non-Patent Citations (2)
| Title |
|---|
| AR应用中的交互设计思考;百度;《http://www.woshipm.com/ucd/371336.html》;20160711;第1页第2段-第5页倒数第2段 * |
| 增强现实科普：AR潮即将来袭！你该知道的全在这;搜狐;《http://www.sohu.com/a/76765053_215596》;20160523;第1页第2段-第6页倒数第3段 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106355153A (en) | 2017-01-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106355153B (en) | A kind of virtual objects display methods, device and system based on augmented reality | |
| US11430192B2 (en) | Placement and manipulation of objects in augmented reality environment | |
| JP7566973B2 (en) | Information processing device, information processing method, and program | |
| CN107018336B (en) | The method and apparatus of method and apparatus and the video processing of image procossing | |
| CN110709897B (en) | Shadow generation for image content inserted into an image | |
| CN109584295A (en) | The method, apparatus and system of automatic marking are carried out to target object in image | |
| WO2016122973A1 (en) | Real time texture mapping | |
| EP1521482A3 (en) | Image display apparatus and method | |
| EP3090411A1 (en) | Augmented reality content adapted to space geometry | |
| KR20170122725A (en) | Modifying scenes of augmented reality using markers with parameters | |
| JP6224327B2 (en) | Information processing system, information processing apparatus, information processing method, and information processing program | |
| CN108525298A (en) | Image processing method, device, storage medium and electronic equipment | |
| CN106683193B (en) | A design method and design device of a three-dimensional model | |
| CN108668050B (en) | Video shooting method and device based on virtual reality | |
| WO2016018422A1 (en) | Virtual changes to a real object | |
| CN104680532A (en) | Object labeling method and device | |
| CN106780757B (en) | A method of augmented reality | |
| CN106204746A (en) | A kind of augmented reality system realizing 3D model live paint | |
| KR20100067155A (en) | Apparatus and method for providing realistic contents through augmented book | |
| CN109035415B (en) | Virtual model processing method, device, equipment and computer readable storage medium | |
| CN112882576A (en) | AR interaction method and device, electronic equipment and storage medium | |
| CN112905014A (en) | Interaction method and device in AR scene, electronic equipment and storage medium | |
| CN110096144A (en) | A kind of interaction holographic projection methods and system based on three-dimensional reconstruction | |
| CN113178017A (en) | AR data display method and device, electronic equipment and storage medium | |
| WO2020106299A1 (en) | Augmenting live images of a scene for occlusion |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20190823 Address after: Room 1008, 1118 Pudong Road, China (Shanghai) Free Trade Pilot Area, Pudong New Area, Shanghai, 200120 Applicant after: Shanghai star Vision Technology Co., Ltd. Address before: Room 1002, 1118 Pudong Road, Shanghai Pudong New Area Free Trade Pilot Area, 200120 Applicant before: Shanghai new mirror Technology Co., Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20200616 Address after: 200120 room 1005, No. 1118, South Pudong Road, free trade zone, Pudong New Area, Shanghai Patentee after: Shanghai Lingxiu glasses Co., Ltd Address before: Room 1008, 1118 Pudong Road, China (Shanghai) Free Trade Pilot Area, Pudong New Area, Shanghai, 200120 Patentee before: SHANGHAI ACTIVIEW TECHNOLOGY Co.,Ltd. |