CN107797665A - A kind of 3-dimensional digital sand table deduction method and its system based on augmented reality - Google Patents
A kind of 3-dimensional digital sand table deduction method and its system based on augmented reality Download PDFInfo
- Publication number
- CN107797665A CN107797665A CN201711130030.4A CN201711130030A CN107797665A CN 107797665 A CN107797665 A CN 107797665A CN 201711130030 A CN201711130030 A CN 201711130030A CN 107797665 A CN107797665 A CN 107797665A
- Authority
- CN
- China
- Prior art keywords
- sand table
- augmented reality
- model
- dimensional
- display terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 239000004576 sand Substances 0.000 title claims abstract description 159
- 230000003190 augmentative effect Effects 0.000 title claims abstract description 70
- 238000000034 method Methods 0.000 title claims abstract description 27
- 230000000694 effects Effects 0.000 claims abstract description 28
- 238000000605 extraction Methods 0.000 claims abstract description 20
- 239000011521 glass Substances 0.000 claims description 7
- 230000002708 enhancing effect Effects 0.000 claims description 4
- 230000001747 exhibiting effect Effects 0.000 claims 1
- 230000032696 parturition Effects 0.000 claims 1
- VMXUWOKSQNHOCA-UKTHLTGXSA-N ranitidine Chemical compound [O-][N+](=O)\C=C(/NC)NCCSCC1=CC=C(CN(C)C)O1 VMXUWOKSQNHOCA-UKTHLTGXSA-N 0.000 claims 1
- 239000011800 void material Substances 0.000 claims 1
- 230000003993 interaction Effects 0.000 abstract description 9
- 238000004422 calculation algorithm Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000001965 increasing effect Effects 0.000 description 2
- 230000001953 sensory effect Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000009264 composting Methods 0.000 description 1
- 239000012535 impurity Substances 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012876 topography Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Processing Or Creating Images (AREA)
Abstract
The embodiment of the invention discloses a kind of 3-dimensional digital sand table deduction method and its system based on augmented reality, wherein, this method includes：The first operation that display terminal receives user deduces application program to open sand table；Deduced in sand table in application program, display terminal gathers currently practical environment picture by built-in image capture device；Display terminal carries out feature extraction to obtain target signature point to currently practical environment picture；Display terminal carries out matching treatment according to default database to target signature point, to obtain target location；Display terminal is obtained according to the target location and display target virtual scene；Display terminal receives user to the second of destination virtual scene the operation, and the second operation includes mobile, scaling, lifting, behavior setting is carried out to role and Real time dynamic display, screen snapshot or video generation is carried out to sand table bandwagon effect.Implement the embodiment of the present invention, enhance and bring sense into when user watches actual object, and improve interaction effect.
Description
Technical field
The present invention relates to augmented reality field, and in particular to a kind of 3-dimensional digital sand table based on augmented reality is deduced
Method and its system.
Background technology
Sand table is the relation according to a certain percentage according to topographic map, airphoto or landform on the spot, with silt, war game and its
The model of its material composting.Sand table is used to topography and geomorphology or building minimizing displaying, so as to be convenient for people to observe, at present
It is widely used in military or business activity.
It is the static performance for using model build etc. subject matter mostly but known sand table is mainly physical plane sand table,
Bandwagon effect lacks interest, for spectators, also lacks interactive.Therefore, there is a kind of multimedia for carrying out interaction
Sand table, its major programme are as follows：On the basis of traditional sand table model, it is soft to be provided with multimedia human-computer interaction for organically combination
The equipment such as the computer of part, LED display, allow it to issue an instruction to realize sand table illuminating lamp to controller by computer
The operation such as unlatching, color and flicker conversion, and the controls such as smog and the big minor adjustment of current, the operation of model vehicle can also be carried out
System, makes sand table model be provided with the artistic effect of vivid and interesting.Although the multimedia sand table is by controller to equipment on sand table
Control enhance the interest and audience interaction of sand table, but its effect is excessively flat, is still difficult to meet spectators Geng Gao's
Demand for experience.
Further, with the continuous development of scientific technology, augmented reality has developed to certain maturity.Increase
Strong reality (Augmented Reality, abbreviation AR), it is a kind of that real world information and virtual world information is " seamless " integrated
New technology, be script in the certain time spatial dimension of real world be difficult experience entity information (visual information,
Sound, taste and tactile etc.), by science and technology such as computers, it is superimposed again after analog simulation, by virtual Information application to truly
The world, perceived by human sensory, so as to reach the sensory experience of exceeding reality.
Based on this, it is necessary to provide a kind of the sand table deduction method based on augmented reality and its system to strengthen user
Sense is brought into when watching actual object, and lifts interaction effect.
The content of the invention
The purpose of the embodiment of the present invention be to provide a kind of 3-dimensional digital sand table deduction method based on augmented reality and its
System, sense is brought into when user watches actual object to strengthen, and lift interaction effect.
To achieve the above object, in a first aspect, the embodiments of the invention provide a kind of 3-dimensional digital based on augmented reality
Sand table deduction method, including：
The first operation that display terminal receives user deduces application program to open sand table；
Deduced in the sand table in application program, the display terminal is gathered current real by built-in image capture device
Border environment picture；
The display terminal carries out feature extraction to obtain target signature point to the currently practical environment picture；
The display terminal carries out matching treatment according to default database to the target signature point, to obtain target position
Put, the target location is any position in augmented reality sand table model, and the database includes characteristic point and the enhancing
The corresponding relation of position in real sand table model, and the corresponding virtual field in each position in the augmented reality sand table model
Scape；
The display terminal is obtained according to the target location and display target virtual scene；
The display terminal receives second operation of the user to the destination virtual scene, and second operation includes moving
Dynamic, scaling, lifting, behavior setting and Real time dynamic display are carried out to role, screen snapshot is carried out to sand table bandwagon effect or is regarded
Frequency generates.
As a preferred embodiment, the first operation that display terminal receives user applies journey to open sand table deduction
Before sequence, methods described also includes：
Processor gathers multiple actual scene information；
The processor is described three-dimensional empty according to multiple actual scene information architecture three-dimensional digital sand table models
Intending digital sand table model includes terrain information；
The processor carries out parameter addition processing to the three-dimensional digital sand table model to obtain three dimensional lifelike mould
Type, the three dimensional lifelike model include terrestrial object information, climatic information and social role；
The processor generates the sand table according to the three dimensional lifelike model and deduces application program.
Deduced as an alternative embodiment, the processor generates the sand table according to the three dimensional lifelike model
Application program specifically includes：
The processor carries out sports rule addition processing to the social role in the three dimensional lifelike model, to be increased
Strong real sand table model；
The processor scans actual object information by the display terminal, and the physical objects information is carried out special
To obtain initial characteristicses point, the actual object information includes picture in kind and in kind for sign extraction；
The processor obtains multiple initial positions in the augmented reality model, and by the initial characteristicses point and just
The beginning one-to-one binding of position progress；
The processor preserves the binding relationship of the initial characteristicses point and initial position, should to generate the sand table deduction
Use program.
Add as an alternative embodiment, the processor carries out parameter to the three-dimensional digital sand table model
Processing is added to be specifically included to obtain the three dimensional lifelike model：
The processor is husky added to three-dimensional numeral by the terrestrial object information, climatic information and social role
Disk model is to obtain the three dimensional lifelike model.
As an alternative embodiment, the terrestrial object information includes vegetation, river and building, the weather letter
Breath includes rainfall, snowed and sunshine, the social role include personage and animal.
Second aspect, the embodiment of the present invention additionally provide a kind of 3-dimensional digital sand table deduction system based on augmented reality,
Including display terminal.Wherein, the display terminal includes：
Receiving module, the first operation for receiving user deduce application program to open sand table；
First acquisition module, currently practical environment picture is gathered for being deduced in the sand table in application program；
Extraction module, for carrying out feature extraction to the currently practical environment picture to obtain target signature point；
Matching module, for carrying out matching treatment to the target signature point according to default database, to obtain target
Position, the target location are any position in augmented reality sand table model, and the database includes characteristic point and the increasing
The corresponding relation of position in strong real sand table model, and each position corresponding one in the augmented reality sand table model is virtual
Scene；
Display module, for obtaining simultaneously display target virtual scene according to the target location；
The receiving module is additionally operable to receive second operation of the user to the destination virtual scene, the second operation bag
Mobile, scaling, lifting are included, behavior setting is carried out to role and Real time dynamic display, screen snapshot is carried out to sand table bandwagon effect
Or video generation.
As an alternative embodiment, the deduction system also includes processor, the processor includes：
Second acquisition module, for gathering multiple actual scene information；
Module is built, for according to multiple actual scene information architecture three-dimensional digital sand table models, described three
Dimension virtual digit sand table model includes terrain information；
Add module, handled for carrying out parameter addition to the three-dimensional digital sand table model to obtain three dimensional lifelike
Model, the three dimensional lifelike model include terrestrial object information, climatic information and social role；
Generation module, application program is deduced for generating the sand table according to the three dimensional lifelike model.
As an alternative embodiment, the generation module is specifically used for：
Sports rule addition processing is carried out to the social role in the three dimensional lifelike model, to obtain augmented reality sand table
Model；
Actual object information is scanned by the display terminal, and feature extraction is carried out to the physical objects information to obtain
Initial characteristicses point is taken, the actual object information includes picture in kind and in kind；
Multiple initial positions in the augmented reality model are obtained, and the initial characteristicses point and initial position are carried out
One-to-one binding；
The binding relationship of the initial characteristicses point and initial position is preserved, application program is deduced to generate the sand table.
As an alternative embodiment, the add module is specifically used for：
The terrestrial object information, climatic information and social role are added to the three-dimensional digital sand table model to obtain
To the three dimensional lifelike model.
As an alternative embodiment, the terrestrial object information includes vegetation, river and building, the weather letter
Breath includes rainfall, snowed and sunshine, the social role include personage and animal；The display terminal includes mobile phone, flat board
Computer and augmented reality glasses.
Implement the 3-dimensional digital sand table deduction method and its system based on augmented reality that the embodiment of the present invention is provided, use
The sand table that display terminal is opened at family deduces application program, deduces in application program in the sand table, is set by built-in IMAQ
It is standby to gather currently practical environment picture, and display target virtual scene is obtained based on the current actual environment picture, so as to strengthen
Sense is brought into when user watches actual object.Meanwhile user can perform movement, scaling, lifting, diagonal to destination virtual scene
Color carry out behavior setting and Real time dynamic display, to sand table bandwagon effect carry out screen snapshot or video generation etc. operation, so as to
Improve interaction effect.
Brief description of the drawings
, below will be to specific in order to illustrate more clearly of the specific embodiment of the invention or technical scheme of the prior art
The required accompanying drawing used is briefly described in embodiment or description of the prior art.In all of the figs, similar element
Or part is typically identified by similar reference.In accompanying drawing, each element or part might not be drawn according to the ratio of reality.
Fig. 1 is the signal stream for the 3-dimensional digital sand table deduction method based on augmented reality that first embodiment of the invention provides
Cheng Tu；
Fig. 2 is the signal stream for the 3-dimensional digital sand table deduction method based on augmented reality that second embodiment of the invention provides
Cheng Tu；
Fig. 3 to Fig. 5 is bandwagon effect figure；
Fig. 6 is that the structure for the 3-dimensional digital sand table deduction system based on augmented reality that first embodiment of the invention provides is shown
It is intended to；
Fig. 7 is the structural representation of display terminal in Fig. 6；
Fig. 8 is the structural representation of processor in Fig. 6.
Embodiment
The embodiment of technical solution of the present invention is described in detail below in conjunction with accompanying drawing.Following examples are only used for
Clearly illustrate technical scheme, therefore be intended only as example, and the protection of the present invention can not be limited with this
Scope.
It should be noted that unless otherwise indicated, technical term or scientific terminology used in this application should be this hair
The ordinary meaning that bright one of ordinary skill in the art are understood.
Fig. 1 is refer to, is the 3-dimensional digital sand table deduction side based on augmented reality that first embodiment of the invention is provided
The schematic flow sheet of method, as illustrated, this method may include steps of：
S101, the first operation that display terminal receives user deduce application program to open sand table.
S102, deduced in sand table in application program, display terminal is gathered currently practical by built-in image capture device
Environment picture.
S103, display terminal carry out feature extraction to obtain target signature point to currently practical environment picture.
S104, display terminal carries out matching treatment according to default database to target signature point, to obtain target location.
Wherein, target location is any position in augmented reality sand table model, and it is existing with enhancing that database includes characteristic point
The corresponding relation (including one-to-one corresponding, one-to-many correspondence, multi-to-multi correspond to) of position in real sand table model, this feature point refers to
Extracted from actual object picture, and the corresponding virtual scene (one in each position in augmented reality sand table model
One correspondence).
S105, display terminal is obtained according to target location and display target virtual scene.
S106, display terminal receive second operation of the user to destination virtual scene.
Specifically, user can move to the destination virtual scene being shown on display terminal, scales, lift, diagonally
Color carry out behavior setting and Real time dynamic display, to sand table bandwagon effect carry out screen snapshot or video generation etc. operation.
Implement the 3-dimensional digital sand table deduction method based on augmented reality that the embodiment of the present invention is provided, user opens aobvious
Show that the sand table of terminal deduces application program, deduced in the sand table in application program, worked as by built-in image capture device collection
Preceding actual environment picture, and display target virtual scene is obtained based on the current actual environment picture, seen so as to enhance user
See and bring sense into during actual object.Meanwhile user can perform movement, scaling to destination virtual scene, lifting, role be gone
For setting and Real time dynamic display, to sand table bandwagon effect carry out screen snapshot or video generation etc. operation, so as to improve mutually
Dynamic effect.
Fig. 2 is refer to, is the 3-dimensional digital sand table deduction side based on augmented reality that second embodiment of the invention is provided
The schematic flow sheet of method, as illustrated, this method may include steps of：
S201, processor gather multiple actual scene information.
The processor can be but be not limited only to possess picture collection function and any equipment of data processing function.Should
Multiple actual scene information that processor is gathered include but are not limited to indoor scene and outdoor scene, outdoor scene include but
It is not limited only to the scene of different geographical features, such as hills, level land and river etc..
S202, processor is according to multiple actual scene information architecture three-dimensional digital sand table models.
Wherein, the three-dimensional digital sand table model includes terrain information.Specifically, it is right according to actual scene information
It carries out feature point extraction, determines to need the particular location that augmented reality sand table is overlapped to display, and this is to specific position
Put and bound, ensure that sand table is shown and fitted with actual environment, so as to realize the structure of three-dimensional digital sand table model.Need
It is noted that the particular location can be a plane.
S203, processor carry out parameter addition processing to three-dimensional digital sand table model to obtain three dimensional lifelike model.
Wherein, three dimensional lifelike model includes terrestrial object information, climatic information and social role.Specifically, processor is by ground
Thing information, climatic information and social role are added to three-dimensional digital sand table model to obtain the three dimensional lifelike model.
Terrestrial object information includes but are not limited to vegetation, river and building, climatic information includes but are not limited to rainfall, snow and
Sunshine, social role include but are not limited to personage and animal.
S204, processor generate sand table according to three dimensional lifelike model and deduce application program.
Specifically, step S204 includes：
(1) processor is carried out at sports rule addition to the social role (personage and animal etc.) in three dimensional lifelike model
Reason, to obtain augmented reality sand table model；The sports rule is included but are not limited to away, runs and jumped；
(2) processor by display terminal scan actual object information, and to physical objects information carry out feature extraction with
Obtain initial characteristicses point；Actual object information includes but are not limited to picture in kind and in kind, such as including desktop and table
Face picture；
(3) processor obtains multiple initial positions in augmented reality sand table model, and by initial characteristicses point and initial bit
Put and carry out one-to-one binding；Such as initial characteristicses point 1 corresponds to initial position 1；
(4) processor preserves the binding relationship of initial characteristicses point and initial position, and application program is deduced to generate sand table.
S205, the first operation that display terminal receives user deduce application program to open sand table.
The display terminal can include but are not limited to mobile phone, tablet personal computer and augmented reality glasses.Work as display terminal
When being mobile phone or tablet personal computer, sand table deduces a APP, Yong Hudian that application program can be understood as being installed on mobile phone or computer
Hit APP and deduce application program to open the sand table.When display terminal is augmented reality glasses, sand table deduces application program can be with
It is interpreted as being arranged at a software control procedure inside augmented reality glasses, software control is provided with augmented reality glasses
The operation button of program, user press the button and deduce application program to start sand table.
S206, deduced in sand table in application program, display terminal is gathered currently practical by built-in image capture device
Environment picture.
After opening sand table deduction application program, display terminal can pass through built-in image capture device (being usually camera)
Gather currently practical environment picture.The actual environment picture can be desktop picture or wall picture etc., but be not limited only to this.
S207, display terminal carry out feature extraction to obtain target signature point to currently practical environment picture.
After collecting actual environment picture, display terminal uses feature extraction algorithm to carry out feature extraction to it to obtain mesh
Mark characteristic point.
Feature extraction is that the environment picture that will be collected is converted into gray-scale map, obtains the contour edge conduct of object in environment
Characteristic point.Algorithm flow:It is by an image (the window grabgraf to be detected):1) it is converted into gray-scale map；2) corrected using Gamma
Method to input picture carry out color space standardization；3) gradient of each pixel is calculated, for obtaining profile information；4)
Divide the image into zonule；5) histogram of gradients in each region is counted, forms the description in each region；6) will be per several areas
Domain forms a group, and an interior description to provincial characteristics of group integrates the description for just having obtained this group；7) by image
All groups of feature description integrates, and rejects discontinuous characteristic point information (impurity), the contour feature for just having obtained image is retouched
State, this is exactly finally to be available for comparing the characteristic vector used.
S208, display terminal carries out matching treatment according to default database to target signature point, to obtain target location.
Wherein, target location is any position in augmented reality sand table model, and it is existing with enhancing that database includes characteristic point
The corresponding relation (including one-to-one corresponding, one-to-many correspondence, multi-to-multi correspond to) of position in real sand table model, this feature point refers to
Extracted from actual object picture, and the corresponding virtual scene (one in each position in augmented reality sand table model
One correspondence).For example, in database characteristic point, the position of augmented reality sand table model and virtual scene corresponding relation
It is as follows：Characteristic point 1 corresponds to position 1, and position 1 corresponds to virtual scene 1；Characteristic point 1 corresponds to position 1/2, and position 1 corresponds to
Virtual scene 1, position 2 correspond to virtual scene 2；Characteristic point 1/2 corresponds to position 1.
If target signature point is a, with reference to learning that target signature point a and characteristic point 1 belong to tolerance after database matching
In the range of, accordingly, it is determined that target location is characterized a little position 1 corresponding to 1.
S209, display terminal is obtained according to target location and display target virtual scene.
Specifically, with reference to position in database and the corresponding relation of virtual scene, virtual field corresponding to position 1 can be learnt
Scape is 1, i.e., virtual scene 1 is destination virtual scene, and is shown on display terminal, as shown in Figures 3 to 5.Need
Bright, Fig. 3 to Fig. 5 is rendering effect figure, and it, which there must be certain color and filling, can just give expression to effect.From Fig. 3 to
In Fig. 5 as can be seen that under any background, virtual scene, and virtual field can be shown by implementing above-mentioned steps S201 to S209
The display effect of scape will not also be influenceed by background.
S210, display terminal receive second operation of the user to destination virtual scene.
Specifically, user can move to the destination virtual scene being shown on display terminal, scales, lift, diagonally
Color carry out behavior setting and Real time dynamic display, to sand table bandwagon effect carry out screen snapshot or video generation etc. operation, so as to
The deduction of the 3-dimensional digital sand table based on augmented reality is realized, improves user and the 3-dimensional digital sand table based on augmented reality
Between interaction effect, and improve enjoyment.
Implement the 3-dimensional digital sand table deduction method based on augmented reality that the embodiment of the present invention is provided, user opens aobvious
Show that the sand table of terminal deduces application program, deduced in the sand table in application program, worked as by built-in image capture device collection
Preceding actual environment picture, and display target virtual scene is obtained based on the current actual environment picture, seen so as to enhance user
See and bring sense into during actual object.Meanwhile user can perform movement, scaling to destination virtual scene, lifting, role be gone
For setting and Real time dynamic display, to sand table bandwagon effect carry out screen snapshot or video generation etc. operation, so as to improve mutually
Dynamic effect.
Fig. 6 is refer to, is the 3-dimensional digital sand table deduction system based on augmented reality that first embodiment of the invention provides
Structural representation, as illustrated, the system include carry out data interaction display terminal 100 and processor 200.Display terminal
100 include but are not limited to mobile phone, tablet personal computer and augmented reality glasses.
Further, Fig. 7 is refer to, display terminal 100 includes：
Receiving module 10, the first operation for receiving user deduce application program to open sand table；
First acquisition module 11, currently practical environment picture is gathered for being deduced in the sand table in application program；
Extraction module 12, for carrying out feature extraction to the currently practical environment picture to obtain target signature point；
Matching module 13, for carrying out matching treatment to the target signature point according to default database, to obtain mesh
Cursor position, the target location be augmented reality sand table model in any position, the database include characteristic point with it is described
The corresponding relation of position in augmented reality sand table model, and each position corresponding one in the augmented reality sand table model is empty
Intend scene；
Display module 14, for obtaining simultaneously display target virtual scene according to the target location；
Receiving module 10 is additionally operable to receive second operation of the user to the destination virtual scene, and second operation includes
Mobile, scaling, lifting, behavior setting and Real time dynamic display are carried out to role, screen snapshot is carried out to sand table bandwagon effect or
Video generates.
Further, Fig. 8 is refer to, processor 200 includes：
Second acquisition module 20, for gathering multiple actual scene information；
Module 21 is built, it is described for according to multiple actual scene information architecture three-dimensional digital sand table models
Three-dimensional digital sand table model includes terrain information；
Add module 22, forced for carrying out parameter addition processing to the three-dimensional digital sand table model with obtaining three-dimensional
True mode, the three dimensional lifelike model include terrestrial object information, climatic information and social role；Terrestrial object information includes vegetation, river
Stream and building, the climatic information include rainfall, snowed and sunshine, the social role include personage and animal；
Generation module 23, application program is deduced for generating the sand table according to the three dimensional lifelike model.
Further, generation module 23 is specifically used for：
Sports rule addition processing is carried out to the social role in the three dimensional lifelike model, to obtain augmented reality sand table
Model；
Actual object information is scanned by the display terminal, and feature extraction is carried out to the physical objects information to obtain
Initial characteristicses point is taken, the actual object information includes picture in kind and in kind；
Obtain multiple initial positions in the augmented reality sand table model, and by the initial characteristicses point and initial position
Carry out one-to-one binding；
The binding relationship of the initial characteristicses point and initial position is preserved, application program is deduced to generate the sand table.
Further, add module 22 is specifically used for：
The terrestrial object information, climatic information and social role are added to the three-dimensional digital sand table model to obtain
To the three dimensional lifelike model.
Implement the 3-dimensional digital sand table deduction system based on augmented reality that the embodiment of the present invention is provided, user opens aobvious
Show that the sand table of terminal deduces application program, deduced in the sand table in application program, worked as by built-in image capture device collection
Preceding actual environment picture, and display target virtual scene is obtained based on the current actual environment picture, seen so as to enhance user
See and bring sense into during actual object.Meanwhile user can perform movement, scaling to destination virtual scene, lifting, role be gone
For setting and Real time dynamic display, to sand table bandwagon effect carry out screen snapshot or video generation etc. operation, so as to improve mutually
Dynamic effect.
It should be noted that in the present embodiment the 3-dimensional digital sand table deduction system based on augmented reality Concrete workflow
Journey refer to the description of method part, will not be repeated here.
Various embodiments above is merely illustrative of the technical solution of the present invention, rather than its limitations；Although with reference to foregoing each reality
Example is applied the present invention is described in detail, it will be understood by those within the art that：It still can be to foregoing each
Technical scheme described in embodiment is modified, and either carries out equivalent substitution to which part or all technical characteristic；And
These modifications are replaced, and the essence of appropriate technical solution is departed from the scope of various embodiments of the present invention technical scheme, its
It all should cover among the claim of the present invention and the scope of specification.
Claims (10)
- A kind of 1. 3-dimensional digital sand table deduction method based on augmented reality, it is characterised in that including：The first operation that display terminal receives user deduces application program to open sand table；Deduced in the sand table in application program, the display terminal gathers currently practical ring by built-in image capture device Border picture；The display terminal carries out feature extraction to obtain target signature point to the currently practical environment picture；The display terminal carries out matching treatment according to default database to the target signature point, to obtain target location, The target location is any position in augmented reality sand table model, and the database includes characteristic point and the augmented reality The corresponding relation of position in sand table model, and the corresponding virtual scene in each position in the augmented reality sand table model；The display terminal is obtained according to the target location and display target virtual scene；The display terminal receives second operation of the user to the destination virtual scene, and second operation includes mobile, contracting Put, lift, behavior setting and Real time dynamic display are carried out to role, screen snapshot or video are carried out to sand table bandwagon effect giving birth to Into.
- 2. the 3-dimensional digital sand table methods of exhibiting based on augmented reality as claimed in claim 1, it is characterised in that display terminal The first operation of user is received so that before opening sand table deduction application program, methods described also includes：Processor gathers multiple actual scene information；The processor is according to multiple actual scene information architecture three-dimensional digital sand table models, the three-dimensional number Word sand table model includes terrain information；The processor carries out parameter addition processing to the three-dimensional digital sand table model to obtain three dimensional lifelike model, institute Stating three dimensional lifelike model includes terrestrial object information, climatic information and social role；The processor generates the sand table according to the three dimensional lifelike model and deduces application program.
- 3. the 3-dimensional digital sand table deduction method based on augmented reality as claimed in claim 2, it is characterised in that the processing Device generates the sand table deduction application program according to the three dimensional lifelike model and specifically included：The processor carries out sports rule addition processing to the social role in the three dimensional lifelike model, existing to obtain enhancing Real sand table model；The processor scans actual object information by the display terminal, and carries out feature to the physical objects information and carry Take to obtain initial characteristicses point, the actual object information includes picture in kind and in kind；The processor obtains multiple initial positions in the augmented reality sand table model, and by the initial characteristicses point and just The beginning one-to-one binding of position progress；The processor preserves the binding relationship of the initial characteristicses point and initial position, and journey is applied to generate the sand table deduction Sequence.
- 4. the 3-dimensional digital sand table deduction method based on augmented reality as claimed in claim 2 or claim 3, it is characterised in that described Processor carries out parameter addition processing to the three-dimensional digital sand table model and specifically wrapped with obtaining the three dimensional lifelike model Include：The terrestrial object information, climatic information and social role are added to the three-dimensional digital sand table mould by the processor Type is to obtain the three dimensional lifelike model.
- 5. the 3-dimensional digital sand table deduction method based on augmented reality as claimed in claim 4, it is characterised in that the atural object Information includes vegetation, river and building, and the climatic information includes rainfall, snows and sunshine, social role's bag Include personage and animal.
- 6. a kind of 3-dimensional digital sand table deduction system based on augmented reality, including display terminal, it is characterised in that the display Terminal includes：Receiving module, the first operation for receiving user deduce application program to open sand table；First acquisition module, currently practical environment picture is gathered for being deduced in the sand table in application program；Extraction module, for carrying out feature extraction to the currently practical environment picture to obtain target signature point；Matching module, for carrying out matching treatment to the target signature point according to default database, to obtain target location, The target location is any position in augmented reality sand table model, and the database includes characteristic point and the augmented reality The corresponding relation of position in sand table model, and the corresponding virtual scene in each position in the augmented reality sand table model；Display module, for obtaining simultaneously display target virtual scene according to the target location；The receiving module is additionally operable to receive second operation of the user to the destination virtual scene, and second operation includes moving Dynamic, scaling, lifting, behavior setting and Real time dynamic display are carried out to role, screen snapshot is carried out to sand table bandwagon effect or is regarded Frequency generates.
- 7. the 3-dimensional digital sand table deduction system based on augmented reality as claimed in claim 6, it is characterised in that the deduction System also includes processor, and the processor includes：Second acquisition module, for gathering multiple actual scene information；Module is built, for according to multiple actual scene information architecture three-dimensional digital sand table models, the three-dimensional void Intending digital sand table model includes terrain information；Add module, handled for carrying out parameter addition to the three-dimensional digital sand table model to obtain three dimensional lifelike mould Type, the three dimensional lifelike model include terrestrial object information, climatic information and social role；Generation module, application program is deduced for generating the sand table according to the three dimensional lifelike model.
- 8. the 3-dimensional digital sand table deduction system based on augmented reality as claimed in claim 7, it is characterised in that the generation Module is specifically used for：Sports rule addition processing is carried out to the social role in the three dimensional lifelike model, to obtain augmented reality sand table mould Type；Actual object information is scanned by the display terminal, and feature extraction is carried out to the physical objects information to obtain just Beginning characteristic point, the actual object information include picture in kind and in kind；Multiple initial positions in the augmented reality sand table model are obtained, and the initial characteristicses point and initial position are carried out One-to-one binding；The binding relationship of the initial characteristicses point and initial position is preserved, application program is deduced to generate the sand table.
- 9. the 3-dimensional digital sand table deduction system based on augmented reality as claimed in claim 7 or 8, it is characterised in that described Add module is specifically used for：By the terrestrial object information, climatic information and social role added to the three-dimensional digital sand table model to obtain State three dimensional lifelike model.
- 10. the 3-dimensional digital sand table deduction system based on augmented reality as claimed in claim 9, it is characterised in that describedly Thing information includes vegetation, river and building, and the climatic information includes rainfall, snows and sunshine, the social role Including personage and animal；The display terminal includes mobile phone, tablet personal computer and augmented reality glasses.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711130030.4A CN107797665B (en) | 2017-11-15 | 2017-11-15 | Three-dimensional digital sand table deduction method and system based on augmented reality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711130030.4A CN107797665B (en) | 2017-11-15 | 2017-11-15 | Three-dimensional digital sand table deduction method and system based on augmented reality |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107797665A true CN107797665A (en) | 2018-03-13 |
| CN107797665B CN107797665B (en) | 2021-02-02 |
Family
ID=61535106
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711130030.4A Active CN107797665B (en) | 2017-11-15 | 2017-11-15 | Three-dimensional digital sand table deduction method and system based on augmented reality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107797665B (en) |
Cited By (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109917906A (en) * | 2019-01-24 | 2019-06-21 | 北京德火科技有限责任公司 | A kind of method and system for realizing sight spot interaction based on augmented reality |
| CN110163831A (en) * | 2019-04-19 | 2019-08-23 | 深圳市思为软件技术有限公司 | The object Dynamic Display method, apparatus and terminal device of three-dimensional sand table |
| CN110209285A (en) * | 2019-06-19 | 2019-09-06 | 哈尔滨拓博科技有限公司 | A kind of sand table display systems based on gesture control |
| CN110349270A (en) * | 2019-07-02 | 2019-10-18 | 石家庄中扬网络科技股份有限公司 | Virtual sand table rendering method based on realistic space positioning |
| CN110348900A (en) * | 2019-07-03 | 2019-10-18 | 联保（北京）科技有限公司 | A kind of data processing method, system and device |
| CN110544311A (en) * | 2018-05-29 | 2019-12-06 | 百度在线网络技术（北京）有限公司 | Safety warning method, device and storage medium |
| CN110648396A (en) * | 2019-09-17 | 2020-01-03 | 西安万像电子科技有限公司 | Image processing method, device and system |
| CN110721387A (en) * | 2019-11-04 | 2020-01-24 | 北京容大天成科技有限公司 | 3D digital psychological sand table implementation method and device, electronic equipment and psychological sand table |
| CN110826375A (en) * | 2018-08-10 | 2020-02-21 | 广东虚拟现实科技有限公司 | Display method, device, terminal device and storage medium |
| CN111104470A (en) * | 2019-11-19 | 2020-05-05 | 青岛海信网络科技股份有限公司 | Method and system for linkage of electronic sand table and emergency platform |
| CN111599223A (en) * | 2020-06-12 | 2020-08-28 | 浙江商汤科技开发有限公司 | Sand table display system and sand table display method |
| CN111640201A (en) * | 2020-06-11 | 2020-09-08 | 浙江商汤科技开发有限公司 | Control method and device for virtual sand table display, electronic equipment and storage medium |
| CN111638793A (en) * | 2020-06-04 | 2020-09-08 | 浙江商汤科技开发有限公司 | Aircraft display method and device, electronic equipment and storage medium |
| CN111651057A (en) * | 2020-06-11 | 2020-09-11 | 浙江商汤科技开发有限公司 | Data display method and device, electronic equipment and storage medium |
| CN111651053A (en) * | 2020-06-10 | 2020-09-11 | 浙江商汤科技开发有限公司 | Urban sand table display method and device, electronic equipment and storage medium |
| CN111651055A (en) * | 2020-06-09 | 2020-09-11 | 浙江商汤科技开发有限公司 | City virtual sand table display method and device, computer equipment and storage medium |
| CN111652984A (en) * | 2020-06-10 | 2020-09-11 | 上海商汤智能科技有限公司 | Sand table demonstration method and device, computer equipment and storage medium |
| CN111651056A (en) * | 2020-06-10 | 2020-09-11 | 浙江商汤科技开发有限公司 | Sand table demonstration method and device, computer equipment and storage medium |
| CN111696193A (en) * | 2020-05-06 | 2020-09-22 | 广东康云科技有限公司 | Internet of things control method, system and device based on three-dimensional scene and storage medium |
| CN113254742A (en) * | 2021-07-14 | 2021-08-13 | 深圳市赛野展览展示有限公司 | Display device based on 5G deep learning artificial intelligence |
| CN113436559A (en) * | 2021-05-19 | 2021-09-24 | 吉林大学 | Sand table dynamic landscape real-time display system and display method |
| CN114661156A (en) * | 2022-03-26 | 2022-06-24 | 深圳市思为软件技术有限公司 | Method for realizing electronic sand table by using sequence frames and related equipment |
| CN115097938A (en) * | 2022-06-25 | 2022-09-23 | 成都西南信息控制研究院有限公司 | Immersive virtual sand table deduction public display system and method |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105045389A (en) * | 2015-07-07 | 2015-11-11 | 深圳水晶石数字科技有限公司 | Demonstration method for interactive sand table system |
| CN106371581A (en) * | 2016-04-01 | 2017-02-01 | 苏州美房云客软件科技股份有限公司 | Interaction method based on IM (Instant Messaging) and 3D virtual technology |
| CN106571072A (en) * | 2015-10-26 | 2017-04-19 | 苏州梦想人软件科技有限公司 | Method for realizing children education card based on AR |
| CN106816077A (en) * | 2015-12-08 | 2017-06-09 | 张涛 | Interactive sandbox methods of exhibiting based on Quick Response Code and augmented reality |
| CN106843150A (en) * | 2017-02-28 | 2017-06-13 | 清华大学 | A kind of industry spot simulation method and device |
| CN106887183A (en) * | 2017-03-24 | 2017-06-23 | 广西七三科技有限公司 | A kind of interactive demonstration method and system of BIM augmented realities in sand table is built |
-
2017
- 2017-11-15 CN CN201711130030.4A patent/CN107797665B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105045389A (en) * | 2015-07-07 | 2015-11-11 | 深圳水晶石数字科技有限公司 | Demonstration method for interactive sand table system |
| CN106571072A (en) * | 2015-10-26 | 2017-04-19 | 苏州梦想人软件科技有限公司 | Method for realizing children education card based on AR |
| CN106816077A (en) * | 2015-12-08 | 2017-06-09 | 张涛 | Interactive sandbox methods of exhibiting based on Quick Response Code and augmented reality |
| CN106371581A (en) * | 2016-04-01 | 2017-02-01 | 苏州美房云客软件科技股份有限公司 | Interaction method based on IM (Instant Messaging) and 3D virtual technology |
| CN106843150A (en) * | 2017-02-28 | 2017-06-13 | 清华大学 | A kind of industry spot simulation method and device |
| CN106887183A (en) * | 2017-03-24 | 2017-06-23 | 广西七三科技有限公司 | A kind of interactive demonstration method and system of BIM augmented realities in sand table is built |
Cited By (30)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110544311A (en) * | 2018-05-29 | 2019-12-06 | 百度在线网络技术（北京）有限公司 | Safety warning method, device and storage medium |
| CN110544311B (en) * | 2018-05-29 | 2023-04-25 | 百度在线网络技术（北京）有限公司 | Security warning method, device and storage medium |
| CN110826375A (en) * | 2018-08-10 | 2020-02-21 | 广东虚拟现实科技有限公司 | Display method, device, terminal device and storage medium |
| CN109917906A (en) * | 2019-01-24 | 2019-06-21 | 北京德火科技有限责任公司 | A kind of method and system for realizing sight spot interaction based on augmented reality |
| CN110163831A (en) * | 2019-04-19 | 2019-08-23 | 深圳市思为软件技术有限公司 | The object Dynamic Display method, apparatus and terminal device of three-dimensional sand table |
| CN110163831B (en) * | 2019-04-19 | 2021-04-23 | 深圳市思为软件技术有限公司 | Method and device for dynamically displaying object of three-dimensional virtual sand table and terminal equipment |
| CN110209285A (en) * | 2019-06-19 | 2019-09-06 | 哈尔滨拓博科技有限公司 | A kind of sand table display systems based on gesture control |
| CN110349270A (en) * | 2019-07-02 | 2019-10-18 | 石家庄中扬网络科技股份有限公司 | Virtual sand table rendering method based on realistic space positioning |
| CN110348900A (en) * | 2019-07-03 | 2019-10-18 | 联保（北京）科技有限公司 | A kind of data processing method, system and device |
| CN110348900B (en) * | 2019-07-03 | 2022-07-29 | 联保（北京）科技有限公司 | Data processing method, system and device |
| CN110648396A (en) * | 2019-09-17 | 2020-01-03 | 西安万像电子科技有限公司 | Image processing method, device and system |
| CN110721387A (en) * | 2019-11-04 | 2020-01-24 | 北京容大天成科技有限公司 | 3D digital psychological sand table implementation method and device, electronic equipment and psychological sand table |
| CN111104470A (en) * | 2019-11-19 | 2020-05-05 | 青岛海信网络科技股份有限公司 | Method and system for linkage of electronic sand table and emergency platform |
| CN111696193B (en) * | 2020-05-06 | 2023-08-25 | 广东康云科技有限公司 | Internet of things control method, system and device based on three-dimensional scene and storage medium |
| CN111696193A (en) * | 2020-05-06 | 2020-09-22 | 广东康云科技有限公司 | Internet of things control method, system and device based on three-dimensional scene and storage medium |
| CN111638793B (en) * | 2020-06-04 | 2023-09-01 | 浙江商汤科技开发有限公司 | Display method and device of aircraft, electronic equipment and storage medium |
| CN111638793A (en) * | 2020-06-04 | 2020-09-08 | 浙江商汤科技开发有限公司 | Aircraft display method and device, electronic equipment and storage medium |
| CN111651055A (en) * | 2020-06-09 | 2020-09-11 | 浙江商汤科技开发有限公司 | City virtual sand table display method and device, computer equipment and storage medium |
| CN111651053A (en) * | 2020-06-10 | 2020-09-11 | 浙江商汤科技开发有限公司 | Urban sand table display method and device, electronic equipment and storage medium |
| CN111651056A (en) * | 2020-06-10 | 2020-09-11 | 浙江商汤科技开发有限公司 | Sand table demonstration method and device, computer equipment and storage medium |
| CN111652984A (en) * | 2020-06-10 | 2020-09-11 | 上海商汤智能科技有限公司 | Sand table demonstration method and device, computer equipment and storage medium |
| CN111652984B (en) * | 2020-06-10 | 2024-03-22 | 上海商汤智能科技有限公司 | Sand table demonstration method and device, computer equipment and storage medium |
| CN111651057A (en) * | 2020-06-11 | 2020-09-11 | 浙江商汤科技开发有限公司 | Data display method and device, electronic equipment and storage medium |
| CN111640201A (en) * | 2020-06-11 | 2020-09-08 | 浙江商汤科技开发有限公司 | Control method and device for virtual sand table display, electronic equipment and storage medium |
| CN111599223A (en) * | 2020-06-12 | 2020-08-28 | 浙江商汤科技开发有限公司 | Sand table display system and sand table display method |
| CN113436559A (en) * | 2021-05-19 | 2021-09-24 | 吉林大学 | Sand table dynamic landscape real-time display system and display method |
| CN113254742A (en) * | 2021-07-14 | 2021-08-13 | 深圳市赛野展览展示有限公司 | Display device based on 5G deep learning artificial intelligence |
| CN114661156A (en) * | 2022-03-26 | 2022-06-24 | 深圳市思为软件技术有限公司 | Method for realizing electronic sand table by using sequence frames and related equipment |
| CN115097938A (en) * | 2022-06-25 | 2022-09-23 | 成都西南信息控制研究院有限公司 | Immersive virtual sand table deduction public display system and method |
| CN115097938B (en) * | 2022-06-25 | 2025-01-28 | 成都西南信息控制研究院有限公司 | Immersive virtual sandbox simulation public display system and method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107797665B (en) | 2021-02-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107797665A (en) | A kind of 3-dimensional digital sand table deduction method and its system based on augmented reality | |
| CN112263837B (en) | Weather rendering method, device, equipment and storage medium in virtual environment | |
| King et al. | ARVino-outdoor augmented reality visualisation of viticulture GIS data | |
| CN106296567B (en) | A method and device for converting multi-level image style based on sparse representation | |
| CN105654471A (en) | Augmented reality AR system applied to internet video live broadcast and method thereof | |
| CN106383587A (en) | Augmented reality scene generation method, device and equipment | |
| CN111080656A (en) | Image processing method, image synthesis method and related device | |
| CN112435333B (en) | Road scene generation method and related device | |
| CN106201173A (en) | The interaction control method of a kind of user's interactive icons based on projection and system | |
| CN104134389B (en) | Interactive sand table demonstration system and method | |
| CN106910188A (en) | The detection method of airfield runway in remote sensing image based on deep learning | |
| CN109712247A (en) | Outdoor scene training system based on mixed reality technology | |
| CN111599007B (en) | Smart city CIM road mapping method based on unmanned aerial vehicle aerial photography | |
| WO2008111993A2 (en) | Geospatial modeling system providing geospatial model data target point filtering based upon radial line segments and related methods | |
| CN104537705A (en) | Augmented reality based mobile platform three-dimensional biomolecule display system and method | |
| Li et al. | Key technology of virtual roaming system in the museum of ancient high-imitative calligraphy and paintings | |
| CN111145135A (en) | Image descrambling processing method, device, equipment and storage medium | |
| CN112950753A (en) | Virtual plant display method, device, equipment and storage medium | |
| CN104407696B (en) | The virtual ball simulation of mobile device and the method for control | |
| KR20120110941A (en) | A method for expressing whether of virtual world and an apparatus thereof | |
| CN111921199B (en) | Method, device, terminal and storage medium for detecting state of virtual object | |
| CN101388067A (en) | A method for implanting interactive entertainment trademark advertisements | |
| CN113822816A (en) | Haze removing method for single remote sensing image optimized by aerial fog scattering model | |
| CN201871223U (en) | Virtual chessboard utilizing projector and image collecting device | |
| CN117173285A (en) | Image generation method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |