CN107797665B - Three-dimensional digital sand table deduction method and system based on augmented reality - Google Patents
Three-dimensional digital sand table deduction method and system based on augmented reality Download PDFInfo
- Publication number
- CN107797665B CN107797665B CN201711130030.4A CN201711130030A CN107797665B CN 107797665 B CN107797665 B CN 107797665B CN 201711130030 A CN201711130030 A CN 201711130030A CN 107797665 B CN107797665 B CN 107797665B
- Authority
- CN
- China
- Prior art keywords
- sand table
- augmented reality
- dimensional
- display terminal
- model
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 239000004576 sand Substances 0.000 title claims abstract description 117
- 230000003190 augmentative effect Effects 0.000 title claims abstract description 65
- 238000000034 method Methods 0.000 title claims abstract description 26
- 244000035744 Hura crepitans Species 0.000 claims abstract description 24
- 230000000694 effects Effects 0.000 claims abstract description 22
- 238000012545 processing Methods 0.000 claims abstract description 16
- 239000000284 extract Substances 0.000 claims abstract description 9
- 238000000605 extraction Methods 0.000 claims description 9
- 241001465754 Metazoa Species 0.000 claims description 6
- 230000003993 interaction Effects 0.000 abstract description 7
- 239000011521 glass Substances 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 5
- 230000002452 interceptive effect Effects 0.000 description 5
- 230000001174 ascending effect Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 239000012535 impurity Substances 0.000 description 1
- 230000009191 jumping Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 239000000779 smoke Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012876 topography Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Processing Or Creating Images (AREA)
Abstract
The embodiment of the invention discloses a three-dimensional digital sand table deduction method and a system thereof based on augmented reality, wherein the method comprises the following steps: the display terminal receives a first operation of a user to open a sandbox deduction application program; in the sand table deduction application program, a display terminal acquires a current actual environment picture through built-in image acquisition equipment; the display terminal extracts the features of the current actual environment picture to obtain target feature points; the display terminal performs matching processing on the target characteristic points according to a preset database to obtain a target position; the display terminal acquires and displays a target virtual scene according to the target position; and the display terminal receives a second operation of the user on the target virtual scene, wherein the second operation comprises moving, zooming, lifting, behavior setting and real-time dynamic display of the character, and screen capture or video generation of a sand table display effect. By implementing the embodiment of the invention, the bring-in feeling of the user when watching the actual object is enhanced, and the interaction effect is improved.
Description
Technical Field
The invention relates to the technical field of augmented reality, in particular to a three-dimensional digital sand table deduction method and a system based on augmented reality.
Background
The sand table is a model piled up by silt, military chess and other materials according to a certain proportion relation according to a topographic map, an aviation photograph or a field topography. Sand tables are used to display the landforms or buildings in a miniaturized form so as to facilitate observation of people, and are widely used in military or commercial activities.
However, the known sand table is mainly a solid plane sand table, and mostly uses a model to perform static expression of subject matters such as buildings, so that the display effect is lack of interest, and the interaction is also lack of for audiences. Therefore, a multimedia sand table capable of performing interaction appears, and the main scheme is as follows: on the basis of a traditional sand table model, a computer provided with multimedia man-machine interaction software, an LED display screen and other equipment are organically combined, so that the sand table illuminating lamp can be started, the color and the flicker transformation and other operations can be realized by sending an instruction to a controller through the computer, and the control of smoke and water flow size adjustment, model vehicle operation and the like can be carried out, so that the sand table model has vivid and interesting artistic effects. Although the interest and audience interactivity of the sand table are enhanced by controlling the equipment on the sand table through the controller, the effect of the multimedia sand table is too flat, and the higher experience requirements of audiences are still difficult to meet.
Further, with the continuous development of scientific technology, augmented reality technology has been developed to a certain degree of maturity. Augmented Reality (AR) is a new technology for seamlessly integrating real world information and virtual world information, and is characterized in that entity information (visual information, sound, taste, touch and the like) which is difficult to experience in a certain time space range of the real world originally is overlapped after simulation through scientific technologies such as computers and the like, virtual information is applied to the real world and is perceived by human senses, and therefore sensory experience beyond Reality is achieved.
Therefore, there is a need for providing a sand table deduction method and system based on augmented reality technology to enhance the user's sense of bring-in when watching an actual object and to improve the interactive effect.
Disclosure of Invention
The embodiment of the invention aims to provide a three-dimensional digital sand table deduction method and a system thereof based on augmented reality so as to enhance the bring-in feeling of a user when the user watches an actual object and improve the interaction effect.
In order to achieve the above object, in a first aspect, an embodiment of the present invention provides an augmented reality-based three-dimensional digital sand table deduction method, including:
the display terminal receives a first operation of a user to open a sandbox deduction application program;
in the sand table deduction application program, the display terminal acquires a current actual environment picture through built-in image acquisition equipment;
the display terminal extracts the features of the current actual environment picture to obtain target feature points;
the display terminal performs matching processing on the target feature points according to a preset database to obtain a target position, wherein the target position is any one position in an augmented reality sand table model, the database comprises a corresponding relation between the feature points and the positions in the augmented reality sand table model, and each position in the augmented reality sand table model corresponds to a virtual scene;
the display terminal acquires and displays a target virtual scene according to the target position;
and the display terminal receives a second operation of the user on the target virtual scene, wherein the second operation comprises moving, zooming, lifting, behavior setting and real-time dynamic display of the character, and screen capture or video generation of a sand table display effect.
As a preferred embodiment, before the display terminal receives a first operation of the user to open the sandbox deduction application, the method further includes:
the processor collects a plurality of actual scene information;
the processor constructs a three-dimensional virtual digital sand table model according to the actual scene information, wherein the three-dimensional virtual digital sand table model comprises terrain information;
the processor performs parameter adding processing on the three-dimensional virtual digital sand table model to obtain a three-dimensional vivid model, wherein the three-dimensional vivid model comprises ground feature information, climate information and social roles;
and the processor generates the sand table deduction application program according to the three-dimensional lifelike model.
As an optional implementation, the generating, by the processor, the sandbox deduction application according to the three-dimensional realistic model specifically includes:
the processor performs motion rule adding processing on the social roles in the three-dimensional realistic model to obtain an augmented reality sand table model;
the processor scans actual object information through the display terminal and extracts characteristics of the actual object information to obtain initial characteristic points, wherein the actual object information comprises a real object and a real object picture;
the processor acquires a plurality of initial positions in the augmented reality model and one-to-one binds the initial characteristic points and the initial positions;
and the processor saves the binding relationship between the initial characteristic point and the initial position so as to generate the sandbox deduction application program.
As an optional implementation manner, the performing, by the processor, parameter addition processing on the three-dimensional virtual digital sand table model to obtain the three-dimensional realistic model specifically includes:
the processor adds the surface feature information, the climate information and the social characters to the three-dimensional virtual digital sand table model to obtain the three-dimensional realistic model.
As an alternative embodiment, the land feature information includes vegetation, rivers, and buildings, the climate information includes rainfall, snowfall, and sunshine, and the social characters include characters and animals.
In a second aspect, an embodiment of the present invention further provides an augmented reality-based three-dimensional digital sand table deduction system, which includes a display terminal. Wherein, the display terminal includes:
the receiving module is used for receiving a first operation of a user to open a sandbox deduction application program;
the first acquisition module is used for acquiring a current actual environment picture in the sand table deduction application program;
the extraction module is used for extracting the features of the current actual environment picture to obtain target feature points;
the matching module is used for matching the target feature points according to a preset database to obtain a target position, the target position is any one position in the augmented reality sand table model, the database comprises a corresponding relation between the feature points and the positions in the augmented reality sand table model, and each position in the augmented reality sand table model corresponds to a virtual scene;
the display module is used for acquiring and displaying a target virtual scene according to the target position;
the receiving module is further used for receiving second operation of the user on the target virtual scene, and the second operation comprises moving, zooming, lifting, behavior setting and real-time dynamic display of the character, and screen capture or video generation of a sand table display effect.
As an optional implementation, the deduction system further comprises a processor, and the processor comprises:
the second acquisition module is used for acquiring a plurality of actual scene information;
the building module is used for building a three-dimensional virtual digital sand table model according to the actual scene information, and the three-dimensional virtual digital sand table model comprises terrain information;
the adding module is used for performing parameter adding processing on the three-dimensional virtual digital sand table model to obtain a three-dimensional vivid model, and the three-dimensional vivid model comprises surface feature information, climate information and social roles;
and the generation module is used for generating the sand table deduction application program according to the three-dimensional vivid model.
As an optional implementation manner, the generating module is specifically configured to:
adding motion rules to the social roles in the three-dimensional realistic model to obtain an augmented reality sand table model;
scanning actual object information through the display terminal, and performing feature extraction on the actual object information to obtain an initial feature point, wherein the actual object information comprises a real object and a real object picture;
acquiring a plurality of initial positions in the augmented reality model, and binding the initial characteristic points and the initial positions in a one-to-one manner;
and saving the binding relationship between the initial characteristic point and the initial position to generate the sandbox deduction application program.
As an optional implementation manner, the adding module is specifically configured to:
and adding the ground feature information, the climate information and the social roles to the three-dimensional virtual digital sand table model to obtain the three-dimensional vivid model.
As an alternative embodiment, the land feature information includes vegetation, rivers, and buildings, the climate information includes rainfall, snowfall, and sunshine, and the social characters include characters and animals; the display terminal comprises a mobile phone, a tablet personal computer and augmented reality glasses.
By implementing the method and the system for three-dimensional digital sand table deduction based on augmented reality provided by the embodiment of the invention, a user opens a sand table deduction application program of the display terminal, acquires the current actual environment picture through the built-in image acquisition equipment in the sand table deduction application program, and acquires and displays the target virtual scene based on the current actual environment picture, so that the sense of bringing when the user watches an actual object is enhanced. Meanwhile, the user can perform operations of moving, zooming, lifting, behavior setting and real-time dynamic display on the target virtual scene, screen capture or video generation on the sand table display effect and the like, so that the interactive effect is improved.
Drawings
In order to more clearly illustrate the detailed description of the invention or the technical solutions in the prior art, the drawings that are needed in the detailed description of the invention or the prior art will be briefly described below. Throughout the drawings, like elements or portions are generally identified by like reference numerals. In the drawings, elements or portions are not necessarily drawn to scale.
Fig. 1 is a schematic flow chart of a method for deriving an augmented reality-based three-dimensional digital sand table according to a first embodiment of the present invention;
fig. 2 is a schematic flow chart of a method for deriving an augmented reality-based three-dimensional digital sand table according to a second embodiment of the present invention;
fig. 3 to 5 are effect display diagrams;
fig. 6 is a schematic structural diagram of an augmented reality-based three-dimensional digital sand table deduction system according to a first embodiment of the present invention;
fig. 7 is a schematic structural view of the display terminal of fig. 6;
fig. 8 is a schematic diagram of the processor of fig. 6.
Detailed Description
Embodiments of the present invention will be described in detail below with reference to the accompanying drawings. The following examples are only for illustrating the technical solutions of the present invention more clearly, and therefore are only examples, and the protection scope of the present invention is not limited thereby.
It is to be noted that, unless otherwise specified, technical or scientific terms used herein shall have the ordinary meaning as understood by those skilled in the art to which the invention pertains.
Referring to fig. 1, a flow chart of a method for deriving an augmented reality-based three-dimensional digital sand table according to a first embodiment of the present invention is shown, where the method includes the following steps:
s101, the display terminal receives a first operation of a user to open a sandbox deduction application program.
And S102, in the sand table deduction application program, the display terminal acquires the current actual environment picture through the built-in image acquisition equipment.
And S103, the display terminal extracts the features of the current actual environment picture to obtain a target feature point.
And S104, the display terminal performs matching processing on the target characteristic points according to a preset database to obtain a target position.
The target position is any position in the augmented reality sand table model, the database comprises corresponding relations (including one-to-one correspondence, one-to-many correspondence and many-to-many correspondence) of characteristic points and positions in the augmented reality sand table model, the characteristic points are extracted from an actual object picture, and each position in the augmented reality sand table model corresponds to a virtual scene (one-to-one correspondence).
And S105, the display terminal acquires and displays the target virtual scene according to the target position.
And S106, the display terminal receives a second operation of the user on the target virtual scene.
Specifically, the user can perform operations such as moving, zooming, lifting, behavior setting and real-time dynamic display on the target virtual scene displayed on the display terminal, and screen capture or video generation on the display effect of the sand table.
By implementing the method for deducing the three-dimensional digital sand table based on the augmented reality provided by the embodiment of the invention, the user opens the sand table deduction application program of the display terminal, the current actual environment picture is acquired through the built-in image acquisition equipment in the sand table deduction application program, and the display target virtual scene is acquired based on the current actual environment picture, so that the bring-in feeling of the user when the user watches an actual object is enhanced. Meanwhile, the user can perform operations of moving, zooming, lifting, behavior setting and real-time dynamic display on the target virtual scene, screen capture or video generation on the sand table display effect and the like, so that the interactive effect is improved.
Referring to fig. 2, a flowchart of a method for deriving an augmented reality-based three-dimensional digital sand table according to a second embodiment of the present invention is shown, where the method includes the following steps:
s201, a processor collects a plurality of actual scene information.
The processor may be, but is not limited to, any device having picture taking and data processing functions. The plurality of actual scene information collected by the processor includes, but is not limited to, indoor scenes and outdoor scenes, and the outdoor scenes include, but is not limited to, scenes with different geographic features, such as hills, flat ground, rivers and the like.
S202, the processor constructs a three-dimensional virtual digital sand table model according to the information of the plurality of actual scenes.
Wherein the three-dimensional virtual digital sand table model comprises terrain information. Specifically, according to actual scene information, feature point extraction is carried out on the sand table, the specific position where the augmented reality sand table needs to be overlaid and displayed is determined, the specific position is bound, the sand table display is guaranteed to be attached to the actual environment, and therefore the three-dimensional virtual digital sand table model is built. It should be noted that the specific position may be a plane.
S203, the processor performs parameter adding processing on the three-dimensional virtual digital sand table model to obtain a three-dimensional vivid model.
The three-dimensional realistic model comprises surface feature information, climate information and social roles. Specifically, the processor adds the ground feature information, the climate information and the social characters to the three-dimensional virtual digital sand table model to obtain the three-dimensional realistic model. The land feature information includes, but is not limited to, vegetation, rivers, and buildings, the climate information includes, but is not limited to, rainfall, snowfall, and sunshine, and the social characters include, but is not limited to, characters and animals.
And S204, generating a sand table deduction application program by the processor according to the three-dimensional realistic model.
Specifically, step S204 includes:
(1) the processor performs motion rule adding processing on social roles (characters, animals and the like) in the three-dimensional realistic model to obtain an augmented reality sand table model; the motion rules include, but are not limited to, walking, running, jumping, etc.;
(2) the processor scans actual object information through the display terminal and extracts the characteristics of the actual object information to obtain initial characteristic points; the actual object information includes, but is not limited to, real objects and real object pictures, for example, including desktop and desktop pictures;
(3) the processor acquires a plurality of initial positions in the augmented reality sand table model, and one-to-one binding is carried out on the initial characteristic points and the initial positions; for example, the initial feature point 1 corresponds to the initial position 1;
(4) the processor saves the binding relationship of the initial characteristic points and the initial positions to generate the sandbox deduction application program.
S205, the display terminal receives a first operation of the user to open the sandbox deduction application program.
The display terminal may include, but is not limited to, a mobile phone, a tablet computer, and augmented reality glasses. When the display terminal is a mobile phone or a tablet computer, the sandbox deduction application program can be understood as an APP installed in the mobile phone or the computer, and the user clicks the APP to open the sandbox deduction application program. When the display terminal is the augmented reality glasses, the sandbox deduction application program can be understood as a software control program arranged inside the augmented reality glasses, an operation button of the software control program is arranged on the augmented reality glasses, and a user presses the button to start the sandbox deduction application program.
And S206, in the sand table deduction application program, the display terminal acquires the current actual environment picture through the built-in image acquisition equipment.
After the sand table deduction application program is opened, the display terminal can acquire the current actual environment picture through a built-in image acquisition device (usually a camera). The actual environment picture may be, but is not limited to, a desktop picture or a wall picture.
And S207, the display terminal extracts the features of the current actual environment picture to obtain target feature points.
After the actual environment picture is collected, the display terminal adopts a feature extraction algorithm to extract features of the picture so as to obtain target feature points.
And the characteristic extraction is to convert the acquired environment picture into a gray scale image and acquire the contour edge of an object in the environment as a characteristic point. The algorithm flow is that 1) an image (window grab image to be detected) is converted into a gray scale image; 2) standardizing the color space of the input image by adopting a Gamma correction method; 3) calculating the gradient of each pixel for obtaining contour information; 4) segmenting the image into small regions; 5) counting a gradient histogram of each region to form a description of each region; 6) combining every several regions into a group, and combining the description of the region characteristics in one group to obtain the description of the group; 7) the feature descriptions of all groups in the image are integrated, and the information (impurities) of discontinuous feature points is removed, so that the profile feature description of the image is obtained, and the profile feature description is finally a feature vector for comparison.
And S208, the display terminal performs matching processing on the target characteristic points according to a preset database to obtain a target position.
The target position is any position in the augmented reality sand table model, the database comprises corresponding relations (including one-to-one correspondence, one-to-many correspondence and many-to-many correspondence) of characteristic points and positions in the augmented reality sand table model, the characteristic points are extracted from an actual object picture, and each position in the augmented reality sand table model corresponds to a virtual scene (one-to-one correspondence). For example, the correspondence between the feature points in the database, the positions of the augmented reality sand table models, and the virtual scenes is as follows: the feature point 1 corresponds to the position 1, and the position 1 corresponds to the virtual scene 1; feature point 1 corresponds to position 1/2, position 1 corresponds to virtual scene 1, and position 2 corresponds to virtual scene 2; feature point 1/2 corresponds to position 1.
If the target characteristic point is a, matching by combining a database to know that the target characteristic point a and the characteristic point 1 belong to an allowable deviation range, and therefore, determining that the target position is the position 1 corresponding to the characteristic point 1.
S209, the display terminal acquires and displays the target virtual scene according to the target position.
Specifically, by combining the corresponding relationship between the position in the database and the virtual scene, it can be known that the virtual scene corresponding to the position 1 is 1, that is, the virtual scene 1 is the target virtual scene, and is displayed on the display terminal, as shown in fig. 3 to 5. It should be noted that fig. 3 to 5 are rendering effect diagrams, which must have a certain color and fill to express the effect. As can be seen from fig. 3 to 5, in any background, the virtual scene can be displayed by implementing the above steps S201 to S209, and the display effect of the virtual scene is not affected by the background.
And S210, the display terminal receives a second operation of the user on the target virtual scene.
Specifically, the user can move, zoom, lift, perform behavior setting and real-time dynamic display on a target virtual scene displayed on the display terminal, perform screen capture or video generation on a sand table display effect, and the like, so that the deduction of the three-dimensional digital sand table based on the augmented reality is realized, the interaction effect between the user and the three-dimensional digital sand table based on the augmented reality is improved, and the enjoyment is improved.
By implementing the method for deducing the three-dimensional digital sand table based on the augmented reality provided by the embodiment of the invention, the user opens the sand table deduction application program of the display terminal, the current actual environment picture is acquired through the built-in image acquisition equipment in the sand table deduction application program, and the display target virtual scene is acquired based on the current actual environment picture, so that the bring-in feeling of the user when the user watches an actual object is enhanced. Meanwhile, the user can perform operations of moving, zooming, lifting, behavior setting and real-time dynamic display on the target virtual scene, screen capture or video generation on the sand table display effect and the like, so that the interactive effect is improved.
Referring to fig. 6, it is a schematic structural diagram of a three-dimensional digital sandbox deriving system based on augmented reality according to a first embodiment of the present invention, and as shown in the figure, the system includes a display terminal 100 and a processor 200 for data interaction. The display terminal 100 includes, but is not limited to, a mobile phone, a tablet computer, and augmented reality glasses.
Further, referring to fig. 7, the display terminal 100 includes:
a receiving module 10, configured to receive a first operation of a user to open a sandbox deduction application;
a first collecting module 11, configured to collect a current actual environment picture in the sandbox deduction application;
an extraction module 12, configured to perform feature extraction on the current actual environment picture to obtain a target feature point;
the matching module 13 is configured to perform matching processing on the target feature points according to a preset database to obtain a target position, where the target position is any one position in an augmented reality sand table model, the database includes a corresponding relationship between feature points and positions in the augmented reality sand table model, and each position in the augmented reality sand table model corresponds to a virtual scene;
the display module 14 is configured to obtain and display a target virtual scene according to the target position;
the receiving module 10 is further configured to receive a second operation of the user on the target virtual scene, where the second operation includes moving, zooming, ascending and descending, setting a behavior of a character and dynamically displaying the character in real time, and performing screen capture or video generation on a display effect of a sand table.
Further, referring to fig. 8, the processor 200 includes:
a second collecting module 20, configured to collect a plurality of actual scene information;
a building module 21, configured to build a three-dimensional virtual digital sand table model according to the plurality of pieces of actual scene information, where the three-dimensional virtual digital sand table model includes terrain information;
the adding module 22 is used for performing parameter adding processing on the three-dimensional virtual digital sand table model to obtain a three-dimensional vivid model, wherein the three-dimensional vivid model comprises surface feature information, climate information and social roles; the land feature information comprises vegetation, rivers and buildings, the climate information comprises rainfall, snowfall and sunshine, and the social roles comprise characters and animals;
and the generating module 23 is configured to generate the sandbox deduction application according to the three-dimensional realistic model.
Further, the generating module 23 is specifically configured to:
adding motion rules to the social roles in the three-dimensional realistic model to obtain an augmented reality sand table model;
scanning actual object information through the display terminal, and performing feature extraction on the actual object information to obtain an initial feature point, wherein the actual object information comprises a real object and a real object picture;
acquiring a plurality of initial positions in the augmented reality sand table model, and binding the initial characteristic points and the initial positions in a one-to-one manner;
and saving the binding relationship between the initial characteristic point and the initial position to generate the sandbox deduction application program.
Further, the adding module 22 is specifically configured to:
and adding the ground feature information, the climate information and the social roles to the three-dimensional virtual digital sand table model to obtain the three-dimensional vivid model.
By implementing the three-dimensional digital sand table deduction system based on augmented reality provided by the embodiment of the invention, a user opens a sand table deduction application program of the display terminal, and in the sand table deduction application program, a current actual environment picture is acquired through built-in image acquisition equipment, and a display target virtual scene is acquired based on the current actual environment picture, so that the bring-in feeling of the user when the user watches an actual object is enhanced. Meanwhile, the user can perform operations of moving, zooming, lifting, behavior setting and real-time dynamic display on the target virtual scene, screen capture or video generation on the sand table display effect and the like, so that the interactive effect is improved.
It should be noted that, in this embodiment, please refer to the description of the method portion for the specific workflow of the augmented reality-based three-dimensional digital sand table deduction system, which is not described herein again.
The above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; such modifications and substitutions do not depart from the spirit and scope of the present invention, and they should be construed as being included in the following claims and description.
Claims (5)
1. A three-dimensional digital sand table deduction method based on augmented reality is characterized by comprising the following steps:
the processor collects a plurality of actual scene information;
the processor extracts feature points of the actual scene information, determines a specific position where the augmented reality sand table needs to be overlaid and is bound, and builds a three-dimensional virtual digital sand table model;
the processor performs parameter adding processing on the three-dimensional virtual digital sand table model to obtain a three-dimensional vivid model;
the processor generates a sand table deduction application program according to the three-dimensional realistic model;
the display terminal receives a first operation of a user to open the sandbox deduction application program;
in the sand table deduction application program, the display terminal acquires a current actual environment picture through built-in image acquisition equipment;
the display terminal extracts the features of the current actual environment picture to obtain target feature points; the characteristic extraction is to convert the collected environment picture into a gray scale image and obtain the contour edge of an object in the environment as a characteristic point;
the display terminal performs matching processing on the target feature points according to a preset database to obtain a target position, wherein the target position is any one position in an augmented reality sand table model, the database comprises a corresponding relation between the feature points and the positions in the augmented reality sand table model, and each position in the augmented reality sand table model corresponds to a virtual scene;
the display terminal acquires and displays a target virtual scene according to the target position;
and the display terminal receives a second operation of the user on the target virtual scene, wherein the second operation comprises moving, zooming, lifting, behavior setting and real-time dynamic display of the character, and screen capture or video generation of a sand table display effect.
2. The augmented reality-based three-dimensional digital sandbox deduction method of claim 1,
the three-dimensional virtual digital sand table model comprises terrain information;
the three-dimensional realistic model comprises surface feature information, climate information and social characters.
3. The augmented reality-based three-dimensional digital sandbox deduction method of claim 2, wherein the processor generating the sandbox deduction application from the three-dimensional realistic model specifically comprises:
the processor performs motion rule adding processing on the social roles in the three-dimensional realistic model to obtain an augmented reality sand table model;
the processor scans actual object information through the display terminal and extracts features of the actual object information to obtain initial feature points, wherein the actual object information comprises a real object and a real object picture;
the processor acquires a plurality of initial positions in the augmented reality sand table model and one-to-one binds the initial characteristic points and the initial positions;
and the processor saves the binding relationship between the initial characteristic point and the initial position so as to generate the sandbox deduction application program.
4. The method according to claim 2 or 3, wherein the parameter adding process of the three-dimensional virtual digital sand table model by the processor to obtain the three-dimensional realistic model specifically comprises:
the processor adds the surface feature information, the climate information and the social characters to the three-dimensional virtual digital sand table model to obtain the three-dimensional realistic model.
5. The augmented reality-based three-dimensional digital sand table deduction method of claim 4, wherein the ground feature information includes vegetation, rivers and buildings, the climate information includes rainfall, snowfall and sunshine, and the social characters include characters and animals.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711130030.4A CN107797665B (en) | 2017-11-15 | 2017-11-15 | Three-dimensional digital sand table deduction method and system based on augmented reality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711130030.4A CN107797665B (en) | 2017-11-15 | 2017-11-15 | Three-dimensional digital sand table deduction method and system based on augmented reality |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107797665A CN107797665A (en) | 2018-03-13 |
| CN107797665B true CN107797665B (en) | 2021-02-02 |
Family
ID=61535106
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711130030.4A Active CN107797665B (en) | 2017-11-15 | 2017-11-15 | Three-dimensional digital sand table deduction method and system based on augmented reality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107797665B (en) |
Families Citing this family (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110544311B (en) * | 2018-05-29 | 2023-04-25 | 百度在线网络技术（北京）有限公司 | Security warning method, device and storage medium |
| CN110826375B (en) * | 2018-08-10 | 2022-08-12 | 广东虚拟现实科技有限公司 | Display method, device, terminal device and storage medium |
| CN109917906A (en) * | 2019-01-24 | 2019-06-21 | 北京德火科技有限责任公司 | A kind of method and system for realizing sight spot interaction based on augmented reality |
| CN110163831B (en) * | 2019-04-19 | 2021-04-23 | 深圳市思为软件技术有限公司 | Method and device for dynamically displaying object of three-dimensional virtual sand table and terminal equipment |
| CN110209285B (en) * | 2019-06-19 | 2020-07-17 | 哈尔滨拓博科技有限公司 | Sand table display system based on gesture control |
| CN110349270B (en) * | 2019-07-02 | 2023-07-28 | 上海迪沪景观设计有限公司 | Virtual sand table presenting method based on real space positioning |
| CN110348900B (en) * | 2019-07-03 | 2022-07-29 | 联保（北京）科技有限公司 | Data processing method, system and device |
| CN110648396A (en) * | 2019-09-17 | 2020-01-03 | 西安万像电子科技有限公司 | Image processing method, device and system |
| CN110721387B (en) * | 2019-11-04 | 2022-04-12 | 北京容大天成科技有限公司 | 3D digital psychological sand table implementation method and device, electronic equipment and psychological sand table |
| CN111104470A (en) * | 2019-11-19 | 2020-05-05 | 青岛海信网络科技股份有限公司 | Method and system for linkage of electronic sand table and emergency platform |
| CN111696193B (en) * | 2020-05-06 | 2023-08-25 | 广东康云科技有限公司 | Internet of things control method, system and device based on three-dimensional scene and storage medium |
| CN111638793B (en) * | 2020-06-04 | 2023-09-01 | 浙江商汤科技开发有限公司 | Display method and device of aircraft, electronic equipment and storage medium |
| CN111651055A (en) * | 2020-06-09 | 2020-09-11 | 浙江商汤科技开发有限公司 | City virtual sand table display method and device, computer equipment and storage medium |
| CN111652984B (en) * | 2020-06-10 | 2024-03-22 | 上海商汤智能科技有限公司 | Sand table demonstration method and device, computer equipment and storage medium |
| CN111651056A (en) * | 2020-06-10 | 2020-09-11 | 浙江商汤科技开发有限公司 | Sand table demonstration method and device, computer equipment and storage medium |
| CN111651053A (en) * | 2020-06-10 | 2020-09-11 | 浙江商汤科技开发有限公司 | Urban sand table display method and device, electronic equipment and storage medium |
| CN111651057A (en) * | 2020-06-11 | 2020-09-11 | 浙江商汤科技开发有限公司 | Data display method and device, electronic equipment and storage medium |
| CN111640201A (en) * | 2020-06-11 | 2020-09-08 | 浙江商汤科技开发有限公司 | Control method and device for virtual sand table display, electronic equipment and storage medium |
| CN111599223A (en) * | 2020-06-12 | 2020-08-28 | 浙江商汤科技开发有限公司 | Sand table display system and sand table display method |
| CN113436559B (en) * | 2021-05-19 | 2023-04-14 | 吉林大学 | A sand table dynamic landscape real-time display system and display method |
| CN113254742B (en) * | 2021-07-14 | 2021-11-30 | 深圳市赛野展览展示有限公司 | Display device based on 5G deep learning artificial intelligence |
| CN114661156B (en) * | 2022-03-26 | 2025-01-07 | 深圳市思为软件技术有限公司 | A method and related equipment for realizing electronic sand table using sequence frames |
| CN115097938B (en) * | 2022-06-25 | 2025-01-28 | 成都西南信息控制研究院有限公司 | Immersive virtual sandbox simulation public display system and method |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106816077A (en) * | 2015-12-08 | 2017-06-09 | 张涛 | Interactive sandbox methods of exhibiting based on Quick Response Code and augmented reality |
| CN106843150A (en) * | 2017-02-28 | 2017-06-13 | 清华大学 | A kind of industry spot simulation method and device |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105045389B (en) * | 2015-07-07 | 2018-09-04 | 深圳水晶石数字科技有限公司 | A kind of demenstration method of interactive sand table system |
| CN106571072A (en) * | 2015-10-26 | 2017-04-19 | 苏州梦想人软件科技有限公司 | Method for realizing children education card based on AR |
| CN106371581A (en) * | 2016-04-01 | 2017-02-01 | 苏州美房云客软件科技股份有限公司 | Interaction method based on IM (Instant Messaging) and 3D virtual technology |
| CN106887183B (en) * | 2017-03-24 | 2019-04-02 | 广西七三科技有限公司 | A kind of interactive demonstration method and system of BIM augmented reality in building sand table |
-
2017
- 2017-11-15 CN CN201711130030.4A patent/CN107797665B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106816077A (en) * | 2015-12-08 | 2017-06-09 | 张涛 | Interactive sandbox methods of exhibiting based on Quick Response Code and augmented reality |
| CN106843150A (en) * | 2017-02-28 | 2017-06-13 | 清华大学 | A kind of industry spot simulation method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107797665A (en) | 2018-03-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107797665B (en) | Three-dimensional digital sand table deduction method and system based on augmented reality | |
| US11601630B2 (en) | Video processing method, electronic device, and non-transitory computer-readable medium | |
| CN112263837B (en) | Weather rendering method, device, equipment and storage medium in virtual environment | |
| WO2018077206A1 (en) | Augmented reality scene generation method, device, system and equipment | |
| King et al. | ARVino-outdoor augmented reality visualisation of viticulture GIS data | |
| TWI556639B (en) | Techniques for adding interactive features to videos | |
| CN104778654A (en) | Intangible cultural heritage digital display system and method thereof | |
| Takeuchi et al. | ClayVision: the (elastic) image of the city | |
| CN114025219B (en) | Rendering method, device, medium and equipment for augmented reality special effects | |
| US9613270B2 (en) | Weather displaying method and device | |
| CN115147554A (en) | Three-dimensional scene construction method, apparatus, device and storage medium | |
| CN108829250A (en) | A kind of object interaction display method based on augmented reality AR | |
| CN106251405A (en) | The method of augmented reality and terminal | |
| CN111145135A (en) | Image descrambling processing method, device, equipment and storage medium | |
| CN114092670A (en) | Virtual reality display method, equipment and storage medium | |
| CN114387445A (en) | Object key point identification method and device, electronic equipment and storage medium | |
| CN112581571A (en) | Control method and device of virtual image model, electronic equipment and storage medium | |
| CN117788689A (en) | Interactive virtual cloud exhibition hall construction method and system based on three-dimensional modeling | |
| EP4510077A1 (en) | Image processing method and apparatus, electronic device, and storage medium | |
| KR101235850B1 (en) | A method for expressing whether of virtual world and an apparatus thereof | |
| CN108805095A (en) | Picture processing method and device, mobile terminal and computer readable storage medium | |
| CN113986407A (en) | Cover generation method and device and computer storage medium | |
| CN114554240A (en) | Interactive method and device in live broadcast, storage medium, and electronic device | |
| CN107680105A (en) | Video data real-time processing method and device, computing device based on virtual world | |
| CN111752391A (en) | A virtual interaction method and computer-readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |