CN109062413A - A kind of AR interactive system and method - Google Patents
A kind of AR interactive system and method Download PDFInfo
- Publication number
- CN109062413A CN109062413A CN201810929104.9A CN201810929104A CN109062413A CN 109062413 A CN109062413 A CN 109062413A CN 201810929104 A CN201810929104 A CN 201810929104A CN 109062413 A CN109062413 A CN 109062413A
- Authority
- CN
- China
- Prior art keywords
- user gesture
- image
- model image
- displacement
- interactive
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a kind of AR interactive systems, including image-display units, user gesture acquiring unit, user gesture position judging unit and image mobile unit, image-display units under AR scene for showing 3D model image, user gesture acquiring unit is used to obtain the information of user gesture, whether user gesture position judging unit is used to judge the position of user gesture in 3D model image, image mobile unit is used in the position of user gesture when on 3D model image, according to the displacement mobile 3 D model image of user gesture, AR interactive system further includes AR program and the interactive program installed on the mobile apparatus, and peripheral hardware operates equipment.The invention also discloses a kind of AR exchange methods.The present invention can not only enrich the 3D model image of display and the interactive mode of user, and interactive operation is simple according to the displacement mobile 3 D model image of user gesture, increase operation ease for use.
Description
Technical field
The present invention relates to AR technical field, specifically a kind of AR interactive system and method.
Background technique
AR, that is, augmented reality.It is by computer technology, by virtual Information application to real world, true environment with
Virtual object has been added to the same picture in real time or space exists simultaneously.With MIT Media Lab fluid
The research achievement SixthSense(6th sense of interface group) for simply introduce its working principle.SixthSense equipment is main
Including camera, small projector, smart phone and mirror, any plane can be become the display of an interaction by projector
Screen.SixthSense captures the environment of surrounding using camera and mirror, and this picture is then transmitted to mobile phone (handset processes
This picture obtains GPS coordinate and the relevant search information from internet), then by these information from projector projects to
In any plane in face of user, regardless of this plane is a wrist or a face wall.Since camera is worn on by user
Front, therefore SixthSense equipment can enhance all that he is seen.For example, if he picks in a grocery store
One tank soup, SixthSense equipment will search for the relevant information of this tank soup, even such as ingredient, price and nutritive value with
Family comment, then projects them in plane.Moreover, user can also by dressing special fingerstall in gesture, with
Various operations are carried out in the information of projection, after these operations are captured by camera, are handled and are held by mobile phone
Row.
It it can be seen from the above, the appearance of augmented reality will greatly improve people's lives, while being scientific and technological progress
Bring tremendous influence.But since existing AR technology is mainly that image and real world are combined presentation, with
The interaction at family is seldom.Therefore it needs to propose a kind of new technical solution, to solve the above problems.
Summary of the invention
The purpose of the present invention is to provide a kind of AR interactive system and methods, to solve mentioned above in the background art ask
Topic.
To achieve the above object, the invention provides the following technical scheme:
A kind of AR interactive system, including image-display units, user gesture acquiring unit, user gesture position judging unit and figure
As mobile unit, described image display unit under AR scene for showing 3D model image；The user gesture acquiring unit
For obtaining the information of user gesture；User gesture position judging unit be used for judge the user gesture position whether
On the 3D model image；Described image mobile unit is used in the position of the user gesture in the 3D model image
When, according to the mobile 3D model image of the displacement of the user gesture；The AR interactive system further includes being mounted on movement to set
Standby upper AR program and interactive program and peripheral hardware operate equipment, and the AR program is used for based on three-dimensional coordinate in mobile device
The upper interface generation AR；The peripheral hardware operation equipment with the mobile device for being associated with and exporting control instruction；The interactive journey
Sequence is interacted for receiving the control instruction according to the control instruction and the interface AR.
As a further solution of the present invention: the user gesture acquiring unit includes screen distance judgment module and user
Gesture information obtain module, screen distance judgment module for judge user gesture whether be less than at a distance from screen it is preset away from
From threshold value；When user gesture data obtaining module is used to be less than preset distance threshold at a distance from screen in user gesture, obtain
Take the projection information of user gesture.
As a further solution of the present invention: the information of the user gesture includes position and the user gesture of user gesture
Displacement, do not have contact screen also in user gesture, but close to screen when, obtain the information of user gesture, with improve obtain letter
The speed of breath.
As a further solution of the present invention: described image mobile unit includes distance calculation module, the interaction of the first image
Module and image rotation unit.
As a further solution of the present invention: the distance calculation module is used in the position of user gesture in 3D illustraton of model
As it is upper when, according to the size of the displacement of user gesture calculate 3D model image screen moving distance, according to user gesture
The direction of displacement determines 3D model image in the moving direction of screen.
As a further solution of the present invention: the first image interactive module by according to determining moving direction and based on
The moving distance mobile 3 D model image of calculation.
As a further solution of the present invention: described image rotary unit is used in the position of user gesture not in 3D mould
When on type image, make 3D model image according to specified axial-rotation, specified is axial determining according to the displacement of user gesture.
As a further solution of the present invention: described image rotary unit includes the angle-determining module and of image rotation
The angle-determining module of two image interactive modules, described image rotation is used in the position of user gesture not in 3D model image
When upper, the direction of the determining displacement with user gesture has the direction of specified angle, and the size according to the displacement of user gesture is true
Determine 3D model image rotation angle, the second image interactive module for make the 3D model image with user gesture
It is axial-rotation that the direction of displacement, which has the direction of specified angle, until the angle of rotation is equal to determining 3D model image rotation
Angle.
A kind of AR exchange method, comprising:
Step S1 shows 3D model image under AR scene；
Step S2, obtains the information of user gesture, and the information of the user gesture includes position and the user gesture of user gesture
Displacement；
Whether step S3 judges the position of the user gesture on the 3D model image；
Step S4 is moved in the position of the user gesture when on the 3D model image according to the displacement of the user gesture
Move the 3D model image.
As a further solution of the present invention:
Compared with prior art, the beneficial effects of the present invention are:
The present invention can not only enrich the 3D model of display according to the mobile 3D model image of the displacement of the user gesture
The interactive mode of image and user, and interactive operation is simple, increases operation ease for use.
Detailed description of the invention
Fig. 1 is a kind of system block diagram of AR interactive system.
Fig. 2 is a kind of structural block diagram of user gesture acquiring unit in AR interactive system.
Fig. 3 is a kind of structural block diagram of image mobile unit in AR interactive system.
Fig. 4 is the structural block diagram of image rotation unit in Fig. 3.
Fig. 5 is a kind of flow diagram of AR exchange method.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other
Embodiment shall fall within the protection scope of the present invention.
Please refer to Fig. 1-4, in the embodiment of the present invention, a kind of AR interactive system, the AR interactive system can be applied to various shiftings
In dynamic terminal, which includes image-display units 1, user gesture acquiring unit 2, user gesture position judging unit
3 and image mobile unit 4, described image display unit 1 under AR scene for showing 3D model image；The user gesture obtains
Take unit 2 for obtaining the information of user gesture, further, the information of the user gesture include user gesture position and
The displacement of user gesture there is not contact screen also in user gesture, but close to screen when, the information of user gesture is obtained, to mention
Height obtains the speed of information；The user gesture acquiring unit 2 includes that screen distance judgment module 21 and user gesture information obtain
Modulus block 22, screen distance judgment module 21 are preset apart from threshold for judging whether user gesture is less than at a distance from screen
Value；When user gesture data obtaining module 22 is used to be less than preset distance threshold at a distance from screen in user gesture, obtain
The projection information of user gesture.
Whether user gesture position judging unit 3 is used to judge the position of the user gesture in the 3D illustraton of model
As upper；Described image mobile unit 4 is used in the position of the user gesture when on the 3D model image, according to described
The mobile 3D model image of the displacement of user gesture；Further, described image mobile unit 4 includes distance calculation module
41, the first image interactive module 42 and image rotation unit 43, wherein distance calculation module 41 is used in the user gesture
Position when on the 3D model image, according to the size of the displacement of user gesture calculate 3D model image screen movement away from
From determining 3D model image in the moving direction of screen according to the direction of the displacement of user gesture；The first image interacts mould
Block 42 is used for according to determining moving direction and the mobile 3D model image of the moving distance of calculating；Described image rotary unit
43 in the position of the user gesture for not when on the 3D model image, making the 3D model image according to specified
Axial-rotation, it is specified axial to be determined according to the displacement of user gesture.
Further, described image rotary unit 43 includes that the angle-determining module 431 of image rotation and the second image are handed over
Mutual module 432, wherein the angle-determining module 431 of image rotation is used in the position of the user gesture not in the 3D mould
When on type image, the direction of the determining displacement with the user gesture has the direction of specified angle, according to the user gesture
The size of displacement determine the angle of 3D model image rotation；The second image interactive module 432 is for making the 3D
Model image has the direction of specified angle as axial-rotation using the direction of the displacement with the user gesture, until the angle of rotation
Degree is equal to the angle of determining 3D model image rotation.
In the embodiment of the present invention, which further includes AR program and the interactive program installed on the mobile apparatus,
And peripheral hardware operates equipment, the AR program is used to generate the interface AR on the mobile apparatus based on three-dimensional coordinate；The peripheral hardware behaviour
Make equipment for being associated with the mobile device and exporting control instruction；The interactive program is used to receive the control instruction,
And it is interacted according to the control instruction and the interface AR.
Referring to Fig. 5, in the embodiment of the present invention, a kind of AR exchange method, including step S1,3D mould is shown under AR scene
Type image；Step S2, obtains the information of user gesture, and the information of the user gesture includes position and the user hand of user gesture
The displacement of gesture；Whether step S3 judges the position of the user gesture on the 3D model image；Step S4, in the use
The position of family gesture is when on the 3D model image, according to the mobile 3D model image of the displacement of the user gesture.
It is obvious to a person skilled in the art that invention is not limited to the details of the above exemplary embodiments, Er Qie
In the case where without departing substantially from spirit or essential attributes of the invention, the present invention can be realized in other specific forms.Therefore, no matter
From the point of view of which point, the present embodiments are to be considered as illustrative and not restrictive, and the scope of the present invention is by appended power
Benefit requires rather than above description limits, it is intended that all by what is fallen within the meaning and scope of the equivalent elements of the claims
Variation is included within the present invention.Any reference signs in the claims should not be construed as limiting the involved claims.
In addition, it should be understood that although this specification is described in terms of embodiments, but not each embodiment is only wrapped
Containing an independent technical solution, this description of the specification is merely for the sake of clarity, and those skilled in the art should
It considers the specification as a whole, the technical solutions in the various embodiments may also be suitably combined, forms those skilled in the art
The other embodiments being understood that.
Claims (9)
1. a kind of AR interactive system, including image-display units (1), user gesture acquiring unit (2), the judgement of user gesture position
Unit (3) and image mobile unit (4), which is characterized in that described image display unit (1) under AR scene for showing 3D mould
Type image；The user gesture acquiring unit (2) is used to obtain the information of user gesture；User gesture position judging unit
(3) for judging the position of the user gesture whether in the 3D model image；Described image mobile unit (4) is used for
The position of the user gesture is when on the 3D model image, according to the mobile 3D illustraton of model of the displacement of the user gesture
Picture；The AR interactive system further includes installation AR program on the mobile apparatus and interactive program and peripheral hardware operation equipment, institute
AR program is stated for generating the interface AR on the mobile apparatus based on three-dimensional coordinate；The peripheral hardware operation equipment is used for and the movement
Equipment is associated with and exports control instruction；The interactive program for receiving the control instruction, and according to the control instruction with
The interface AR interacts.
2. a kind of AR interactive system according to claim 1 and method, which is characterized in that the user gesture acquiring unit
It (2) include screen distance judgment module (21) and user gesture data obtaining module (22), screen distance judgment module (21) is used
In judging whether user gesture is less than preset distance threshold at a distance from screen；User gesture data obtaining module (22) is used for
When user gesture is less than preset distance threshold at a distance from screen, the projection information of user gesture is obtained.
3. a kind of AR interactive system according to claim 1 and method, which is characterized in that the packet of the user gesture
Include the position of user gesture and the displacement of user gesture, do not have contact screen also in user gesture, but close to screen when, obtain use
The information of family gesture, to improve the speed for obtaining information.
4. a kind of AR interactive system according to claim 1 and method, which is characterized in that described image mobile unit (4)
Including distance calculation module (41), the first image interactive module (42) and image rotation unit (43).
5. a kind of AR interactive system according to claim 4 and method, which is characterized in that: the distance calculation module
(41) for when on 3D model image, calculating 3D illustraton of model according to the size of the displacement of user gesture in the position of user gesture
As the moving distance in screen, determine 3D model image in the moving direction of screen according to the direction of the displacement of user gesture.
6. a kind of AR interactive system according to claim 4 and method, which is characterized in that the first image interactive module
(42) for the moving distance mobile 3 D model image according to determining moving direction and calculating.
7. a kind of AR interactive system according to claim 4 and method, which is characterized in that described image rotary unit (43)
For not when on 3D model image, making 3D model image according to specified axial-rotation in the position of user gesture, specify
Axial determined according to the displacement of user gesture.
8. a kind of AR interactive system according to claim 4 and method, which is characterized in that described image rotary unit (43)
The angle of angle-determining module (431) and the second image interactive module (432) including image rotation, described image rotation determines
Module (431) is used in the position of user gesture not when on 3D model image, the direction of the determining displacement with user gesture
Direction with specified angle, according to the size of the displacement of user gesture determine 3D model image rotation angle, described second
The side that image interactive module (432) is used to that the 3D model image to be made to have specified angle with the direction of the displacement with user gesture
To for axial-rotation, until the angle of rotation is equal to the angle of determining 3D model image rotation.
9. it is a kind of according to claim 1~8 in any AR interaction method characterized by comprising
Step S1 shows 3D model image under AR scene；
Step S2, obtains the information of user gesture, and the information of the user gesture includes position and the user gesture of user gesture
Displacement；
Whether step S3 judges the position of the user gesture on the 3D model image；
Step S4 is moved in the position of the user gesture when on the 3D model image according to the displacement of the user gesture
Move the 3D model image.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810929104.9A CN109062413A (en) | 2018-08-15 | 2018-08-15 | A kind of AR interactive system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810929104.9A CN109062413A (en) | 2018-08-15 | 2018-08-15 | A kind of AR interactive system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109062413A true CN109062413A (en) | 2018-12-21 |
Family
ID=64686102
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810929104.9A Pending CN109062413A (en) | 2018-08-15 | 2018-08-15 | A kind of AR interactive system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109062413A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111880652A (en) * | 2020-07-16 | 2020-11-03 | 北京悉见科技有限公司 | Method, apparatus and storage medium for moving position of AR object |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106933350A (en) * | 2017-02-09 | 2017-07-07 | 深圳市创想天空科技股份有限公司 | AR exchange methods and device |
| CN107272889A (en) * | 2017-05-23 | 2017-10-20 | 武汉秀宝软件有限公司 | A kind of AR interface alternation method and system based on three-dimensional coordinate |
| CN107885313A (en) * | 2016-09-29 | 2018-04-06 | 阿里巴巴集团控股有限公司 | A kind of equipment exchange method, device and equipment |
-
2018
- 2018-08-15 CN CN201810929104.9A patent/CN109062413A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107885313A (en) * | 2016-09-29 | 2018-04-06 | 阿里巴巴集团控股有限公司 | A kind of equipment exchange method, device and equipment |
| CN106933350A (en) * | 2017-02-09 | 2017-07-07 | 深圳市创想天空科技股份有限公司 | AR exchange methods and device |
| CN107272889A (en) * | 2017-05-23 | 2017-10-20 | 武汉秀宝软件有限公司 | A kind of AR interface alternation method and system based on three-dimensional coordinate |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111880652A (en) * | 2020-07-16 | 2020-11-03 | 北京悉见科技有限公司 | Method, apparatus and storage medium for moving position of AR object |
| CN111880652B (en) * | 2020-07-16 | 2024-08-13 | 北京悉见科技有限公司 | Method, apparatus and storage medium for moving AR object position |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111294665B (en) | Video generation method and device, electronic equipment and readable storage medium | |
| US20230088308A1 (en) | Puppeteering Remote Avatar by Facial Expressions | |
| US11893702B2 (en) | Virtual object processing method and apparatus, and storage medium and electronic device | |
| WO2021067044A1 (en) | Systems and methods for video communication using a virtual camera | |
| US20130208005A1 (en) | Image processing device, image processing method, and program | |
| CN107274469A (en) | The coordinative render method of Virtual reality | |
| US9286713B2 (en) | 3D design and collaboration over a network | |
| US11288871B2 (en) | Web-based remote assistance system with context and content-aware 3D hand gesture visualization | |
| CN103489219B (en) | 3D hair style effect simulation system based on depth image analysis | |
| CN105892643A (en) | Multi-interface unified display system and method based on virtual reality | |
| JP6721072B2 (en) | Calculation processing execution method, calculation processing system and program | |
| CN109582122A (en) | Augmented reality information providing method, device and electronic equipment | |
| CN108133454B (en) | Space geometric model image switching method, device and system and interaction equipment | |
| CN103279942A (en) | Control method for realizing virtual 3D (3-dimension) display on 2D (2-dimension) screen on basis of environment sensor | |
| WO2021093679A1 (en) | Visual positioning method and device | |
| Chen et al. | A case study of security and privacy threats from augmented reality (ar) | |
| WO2020215789A1 (en) | Virtual paintbrush implementing method and apparatus, and computer readable storage medium | |
| CN115131528B (en) | Virtual reality scene determination method, device and system | |
| US20230133416A1 (en) | Image processing method and apparatus, and device and medium | |
| EP4272061A1 (en) | Systems and methods for generating stabilized images of a real environment in artificial reality | |
| CN109992111B (en) | Augmented reality extension method and electronic device | |
| CN111651052A (en) | Display method, device, electronic device and storage medium of virtual sand table | |
| CN109062413A (en) | A kind of AR interactive system and method | |
| EP4485357A2 (en) | Image processing method and apparatus, electronic device, and storage medium | |
| CN206421330U (en) | A kind of virtual reality resource platform system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181221 |
|
| RJ01 | Rejection of invention patent application after publication |