CN105739703A - Virtual reality somatosensory interaction system and method for wireless head-mounted display equipment - Google Patents
Virtual reality somatosensory interaction system and method for wireless head-mounted display equipment Download PDFInfo
- Publication number
- CN105739703A CN105739703A CN201610073604.8A CN201610073604A CN105739703A CN 105739703 A CN105739703 A CN 105739703A CN 201610073604 A CN201610073604 A CN 201610073604A CN 105739703 A CN105739703 A CN 105739703A
- Authority
- CN
- China
- Prior art keywords
- operator
- instruction information
- digital
- mobile terminal
- head
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003238 somatosensory effect Effects 0.000 title claims abstract description 26
- 230000003993 interaction Effects 0.000 title claims abstract description 25
- 238000000034 method Methods 0.000 title claims abstract description 19
- 230000033001 locomotion Effects 0.000 claims abstract description 53
- 230000005484 gravity Effects 0.000 claims description 6
- 230000002452 interceptive effect Effects 0.000 claims description 5
- 238000012544 monitoring process Methods 0.000 claims description 3
- 230000000007 visual effect Effects 0.000 claims 5
- 230000004886 head movement Effects 0.000 abstract description 11
- 230000005540 biological transmission Effects 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 5
- 238000002474 experimental method Methods 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 210000000988 bone and bone Anatomy 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/012—Head tracking input arrangements
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
本发明涉及一种面向无线头戴显示设备的虚拟现实体感交互系统及方法。该系统包括肢体动作采集装置，与服务器相连接，用于根据操作者的肢体动作信息生成第一数字动作指令信息以提供给服务器；服务器通过无线路由器与移动终端相连接，用于根据第一数字动作指令信息生成数字操纵指令信息以提供给移动终端；头部动作采集装置固定在该操作者头部，且与移动终端相连接，用于根据操作者的头部动作信息转换成操作者的旋转角度生成第二数字动作指令信息以提供给移动终端；移动终端用于在三维虚拟软件上显示数字操纵指令信息以及调整该三维虚拟软件的三维视角以与操作者显示视角保持一致。本发明无需操作者佩戴过多的姿态捕获设备，提高用户体验。
The invention relates to a virtual reality somatosensory interaction system and method for wireless head-mounted display devices. The system includes a body movement collection device, connected to a server, for generating first digital movement instruction information based on the operator's body movement information to provide to the server; the server is connected to the mobile terminal through a wireless router, for generating first digital movement instruction information based on the operator's body movement information. The action command information generates digital manipulation command information to provide to the mobile terminal; the head movement acquisition device is fixed on the operator's head and connected to the mobile terminal for converting the operator's head movement information into the operator's rotation. The angle generates second digital action instruction information to provide to the mobile terminal; the mobile terminal is used to display the digital manipulation instruction information on the three-dimensional virtual software and adjust the three-dimensional perspective of the three-dimensional virtual software to be consistent with the operator's display perspective. The invention does not require the operator to wear too many gesture capture devices, thereby improving user experience.
Description
技术领域technical field
本发明涉及虚拟现实技术，具体涉及面向无线头戴显示设备的虚拟现实体感交互系统及方法。The invention relates to virtual reality technology, in particular to a virtual reality somatosensory interaction system and method for wireless head-mounted display devices.
背景技术Background technique
虚拟现实(VirtualReality，VR)，又称灵境技术，是利用计算机图形学、多传感器技术、人机交互技术、人工智能技术等，在计算机或其他智能设备上生成三维或多维的虚拟仿真场景供使用者体验。虚拟现实的应用领域广泛，目前较多的运用于医疗、航空、工程和销售等领域，而在娱乐、影视、游戏、教育和增强现实等领域，虚拟现实的应用前景也十分广阔。Virtual reality (Virtual Reality, VR), also known as Lingjing technology, is to use computer graphics, multi-sensor technology, human-computer interaction technology, artificial intelligence technology, etc. to generate three-dimensional or multi-dimensional virtual simulation scenes on computers or other smart devices for use. experience. Virtual reality is widely used in fields such as medical treatment, aviation, engineering, and sales. In entertainment, film and television, games, education, and augmented reality, the application prospect of virtual reality is also very broad.
然而现今虚拟现实常用设备往往需要大量的可穿戴设备，例如数据手套、数据衣、操纵杆、虚拟现实跑步机等，使得用户的虚拟现实体验并不舒适。这些可穿戴设备既不适合长时间佩戴，又不适合用户自由移动，缺乏体验的真实感。而普通图像捕捉设备需要传输的数据量较大，不适合实时的大量数据传输或者处理的虚拟现实体验系统。However, today's commonly used virtual reality devices often require a large number of wearable devices, such as data gloves, data suits, joysticks, virtual reality treadmills, etc., making the user's virtual reality experience uncomfortable. These wearable devices are neither suitable for long-time wearing, nor suitable for users to move freely, and lack the sense of reality of the experience. However, ordinary image capture devices need to transmit a large amount of data, which is not suitable for real-time large-scale data transmission or virtual reality experience system processing.
发明内容Contents of the invention
针对现有技术中的缺陷，本发明提供一种面向无线头戴显示设备的虚拟现实体感交互系统及方法，以解决现有技术中需要操作者佩戴大量的可穿戴设备而导致的用户体验差的技术问题。Aiming at the deficiencies in the prior art, the present invention provides a virtual reality somatosensory interaction system and method for wireless head-mounted display devices to solve the problem of poor user experience caused by requiring operators to wear a large number of wearable devices in the prior art. technical problem.
第一方面，本发明提供了一种面向无线头戴显示设备的虚拟现实体感交互系统，所述系统包括：肢体动作采集装置、头部动作采集装置、无线路由器、运行有三维虚拟软件的移动终端和服务器；其中，In the first aspect, the present invention provides a virtual reality somatosensory interaction system for wireless head-mounted display devices, the system includes: a body movement collection device, a head movement collection device, a wireless router, and a mobile terminal running 3D virtual software and server; where,
所述肢体动作采集装置，与所述服务器相连接，用于根据操作者的肢体动作信息生成第一数字动作指令信息以提供给所述服务器；The body movement acquisition device is connected to the server, and is used to generate first digital movement instruction information according to the operator's body movement information to provide to the server;
所述服务器，通过无线路由器与所述移动终端相连接，用于根据所述第一数字动作指令信息生成数字操纵指令信息以提供给所述移动终端；The server is connected to the mobile terminal through a wireless router, and is configured to generate digital manipulation instruction information according to the first digital action instruction information to provide to the mobile terminal;
所述头部动作采集装置，固定在该操作者头部，且与所述移动终端相连接，用于根据操作者的头部动作信息转换成操作者的旋转角度生成第二数字动作指令信息以提供给所述移动终端；The head motion acquisition device is fixed on the operator's head and connected to the mobile terminal, and is used to convert the operator's head motion information into the operator's rotation angle to generate second digital motion instruction information to provided to the mobile terminal;
所述移动终端，用于在所述三维虚拟软件上显示所述数字操纵指令信息以及根据所述第二数字动作指令信息调整该三维虚拟软件的三维视角以与操作者显示视角保持一致。The mobile terminal is used for displaying the digital manipulation instruction information on the 3D virtual software and adjusting the 3D viewing angle of the 3D virtual software according to the second digital motion instruction information so as to be consistent with the display viewing angle of the operator.
优选地，所述系统还包括显示装置，该显示装置与所述服务器相连接，用于显示所述第一数字动作指令信息以实现数据监测。Preferably, the system further includes a display device connected to the server for displaying the first digital action instruction information to realize data monitoring.
优选地，所述头部动作采集装置设置在所述移动终端内部。Preferably, the head motion collection device is set inside the mobile terminal.
优选地，所述移动终端包括陀螺仪和重力感应器，用于根据操作者的头部动作信息转换成操作者的旋转角度。Preferably, the mobile terminal includes a gyroscope and a gravity sensor for converting the operator's head movement information into the operator's rotation angle.
优选地，所述移动终端为SamsungGalaxyNote4智能手机或者魅族MX3智能手机。Preferably, the mobile terminal is a Samsung Galaxy Note4 smart phone or a Meizu MX3 smart phone.
优选地，所述肢体动作采集装置为Kinect、Leapmotion和RealSense中的一种或者多种。Preferably, the body motion acquisition device is one or more of Kinect, Leapmotion and RealSense.
优选地，所述头部动作采集装置为SamsungGearVR、索尼Oculus和暴风魔镜中的一种或者多种。Preferably, the head motion acquisition device is one or more of Samsung GearVR, Sony Oculus and Baofeng Mirror.
第二方面，本发明实施例还提供了一种面向无线头戴显示设备的虚拟现实体感交互方法，所述方法包括：In the second aspect, the embodiment of the present invention also provides a virtual reality somatosensory interaction method for a wireless head-mounted display device, the method comprising:
运行三维虚拟软件；Run 3D virtual software;
接收来自服务器生成的数字操纵指令信息，所述数字操纵指令信息根据操作者的肢体动作信息生成第一数字动作指令信息生成；receiving digital manipulation instruction information generated from the server, the digital manipulation instruction information is generated according to the operator's body movement information to generate first digital movement instruction information;
接收来自头部动作采集装置生成的第二数字动作指令信息；所述第二数字动作指令信息根据操作者的头部动作信息生成；receiving second digital motion instruction information generated by the head motion acquisition device; the second digital motion instruction information is generated according to the operator's head motion information;
在所述三维虚拟软件上显示所述数字操纵指令信息以及根据所述第二数字动作指令信息调整该三维虚拟软件的三维视角以与操作者显示视角保持一致。Displaying the digital manipulation instruction information on the 3D virtual software and adjusting the 3D viewing angle of the 3D virtual software according to the second digital motion instruction information to be consistent with the display viewing angle of the operator.
优选地，所述方法还包括：采用内置陀螺仪和重力感应器获取操作者的头部动作信息。Preferably, the method further includes: using a built-in gyroscope and a gravity sensor to obtain information about the operator's head movement.
由上述技术方案可知，本发明提供了一种面向无线头戴显示设备的虚拟现实体感交互系统及方法，该系统通过肢体动作采集装置与头部动作采集装置获取操作者的动作信息，通过服务器实时传输给移动终端。本发明中用户只需操作者佩戴移动终端与头部动作采集装置即可，大大减少可穿戴设备的数量，从而极大的提高了用户使用体验。另外，肢体动作识别所涉及到的传输数据量相比传统方式较少，这使得数据处理更快速，实现虚拟现实互动应用的渲染实时性。本发明专利相对与传统虚拟现实产品更适应于量产和大范围推广。It can be seen from the above technical solutions that the present invention provides a virtual reality somatosensory interaction system and method for wireless head-mounted display devices. transmitted to the mobile terminal. In the present invention, the user only needs the operator to wear the mobile terminal and the head movement acquisition device, which greatly reduces the number of wearable devices, thus greatly improving the user experience. In addition, the amount of transmitted data involved in body motion recognition is less than traditional methods, which makes data processing faster and realizes real-time rendering of virtual reality interactive applications. Compared with traditional virtual reality products, the invention patent is more suitable for mass production and large-scale promotion.
附图说明Description of drawings
通过参考附图会更加清楚的理解本发明的特征和优点，附图是示意性的而不应理解为对本发明进行任何限制，在附图中：The features and advantages of the present invention will be more clearly understood by referring to the accompanying drawings, which are schematic and should not be construed as limiting the invention in any way. In the accompanying drawings:
图1是本发明实施例提供的一种面向无线头戴显示设备的虚拟现实体感交互系统的结构示意图；FIG. 1 is a schematic structural diagram of a virtual reality somatosensory interaction system for wireless head-mounted display devices provided by an embodiment of the present invention;
图2为本发明实施例提供的一种面向无线头戴显示设备的虚拟现实体感交互方法流程框图。Fig. 2 is a flowchart of a virtual reality somatosensory interaction method for a wireless head-mounted display device according to an embodiment of the present invention.
具体实施方式detailed description
为使本发明实施例的目的、技术方案和优点更加清楚，下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.
本发明实施例提供了一种面向无线头戴显示设备的虚拟现实体感交互系统，如图1所示，所述系统包括：肢体动作采集装置2、头部动作采集装置3、无线路由器5、运行有三维虚拟软件的移动终端6和服务器4；其中，The embodiment of the present invention provides a virtual reality somatosensory interaction system for wireless head-mounted display devices. As shown in FIG. Mobile terminal 6 and server 4 with three-dimensional virtual software; Wherein,
肢体动作采集装置2与服务器4相连接，用于根据操作者1的肢体动作信息生成第一数字动作指令信息以提供给该服务器4；The body movement acquisition device 2 is connected to the server 4, and is used to generate first digital movement instruction information according to the body movement information of the operator 1 to provide to the server 4;
服务器4通过无线路由器5与移动终端6相连接，用于根据第一数字动作指令信息生成数字操纵指令信息以提供给移动终端6；The server 4 is connected to the mobile terminal 6 through the wireless router 5, and is used to generate digital manipulation instruction information according to the first digital action instruction information to provide to the mobile terminal 6;
头部动作采集装置3固定在该操作者1头部，且与移动终端6相连接，用于获取操作者1的头部动作信息生成第二数字动作指令信息以提供给移动终端6；The head motion acquisition device 3 is fixed on the head of the operator 1, and is connected to the mobile terminal 6, and is used to obtain the head motion information of the operator 1 to generate second digital motion instruction information to provide to the mobile terminal 6;
移动终端6用于在三维虚拟软件上显示数字操纵指令信息以及根据第二数字动作指令信息调整该三维虚拟软件的三维视角以与操作者1的显示视角保持一致。The mobile terminal 6 is used for displaying digital manipulation instruction information on the 3D virtual software and adjusting the 3D viewing angle of the 3D virtual software to be consistent with the display viewing angle of the operator 1 according to the second digital motion instruction information.
本发明通过将肢体动作信息采集与头部动作信息采集分开，将采集用户肢体动作信息的肢体动作采集装置可以脱离操作者，此时用户肢体动作信息可以直接传输至服务器，可以提高数据的传输速度。且操作者需要佩戴头部动作采集装置，然后通过移动终端将所采集的数据传输至服务器；同时操作者需要佩戴移动终端6即可实现采集头部动作以及为操作者显示三维虚拟画面，提高用户体验。In the present invention, by separating the collection of body movement information from the collection of head movement information, the body movement collection device for collecting the user's body movement information can be separated from the operator. At this time, the user's body movement information can be directly transmitted to the server, and the data transmission speed can be improved. . And the operator needs to wear the head motion collection device, and then transmit the collected data to the server through the mobile terminal; at the same time, the operator needs to wear the mobile terminal 6 to realize the collection of head motion and display a three-dimensional virtual picture for the operator, improving user experience.
为方便操作者给所显示的内容进行监测，本发明实施例提供的虚拟现实体感交互系统还包括显示装置。如图1所示，该显示装置7与服务器4相连接，用于显示第一数字动作指令信息以实现数据监测。实际应用中，该显示装置7还用于实时显示人体骨骼位置等信息，以方便操作者查看。In order to facilitate the operator to monitor the displayed content, the virtual reality somatosensory interaction system provided by the embodiment of the present invention further includes a display device. As shown in FIG. 1 , the display device 7 is connected to the server 4 for displaying the first digital action instruction information to realize data monitoring. In practical applications, the display device 7 is also used to display information such as the position of human bones in real time, so as to be convenient for the operator to view.
为进一步减少操作者佩戴设备的数量，本发明实施例提供的虚拟现实体感交互系统中将头部动作采集装置3设置在移动终端6内部。这样，只需要操作都佩戴一个移动终端6即可，可以省去操作者佩戴多个可穿戴设备的时间，并且通过一个移动终端传输数据可提高数据传输的准确度，增强真实感。In order to further reduce the number of equipment worn by the operator, the head motion acquisition device 3 is set inside the mobile terminal 6 in the virtual reality somatosensory interaction system provided by the embodiment of the present invention. In this way, only one mobile terminal 6 needs to be worn by the operator, which saves the time for the operator to wear multiple wearable devices, and the transmission of data through one mobile terminal can improve the accuracy of data transmission and enhance the sense of reality.
需要说明的是，为及时将头部动作采集装置所生成的第二数字动作指令信息转换成操作者的旋转角度，本发明实施例中移动终端6还包括：陀螺仪和重力感应器，用于根据操作者的头部动作信息转换成操作者的旋转角度。It should be noted that, in order to timely convert the second digital motion command information generated by the head motion acquisition device into the operator's rotation angle, the mobile terminal 6 in the embodiment of the present invention also includes: a gyroscope and a gravity sensor for The operator's head movement information is converted into the operator's rotation angle.
需要说明的是，本发明实施例中移动终端6采用SamsungGalaxyNote4智能手机或者魅族MX3智能手机实现。本发明实施例中肢体动作采集装置2采用Kinect(利用红外摄像头发射红外射线来识别人体的动作)、Leapmotion和RealSense中的一种或者多种。头部动作采集装置3可以采用SamsungGearVR、索尼Oculus和暴风魔镜中的一种或者多种。当然，本领域技术人员可以合适的移动终端以及与该移动终端相匹配或者相兼容的头部动作采集装置，采集操作者的头部动作信息与运行三维虚拟软件即可，本发明不作限定。It should be noted that, in the embodiment of the present invention, the mobile terminal 6 is realized by a Samsung Galaxy Note4 smart phone or a Meizu MX3 smart phone. In the embodiment of the present invention, the body motion collection device 2 adopts one or more of Kinect (using an infrared camera to emit infrared rays to identify human body motions), Leapmotion and RealSense. The head motion acquisition device 3 can adopt one or more of SamsungGearVR, Sony Oculus and Baofeng Mojing. Of course, those skilled in the art can use a suitable mobile terminal and a head movement acquisition device matched or compatible with the mobile terminal to collect the operator's head movement information and run the 3D virtual software, which is not limited by the present invention.
需要说明的是，本发明实施例中，服务器4与移动终端6之间通过TCP/IP协议通信实现。It should be noted that, in the embodiment of the present invention, the communication between the server 4 and the mobile terminal 6 is realized through TCP/IP protocol communication.
需要说明的是，为实现移动终端6与服务器4之间能够可靠的数据传输，本发明实施例中对操作者的活动范围了作了限定。例如，图1中有效范围8可以设置为1～4米，这样操作者可以体验到比较流畅的显示画面。It should be noted that, in order to realize reliable data transmission between the mobile terminal 6 and the server 4, the scope of activities of the operator is limited in the embodiment of the present invention. For example, the effective range 8 in FIG. 1 can be set to 1-4 meters, so that the operator can experience a smoother display screen.
本发明实施例还提供了一种面向无线头戴显示设备的虚拟现实体感交互方法，如图2所示，所述方法包括：The embodiment of the present invention also provides a virtual reality somatosensory interaction method for a wireless head-mounted display device, as shown in FIG. 2 , the method includes:
运行三维虚拟软件；Run 3D virtual software;
接收来自服务器生成的数字操纵指令信息，所述数字操纵指令信息根据操作者的肢体动作信息生成第一数字动作指令信息生成；receiving digital manipulation instruction information generated from the server, the digital manipulation instruction information is generated according to the operator's body movement information to generate first digital movement instruction information;
接收来自头部动作采集装置生成的第二数字动作指令信息；所述第二数字动作指令信息根据操作者的头部动作信息生成；receiving second digital motion instruction information generated by the head motion acquisition device; the second digital motion instruction information is generated according to the operator's head motion information;
在所述三维虚拟软件上显示所述数字操纵指令信息以及根据所述第二数字动作指令信息调整该三维虚拟软件的三维视角以与操作者显示视角保持一致。Displaying the digital manipulation instruction information on the 3D virtual software and adjusting the 3D viewing angle of the 3D virtual software according to the second digital motion instruction information to be consistent with the display viewing angle of the operator.
优选地，所述方法还包括：采用陀螺仪和重力感应器获取操作者的头部动作信息。Preferably, the method further includes: using a gyroscope and a gravity sensor to acquire information about the operator's head movement.
可以看出，本发明实施例提供的虚拟现实体感交互方法是在上文所述的虚拟现实感交互系统的基础上实现的，为此具有相同的技术特征，可以解决相同的技术问题，达到相同的技术效果，在此不再一一赘述了。It can be seen that the virtual reality somatosensory interaction method provided by the embodiment of the present invention is realized on the basis of the above-mentioned virtual reality interactive system. Therefore, it has the same technical characteristics, can solve the same technical problems, and achieve the same The technical effects are not repeated here one by one.
综上所述，本发明实施例提供的面向无线头戴显示设备的虚拟现实体感交互系统及方法，能够突破现有虚拟现实设备需要操作者穿戴大量设备而导致真实感和浸入感不够强烈且体验易疲劳的局限性。同时优化了普通图像捕捉设备需要传输的数据量较大，不适合用来作为需要实时大量数据传输、处理的虚拟现实体验系统的数据传输媒介的技术缺陷。In summary, the virtual reality somatosensory interaction system and method for wireless head-mounted display devices provided by the embodiments of the present invention can break through the existing virtual reality devices that require the operator to wear a large number of devices, resulting in insufficient sense of reality and immersion Fatigue limitations. At the same time, it optimizes the technical defect that ordinary image capture equipment needs to transmit a large amount of data, which is not suitable for use as a data transmission medium for a virtual reality experience system that requires real-time large-scale data transmission and processing.
需要说明的是，本发明并不限制为面向无线头戴显示设备的虚拟现实体感交互游戏，应用本发明实现的其他面向无线头戴显示设备的虚拟现实体感交互系统的创作、替代也应在本发明的保护范围之内，例如，也可以为面向无线头戴显示设备的虚拟现实体感交互的医学实验平台等，即本发明实施例中的操作者可以为进行医学实验练习的学生等，学生作为操作者通过本系统进行虚拟的医学实验练习。It should be noted that the present invention is not limited to virtual reality somatosensory interactive games for wireless head-mounted display devices, and the creation and replacement of other virtual reality somatosensory interactive systems for wireless head-mounted display devices implemented by applying the present invention should also be included in this article. Within the scope of protection of the invention, for example, it can also be a medical experiment platform for virtual reality somatosensory interaction oriented to wireless head-mounted display devices, that is, the operator in the embodiment of the present invention can be a student performing medical experiment exercises. The operator performs virtual medical experiment exercises through the system.
在本发明中，术语“第一”、“第二”、“第三”仅用于描述目的，而不能理解为指示或暗示相对重要性。术语“多个”指两个或两个以上，除非另有明确的限定。In the present invention, the terms "first", "second", and "third" are used for descriptive purposes only, and cannot be understood as indicating or implying relative importance. The term "plurality" means two or more, unless otherwise clearly defined.
虽然结合附图描述了本发明的实施方式，但是本领域技术人员可以在不脱离本发明的精神和范围的情况下做出各种修改和变型，这样的修改和变型均落入由所附权利要求所限定的范围之内。Although the embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art can make various modifications and variations without departing from the spirit and scope of the present invention. within the bounds of the requirements.
Claims (9)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610073604.8A CN105739703A (en) | 2016-02-02 | 2016-02-02 | Virtual reality somatosensory interaction system and method for wireless head-mounted display equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610073604.8A CN105739703A (en) | 2016-02-02 | 2016-02-02 | Virtual reality somatosensory interaction system and method for wireless head-mounted display equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105739703A true CN105739703A (en) | 2016-07-06 |
Family
ID=56244787
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610073604.8A Pending CN105739703A (en) | 2016-02-02 | 2016-02-02 | Virtual reality somatosensory interaction system and method for wireless head-mounted display equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105739703A (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106385682A (en) * | 2016-09-21 | 2017-02-08 | 平越 | Multi-functional virtual reality entertainment system and method thereof |
| CN106383581A (en) * | 2016-09-21 | 2017-02-08 | 平越 | Reproduction type virtual reality entertainment system and method |
| CN106385348A (en) * | 2016-09-21 | 2017-02-08 | 平越 | Virtual reality entertainment system with step-by-step identification function and method of virtual reality entertainment system |
| CN106445176A (en) * | 2016-12-06 | 2017-02-22 | 腾讯科技（深圳）有限公司 | Man-machine interaction system and interaction method based on virtual reality technique |
| CN106648054A (en) * | 2016-10-08 | 2017-05-10 | 河海大学常州校区 | Multi-mode interactive method for RealSense-based accompanying robot |
| CN107756376A (en) * | 2017-10-18 | 2018-03-06 | 江西制造职业技术学院 | A kind of space station using anthropomorphic robot is repaired and maintaining method |
| CN107945270A (en) * | 2016-10-12 | 2018-04-20 | 阿里巴巴集团控股有限公司 | A kind of 3-dimensional digital sand table system |
| CN108031116A (en) * | 2017-11-01 | 2018-05-15 | 上海绿岸网络科技股份有限公司 | The VR games systems of action behavior compensation are carried out in real time |
| CN110502115A (en) * | 2019-08-19 | 2019-11-26 | Oppo广东移动通信有限公司 | Interaction method, head-mounted device and storage medium |
| CN113144592A (en) * | 2021-03-03 | 2021-07-23 | 南京爱奇艺智能科技有限公司 | Interaction method of VR equipment and mobile equipment |
| CN115562599A (en) * | 2022-02-25 | 2023-01-03 | 上海惠存展览展示有限公司 | Three-dimensional virtual scene and human body action synthesis display system |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB2345538A (en) * | 1998-11-06 | 2000-07-12 | David James | Optical tracker |
| CN103488291A (en) * | 2013-09-09 | 2014-01-01 | 北京诺亦腾科技有限公司 | Immersion virtual reality system based on motion capture |
| CN103793060A (en) * | 2014-02-14 | 2014-05-14 | 杨智 | User interaction system and method |
| CN104571510A (en) * | 2014-12-30 | 2015-04-29 | 青岛歌尔声学科技有限公司 | Gesture input system and method in 3D scene |
| CN105045398A (en) * | 2015-09-07 | 2015-11-11 | 哈尔滨市一舍科技有限公司 | Virtual reality interaction device based on gesture recognition |
| US20150348327A1 (en) * | 2014-05-30 | 2015-12-03 | Sony Computer Entertainment America Llc | Head Mounted Device (HMD) System Having Interface With Mobile Computing Device for Rendering Virtual Reality Content |
-
2016
- 2016-02-02 CN CN201610073604.8A patent/CN105739703A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB2345538A (en) * | 1998-11-06 | 2000-07-12 | David James | Optical tracker |
| CN103488291A (en) * | 2013-09-09 | 2014-01-01 | 北京诺亦腾科技有限公司 | Immersion virtual reality system based on motion capture |
| CN103793060A (en) * | 2014-02-14 | 2014-05-14 | 杨智 | User interaction system and method |
| US20150348327A1 (en) * | 2014-05-30 | 2015-12-03 | Sony Computer Entertainment America Llc | Head Mounted Device (HMD) System Having Interface With Mobile Computing Device for Rendering Virtual Reality Content |
| CN104571510A (en) * | 2014-12-30 | 2015-04-29 | 青岛歌尔声学科技有限公司 | Gesture input system and method in 3D scene |
| CN105045398A (en) * | 2015-09-07 | 2015-11-11 | 哈尔滨市一舍科技有限公司 | Virtual reality interaction device based on gesture recognition |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106383581A (en) * | 2016-09-21 | 2017-02-08 | 平越 | Reproduction type virtual reality entertainment system and method |
| CN106385348A (en) * | 2016-09-21 | 2017-02-08 | 平越 | Virtual reality entertainment system with step-by-step identification function and method of virtual reality entertainment system |
| CN106385682A (en) * | 2016-09-21 | 2017-02-08 | 平越 | Multi-functional virtual reality entertainment system and method thereof |
| CN106648054A (en) * | 2016-10-08 | 2017-05-10 | 河海大学常州校区 | Multi-mode interactive method for RealSense-based accompanying robot |
| CN106648054B (en) * | 2016-10-08 | 2019-07-16 | 河海大学常州校区 | A Multimodal Interaction Method for Companion Robot Based on RealSense |
| CN107945270A (en) * | 2016-10-12 | 2018-04-20 | 阿里巴巴集团控股有限公司 | A kind of 3-dimensional digital sand table system |
| CN106445176A (en) * | 2016-12-06 | 2017-02-22 | 腾讯科技（深圳）有限公司 | Man-machine interaction system and interaction method based on virtual reality technique |
| CN107756376A (en) * | 2017-10-18 | 2018-03-06 | 江西制造职业技术学院 | A kind of space station using anthropomorphic robot is repaired and maintaining method |
| CN108031116A (en) * | 2017-11-01 | 2018-05-15 | 上海绿岸网络科技股份有限公司 | The VR games systems of action behavior compensation are carried out in real time |
| CN110502115A (en) * | 2019-08-19 | 2019-11-26 | Oppo广东移动通信有限公司 | Interaction method, head-mounted device and storage medium |
| CN110502115B (en) * | 2019-08-19 | 2021-08-13 | Oppo广东移动通信有限公司 | Interaction method, headset and storage medium |
| CN113144592A (en) * | 2021-03-03 | 2021-07-23 | 南京爱奇艺智能科技有限公司 | Interaction method of VR equipment and mobile equipment |
| CN115562599A (en) * | 2022-02-25 | 2023-01-03 | 上海惠存展览展示有限公司 | Three-dimensional virtual scene and human body action synthesis display system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105739703A (en) | Virtual reality somatosensory interaction system and method for wireless head-mounted display equipment | |
| TWI659335B (en) | Graphic processing method and device, virtual reality system, computer storage medium | |
| CN111294665B (en) | Video generation method and device, electronic equipment and readable storage medium | |
| US20200051306A1 (en) | Avatar animation system | |
| CN109671141B (en) | Image rendering method and device, storage medium and electronic device | |
| CN111694429A (en) | Virtual object driving method and device, electronic equipment and readable storage | |
| Gao et al. | An oriented point-cloud view for MR remote collaboration | |
| Roth et al. | A simplified inverse kinematic approach for embodied VR applications | |
| CN105323129A (en) | A home virtual reality entertainment system | |
| CN112198959A (en) | Virtual reality interaction method, device and system | |
| CN107274469A (en) | The coordinative render method of Virtual reality | |
| CN111368137A (en) | Video generation method and device, electronic equipment and readable storage medium | |
| CN106598229A (en) | Virtual reality scene generation method and equipment, and virtual reality system | |
| CN104778654A (en) | Intangible cultural heritage digital display system and method thereof | |
| CN108983974B (en) | AR scene processing method, device, equipment and computer-readable storage medium | |
| CN205068298U (en) | Interaction system is wandered to three -dimensional scene | |
| CN205121943U (en) | Interactive analog simulation sand table based on kinect degree of depth video camera | |
| CN105955483A (en) | Virtual reality terminal and visual virtualization method and device thereof | |
| CN204406327U (en) | Based on the limb rehabilitating analog simulation training system of said three-dimensional body sense video camera | |
| CN106886284A (en) | A kind of Cultural relics in museum interactive system based on Kinect | |
| CN105184622A (en) | Network shopping for consumer by utilization of virtual technology | |
| CN102184342A (en) | Virtual-real fused hand function rehabilitation training system and method | |
| Tan et al. | Virtual reality based immersive telepresence system for remote conversation and collaboration | |
| WO2017061890A1 (en) | Wireless full body motion control sensor | |
| CN108022305A (en) | An AR technology-based viewing experience system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160706 |
|
| RJ01 | Rejection of invention patent application after publication |