[go: up one dir, main page]

CN110045826A - Virtual reality experience methods, devices and systems applied to vehicle - Google Patents

Virtual reality experience methods, devices and systems applied to vehicle Download PDF

Info

Publication number
CN110045826A
CN110045826A CN201910258316.3A CN201910258316A CN110045826A CN 110045826 A CN110045826 A CN 110045826A CN 201910258316 A CN201910258316 A CN 201910258316A CN 110045826 A CN110045826 A CN 110045826A
Authority
CN
China
Prior art keywords
vehicle
experience
virtual reality
image
motion trajectory
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910258316.3A
Other languages
Chinese (zh)
Inventor
尹杰
彭军
楼天城
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Ma Chi Xing Technology Co Ltd
Beijing HX Pony AI Technology Co Ltd
Original Assignee
Beijing Ma Chi Xing Technology Co Ltd
Beijing HX Pony AI Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Ma Chi Xing Technology Co Ltd, Beijing HX Pony AI Technology Co Ltd filed Critical Beijing Ma Chi Xing Technology Co Ltd
Priority to CN201910258316.3A priority Critical patent/CN110045826A/en
Publication of CN110045826A publication Critical patent/CN110045826A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B9/00Simulators for teaching or training purposes
    • G09B9/02Simulators for teaching or training purposes for teaching control of vehicles or other craft
    • G09B9/04Simulators for teaching or training purposes for teaching control of vehicles or other craft for teaching control of land vehicles

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Processing Or Creating Images (AREA)

Abstract

本发明公开了一种应用于车辆的虚拟现实体验方法、装置和系统。其中,车辆包括虚拟现实设备,方法包括:获取虚拟现实设备捕获到的图像,然后基于图像,确定车辆的运动轨迹,并驱动车辆沿着运动轨迹进行移动。本发明解决了相关技术中模拟驾驶车辆体验效果单一,无法满足人们体验需求的技术问题。

The invention discloses a virtual reality experience method, device and system applied to a vehicle. Wherein, the vehicle includes a virtual reality device, and the method includes: acquiring an image captured by the virtual reality device, then determining a motion trajectory of the vehicle based on the image, and driving the vehicle to move along the motion trajectory. The invention solves the technical problem in the related art that the simulated driving vehicle experience effect is single and cannot meet people's experience demands.

Description

应用于车辆的虚拟现实体验方法、装置和系统Method, device and system for virtual reality experience applied to vehicle

技术领域technical field

本发明涉及虚拟现实领域,具体而言,涉及一种应用于车辆的虚拟现实体验方法、装置和系统。The present invention relates to the field of virtual reality, in particular, to a method, device and system for virtual reality experience applied to vehicles.

背景技术Background technique

虚拟现实(Virtual Reality)是仿真技术的一个重要方向,是仿真技术与计算机图形学、人机接口技术、多媒体技术、传感技术、网络技术等多种技术的集合。VR技术主要包括模拟环境、感知、自然技能和传感设备等方面,近几年来,涉及虚拟现实技术的各种设备也出现了井喷式蓬勃发展,在3D电影和一些简单游戏上得到了应用。VR设备的人体工程越来越人性化,消费者的体验正在逐渐升级。Virtual reality is an important direction of simulation technology, which is a collection of simulation technology and computer graphics, human-machine interface technology, multimedia technology, sensor technology, network technology and other technologies. VR technology mainly includes simulated environment, perception, natural skills and sensing equipment. In recent years, various equipment related to virtual reality technology has also experienced a boom, and has been applied in 3D movies and some simple games. The ergonomics of VR equipment are becoming more and more user-friendly, and the consumer experience is gradually being upgraded.

在模拟驾驶领域,由于学员的驾驶经验不足,如何在安全的环境中让学员尽可能感受真实的驾驶环境是一个非常重要的课题。然而,现有的VR教练车在教学过程中只能够提供给学员视觉体验,对学员的触觉体验研究较少,学员在使用教练车练习的过程中,仅依靠视觉来体验整个驾驶过程,模拟真实驾驶环境的体验较差,对学员的吸引力难免不够。In the field of simulated driving, due to the lack of driving experience of the students, how to make the students feel the real driving environment as much as possible in a safe environment is a very important topic. However, the existing VR coach car can only provide students with a visual experience in the teaching process, and there is little research on the tactile experience of the students. During the practice process of using the coach car, the students only rely on the vision to experience the entire driving process, simulating the real experience. The experience of the driving environment is poor, and the attraction to the students is inevitably not enough.

针对相关技术中模拟驾驶车辆体验效果单一,无法满足人们体验需求的技术问题,目前尚未提出有效的解决方案。Aiming at the technical problem that the simulated driving vehicle experience effect in related technologies is single and cannot meet people's experience needs, no effective solution has been proposed yet.

发明内容SUMMARY OF THE INVENTION

本发明实施例提供了一种应用于车辆的虚拟现实体验方法、装置和系统,以至少解决相关技术中模拟驾驶车辆体验效果单一,无法满足人们体验需求的技术问题。Embodiments of the present invention provide a virtual reality experience method, device and system applied to a vehicle, to at least solve the technical problem in the related art that the simulated driving vehicle experience effect is single and cannot meet people's experience needs.

根据本发明实施例的一个方面,提供了一种应用于车辆的虚拟现实体验方法,车辆包括虚拟现实设备,方法包括:获取虚拟现实设备捕获到的图像;基于图像,确定车辆的运动轨迹,并驱动车辆沿着运动轨迹进行移动。According to an aspect of the embodiments of the present invention, a virtual reality experience method applied to a vehicle is provided, the vehicle includes a virtual reality device, and the method includes: acquiring an image captured by the virtual reality device; determining a motion trajectory of the vehicle based on the image, and Drive the vehicle to move along the motion trajectory.

可选地,基于图像,确定车辆的运动轨迹,并驱动车辆沿着运动轨迹进行移动,包括:确定与图像匹配的体验类型和体验时间;基于体验类型和体验时间,计算车辆的运动轨迹;驱动车辆沿着运动轨迹在体验时间内进行移动。Optionally, determining the motion trajectory of the vehicle based on the image, and driving the vehicle to move along the motion trajectory, including: determining the experience type and experience time matching the image; calculating the motion trajectory of the vehicle based on the experience type and the experience time; driving The vehicle moves along the motion trajectory during the experience time.

可选地,在基于图像,确定车辆的运动轨迹,并驱动车辆沿着运动轨迹进行移动之后,方法还包括:采集车辆预设范围内的交通信息;获取虚拟现实设备的图像;基于交通信息和图像确定车辆的状态。Optionally, after determining the motion trajectory of the vehicle based on the image, and driving the vehicle to move along the motion trajectory, the method further includes: collecting traffic information within a preset range of the vehicle; acquiring an image of a virtual reality device; The image determines the state of the vehicle.

可选地,基于交通信息和图像确定车辆的状态,包括:在运动轨迹上没有障碍物且与图像匹配的体验类型不变的情况下,获取车辆的属性信息,其中,属性信息至少包括车辆的载重和储能;基于属性信息计算车辆能够维持体验类型的持续时间;驱动车辆移动持续时间。Optionally, determining the state of the vehicle based on the traffic information and the image includes: obtaining attribute information of the vehicle when there are no obstacles on the motion trajectory and the experience type matched with the image remains unchanged, wherein the attribute information at least includes the vehicle's attribute information. Loading and energy storage; calculating the duration that the vehicle can sustain the experience type based on attribute information; driving the vehicle movement duration.

可选地,基于交通信息和图像确定车辆的状态,包括:在运动轨迹上有障碍物的情况下,停止驱动车辆;基于图像确定待体验类型和待体验时间。Optionally, determining the state of the vehicle based on the traffic information and the image includes: stopping the driving of the vehicle when there is an obstacle on the motion track; determining the type and time to be experienced based on the image.

根据本发明实施例的另一个方面,还提供了一种虚拟现实体验系统,系统包括:虚拟现实设备,内置于车辆中,用于提供虚拟现实捕获到的图像;控制器,与虚拟现实设备相连,用于基于图像,确定车辆的运动轨迹;驱动机构,用于驱动车辆沿着运动轨迹进行移动。According to another aspect of the embodiments of the present invention, a virtual reality experience system is also provided. The system includes: a virtual reality device, which is built in the vehicle and used to provide images captured by the virtual reality; a controller, which is connected to the virtual reality device , which is used to determine the motion trajectory of the vehicle based on the image; the driving mechanism is used to drive the vehicle to move along the motion trajectory.

可选地,基于图像,确定车辆的运动轨迹,包括:确定与图像匹配的体验类型和体验时间;基于体验类型和体验时间,计算车辆的运动轨迹。Optionally, determining the motion trajectory of the vehicle based on the image includes: determining an experience type and experience time matching the image; and calculating the motion trajectory of the vehicle based on the experience type and the experience time.

可选地,驱动车辆沿着运动轨迹进行移动,包括:驱动车辆沿着运动轨迹在体验时间内进行移动。Optionally, driving the vehicle to move along the motion trajectory includes: driving the vehicle to move along the motion trajectory within the experience time.

可选地,系统还包括:采集设备,用于采集车辆预设范围内的交通信息;控制器还用于在驱动车辆沿着运动轨迹进行移动之后,基于虚拟现实设备的实时图像和交通信息确定车辆的状态。Optionally, the system further includes: a collection device for collecting traffic information within a preset range of the vehicle; the controller is further configured to determine based on the real-time image of the virtual reality device and the traffic information after the vehicle is driven to move along the motion track. the state of the vehicle.

可选地,基于虚拟现实设备的实时图像和交通信息确定车辆的状态,包括:在运动轨迹上没有障碍物且实时图像对应的体验类型不变的情况下,获取车辆的属性信息,其中,属性信息至少包括车辆的载重和储能;基于属性信息计算车辆能够维持体验类型的持续时间;驱动车辆运动持续时间。Optionally, determining the state of the vehicle based on the real-time image and traffic information of the virtual reality device includes: obtaining attribute information of the vehicle under the condition that there are no obstacles on the motion trajectory and the experience type corresponding to the real-time image remains unchanged, wherein the attribute The information includes at least the load and energy storage of the vehicle; the duration that the vehicle can maintain the experience type is calculated based on the attribute information; the duration of the driving vehicle movement.

可选地,基于虚拟现实设备的实时图像和交通信息确定车辆的状态,包括:在运动轨迹上有障碍物的情况下,停止驱动车辆;基于实时图像确定待体验类型和待体验时间。Optionally, determining the state of the vehicle based on the real-time image and traffic information of the virtual reality device includes: stopping the driving of the vehicle when there is an obstacle on the motion track; determining the type and time to be experienced based on the real-time image.

根据本发明实施例的另一个方面,还提供了一种应用于车辆的虚拟现实体验装置,包括:获取模块,用于获取虚拟现实设备捕获到的图像;确定模块,用于基于图像,确定车辆的运动轨迹,并驱动车辆沿着运动轨迹进行移动。According to another aspect of the embodiments of the present invention, there is also provided a virtual reality experience device applied to a vehicle, including: an acquisition module for acquiring an image captured by the virtual reality device; a determination module for determining the vehicle based on the image motion trajectory and drive the vehicle to move along the motion trajectory.

根据本发明实施例的另一个方面,还提供了一种存储介质,存储介质包括存储的程序,其中,在程序运行时控制存储介质所在设备执行上述任意一种应用于车辆的虚拟现实体验方法。According to another aspect of the embodiments of the present invention, a storage medium is also provided, the storage medium includes a stored program, wherein when the program runs, the device where the storage medium is located is controlled to execute any of the foregoing virtual reality experience methods applied to vehicles.

根据本发明实施例的另一个方面,还提供了一种处理器,处理器用于运行程序,其中,程序运行时执行上述任意一种应用于车辆的虚拟现实体验方法。According to another aspect of the embodiments of the present invention, a processor is also provided, and the processor is configured to run a program, wherein when the program runs, any one of the foregoing virtual reality experience methods applied to a vehicle is executed.

在本发明实施例中,车辆包括虚拟现实设备,方法包括:获取虚拟现实设备捕获到的图像,然后基于图像,确定车辆的运动轨迹,并驱动车辆沿着运动轨迹进行移动。与现有技术相比,本申请依据虚拟现实设备的图像调整车辆的实际运动轨迹,通过车辆的移动尽可能提供给学员视觉、触觉体验,达到了模拟真实驾驶环境的目的,解决了相关技术中模拟驾驶车辆体验效果单一,无法满足人们体验需求技术问题。In the embodiment of the present invention, the vehicle includes a virtual reality device, and the method includes: acquiring an image captured by the virtual reality device, then determining a motion trajectory of the vehicle based on the image, and driving the vehicle to move along the motion trajectory. Compared with the prior art, the present application adjusts the actual motion trajectory of the vehicle according to the image of the virtual reality device, and provides the students with visual and tactile experience as much as possible through the movement of the vehicle, so as to achieve the purpose of simulating the real driving environment and solve the problem in the related art. The simulated driving vehicle experience has a single effect and cannot meet the technical problems of people's experience needs.

附图说明Description of drawings

此处所说明的附图用来提供对本发明的进一步理解,构成本申请的一部分,本发明的示意性实施例及其说明用于解释本发明,并不构成对本发明的不当限定。在附图中:The accompanying drawings described herein are used to provide a further understanding of the present invention and constitute a part of the present application. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the attached image:

图1是根据本发明实施例一的一种可选的虚拟现实体验系统示意图;1 is a schematic diagram of an optional virtual reality experience system according to Embodiment 1 of the present invention;

图2是根据本申请实施例二的一种可选的应用于车辆的虚拟现实体验方法的流程图;以及FIG. 2 is a flowchart of an optional virtual reality experience method applied to a vehicle according to Embodiment 2 of the present application; and

图3是根据本发明实施例三的一种可选的应用于车辆的虚拟现实体验装置的结构示意图。FIG. 3 is a schematic structural diagram of an optional virtual reality experience device applied to a vehicle according to Embodiment 3 of the present invention.

具体实施方式Detailed ways

为了使本技术领域的人员更好地理解本发明方案,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分的实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都应当属于本发明保护的范围。In order to make those skilled in the art better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only Embodiments are part of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

需要说明的是,本发明的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换,以便这里描述的本发明的实施例能够以除了在这里图示或描述的那些以外的顺序实施。此外,术语“包括”和“具有”以及他们的任何变形,意图在于覆盖不排他的包含,例如,包含了一系列步骤或单元的过程、方法、系统、产品或设备不必限于清楚地列出的那些步骤或单元,而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。It should be noted that the terms "first", "second" and the like in the description and claims of the present invention and the above drawings are used to distinguish similar objects, and are not necessarily used to describe a specific sequence or sequence. It is to be understood that the data so used may be interchanged under appropriate circumstances such that the embodiments of the invention described herein can be practiced in sequences other than those illustrated or described herein. Furthermore, the terms "comprising" and "having" and any variations thereof, are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those expressly listed Rather, those steps or units may include other steps or units not expressly listed or inherent to these processes, methods, products or devices.

实施例1Example 1

在描述本申请的各实施例的进一步细节之前,将参考图1来描述可用于实现本申请的原理的一个可选的虚拟现实体验系统。在其最基本的配置中,图1是根据本发明实施例的虚拟现实体验系统示意图。出于描述的目的,所绘的体系结构仅为合适环境的一个示例,并非对本申请的使用范围或功能提出任何局限。也不应将该系统解释为对图1所示的任一组件或其组合具有任何依赖或需求。Before describing further details of various embodiments of the present application, an alternative virtual reality experience system that may be used to implement the principles of the present application will be described with reference to FIG. 1 . In its most basic configuration, FIG. 1 is a schematic diagram of a virtual reality experience system according to an embodiment of the present invention. For descriptive purposes, the depicted architecture is only one example of a suitable environment, and does not imply any limitation on the scope of use or functionality of this application. Nor should the system be construed as having any reliance or requirement on any one or combination of components shown in Figure 1 .

如图1所示,本申请提供的虚拟现实体验系统包括:虚拟现实设备102、控制器104和驱动机构106。As shown in FIG. 1 , the virtual reality experience system provided by the present application includes: a virtual reality device 102 , a controller 104 and a driving mechanism 106 .

其中,虚拟现实设备102,内置于车辆中,用于提供捕获到的虚拟现实图像。Among them, the virtual reality device 102 is built in the vehicle and used to provide the captured virtual reality image.

一种可选方案中,上述虚拟现实设备捕获到的图像可以显示在车辆的显示屏上,或者车辆的挡风玻璃上,以提供环绕的视觉画面。上述车辆可以内置座椅,座椅上可以提供安全带,用来固定使用者,同时作为各中触觉体验的中介;车内还可以储备安全气囊,保障使用者的人身安全。上述捕获方式可以基于程序下载,也可以基于外部环境的抓取。In an optional solution, the image captured by the above-mentioned virtual reality device may be displayed on the display screen of the vehicle, or on the windshield of the vehicle, so as to provide a surrounding visual picture. The above-mentioned vehicle can have a built-in seat, and a seat belt can be provided on the seat to fix the user and at the same time serve as an intermediary for various tactile experiences; an airbag can also be stored in the vehicle to ensure the personal safety of the user. The above capture method can be based on program download, or can be based on crawling of the external environment.

一种可选方案中,上述虚拟现实图像可以为需要加速、减速、向左、向右、颠簸、急刹等各种场景画面。In an optional solution, the above-mentioned virtual reality images may be images of various scenes that require acceleration, deceleration, leftward, rightward, bumpy, and sudden braking.

控制器104,与虚拟现实设备相连,用于基于图像,确定车辆的运动轨迹。The controller 104, connected with the virtual reality device, is used for determining the movement track of the vehicle based on the image.

一种可选方案中,上述运动轨迹为能产生与虚拟现实图像的场景相匹配的车辆真实移动轨迹。In an optional solution, the above-mentioned movement trajectory is a real movement trajectory of the vehicle that can generate a scene matching the virtual reality image.

例如,当前虚拟现实设备的画面为向左转弯,那么车辆的真实运动轨迹就为向左转弯;当前虚拟现实设备的画面需要产生向左的离心力,那么车辆的真实运动轨迹就为前进或者后退时向右转向。For example, if the current picture of the virtual reality device is to turn left, then the real motion trajectory of the vehicle is to turn left; the current picture of the virtual reality device needs to generate a centrifugal force to the left, then the true motion trajectory of the vehicle is when the vehicle moves forward or backward. Turn right.

驱动机构106,用于驱动车辆沿着运动轨迹进行移动。The driving mechanism 106 is used for driving the vehicle to move along the movement track.

一种可选方案中,上述驱动机构可以为电机、车轮等组成的部件。In an optional solution, the above-mentioned driving mechanism may be a component composed of a motor, a wheel, and the like.

在确定好车辆的运动轨迹后,控制器会控制驱动机构驱动车辆沿着确定的运动轨迹进行移动,以产生和虚拟现实设备提供的画面相符的各种感应力。After the motion trajectory of the vehicle is determined, the controller will control the driving mechanism to drive the vehicle to move along the determined motion trajectory, so as to generate various induction forces consistent with the pictures provided by the virtual reality device.

在一个可选的实施例中,使用者坐在车辆的座椅内,同时系好安全带。当车辆的显示屏上显示的画面为绕着山路左转时,控制器经画面分析,确定车辆的运动轨迹为向左的圆弧,就会控制驱动机构驱动车辆在前进的过程中左转,使用者产生向右的离心力,达到视觉和触觉的统一。此时,如果画面中突然出现一只小动物,车辆会立刻停止,由于惯性使用者会向前倾倒,这时安全气囊打开,确保了使用者的安全,提高了模拟真实环境的体验效果。In an alternative embodiment, the user is seated in the seat of the vehicle while wearing the seat belt. When the picture displayed on the display screen of the vehicle is to turn left around the mountain road, the controller analyzes the picture and determines that the motion trajectory of the vehicle is an arc to the left, and controls the driving mechanism to drive the vehicle to turn left during the forward process. The user generates a rightward centrifugal force to achieve the unity of vision and touch. At this time, if a small animal suddenly appears on the screen, the vehicle will stop immediately, and the user will fall forward due to inertia. At this time, the airbag will be deployed to ensure the safety of the user and improve the experience of simulating the real environment.

基于本申请上述实施例提供的方案,虚拟现实体验系统包括:虚拟现实设备,内置于车辆中,用于提供捕获到的虚拟现实图像;控制器,与虚拟现实设备相连,用于基于图像,确定车辆的运动轨迹;驱动机构,用于驱动车辆沿着运动轨迹进行移动。与现有技术相比,本申请依据虚拟现实设备的图像调整车辆的实际运动轨迹,通过车辆的移动尽可能提供给学员视觉、触觉体验,达到了模拟真实驾驶环境的目的,解决了相关技术中模拟驾驶车辆体验效果单一,无法满足人们体验需求技术问题。Based on the solutions provided by the above-mentioned embodiments of the present application, the virtual reality experience system includes: a virtual reality device built into the vehicle for providing captured virtual reality images; a controller connected to the virtual reality device for determining based on the images The motion trajectory of the vehicle; the drive mechanism is used to drive the vehicle to move along the motion trajectory. Compared with the prior art, the present application adjusts the actual motion trajectory of the vehicle according to the image of the virtual reality device, and provides the students with visual and tactile experience as much as possible through the movement of the vehicle, so as to achieve the purpose of simulating the real driving environment and solve the problem in the related art. The simulated driving vehicle experience has a single effect and cannot meet the technical problems of people's experience needs.

可选地,基于图像,确定车辆的运动轨迹,包括:确定与图像匹配的体验类型和体验时间;基于体验类型和体验时间,计算车辆的运动轨迹。Optionally, determining the motion trajectory of the vehicle based on the image includes: determining an experience type and experience time matching the image; and calculating the motion trajectory of the vehicle based on the experience type and the experience time.

一种可选方案中,上述体验类型可以为加速、减速、向左、向右、颠簸、急刹等,上述体验时间为上述体验类型的维持时间。维持时间保持在合适的范围内,可以确保最佳的体验效果,体验时间的设定原则需要考虑虚拟现实设备画面的持续时间。In an optional solution, the above-mentioned experience type may be acceleration, deceleration, leftward, rightward, bumpy, sudden braking, etc., and the above-mentioned experience time is the maintenance time of the above-mentioned experience type. Keeping the maintenance time within an appropriate range can ensure the best experience effect. The setting principle of the experience time needs to consider the duration of the virtual reality device screen.

虚拟现实设备可以按照预设周期向车辆的控制器发送画面,控制器经分析后,确定与画面匹配的体验类型和体验时间,然后计算出车辆的真实运动轨迹。The virtual reality device can send pictures to the controller of the vehicle according to a preset cycle. After analysis, the controller determines the experience type and experience time that match the picture, and then calculates the real trajectory of the vehicle.

可选地,驱动车辆沿着运动轨迹进行移动,包括:驱动车辆沿着运动轨迹在体验时间内进行移动。Optionally, driving the vehicle to move along the motion trajectory includes: driving the vehicle to move along the motion trajectory within the experience time.

在计算出车辆的真实运动轨迹后,驱动机构就会驱动车辆在体验时间内沿着运动轨迹进行移动,通过车辆的移动产生不同的惯性、离心力等,达到视觉和触觉的统一。After calculating the real motion trajectory of the vehicle, the driving mechanism will drive the vehicle to move along the motion trajectory within the experience time, and generate different inertia and centrifugal force through the movement of the vehicle to achieve the unity of vision and touch.

可选地,系统还包括:采集设备,用于采集车辆预设范围内的交通信息;控制器还用于在驱动车辆沿着运动轨迹进行移动之后,基于虚拟现实设备的实时图像和交通信息确定车辆的状态。Optionally, the system further includes: a collection device for collecting traffic information within a preset range of the vehicle; the controller is further configured to determine based on the real-time image of the virtual reality device and the traffic information after the vehicle is driven to move along the motion track. the state of the vehicle.

一种可选方案中,上述采集设备可以为车辆外置的摄像头,用于采集车辆周围的交通信息;上述交通信息为车辆真实环境中的交通信息。由于驾校中还有其它车辆或人,多台车辆同时行驶不可避免会产生碰撞。此时,实时采集车辆预设范围内的交通信息十分必要。In an optional solution, the above-mentioned collection device may be a camera external to the vehicle, which is used to collect traffic information around the vehicle; the above-mentioned traffic information is the traffic information in the real environment of the vehicle. Since there are other vehicles or people in the driving school, multiple vehicles running at the same time will inevitably collide. At this time, it is very necessary to collect the traffic information within the preset range of the vehicle in real time.

需要说明的是,虚拟现实设备的画面也在不断切换,上一时刻画面确定的体验类型和下一时刻确定的体验类型并不一定相同,因此,当车辆沿着运动轨迹移动时,需要综合考虑虚拟现实设备的实时图像和交通信息来调整车辆的状态。It should be noted that the screen of the virtual reality device is constantly switching, and the experience type determined by the screen at the previous moment is not necessarily the same as the experience type determined at the next moment. Therefore, when the vehicle moves along the motion trajectory, it needs to be comprehensively considered. Real-time images and traffic information from virtual reality devices to adjust the state of the vehicle.

可选地,基于虚拟现实设备的实时图像和交通信息确定车辆的状态,包括:在运动轨迹上没有障碍物且实时图像对应的体验类型不变的情况下,获取车辆的属性信息,其中,属性信息至少包括车辆的载重和储能;基于属性信息计算车辆能够维持体验类型的持续时间;驱动车辆运动持续时间。Optionally, determining the state of the vehicle based on the real-time image and traffic information of the virtual reality device includes: obtaining attribute information of the vehicle under the condition that there are no obstacles on the motion trajectory and the experience type corresponding to the real-time image remains unchanged, wherein the attribute The information includes at least the load and energy storage of the vehicle; the duration that the vehicle can maintain the experience type is calculated based on the attribute information; the duration of the driving vehicle movement.

容易注意到,如果体验类型对应的体验时间过短,使用者还没来得及体验到模拟驾驶的感受,体验就停止了,这样的体验效果势必不佳。因此,如何尽可能大的延长体验时间也是本申请的一个关键点。It is easy to notice that if the experience time corresponding to the experience type is too short, and the user has not had time to experience the feeling of simulated driving, the experience will stop, and the effect of such an experience is bound to be poor. Therefore, how to extend the experience time as much as possible is also a key point of this application.

上述方案经过分析计算后,在确定运行轨迹上没有障碍物且虚拟现实设备的画面对应的体验类型不变的情况下,根据车辆的属性信息,例如载重、油耗等情况,来计算车辆能够维持该体验类型的持续时间,然后驱动该车辆持续行驶该持续时间。这样,在确定好的体验类型下,车辆的运行时间为体验时间和持续时间的总和,大大延长了使用者的体验时间,提高了用户体验。After the above solution is analyzed and calculated, when it is determined that there are no obstacles on the running track and the experience type corresponding to the screen of the virtual reality device remains unchanged, it is calculated according to the attribute information of the vehicle, such as load, fuel consumption, etc., that the vehicle can maintain this condition. Experience the duration of the type and then drive the vehicle for that duration. In this way, under the determined experience type, the running time of the vehicle is the sum of the experience time and the duration, which greatly prolongs the user's experience time and improves the user's experience.

可选地,基于虚拟现实设备的实时图像和交通信息确定车辆的状态,包括:在运动轨迹上有障碍物的情况下,停止驱动车辆;基于实时图像确定待体验类型和待体验时间。Optionally, determining the state of the vehicle based on the real-time image and traffic information of the virtual reality device includes: stopping the driving of the vehicle when there is an obstacle on the motion track; determining the type and time to be experienced based on the real-time image.

上述方案经过分析计算后,在确定运行轨迹上有障碍物的情况下,立即停止驱动车辆,避免发生危险。然后,结合虚拟现实设备的实时图像,确定车辆下一个体验类型和体验时间,例如左转以避开障碍物。当障碍物为另一辆车时,也可以原地静止一段时间等待障碍物自行移开。After the above scheme is analyzed and calculated, when it is determined that there are obstacles on the running track, the driving vehicle is stopped immediately to avoid danger. Then, combined with the real-time imagery of the virtual reality device, the vehicle's next experience type and experience time, such as turning left to avoid obstacles, are determined. When the obstacle is another vehicle, you can also stand still for a period of time and wait for the obstacle to move away by itself.

上述实施例提供的虚拟现实体验系统包括:虚拟现实设备,内置于车辆中,用于提供捕获到的虚拟现实图像;控制器,与虚拟现实设备相连,用于基于图像,确定车辆的运动轨迹;驱动机构,用于驱动车辆沿着运动轨迹进行移动。与现有技术相比,本申请依据虚拟现实设备的图像调整车辆的实际运动轨迹,通过车辆的移动尽可能提供给学员视觉、触觉体验;通过虚拟现实设备的实时图像和交通信息确定车辆的下一个状态;通过计算车辆维持体验类型还可以持续的持续时间,以延长使用者的体验时间,达到了模拟真实驾驶环境的目的,进而解决了相关技术中模拟驾驶车辆体验效果单一,无法满足人们体验需求技术问题。The virtual reality experience system provided by the above embodiment includes: a virtual reality device, built in the vehicle, for providing a captured virtual reality image; a controller, connected with the virtual reality device, for determining the motion trajectory of the vehicle based on the image; The drive mechanism is used to drive the vehicle to move along the motion track. Compared with the prior art, the present application adjusts the actual motion trajectory of the vehicle according to the image of the virtual reality device, and provides the students with visual and tactile experience as much as possible through the movement of the vehicle; A state; by calculating the duration that the vehicle maintains the experience type, it can prolong the user's experience time, achieve the purpose of simulating the real driving environment, and solve the problem that the simulated driving vehicle experience in related technologies is single and cannot satisfy people's experience. Requires technical issues.

实施例2Example 2

在实施例1提供的虚拟现实体验系统下,本实施例提供了一种应用于车辆的虚拟现实体验方法,需要说明的是,在附图的流程图示出的步骤可以在诸如一组计算机可执行指令的计算机系统中执行,并且,虽然在流程图中示出了逻辑顺序,但是在某些情况下,可以以不同于此处的顺序执行所示出或描述的步骤。Under the virtual reality experience system provided in Embodiment 1, this embodiment provides a virtual reality experience method applied to a vehicle. It should be noted that the steps shown in the flowchart of the accompanying drawings can be performed on a computer, such as a group of computers. The instructions are executed in a computer system and, although a logical order is shown in the flowcharts, in some cases the steps shown or described may be performed in an order different from that herein.

图2是根据本发明实施例的应用于车辆的虚拟现实体验方法的流程图,车辆包括虚拟现实设备,如图2所示,该方法包括如下步骤:FIG. 2 is a flowchart of a virtual reality experience method applied to a vehicle according to an embodiment of the present invention. The vehicle includes a virtual reality device. As shown in FIG. 2 , the method includes the following steps:

步骤S202,获取虚拟现实设备捕获到的图像。Step S202, acquiring an image captured by a virtual reality device.

一种可选方案中,上述虚拟现实设备捕获到的图像可以显示在车辆的显示屏上,或者车辆的挡风玻璃上,以提供环绕的视觉画面。上述车辆可以内置座椅,座椅上可以提供安全带,用来固定使用者,同时作为各中触觉体验的中介;车内还可以储备安全气囊,保障使用者的人身安全。上述捕获方式可以基于程序下载,也可以基于外部环境的抓取。In an optional solution, the image captured by the above-mentioned virtual reality device may be displayed on the display screen of the vehicle, or on the windshield of the vehicle, so as to provide a surrounding visual picture. The above-mentioned vehicle can have a built-in seat, and a seat belt can be provided on the seat to fix the user and at the same time serve as an intermediary for various tactile experiences; an airbag can also be stored in the vehicle to ensure the personal safety of the user. The above capture method can be based on program download, or can be based on crawling of the external environment.

一种可选方案中,上述虚拟现实图像可以为需要加速、减速、向左、向右、颠簸、急刹等各种场景画面。In an optional solution, the above-mentioned virtual reality images may be images of various scenes that require acceleration, deceleration, leftward, rightward, bumpy, and sudden braking.

步骤S204,基于图像,确定车辆的运动轨迹,并驱动车辆沿着运动轨迹进行移动。Step S204, based on the image, determine the motion trajectory of the vehicle, and drive the vehicle to move along the motion trajectory.

一种可选方案中,上述运动轨迹为能产生与虚拟现实图像的场景相匹配的车辆真实移动轨迹。In an optional solution, the above-mentioned movement trajectory is a real movement trajectory of the vehicle that can generate a scene matching the virtual reality image.

上述步骤中,在确定好车辆的运动轨迹后,控制器会控制驱动机构驱动车辆沿着确定的运动轨迹进行移动,以产生和虚拟现实设备提供的画面相符的各种感应力。In the above steps, after the motion trajectory of the vehicle is determined, the controller will control the drive mechanism to drive the vehicle to move along the determined motion trajectory, so as to generate various induction forces consistent with the images provided by the virtual reality device.

可选地,上述步骤S204基于图像,确定车辆的运动轨迹,并驱动车辆沿着运动轨迹进行移动,包括:Optionally, the above step S204 determines the motion trajectory of the vehicle based on the image, and drives the vehicle to move along the motion trajectory, including:

步骤S2041,确定与图像匹配的体验类型和体验时间。Step S2041: Determine the experience type and experience time matching the image.

一种可选方案中,上述体验类型可以为加速、减速、向左、向右、颠簸、急刹等,上述体验时间为上述体验类型的维持时间。维持时间保持在合适的范围内,可以确保最佳的体验效果,体验时间的设定原则需要考虑虚拟现实设备画面的持续时间。In an optional solution, the above-mentioned experience type may be acceleration, deceleration, leftward, rightward, bumpy, sudden braking, etc., and the above-mentioned experience time is the maintenance time of the above-mentioned experience type. Keeping the maintenance time within an appropriate range can ensure the best experience effect. The setting principle of the experience time needs to consider the duration of the virtual reality device screen.

虚拟现实设备可以按照预设周期向车辆的控制器发送画面,控制器经分析后,确定与画面匹配的体验类型和体验时间,然后计算出车辆的真实运动轨迹。The virtual reality device can send pictures to the controller of the vehicle according to a preset cycle. After analysis, the controller determines the experience type and experience time that match the picture, and then calculates the real trajectory of the vehicle.

步骤S2042,基于体验类型和体验时间,计算车辆的运动轨迹。Step S2042, based on the experience type and the experience time, calculate the motion trajectory of the vehicle.

步骤S2043,驱动车辆沿着运动轨迹在体验时间内进行移动。Step S2043, the driving vehicle moves along the motion track within the experience time.

在计算出车辆的真实运动轨迹后,驱动机构就会驱动车辆在体验时间内沿着运动轨迹进行移动,通过车辆的移动产生不同的惯性、离心力等,达到视觉和触觉的统一。After calculating the real motion trajectory of the vehicle, the driving mechanism will drive the vehicle to move along the motion trajectory within the experience time, and generate different inertia and centrifugal force through the movement of the vehicle to achieve the unity of vision and touch.

可选地,在步骤S204基于图像,确定车辆的运动轨迹,并驱动车辆沿着运动轨迹进行移动之后,上述方法还包括:Optionally, after determining the motion trajectory of the vehicle based on the image in step S204 and driving the vehicle to move along the motion trajectory, the above method further includes:

步骤S2061,采集车辆预设范围内的交通信息。Step S2061, collecting traffic information within a preset range of the vehicle.

步骤S2062,获取虚拟现实设备的图像。Step S2062, acquiring an image of a virtual reality device.

步骤S2063,基于交通信息和图像确定车辆的状态。Step S2063, the state of the vehicle is determined based on the traffic information and the image.

一种可选方案中,上述采集方式可以为使用车辆外置的摄像头进行采集,以获取车辆周围的交通信息;上述交通信息为车辆真实环境中的交通信息。由于驾校中还有其它车辆或人,多台车辆同时行驶不可避免会产生碰撞。此时,实时采集车辆预设范围内的交通信息十分必要。In an optional solution, the above-mentioned collection method may be collected by using a camera external to the vehicle to obtain traffic information around the vehicle; the above-mentioned traffic information is the traffic information in the real environment of the vehicle. Since there are other vehicles or people in the driving school, multiple vehicles running at the same time will inevitably collide. At this time, it is very necessary to collect the traffic information within the preset range of the vehicle in real time.

需要说明的是,虚拟现实设备的画面也在不断切换,上一时刻画面确定的体验类型和下一时刻确定的体验类型并不一定相同,因此,当车辆沿着运动轨迹移动时,需要综合考虑虚拟现实设备的实时图像和交通信息来调整车辆的状态。It should be noted that the screen of the virtual reality device is constantly switching, and the experience type determined by the screen at the previous moment is not necessarily the same as the experience type determined at the next moment. Therefore, when the vehicle moves along the motion trajectory, it needs to be comprehensively considered. Real-time images and traffic information from virtual reality devices to adjust the state of the vehicle.

可选地,步骤S2063基于交通信息和图像确定车辆的状态,包括:Optionally, step S2063 determines the state of the vehicle based on the traffic information and the image, including:

步骤S20631,在运动轨迹上没有障碍物且与图像匹配的体验类型不变的情况下,获取车辆的属性信息,其中,属性信息至少包括车辆的载重和储能。Step S20631, in the case that there is no obstacle on the motion trajectory and the experience type matched with the image remains unchanged, acquire attribute information of the vehicle, wherein the attribute information at least includes the load and energy storage of the vehicle.

步骤S20632,基于属性信息计算车辆能够维持体验类型的持续时间。Step S20632: Calculate the duration for which the vehicle can maintain the experience type based on the attribute information.

步骤S20633,驱动车辆移动持续时间。Step S20633, drive the vehicle to move for the duration.

容易注意到,如果体验类型对应的体验时间过短,使用者还没来得及体验到模拟驾驶的感受,体验就停止了,这样的体验效果势必不佳。因此,如何尽可能大的延长体验时间也是本申请的一个关键点。It is easy to notice that if the experience time corresponding to the experience type is too short, and the user has not had time to experience the feeling of simulated driving, the experience will stop, and the effect of such an experience is bound to be poor. Therefore, how to extend the experience time as much as possible is also a key point of this application.

上述方案经过分析计算后,在确定运行轨迹上没有障碍物且虚拟现实设备的画面对应的体验类型不变的情况下,根据车辆的属性信息,例如载重、油耗等情况,来计算车辆能够维持该体验类型的持续时间,然后驱动该车辆持续行驶该持续时间。这样,在确定好的体验类型下,车辆的运行时间为体验时间和持续时间的总和,大大延长了使用者的体验时间,提高了用户体验。After the above solution is analyzed and calculated, when it is determined that there are no obstacles on the running track and the experience type corresponding to the screen of the virtual reality device remains unchanged, it is calculated according to the attribute information of the vehicle, such as load, fuel consumption, etc., that the vehicle can maintain this condition. Experience the duration of the type and then drive the vehicle for that duration. In this way, under the determined experience type, the running time of the vehicle is the sum of the experience time and the duration, which greatly prolongs the user's experience time and improves the user's experience.

可选地,步骤S2063基于交通信息和图像确定车辆的状态,包括:Optionally, step S2063 determines the state of the vehicle based on the traffic information and the image, including:

步骤S20634,在运动轨迹上有障碍物的情况下,停止驱动车辆。Step S20634, when there is an obstacle on the motion track, stop driving the vehicle.

步骤S20635,基于图像确定待体验类型和待体验时间。Step S20635: Determine the type of to-be-experienced and the to-be-experienced time based on the image.

上述方案经过分析计算后,在确定运行轨迹上有障碍物的情况下,立即停止驱动车辆,避免发生危险。然后,结合虚拟现实设备的实时图像,确定车辆下一个体验类型和体验时间,例如左转以避开障碍物。当障碍物为另一辆车时,也可以原地静止一段时间等待障碍物自行移开。After the above scheme is analyzed and calculated, when it is determined that there are obstacles on the running track, the driving vehicle is stopped immediately to avoid danger. Then, combined with the real-time imagery of the virtual reality device, the type and time of the vehicle's next experience, such as turning left to avoid obstacles, are determined. When the obstacle is another vehicle, you can also stand still for a period of time and wait for the obstacle to move away by itself.

通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到根据上述实施例的方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端设备(可以是手机,计算机,服务器,或者网络设备等)执行本发明各个实施例所述的方法。From the description of the above embodiments, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is better implementation. Based on this understanding, the technical solutions of the present invention can be embodied in the form of software products in essence or the parts that make contributions to the prior art, and the computer software products are stored in a storage medium (such as ROM/RAM, magnetic disk, CD-ROM), including several instructions to make a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in the various embodiments of the present invention.

实施例3Example 3

根据本发明实施例,提供了一种应用于车辆的虚拟现实体验装置,图3是根据本申请实施例的应用于车辆的虚拟现实体验装置示意图。如图3所示,该装置300包括第一获取模块302和第一确定模块304。According to an embodiment of the present invention, a virtual reality experience device applied to a vehicle is provided. FIG. 3 is a schematic diagram of a virtual reality experience device applied to a vehicle according to an embodiment of the present application. As shown in FIG. 3 , the apparatus 300 includes a first obtaining module 302 and a first determining module 304 .

其中,第一获取模块302,用于获取虚拟现实设备捕获到的图像;第一确定模块304,用于基于图像,确定车辆的运动轨迹,并驱动车辆沿着运动轨迹进行移动。Wherein, the first acquisition module 302 is used to acquire the image captured by the virtual reality device; the first determination module 304 is used to determine the motion trajectory of the vehicle based on the image, and drive the vehicle to move along the motion trajectory.

可选地,第一确定模块包括:第一确定子模块,用于确定与图像匹配的体验类型和体验时间;第一计算模块,用于基于体验类型和体验时间,计算车辆的运动轨迹;第一驱动模块,用于驱动车辆沿着运动轨迹在体验时间内进行移动。Optionally, the first determination module includes: a first determination sub-module for determining the experience type and experience time matched with the image; a first calculation module for calculating the motion trajectory of the vehicle based on the experience type and the experience time; A driving module is used to drive the vehicle to move along the motion track within the experience time.

可选地,上述装置还包括:采集模块,用于在基于图像,确定车辆的运动轨迹,并驱动车辆沿着运动轨迹进行移动之后,采集车辆预设范围内的交通信息;第二获取模块,用于获取虚拟现实设备的图像;第二确定模块,用于基于交通信息和图像确定车辆的状态。Optionally, the above-mentioned device further includes: a collection module, configured to collect traffic information within a preset range of the vehicle after determining the motion trajectory of the vehicle based on the image and driving the vehicle to move along the motion trajectory; the second acquisition module, The second determining module is used for acquiring the image of the virtual reality device, and is used for determining the state of the vehicle based on the traffic information and the image.

可选地,第二确定模块包括:第三获取模块,用于在运动轨迹上没有障碍物且与图像匹配的体验类型不变的情况下,获取车辆的属性信息,其中,属性信息至少包括车辆的载重和储能;第二计算模块,用于基于属性信息计算车辆能够维持体验类型的持续时间;第二驱动模块,用于驱动车辆移动持续时间。Optionally, the second determination module includes: a third acquisition module, configured to acquire attribute information of the vehicle when there are no obstacles on the motion trajectory and the experience type matched with the image remains unchanged, wherein the attribute information at least includes the vehicle. The load and energy storage; the second calculation module is used to calculate the duration that the vehicle can maintain the experience type based on the attribute information; the second drive module is used to drive the vehicle to move for the duration.

可选地,第二确定模块包括:停止模块,用于在运动轨迹上有障碍物的情况下,停止驱动车辆;第三确定模块,用于基于图像确定待体验类型和待体验时间。Optionally, the second determination module includes: a stop module, configured to stop driving the vehicle when there is an obstacle on the motion trajectory; and a third determination module, configured to determine the type of to-be-experienced and the to-be-experienced time based on the image.

需要说明的是,上述第一获取模块302和第一确定模块304对应于实施例2中的步骤S202至步骤S204,上述两个模块与对应的步骤所实现的示例和应用场景相同,但不限于上述实施例2所公开的内容。需要说明的是,上述模块作为装置的一部分可以运行在实施例一提供的虚拟现实体验系统中。It should be noted that the above-mentioned first obtaining module 302 and the first determining module 304 correspond to steps S202 to S204 in Embodiment 2, and the examples and application scenarios implemented by the above-mentioned two modules and the corresponding steps are the same, but not limited to The content disclosed in Example 2 above. It should be noted that, as a part of the apparatus, the above-mentioned modules may run in the virtual reality experience system provided in the first embodiment.

实施例4Example 4

根据本发明实施例,提供了一种存储介质,存储介质包括存储的程序,其中,在程序运行时控制存储介质所在设备执行实施例2中的应用于车辆的虚拟现实体验方法。According to an embodiment of the present invention, a storage medium is provided, the storage medium includes a stored program, wherein when the program runs, the device where the storage medium is located is controlled to execute the virtual reality experience method applied to a vehicle in Embodiment 2.

一种可选方案中,上述存储介质可以位于实施例一提供的虚拟现实体验系统中,也可以独立存在。In an optional solution, the above-mentioned storage medium may be located in the virtual reality experience system provided in the first embodiment, or may exist independently.

根据本发明实施例的另一个方面,还提供了一种处理器,处理器用于运行程序,其中,程序运行时执行上述任意一种应用于车辆的虚拟现实体验方法。According to another aspect of the embodiments of the present invention, a processor is also provided, and the processor is configured to run a program, wherein when the program runs, any one of the foregoing virtual reality experience methods applied to a vehicle is executed.

实施例5Example 5

根据本发明实施例,提供了一种处理器,处理器用于运行程序,其中,在程序运行时执行下述步骤:获取虚拟现实设备的图像;基于图像,确定车辆的运动轨迹,并驱动车辆沿着运动轨迹进行移动。According to an embodiment of the present invention, a processor is provided, and the processor is used for running a program, wherein the following steps are performed when the program is running: acquiring an image of a virtual reality device; determining a motion trajectory of the vehicle based on the image, and driving the vehicle along the move along the trajectory.

进一步地,处理器还可以执行实施例2中其他步骤的指令,此处不再赘述。Further, the processor may also execute the instructions of other steps in Embodiment 2, which will not be repeated here.

本实施例通过硬件平台自动运行处理器,处理器首先获取虚拟现实设备捕获到的图像,然后基于图像,确定车辆的运动轨迹,并驱动车辆沿着运动轨迹进行移动。由此可见,处理器依据虚拟现实设备的图像调整车辆的实际运动轨迹,通过车辆的移动尽可能提供给学员视觉、触觉体验;通过虚拟现实设备的实时图像和交通信息确定车辆的下一个状态;通过计算车辆维持体验类型还可以持续的持续时间,以延长使用者的体验时间,达到了模拟真实驾驶环境的目的,进而解决了相关技术中模拟驾驶车辆体验效果单一,无法满足人们体验需求技术问题。In this embodiment, the hardware platform automatically runs the processor. The processor first acquires the image captured by the virtual reality device, then determines the motion trajectory of the vehicle based on the image, and drives the vehicle to move along the motion trajectory. It can be seen that the processor adjusts the actual motion trajectory of the vehicle according to the image of the virtual reality device, and provides the students with visual and tactile experience as much as possible through the movement of the vehicle; the next state of the vehicle is determined by the real-time image and traffic information of the virtual reality device; By calculating the duration that the vehicle can maintain the experience type, it can prolong the user's experience time, achieve the purpose of simulating the real driving environment, and solve the technical problem that the simulated driving vehicle experience in the related technologies is single and cannot meet people's experience needs. .

上述本发明实施例序号仅仅为了描述,不代表实施例的优劣。The above-mentioned serial numbers of the embodiments of the present invention are only for description, and do not represent the advantages or disadvantages of the embodiments.

在本发明的上述实施例中,对各个实施例的描述都各有侧重,某个实施例中没有详述的部分,可以参见其他实施例的相关描述。In the above-mentioned embodiments of the present invention, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.

在本申请所提供的几个实施例中,应该理解到,所揭露的技术内容,可通过其它的方式实现。其中,以上所描述的装置实施例仅仅是示意性的,例如所述单元的划分,可以为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,单元或模块的间接耦合或通信连接,可以是电性或其它的形式。In the several embodiments provided in this application, it should be understood that the disclosed technical content may be implemented in other ways. The device embodiments described above are only illustrative. For example, the division of the units may be a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or may be Integration into another system, or some features can be ignored, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of units or modules, and may be in electrical or other forms.

所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and components shown as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

另外,在本发明各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units.

所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可为个人计算机、服务器或者网络设备等)执行本发明各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、移动硬盘、磁碟或者光盘等各种可以存储程序代码的介质。The integrated unit, if implemented in the form of a software functional unit and sold or used as an independent product, may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium , including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk and other media that can store program codes .

以上所述仅是本发明的优选实施方式,应当指出,对于本技术领域的普通技术人员来说,在不脱离本发明原理的前提下,还可以做出若干改进和润饰,这些改进和润饰也应视为本发明的保护范围。The above are only the preferred embodiments of the present invention. It should be pointed out that for those skilled in the art, without departing from the principles of the present invention, several improvements and modifications can be made. It should be regarded as the protection scope of the present invention.

Claims (14)

1.一种应用于车辆的虚拟现实体验方法,所述车辆包括虚拟现实设备,其特征在于,所述方法包括:1. A virtual reality experience method applied to a vehicle, the vehicle comprising a virtual reality device, wherein the method comprises: 获取所述虚拟现实设备捕获到的图像;acquiring an image captured by the virtual reality device; 基于所述图像,确定所述车辆的运动轨迹,并驱动所述车辆沿着所述运动轨迹进行移动。Based on the image, a motion trajectory of the vehicle is determined, and the vehicle is driven to move along the motion trajectory. 2.根据权利要求1所述的方法,其特征在于,基于所述图像,确定所述车辆的运动轨迹,并驱动所述车辆沿着所述运动轨迹进行移动,包括:2 . The method according to claim 1 , wherein determining a motion trajectory of the vehicle based on the image, and driving the vehicle to move along the motion trajectory, comprising: 3 . 确定与所述图像匹配的体验类型和体验时间;determine the type of experience and the time of experience that matches the image; 基于所述体验类型和所述体验时间,计算所述车辆的运动轨迹;calculating the motion trajectory of the vehicle based on the experience type and the experience time; 驱动所述车辆沿着所述运动轨迹在所述体验时间内进行移动。The vehicle is driven to move along the motion trajectory within the experience time. 3.根据权利要求1所述的方法,其特征在于,在基于所述图像,确定所述车辆的运动轨迹,并驱动所述车辆沿着所述运动轨迹进行移动之后,所述方法还包括:3 . The method according to claim 1 , wherein after determining the motion trajectory of the vehicle based on the image and driving the vehicle to move along the motion trajectory, the method further comprises: 4 . 采集所述车辆预设范围内的交通信息;collecting traffic information within a preset range of the vehicle; 获取虚拟现实设备的图像;Get images of virtual reality devices; 基于所述交通信息和所述图像确定所述车辆的状态。A state of the vehicle is determined based on the traffic information and the image. 4.根据权利要求3所述的方法,其特征在于,基于所述交通信息和所述图像确定所述车辆的状态,包括:4. The method of claim 3, wherein determining the state of the vehicle based on the traffic information and the image comprises: 在所述运动轨迹上没有障碍物且与所述图像匹配的体验类型不变的情况下,获取所述车辆的属性信息,其中,所述属性信息至少包括所述车辆的载重和储能;Under the condition that there is no obstacle on the motion trajectory and the experience type matched with the image remains unchanged, acquire attribute information of the vehicle, wherein the attribute information at least includes the load and energy storage of the vehicle; 基于所述属性信息计算所述车辆能够维持所述体验类型的持续时间;calculating a duration for which the vehicle can maintain the experience type based on the attribute information; 驱动所述车辆移动所述持续时间。The vehicle is driven for the duration. 5.根据权利要求3所述的方法,其特征在于,基于所述交通信息和所述图像确定所述车辆的状态,包括:5. The method of claim 3, wherein determining the state of the vehicle based on the traffic information and the image comprises: 在所述运动轨迹上有障碍物的情况下,停止驱动所述车辆;Stop driving the vehicle when there is an obstacle on the motion track; 基于所述图像确定待体验类型和待体验时间。The type to experience and the time to experience are determined based on the image. 6.一种虚拟现实体验系统,其特征在于,所述系统包括:6. A virtual reality experience system, wherein the system comprises: 虚拟现实设备,内置于车辆中,用于提供捕获到的虚拟现实图像;Virtual reality equipment, built into the vehicle to provide captured virtual reality images; 控制器,与所述虚拟现实设备相连,用于基于所述图像,确定所述车辆的运动轨迹;a controller, connected to the virtual reality device, for determining the motion trajectory of the vehicle based on the image; 驱动机构,用于驱动所述车辆沿着所述运动轨迹进行移动。The driving mechanism is used for driving the vehicle to move along the movement track. 7.根据权利要求6所述的系统,其特征在于,基于所述图像,确定所述车辆的运动轨迹,包括:7. The system according to claim 6, wherein, based on the image, determining the motion trajectory of the vehicle, comprising: 确定与所述图像匹配的体验类型和体验时间;determine the type of experience and the time of experience that matches the image; 基于所述体验类型和所述体验时间,计算所述车辆的运动轨迹。Based on the experience type and the experience time, a motion trajectory of the vehicle is calculated. 8.根据权利要求7所述的系统,其特征在于,驱动所述车辆沿着所述运动轨迹进行移动,包括:8. The system according to claim 7, wherein driving the vehicle to move along the motion trajectory comprises: 驱动所述车辆沿着所述运动轨迹在所述体验时间内进行移动。The vehicle is driven to move along the motion trajectory within the experience time. 9.根据权利要求6所述的系统,其特征在于,所述系统还包括:9. The system of claim 6, wherein the system further comprises: 采集设备,用于采集所述车辆预设范围内的交通信息;a collection device for collecting traffic information within a preset range of the vehicle; 所述控制器还用于在驱动所述车辆沿着所述运动轨迹进行移动之后,基于所述虚拟现实设备的实时图像和所述交通信息确定所述车辆的状态。The controller is further configured to determine the state of the vehicle based on the real-time image of the virtual reality device and the traffic information after the vehicle is driven to move along the motion track. 10.根据权利要求9所述的系统,其特征在于,基于所述虚拟现实设备的实时图像和所述交通信息确定所述车辆的状态,包括:10. The system according to claim 9, wherein determining the state of the vehicle based on the real-time image of the virtual reality device and the traffic information comprises: 在所述运动轨迹上没有障碍物且所述实时图像对应的体验类型不变的情况下,获取所述车辆的属性信息,其中,所述属性信息至少包括所述车辆的载重和储能;Under the condition that there is no obstacle on the motion trajectory and the experience type corresponding to the real-time image remains unchanged, acquire attribute information of the vehicle, wherein the attribute information at least includes the load and energy storage of the vehicle; 基于所述属性信息计算所述车辆能够维持所述体验类型的持续时间;calculating a duration for which the vehicle can maintain the experience type based on the attribute information; 驱动所述车辆运动所述持续时间。The vehicle is driven for the duration. 11.根据权利要求9所述的系统,其特征在于,基于所述虚拟现实设备的实时图像和所述交通信息确定所述车辆的状态,包括:11. The system according to claim 9, wherein determining the state of the vehicle based on the real-time image of the virtual reality device and the traffic information comprises: 在所述运动轨迹上有障碍物的情况下,停止驱动所述车辆;Stop driving the vehicle when there is an obstacle on the motion track; 基于所述实时图像确定待体验类型和待体验时间。The to-be-experienced type and to-be-experienced time are determined based on the real-time image. 12.一种应用于车辆的虚拟现实体验装置,其特征在于,包括:12. A virtual reality experience device applied to a vehicle, comprising: 获取模块,用于获取虚拟现实设备捕获到的图像;The acquisition module is used to acquire the image captured by the virtual reality device; 确定模块,用于基于所述图像,确定所述车辆的运动轨迹,并驱动所述车辆沿着所述运动轨迹进行移动。A determination module, configured to determine a motion trajectory of the vehicle based on the image, and drive the vehicle to move along the motion trajectory. 13.一种存储介质,其特征在于,所述存储介质包括存储的程序,其中,在所述程序运行时控制所述存储介质所在设备执行权利要求1至5中任意一项所述的应用于车辆的虚拟现实体验方法。13. A storage medium, characterized in that the storage medium comprises a stored program, wherein when the program is run, a device where the storage medium is located is controlled to execute the application described in any one of claims 1 to 5. Methods of virtual reality experience in vehicles. 14.一种处理器,其特征在于,所述处理器用于运行程序,其中,所述程序运行时执行权利要求1至5中任意一项所述的应用于车辆的虚拟现实体验方法。14. A processor, wherein the processor is configured to run a program, wherein when the program runs, the virtual reality experience method applied to a vehicle according to any one of claims 1 to 5 is executed.
CN201910258316.3A 2019-04-01 2019-04-01 Virtual reality experience methods, devices and systems applied to vehicle Pending CN110045826A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910258316.3A CN110045826A (en) 2019-04-01 2019-04-01 Virtual reality experience methods, devices and systems applied to vehicle

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910258316.3A CN110045826A (en) 2019-04-01 2019-04-01 Virtual reality experience methods, devices and systems applied to vehicle

Publications (1)

Publication Number Publication Date
CN110045826A true CN110045826A (en) 2019-07-23

Family

ID=67275880

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910258316.3A Pending CN110045826A (en) 2019-04-01 2019-04-01 Virtual reality experience methods, devices and systems applied to vehicle

Country Status (1)

Country Link
CN (1) CN110045826A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113642111A (en) * 2021-08-20 2021-11-12 Oppo广东移动通信有限公司 Safety protection method and device, medium, electronic equipment and vehicle

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1997019398A1 (en) * 1995-11-24 1997-05-29 Philips Electronics N.V. A method for presenting virtual reality enhanced with tactile stimuli, and a system for executing the method
JP2000112334A (en) * 1998-10-07 2000-04-21 Mitsubishi Heavy Ind Ltd Driving operation training device
RU160084U1 (en) * 2015-07-20 2016-02-27 Общество с ограниченной ответственностью "АВИАРЕАЛ" DRIVING SIMULATOR OF VIRTUAL REALITY WITH ADDITION OF REAL OBJECTS
US20170103571A1 (en) * 2015-10-13 2017-04-13 Here Global B.V. Virtual Reality Environment Responsive to Predictive Route Navigation
US20170236328A1 (en) * 2016-02-12 2017-08-17 Disney Enterprises, Inc. Method for motion-synchronized ar or vr entertainment experience
US20180040163A1 (en) * 2016-08-05 2018-02-08 Uber Technologies, Inc. Virtual reality experience for a vehicle
CN107945604A (en) * 2017-12-07 2018-04-20 中国航空工业集团公司西安航空计算技术研究所 A kind of traffic safety immersion experiencing system based on virtual reality technology
WO2018097818A1 (en) * 2016-11-22 2018-05-31 Ford Global Technologies, Llc Virtual reality interface to an autonomous vehicle
CN108452524A (en) * 2018-02-24 2018-08-28 江苏斯当特动漫设备制造有限公司 A kind of virtual reality racing car that can generate acceleration sense organ
CN108922307A (en) * 2018-07-26 2018-11-30 杭州拓叭吧科技有限公司 Drive simulating training method, device and driving simulation system
US20190019329A1 (en) * 2017-07-14 2019-01-17 Lyft, Inc. Providing a virtual reality transportation experience

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1997019398A1 (en) * 1995-11-24 1997-05-29 Philips Electronics N.V. A method for presenting virtual reality enhanced with tactile stimuli, and a system for executing the method
JP2000112334A (en) * 1998-10-07 2000-04-21 Mitsubishi Heavy Ind Ltd Driving operation training device
RU160084U1 (en) * 2015-07-20 2016-02-27 Общество с ограниченной ответственностью "АВИАРЕАЛ" DRIVING SIMULATOR OF VIRTUAL REALITY WITH ADDITION OF REAL OBJECTS
US20170103571A1 (en) * 2015-10-13 2017-04-13 Here Global B.V. Virtual Reality Environment Responsive to Predictive Route Navigation
US20170236328A1 (en) * 2016-02-12 2017-08-17 Disney Enterprises, Inc. Method for motion-synchronized ar or vr entertainment experience
US20180040163A1 (en) * 2016-08-05 2018-02-08 Uber Technologies, Inc. Virtual reality experience for a vehicle
WO2018097818A1 (en) * 2016-11-22 2018-05-31 Ford Global Technologies, Llc Virtual reality interface to an autonomous vehicle
US20190019329A1 (en) * 2017-07-14 2019-01-17 Lyft, Inc. Providing a virtual reality transportation experience
CN107945604A (en) * 2017-12-07 2018-04-20 中国航空工业集团公司西安航空计算技术研究所 A kind of traffic safety immersion experiencing system based on virtual reality technology
CN108452524A (en) * 2018-02-24 2018-08-28 江苏斯当特动漫设备制造有限公司 A kind of virtual reality racing car that can generate acceleration sense organ
CN108922307A (en) * 2018-07-26 2018-11-30 杭州拓叭吧科技有限公司 Drive simulating training method, device and driving simulation system

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113642111A (en) * 2021-08-20 2021-11-12 Oppo广东移动通信有限公司 Safety protection method and device, medium, electronic equipment and vehicle

Similar Documents

Publication Publication Date Title
US10825350B2 (en) Virtual reality driver training and assessment system
CN104851330B (en) A kind of parking simulated training method and system
US20200171386A1 (en) Reality vs virtual reality racing
JP2020527432A5 (en)
CN109636924A (en) Vehicle multi-mode formula augmented reality system based on real traffic information three-dimensional modeling
CN107004363A (en) Image processing apparatus and in-vehicle display system and display device and image processing method and image processing program
WO2022017139A1 (en) Parking display method and vehicle
US20240095418A1 (en) System and method for an augmented-virtual reality driving simulator using a vehicle
Serrano et al. Insertion of real agents behaviors in CARLA autonomous driving simulator
CN113539010B (en) Driving simulation method, device, equipment and storage medium
CN110045826A (en) Virtual reality experience methods, devices and systems applied to vehicle
WO2013041152A1 (en) Methods to command a haptic renderer from real motion data
CN108429793B (en) Vehicle physics simulation method, system, client, electronic device and server
CN210804847U (en) Remote control driving system
CN114840092A (en) Method, device, equipment and storage medium for interacting with vehicle-mounted display equipment
CN113805495A (en) Remote automatic driving simulation control method, device and system and electronic equipment
CN111800542A (en) Information prompting method, information prompting platform and terminal
CN108446644A (en) A kind of virtual display system for New-energy electric vehicle
CN118742799A (en) A test environment for urban human-computer interaction
CN114898530A (en) A detection method and detection equipment for fatigue driving
CN111477042A (en) Safety education interaction system based on augmented reality and interaction control method thereof
CN202605707U (en) Interactive experience system for avoiding hidden weapons
CN107596682A (en) A method and system for implementing VR virtual interactive skiing
Moniri et al. Eyevius: Intelligent vehicles in intelligent urban spaces
CN114491787A (en) Multi-vehicle multi-simulator linkage driving system and data processing method thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20190723