[go: up one dir, main page]

CN115474177A - Communication method, device, electronic device and storage medium of vehicle-mounted VR equipment - Google Patents

Communication method, device, electronic device and storage medium of vehicle-mounted VR equipment Download PDF

Info

Publication number
CN115474177A
CN115474177A CN202210201030.3A CN202210201030A CN115474177A CN 115474177 A CN115474177 A CN 115474177A CN 202210201030 A CN202210201030 A CN 202210201030A CN 115474177 A CN115474177 A CN 115474177A
Authority
CN
China
Prior art keywords
vehicle
data
data packet
target
inertial measurement
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210201030.3A
Other languages
Chinese (zh)
Inventor
丁彬
傅强
帅一帆
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Co Wheels Technology Co Ltd
Original Assignee
Beijing Co Wheels Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Co Wheels Technology Co Ltd filed Critical Beijing Co Wheels Technology Co Ltd
Priority to CN202210201030.3A priority Critical patent/CN115474177A/en
Publication of CN115474177A publication Critical patent/CN115474177A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/30Services specially adapted for particular environments, situations or purposes
    • H04W4/40Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P]
    • H04W4/48Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P] for in-vehicle communication
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

The disclosure provides a communication method and device of vehicle-mounted VR equipment, computer equipment and a storage medium, and relates to the technical field of communication. The method comprises the following steps: receiving a data packet sent by the vehicle-mounted VR equipment through a wireless network; in response to the fact that the data packet is determined to be target subscription data, generating a target picture to be displayed according to the camera data and the inertia measurement information contained in the data packet; and sending the target picture to be displayed to the vehicle-mounted VR equipment through a wireless network. Therefore, wifi is used as a carrier for transmitting information to communicate, data transmission in a wireless mode of the vehicle-mounted VR device can be achieved, and VR experience of a user is improved.

Description

车载VR设备的通信方法、装置、电子设备及存储介质Communication method, device, electronic device and storage medium of vehicle-mounted VR equipment

技术领域technical field

本公开涉及通信技术领域,尤其涉及一种车载VR设备的通信方法、装置、电子设备及存储介质。The present disclosure relates to the technical field of communication, and in particular, to a communication method, device, electronic device and storage medium of a vehicle-mounted VR device.

背景技术Background technique

目前车载VR(Virtual Reality,虚拟现实)都是通过有线方式实现通信的,也即通常是通过双c线缆将VR头显与车辆连接起来,从而实现了信号传输。然而有线的方式会让用户感觉到不够舒服自然,同时外观看过去也像是在打吊瓶,非常不美观。因而,如何实现车载VR头显的无线通信是当今需要解决的问题。At present, vehicle-mounted VR (Virtual Reality, virtual reality) all realizes communication through wired means, that is, the VR headset is usually connected to the vehicle through a double-c cable, thereby realizing signal transmission. However, the wired method will make users feel uncomfortable and natural, and at the same time, the appearance looks like a bottle in the past, which is very unsightly. Therefore, how to realize the wireless communication of the vehicle-mounted VR headset is a problem that needs to be solved today.

发明内容Contents of the invention

本公开旨在至少在一定程度上解决相关技术中的技术问题之一。The present disclosure aims to solve one of the technical problems in the related art at least to a certain extent.

本公开第一方面实施例提出了一种车载VR设备的通信方法,包括:The embodiment of the first aspect of the present disclosure proposes a communication method for a vehicle-mounted VR device, including:

接收车载VR设备通过无线网络发送的数据包;Receive the data packets sent by the vehicle-mounted VR device through the wireless network;

响应于确定所述数据包为目标订阅数据,根据所述数据包中包含的摄像数据和惯性测量信息,生成目标待显示画面;In response to determining that the data packet is target subscription data, generate a target to-be-displayed picture according to the camera data and inertial measurement information contained in the data packet;

将所述目标待显示画面通过无线网络发送至所述车载VR设备。Sending the target to-be-displayed image to the vehicle-mounted VR device through a wireless network.

本公开第二方面实施例提出了一种车载VR设备的通信装置,包括:The embodiment of the second aspect of the present disclosure proposes a communication device for a vehicle-mounted VR device, including:

接收模块,用于接收车载VR设备通过无线网络发送的数据包;The receiving module is used to receive the data packet sent by the vehicle-mounted VR device through the wireless network;

生成模块,用于响应于确定所述数据包为目标订阅数据,根据所述数据包中包含的摄像数据和惯性测量信息,生成目标待显示画面;A generating module, configured to generate a target image to be displayed according to the camera data and inertial measurement information contained in the data packet in response to determining that the data packet is target subscription data;

发送模块,用于将所述目标待显示画面通过无线网络发送至所述车载VR设备。A sending module, configured to send the target image to be displayed to the vehicle-mounted VR device through a wireless network.

本公开第三方面实施例提出了一种计算机设备,包括:存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,所述处理器执行所述程序时,实现如本公开第一方面实施例提出的车载VR设备的通信方法。The embodiment of the third aspect of the present disclosure proposes a computer device, including: a memory, a processor, and a computer program stored in the memory and operable on the processor. When the processor executes the program, it realizes the A communication method for a vehicle-mounted VR device proposed in the embodiment of the first aspect.

本公开第四方面实施例提出了一种非临时性计算机可读存储介质,存储有计算机程序,所述计算机程序被处理器执行时实现如本公开第一方面实施例提出的车载VR设备的通信方法。The embodiment of the fourth aspect of the present disclosure proposes a non-transitory computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the communication of the vehicle-mounted VR device as proposed in the embodiment of the first aspect of the present disclosure is realized. method.

本公开第五方面实施例提出了一种计算机程序产品,当所述计算机程序产品中的指令处理器执行时,执行本公开第一方面提出的车载VR设备的通信方法。The embodiment of the fifth aspect of the present disclosure provides a computer program product, and when the instruction processor in the computer program product is executed, executes the communication method for the vehicle-mounted VR device proposed in the first aspect of the present disclosure.

本公开提供的车载VR设备的通信方法、装置、计算机设备及存储介质,存在如下有益效果:The communication method, device, computer equipment, and storage medium of the vehicle-mounted VR equipment provided by the present disclosure have the following beneficial effects:

本公开实施例中,车机首先接收车载VR设备通过无线网络发送的数据包,响应于确定所述数据包为目标订阅数据,根据所述数据包中包含的摄像数据和惯性测量信息,生成目标待显示画面;将所述目标待显示画面通过无线网络发送至所述车载VR设备。由此,以wifi作为传输信息的载体进行通信,可以实现车载VR设备无线方式的数据传输,也即可以保障与车载VR设备之间的无线通信,从而提高了用户的VR体验。In the embodiment of the present disclosure, the vehicle machine first receives the data packet sent by the vehicle-mounted VR device through the wireless network, and in response to determining that the data packet is target subscription data, generates a target according to the camera data and inertial measurement information contained in the data packet. The picture to be displayed: sending the target picture to be displayed to the vehicle-mounted VR device through a wireless network. Therefore, using wifi as the carrier of information transmission for communication can realize the wireless data transmission of the vehicle-mounted VR device, that is, can ensure the wireless communication with the vehicle-mounted VR device, thereby improving the user's VR experience.

本公开附加的方面和优点将在下面的描述中部分给出,部分将从下面的描述中变得明显,或通过本公开的实践了解到。Additional aspects and advantages of the disclosure will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the disclosure.

附图说明Description of drawings

本公开上述的和/或附加的方面和优点从下面结合附图对实施例的描述中将变得明显和容易理解,其中:The above and/or additional aspects and advantages of the present disclosure will become apparent and understandable from the following description of the embodiments in conjunction with the accompanying drawings, wherein:

图1为本公开第一实施例所提供的车载VR设备的通信方法的流程示意图;FIG. 1 is a schematic flowchart of a communication method for a vehicle-mounted VR device provided by a first embodiment of the present disclosure;

图2为本公开第二实施例所提供的车载VR设备的通信方法的流程示意图;FIG. 2 is a schematic flowchart of a communication method for a vehicle-mounted VR device provided by a second embodiment of the present disclosure;

图3为本公开第三实施例所提供的车载VR设备的通信装置的结构框图;FIG. 3 is a structural block diagram of a communication device for a vehicle-mounted VR device provided by a third embodiment of the present disclosure;

图4示出了适于用来实现本公开实施方式的示例性计算机设备的框图。Figure 4 shows a block diagram of an exemplary computer device suitable for use in implementing embodiments of the present disclosure.

具体实施方式detailed description

下面详细描述本公开的实施例,所述实施例的示例在附图中示出,其中自始至终相同或类似的标号表示相同或类似的元件或具有相同或类似功能的元件。下面通过参考附图描述的实施例是示例性的,旨在用于解释本公开,而不能理解为对本公开的限制。Embodiments of the present disclosure are described in detail below, examples of which are illustrated in the drawings, in which the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary and are intended to explain the present disclosure and should not be construed as limiting the present disclosure.

下面参考附图描述本公开实施例的车载VR设备的通信方法、装置、计算机设备和存储介质。The following describes the communication method, device, computer equipment and storage medium of the vehicle-mounted VR device according to the embodiments of the present disclosure with reference to the accompanying drawings.

图1为本公开第一实施例所提供的车载VR设备的通信方法的流程示意图。FIG. 1 is a schematic flowchart of a communication method for a vehicle-mounted VR device provided by a first embodiment of the present disclosure.

需要说明的是,本公开第一实施例中的车载VR设备的通信方法的执行主体为车载VR设备的通信装置,该装置可以由软件和/或硬件的方式实现,该装置可以配置在车机的服务器中,下面将以“车机”作为执行主体对本公开第一实施例中提出的车载VR设备的通信方法进行说明,在此不进行限定。It should be noted that the communication method of the vehicle-mounted VR device in the first embodiment of the present disclosure is executed by the communication device of the vehicle-mounted VR device, which can be realized by software and/or hardware, and which can be configured in the vehicle In the server of the present disclosure, the communication method of the vehicle-mounted VR device proposed in the first embodiment of the present disclosure will be described below with "vehicle-machine" as the execution subject, and no limitation is made here.

如图1所示,该车载VR设备的通信方法可以包括以下步骤:As shown in Figure 1, the communication method of the vehicle-mounted VR device may include the following steps:

步骤101,接收车载VR设备通过无线网络发送的数据包。Step 101, receiving a data packet sent by a vehicle-mounted VR device through a wireless network.

其中,车载VR设备可以为VR头显,VR眼镜,在此不做限定。Wherein, the vehicle-mounted VR device may be a VR headset or VR glasses, which are not limited here.

需要说明的是,车载VR设备作为一种显示设备,可以只安装一个wifi模块来进行数据的接收和发送,以实现车载VR设备的轻量化,减轻用户头部负担。It should be noted that, as a display device, the vehicle-mounted VR device can only install a wifi module to receive and send data, so as to realize the lightweight of the vehicle-mounted VR device and reduce the burden on the user's head.

由于在车载VR设备中布置了wifi模块,因而在车载VR设备进入车内后可以自动与车机wifi模块进行连接,从而建立无线通路,可以实现无线的数据传输和发送。Since the wifi module is arranged in the vehicle-mounted VR device, the vehicle-mounted VR device can automatically connect with the vehicle-mounted wifi module after entering the vehicle, thereby establishing a wireless path and realizing wireless data transmission and sending.

可理解的是,在车机和车载VR设备之间建立了无线网络的连接(wifi连接)之后,车载VR设备可以将在该通道上将自己实时产生的数据以数据包的形式发送至车机。其中,数据包括但不限于车载VR设备中VR眼镜上的摄像头拍摄的画面、VR眼镜中IMU数据(惯性测量信息)。It is understandable that after a wireless network connection (wifi connection) is established between the vehicle-mounted VR device and the vehicle-mounted VR device, the vehicle-mounted VR device can send the data generated by itself in real time on this channel to the vehicle-mounted device in the form of data packets. . Wherein, the data includes but is not limited to the picture taken by the camera on the VR glasses in the vehicle-mounted VR device, and the IMU data (inertial measurement information) in the VR glasses.

步骤102,响应于确定所述数据包为目标订阅数据,根据所述数据包中包含的摄像数据和惯性测量信息,生成目标待显示画面。Step 102, in response to determining that the data packet is target subscription data, generate a target image to be displayed according to the camera data and inertial measurement information included in the data packet.

其中,目标订阅数据可以为满足预设的订阅条件的数据。在车机接收到数据包之后,可以将其发送至input系统(输入系统)进行判断。若当前的数据包为目标订阅数据,则可以将该数据作为待使用的数据用于之后的计算。若当前的数据包不为目标订阅数据,车机则可以将数据包信息发送至缓冲器中挤压丢弃,在此不做限定。由此,可以只有在数据包数据为目标订阅数据,也即数据包中的信息为订阅信息,也即有效信息时,对该信息可以进行利用,从而能够对信息进行过滤和筛选,保障了待计算信息的可用度。Wherein, the target subscription data may be data satisfying a preset subscription condition. After the car machine receives the data packet, it can be sent to the input system (input system) for judgment. If the current data package is the target subscription data, the data can be used as the data to be used for subsequent calculations. If the current data packet is not the target subscription data, the car machine can send the data packet information to the buffer to squeeze and discard, which is not limited here. Therefore, only when the data packet data is the target subscription data, that is, when the information in the data packet is subscription information, that is, valid information, the information can be used, so that the information can be filtered and screened, ensuring the Calculate the availability of information.

其中,目标待显示画面可以为待显示于车载VR设备中的画面。Wherein, the target image to be displayed may be an image to be displayed in the vehicle-mounted VR device.

其中,摄像数据可以为车载VR设备的摄像头在车内拍摄的画面,其可以为多帧图像,用于获取车内的场景信息。Wherein, the camera data may be a picture captured by a camera of the vehicle-mounted VR device in the vehicle, which may be a multi-frame image, and is used to obtain scene information in the vehicle.

其中,惯性测量信息可以用于测量用户的姿态信息,由于VR设备是被用户佩戴在头部,因而其可以检测到头部向不同方向的自由转动的角度,或者,还可以为俯仰角。Among them, the inertial measurement information can be used to measure the posture information of the user. Since the VR device is worn by the user on the head, it can detect the angle of free rotation of the head in different directions, or it can also be the pitch angle.

具体的,惯性测量信息可以由车载VR设备中的惯性传感器(Inertialmeasurement unit,IMU)获取。其中,惯性传感器包括加速度计和陀螺仪。Specifically, the inertial measurement information may be acquired by an inertial sensor (Inertialmeasurement unit, IMU) in the vehicle-mounted VR device. Among them, inertial sensors include accelerometers and gyroscopes.

本公开中,可以选用具有6自由度的车载VR设备,其不仅可以检测头部的转动带来的视野角度变化,还能够检测到由于身体移动带来的上下前后左右位移的变化。In the present disclosure, a vehicle-mounted VR device with 6 degrees of freedom can be selected, which can not only detect the change of field of view angle caused by the rotation of the head, but also detect the change of up, down, front, back, left, and right displacement caused by body movement.

需要说明的是,本公开中,车机可以根据数据包中包含的惯性测量信息解算当前用户在车内的姿态,以及根据摄像数据确定用户在车内的位置。车机可以通过车载VR处理器,将位移数据以及姿态信息发送至图形处理器,从而图形处理器可以对画面进行渲染绘制处理,从而生成目标显示画面。It should be noted that, in this disclosure, the car machine can calculate the current posture of the user in the car according to the inertial measurement information contained in the data packet, and determine the position of the user in the car according to the camera data. The car machine can send displacement data and attitude information to the graphics processor through the on-board VR processor, so that the graphics processor can render and draw the picture to generate the target display picture.

步骤103,将所述目标待显示画面通过无线网络发送至所述车载VR设备。Step 103, sending the target image to be displayed to the vehicle-mounted VR device through a wireless network.

具体的,车机可以通过无线网络将目标待显示画面发送至车载VR设备进行显示,车载VR设备可以根据接收到的画面进行分割,并送至不同的显示器中进行显示。Specifically, the vehicle machine can send the target to-be-displayed picture to the vehicle-mounted VR device for display through the wireless network, and the vehicle-mounted VR device can divide the received picture and send it to different monitors for display.

本公开实施例中,车机首先接收车载VR设备通过无线网络发送的数据包,响应于确定所述数据包为目标订阅数据,根据所述数据包中包含的摄像数据和惯性测量信息,生成目标待显示画面;将所述目标待显示画面通过无线网络发送至所述车载VR设备。由此,以wifi作为传输信息的载体进行通信,可以实现车载VR设备无线方式的数据传输,也即可以保障与车载VR设备之间的无线通信,从而提高了用户的VR体验。In the embodiment of the present disclosure, the vehicle machine first receives the data packet sent by the vehicle-mounted VR device through the wireless network, and in response to determining that the data packet is target subscription data, generates a target according to the camera data and inertial measurement information contained in the data packet. The picture to be displayed: sending the target picture to be displayed to the vehicle-mounted VR device through a wireless network. Therefore, using wifi as the carrier of information transmission for communication can realize the wireless data transmission of the vehicle-mounted VR device, that is, can ensure the wireless communication with the vehicle-mounted VR device, thereby improving the user's VR experience.

图2是根据本公开第二实施例的车载VR设备的通信方法的流程示意图。Fig. 2 is a schematic flowchart of a communication method for a vehicle-mounted VR device according to a second embodiment of the present disclosure.

如图2所示,该车载VR设备的通信方法可以包括以下步骤:As shown in Figure 2, the communication method of the vehicle-mounted VR device may include the following steps:

步骤201,接收车载VR设备通过无线网络发送的广播消息。Step 201, receiving a broadcast message sent by a vehicle-mounted VR device through a wireless network.

需要说明的是,可以在车载VR设备中植入wifi模块,来进行数据的发送和接收,而所要显示的数据依旧由车机提供。其中,wifi可以选用wifi6,且达到8stream,以保证带宽达到9.6Gbps,实现满跑。因为车载VR设备采用可以接收的刷新率、并采用DSC压缩后,最少需要9Gbps的带宽。It should be noted that a wifi module can be implanted in the vehicle-mounted VR device to send and receive data, and the data to be displayed is still provided by the vehicle. Among them, wifi can choose wifi6, and reach 8stream, to ensure the bandwidth reaches 9.6Gbps, to achieve full running. Because the vehicle-mounted VR device uses an acceptable refresh rate and uses DSC compression, it needs at least 9Gbps of bandwidth.

其中,无线网络可以为wifi。Wherein, the wireless network may be wifi.

具体的,在车机开启工作后,wifi可以在后台开始进行轮询,以监听特定信息。当车载VR设备开机后,开始使用wifi发送特殊广播,该广播包含vendor信息(厂商信息)和mac信息(物理地址信息)。Specifically, after the car machine is turned on, the wifi can start polling in the background to monitor specific information. When the vehicle-mounted VR device is turned on, it starts to use wifi to send a special broadcast, which contains vendor information (manufacturer information) and mac information (physical address information).

步骤202,对所述广播消息进行解析,以确定所述广播消息中包含的厂商信息。Step 202, analyze the broadcast message to determine the manufacturer information contained in the broadcast message.

需要说明的是,在车机的wifi监听到该广播消息后,可以解析广播包,以判断广播中的厂商信息是否是车机已经录入的白名单中的一员。It should be noted that after the wifi of the car monitors the broadcast message, it can analyze the broadcast packet to determine whether the manufacturer information in the broadcast is a member of the white list that has been entered in the car.

步骤203,在确定所述厂商信息属于预设的白名单信息的情况下,建立与所述车载VR设备之间的无线连接。Step 203: Establishing a wireless connection with the vehicle-mounted VR device when it is determined that the manufacturer information belongs to the preset white list information.

需要说明的是,若厂商信息属于预设的白名单信息,则车机可以将该厂商信息认定为可信设备,随即与该车载VR设备建立连接,进一步地该设备作为无线接入点接入到wifi网络中,建立无线连接。It should be noted that if the manufacturer's information belongs to the preset white list information, the car machine can identify the manufacturer's information as a trusted device, and then establish a connection with the car VR device, and further access the device as a wireless access point. Go to the wifi network and establish a wireless connection.

可选的,该装置可以根据广播消息中包含的地址标识信息,确定无线连接的名称。其中,地址标识信息可以为mac信息。本公开中,可以将mac地址作为名字命名该无线连接。Optionally, the device may determine the name of the wireless connection according to the address identification information included in the broadcast message. Wherein, the address identification information may be mac information. In the present disclosure, the wireless connection may be named with the mac address as the name.

步骤204,启动车载VR处理器。Step 204, start the vehicle-mounted VR processor.

其中,车载VR处理器可以为车机中的VR设备启动器(vr_lanucher)。Wherein, the vehicle-mounted VR processor may be a VR device initiator (vr_lanucher) in the vehicle.

具体的,在无线连接建立之后,即可启动车机中的车载VR处理器,与此同时,车载VR设备也已经启动了wifi连接,并通过该无线连接将自己实时产生的数据发送至车机。Specifically, after the wireless connection is established, the vehicle-mounted VR processor in the vehicle can be started. At the same time, the vehicle-mounted VR device has also started the wifi connection, and the data generated by itself in real time is sent to the vehicle through the wireless connection. .

步骤205,获取所述VR处理器发送的订阅请求,其中,所述订阅请求中用于订阅车载VR设备发送的摄像数据和惯性测量信息。Step 205, acquiring a subscription request sent by the VR processor, wherein the subscription request is used to subscribe to the camera data and inertial measurement information sent by the vehicle-mounted VR device.

其中,订阅请求可以包括对订阅与摄像数据和惯性测量信息相关联的数据可用性通知的请求。Wherein, the subscription request may include a request to subscribe to data availability notifications associated with camera data and inertial measurement information.

其中,订阅请求可以为VR处理器发送给车机的,在VR处理器启动之后,即可对车载VR设备通过无线网络发送摄像数据和惯性测量信息进行订阅。从而在之后接收车载VR设备通过无线网络发送的数据包之后,对数据进行判断,以确定数据是否为订阅信息。Wherein, the subscription request can be sent by the VR processor to the vehicle, and after the VR processor is started, the vehicle VR device can subscribe to the camera data and inertial measurement information sent by the wireless network. Therefore, after receiving the data packet sent by the vehicle-mounted VR device through the wireless network, the data is judged to determine whether the data is subscription information.

步骤206,接收车载VR设备通过无线网络发送的数据包。Step 206, receiving the data packet sent by the vehicle-mounted VR device through the wireless network.

需要说明的是,步骤206的具体实现方式可以参照上述实施例,在此不进行赘述。It should be noted that, for a specific implementation manner of step 206, reference may be made to the foregoing embodiments, and details are not described here.

步骤207,响应于数据包中包含摄像数据和惯性测量信息,确定所述数据包为目标订阅数据。Step 207, in response to the fact that the data packet contains camera data and inertial measurement information, determine that the data packet is target subscription data.

需要说明的是,摄像数据和惯性测量信息也即为目前的订阅对象,在数据包中包含摄像数据和惯性测量信息的情况下,车机即可确定数据包为目标订阅数据。It should be noted that camera data and inertial measurement information are also the current subscription objects. If the data package contains camera data and inertial measurement information, the vehicle can determine the data package as the target subscription data.

本公开中,车机可以实时的将当前的目标订阅数据加入预设的数据订阅列表,同时,也可以根据需要对订阅对象进行修改和更新。In the present disclosure, the car machine can add the current target subscription data to the preset data subscription list in real time, and at the same time, modify and update the subscription objects as required.

步骤208,根据所述摄像数据中包含的各个图像,确定用户的位移数据。Step 208, determine the user's displacement data according to each image included in the camera data.

其中,摄像数据,也即VR设备(VR眼镜)拍摄所得的画面数据。可以理解的是,由于VR设备可以源源不断的将画面数据传输给车机,也即车机可以获取多组图像画面用于进行计算。Wherein, the camera data, that is, the picture data captured by the VR device (VR glasses). It is understandable that since the VR device can continuously transmit picture data to the car machine, that is, the car machine can obtain multiple sets of image frames for calculation.

可选的,可以通过多组图像中三维空间点,也即像素点的坐标数据,计算当前VR设备所处的位置。具体的,可以通过机器学习算法对多组相邻帧图像进行对比分析,可以对当前VR设备,也即用户的运动情况进行分析,以确定各帧图像对应的相对位置。Optionally, the position of the current VR device can be calculated by using coordinate data of three-dimensional space points in multiple sets of images, that is, pixel points. Specifically, machine learning algorithms can be used to compare and analyze multiple groups of adjacent frame images, and the current VR device, that is, the motion of the user, can be analyzed to determine the relative positions of each frame of images.

或者,可以预先设置有标靶基础图像,也即参考图像。其中,标靶基础图像中可以包含有多个参考区域,比如座位参考区域、车窗参考区域、车门参考区域等等,且每个参考区域中都包含有标定物体(目标物)的空间坐标以及基线等。通过比较摄像数据中的图像与标靶基础图像,可以判断当前VR设备的位置情况,也即在车内的空间位置。Alternatively, a target basic image, that is, a reference image, may be preset. Among them, the target basic image can contain multiple reference areas, such as seat reference area, car window reference area, car door reference area, etc., and each reference area contains the spatial coordinates of the calibration object (target object) and baseline etc. By comparing the image in the camera data with the base image of the target, the current position of the VR device can be judged, that is, the spatial position in the vehicle.

可选的,VR处理器在收到惯性测量信息后可以通过cv的算法把摄像头数据转化为用户的位移数据。Optionally, after receiving the inertial measurement information, the VR processor can convert the camera data into the user's displacement data through the cv algorithm.

步骤209,根据所述惯性测量信息,确定所述用户的姿态信息。Step 209, determine the posture information of the user according to the inertial measurement information.

具体的,VR设备上的惯性测量传感器可以获取VR设备各个时刻的角速度,加速度,俯仰角等偏差数据。由于车内的环境较为的复杂,且处于一种运动的状态,因而可以基于IMU陀螺惯性测量传感器收集不同时刻下VR设备的姿态信息。需要说明的是,由于VR设备需要人佩戴在脑部,也即该IMU测量的姿态信息可以用于表征用户头部的姿态。Specifically, the inertial measurement sensor on the VR device can obtain deviation data such as angular velocity, acceleration, and pitch angle at each moment of the VR device. Since the environment in the car is relatively complex and in a state of motion, the posture information of the VR device at different moments can be collected based on the IMU gyro inertial measurement sensor. It should be noted that since the VR device needs to be worn on the brain, that is, the posture information measured by the IMU can be used to characterize the posture of the user's head.

步骤210,基于所述位移数据以及所述姿态信息,对所述图像进行处理,以生成目标待显示画面。Step 210, based on the displacement data and the posture information, process the image to generate a target image to be displayed.

需要说明的是,车机可以将位移数据以及所述姿态信息再次发送给图形处理器,也即GPU,进行渲染和绘制以生成目标待显示画面。It should be noted that the car machine can send the displacement data and the attitude information to the graphics processor, that is, the GPU, for rendering and drawing to generate a target image to be displayed.

步骤211,将所述目标待显示画面通过无线网络发送至所述车载VR设备。Step 211, sending the target image to be displayed to the vehicle-mounted VR device through a wireless network.

需要说明的是,步骤211的具体实现方式可以参照上述实施例,在此不进行赘述。It should be noted that, for a specific implementation manner of step 211, reference may be made to the foregoing embodiments, and details are not described here.

本公开实施例中,首先接收车载VR设备通过无线网络发送的广播消息,然后对所述广播消息进行解析,以确定所述广播消息中包含的厂商信息,之后在确定所述厂商信息属于预设的白名单信息的情况下,建立与所述车载VR设备之间的无线连接,然后启动车载VR处理器,之后获取所述VR处理器发送的订阅请求,其中,所述订阅请求中用于订阅车载VR设备发送的摄像数据和惯性测量信息,然后接收车载VR设备通过无线网络发送的数据包,之后响应于所述数据包中包含摄像数据和惯性测量信息,确定所述数据包为目标订阅数据,然后根据所述摄像数据中包含的各个图像,确定用户的位移数据,之后根据所述惯性测量信息,确定所述用户的姿态信息,之后基于所述位移数据以及所述姿态信息,对所述图像进行处理,以生成目标待显示画面,最后将所述目标待显示画面通过无线网络发送至所述车载VR设备。由此,车机可以在接收到车载VR设备通过无线网络发送的广播消息之后,根据广播消息中包含的厂商信息确定是否与车载VR设备进行无线连接,并在只有确定收到的数据包为已订阅的数据的前提下,对数据包进行处理,生成目标待显示画面。不仅保障了数据来源的准确度和可靠度,同时也保证了数据的有效性。由于是以wifi作为传输信息的载体进行通信,可以实现车载VR设备无线方式的数据传输,也即可以保障与车载VR设备之间的无线通信,从而提高了用户的VR体验。In the embodiment of the present disclosure, first receive the broadcast message sent by the vehicle-mounted VR device through the wireless network, then analyze the broadcast message to determine the manufacturer information contained in the broadcast message, and then determine that the manufacturer information belongs to the preset In the case of whitelist information, establish a wireless connection with the vehicle-mounted VR device, then start the vehicle-mounted VR processor, and then obtain the subscription request sent by the VR processor, wherein the subscription request is used for subscribing The camera data and inertial measurement information sent by the vehicle-mounted VR device, and then receive the data packet sent by the vehicle-mounted VR device through the wireless network, and then determine that the data packet is the target subscription data in response to the camera data and inertial measurement information contained in the data packet , and then determine the user's displacement data according to each image contained in the camera data, and then determine the user's posture information according to the inertial measurement information, and then based on the displacement data and the posture information, the The image is processed to generate a target image to be displayed, and finally the target image to be displayed is sent to the vehicle-mounted VR device through a wireless network. Thus, after receiving the broadcast message sent by the vehicle-mounted VR device through the wireless network, the car machine can determine whether to wirelessly connect with the vehicle-mounted VR device according to the manufacturer information contained in the broadcast message, and only when it is determined that the received data packet is Under the premise of subscribed data, process the data packet and generate the target screen to be displayed. Not only the accuracy and reliability of the data source are guaranteed, but also the validity of the data is guaranteed. Since wifi is used as the carrier of information transmission for communication, it can realize the wireless data transmission of the vehicle-mounted VR device, that is, it can guarantee the wireless communication with the vehicle-mounted VR device, thereby improving the user's VR experience.

图3为本公开第三实施例所提供的车载VR设备的通信装置的结构示意图。FIG. 3 is a schematic structural diagram of a communication device for a vehicle-mounted VR device provided by a third embodiment of the present disclosure.

如图3所示,该车载VR设备的通信装置300可以包括:接收模块310、生成模块320、发送模块330。As shown in FIG. 3 , the communication device 300 of the vehicle-mounted VR device may include: a receiving module 310 , a generating module 320 , and a sending module 330 .

接收模块,用于接收车载VR设备通过无线网络发送的数据包;The receiving module is used to receive the data packet sent by the vehicle-mounted VR device through the wireless network;

生成模块,用于响应于确定所述数据包为目标订阅数据,根据所述数据包中包含的摄像数据和惯性测量信息,生成目标待显示画面;A generating module, configured to generate a target image to be displayed according to the camera data and inertial measurement information contained in the data packet in response to determining that the data packet is target subscription data;

发送模块,用于将所述目标待显示画面通过无线网络发送至所述车载VR设备。A sending module, configured to send the target image to be displayed to the vehicle-mounted VR device through a wireless network.

可选的,所述接收模块,还包括:Optionally, the receiving module also includes:

接收单元,用于接收车载VR设备通过无线网络发送的广播消息;The receiving unit is used to receive the broadcast message sent by the vehicle-mounted VR device through the wireless network;

确定单元,用于对所述广播消息进行解析,以确定所述广播消息中包含的厂商信息;a determining unit, configured to analyze the broadcast message to determine the manufacturer information contained in the broadcast message;

建立单元,用于在确定所述厂商信息属于预设的白名单信息的情况下,建立与所述车载VR设备之间的无线连接。The establishment unit is configured to establish a wireless connection with the vehicle-mounted VR device when it is determined that the manufacturer information belongs to the preset white list information.

可选的,所述建立单元,还用于:Optionally, the establishment unit is also used for:

启动车载VR处理器;Start the on-board VR processor;

获取所述VR处理器发送的订阅请求,其中,所述订阅请求中用于订阅车载VR设备发送的摄像数据和惯性测量信息。Obtain the subscription request sent by the VR processor, wherein the subscription request is used to subscribe to the camera data and inertial measurement information sent by the vehicle-mounted VR device.

可选的,所述生成模块,具体用于:Optionally, the generating module is specifically used for:

响应于所述数据包中包含摄像数据和惯性测量信息,确定所述数据包为目标订阅数据;In response to the data packet containing camera data and inertial measurement information, determining that the data packet is target subscription data;

根据所述摄像数据中包含的各个图像,确定用户的位移数据;Determine the user's displacement data according to each image contained in the camera data;

根据所述惯性测量信息,确定所述用户的姿态信息;determining posture information of the user according to the inertial measurement information;

基于所述位移数据以及所述姿态信息,对所述图像进行处理,以生成目标待显示画面。Based on the displacement data and the posture information, the image is processed to generate a target image to be displayed.

本公开实施例中,车机首先接收车载VR设备通过无线网络发送的数据包,响应于确定所述数据包为目标订阅数据,根据所述数据包中包含的摄像数据和惯性测量信息,生成目标待显示画面;将所述目标待显示画面通过无线网络发送至所述车载VR设备。由此,以wifi作为传输信息的载体进行通信,可以实现车载VR设备无线方式的数据传输,也即可以保障与车载VR设备之间的无线通信,从而提高了用户的VR体验。In the embodiment of the present disclosure, the vehicle machine first receives the data packet sent by the vehicle-mounted VR device through the wireless network, and in response to determining that the data packet is target subscription data, generates a target according to the camera data and inertial measurement information contained in the data packet. The picture to be displayed: sending the target picture to be displayed to the vehicle-mounted VR device through a wireless network. Therefore, using wifi as the carrier of information transmission for communication can realize the wireless data transmission of the vehicle-mounted VR device, that is, can ensure the wireless communication with the vehicle-mounted VR device, thereby improving the user's VR experience.

为了实现上述实施例,本公开还提出一种计算机设备,包括:存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,处理器执行程序时,实现如本公开前述实施例提出的车载VR设备的通信方法。In order to realize the above-mentioned embodiments, the present disclosure also proposes a computer device, including: a memory, a processor, and a computer program stored on the memory and operable on the processor. When the processor executes the program, the foregoing embodiments of the present disclosure are implemented. A communication method for a vehicle-mounted VR device is proposed.

为了实现上述实施例,本公开还提出一种非临时性计算机可读存储介质,存储有计算机程序,计算机程序被处理器执行时实现如本公开前述实施例提出的车载VR设备的通信方法。In order to realize the above-mentioned embodiments, the present disclosure also proposes a non-transitory computer-readable storage medium storing a computer program. When the computer program is executed by a processor, the communication method of the vehicle-mounted VR device as proposed in the foregoing embodiments of the present disclosure is implemented.

为了实现上述实施例,本公开还提出一种计算机程序产品,当计算机程序产品中的指令处理器执行时,执行如本公开前述实施例提出的车载VR设备的通信方法。In order to realize the above-mentioned embodiments, the present disclosure also proposes a computer program product. When the instruction processor in the computer program product executes, it executes the communication method of the vehicle-mounted VR device as proposed in the foregoing embodiments of the present disclosure.

图4示出了适于用来实现本公开实施方式的示例性计算机设备的框图。图4显示的计算机设备12仅仅是一个示例,不应对本公开实施例的功能和使用范围带来任何限制。Figure 4 shows a block diagram of an exemplary computer device suitable for use in implementing embodiments of the present disclosure. The computer device 12 shown in FIG. 4 is only an example, and should not limit the functions and scope of use of the embodiments of the present disclosure.

如图4所示,计算机设备12以通用计算设备的形式表现。计算机设备12的组件可以包括但不限于:一个或者多个处理器或者处理单元16,系统存储器28,连接不同系统组件(包括系统存储器28和处理单元16)的总线18。As shown in FIG. 4, computer device 12 takes the form of a general-purpose computing device. Components of computer device 12 may include, but are not limited to: one or more processors or processing units 16 , system memory 28 , bus 18 connecting various system components including system memory 28 and processing unit 16 .

总线18表示几类总线结构中的一种或多种,包括存储器总线或者存储器控制器,外围总线,图形加速端口,处理器或者使用多种总线结构中的任意总线结构的局域总线。举例来说,这些体系结构包括但不限于工业标准体系结构(Industry StandardArchitecture;以下简称:ISA)总线,微通道体系结构(Micro Channel Architecture;以下简称:MAC)总线,增强型ISA总线、视频电子标准协会(Video Electronics StandardsAssociation;以下简称:VESA)局域总线以及外围组件互连(Peripheral ComponentInterconnection;以下简称:PCI)总线。Bus 18 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, or a local bus using any of a variety of bus structures. For example, these architectures include but are not limited to Industry Standard Architecture (Industry Standard Architecture; hereinafter referred to as: ISA) bus, Micro Channel Architecture (Micro Channel Architecture; hereinafter referred to as: MAC) bus, enhanced ISA bus, video electronics standard Association (Video Electronics Standards Association; hereinafter referred to as: VESA) local bus and peripheral component interconnection (Peripheral Component Interconnection; hereinafter referred to as: PCI) bus.

计算机设备12典型地包括多种计算机系统可读介质。这些介质可以是任何能够被计算机设备12访问的可用介质,包括易失性和非易失性介质,可移动的和不可移动的介质。Computer device 12 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by computer device 12 and include both volatile and nonvolatile media, removable and non-removable media.

存储器28可以包括易失性存储器形式的计算机系统可读介质,例如随机存取存储器(Random Access Memory;以下简称:RAM)30和/或高速缓存存储器32。计算机设备12可以进一步包括其它可移动/不可移动的、易失性/非易失性计算机系统存储介质。仅作为举例,存储系统34可以用于读写不可移动的、非易失性磁介质(图4未显示,通常称为“硬盘驱动器”)。尽管图4中未示出,可以提供用于对可移动非易失性磁盘(例如“软盘”)读写的磁盘驱动器,以及对可移动非易失性光盘(例如:光盘只读存储器(Compact Disc Read OnlyMemory;以下简称:CD-ROM)、数字多功能只读光盘(Digital Video Disc Read OnlyMemory;以下简称:DVD-ROM)或者其它光介质)读写的光盘驱动器。在这些情况下,每个驱动器可以通过一个或者多个数据介质接口与总线18相连。存储器28可以包括至少一个程序产品,该程序产品具有一组(例如至少一个)程序模块,这些程序模块被配置以执行本公开各实施例的功能。The memory 28 may include a computer system readable medium in the form of a volatile memory, such as a random access memory (Random Access Memory; hereinafter referred to as: RAM) 30 and/or a cache memory 32 . Computer device 12 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 34 may be used to read and write to non-removable, non-volatile magnetic media (not shown in FIG. 4, commonly referred to as a "hard drive"). Although not shown in FIG. 4, a disk drive for reading and writing to a removable nonvolatile disk (such as a "floppy disk") may be provided, as well as a disk drive for a removable nonvolatile disk (such as a CD-ROM (Compact Disc Read Only Memory (hereinafter referred to as: CD-ROM), Digital Video Disc Read Only Memory (hereinafter referred to as: DVD-ROM) or other optical media) read and write optical disc drives. In these cases, each drive may be connected to bus 18 via one or more data media interfaces. Memory 28 may include at least one program product having a set (eg, at least one) of program modules configured to perform the functions of various embodiments of the present disclosure.

具有一组(至少一个)程序模块42的程序/实用工具40,可以存储在例如存储器28中,这样的程序模块42包括但不限于操作系统、一个或者多个应用程序、其它程序模块以及程序数据,这些示例中的每一个或某种组合中可能包括网络环境的实现。程序模块42通常执行本公开所描述的实施例中的功能和/或方法。A program/utility 40 having a set (at least one) of program modules 42 may be stored, for example, in memory 28, such program modules 42 including but not limited to an operating system, one or more application programs, other program modules, and program data , each or some combination of these examples may include implementations of network environments. The program modules 42 generally perform the functions and/or methods of the embodiments described in this disclosure.

计算机设备12也可以与一个或多个外部设备14(例如键盘、指向设备、显示器24等)通信,还可与一个或者多个使得用户能与该计算机设备12交互的设备通信,和/或与使得该计算机设备12能与一个或多个其它计算设备进行通信的任何设备(例如网卡,调制解调器等等)通信。这种通信可以通过输入/输出(I/O)接口22进行。并且,计算机设备12还可以通过网络适配器20与一个或者多个网络(例如局域网(Local Area Network;以下简称:LAN),广域网(Wide Area Network;以下简称:WAN)和/或公共网络,例如因特网)通信。如图所示,网络适配器20通过总线18与计算机设备12的其它模块通信。应当明白,尽管图中未示出,可以结合计算机设备12使用其它硬件和/或软件模块,包括但不限于:微代码、设备驱动器、冗余处理单元、外部磁盘驱动阵列、RAID系统、磁带驱动器以及数据备份存储系统等。The computer device 12 may also communicate with one or more external devices 14 (e.g., a keyboard, pointing device, display 24, etc.), and with one or more devices that enable a user to interact with the computer device 12, and/or with Any device (eg, network card, modem, etc.) that enables the computing device 12 to communicate with one or more other computing devices. Such communication may occur through input/output (I/O) interface 22 . Moreover, the computer device 12 can also be connected with one or more networks (such as a local area network (Local Area Network; hereinafter referred to as: LAN), a wide area network (Wide Area Network; hereinafter referred to as: WAN) and/or public networks, such as the Internet, through the network adapter 20. ) communication. As shown, network adapter 20 communicates with other modules of computer device 12 via bus 18 . It should be appreciated that although not shown, other hardware and/or software modules may be used in conjunction with computer device 12, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives And data backup storage system, etc.

处理单元16通过运行存储在系统存储器28中的程序,从而执行各种功能应用以及数据处理,例如实现前述实施例中提及的方法。The processing unit 16 executes various functional applications and data processing by running the programs stored in the system memory 28 , such as implementing the methods mentioned in the foregoing embodiments.

在本说明书的描述中,参考术语“一个实施例”、“一些实施例”、“示例”、“具体示例”、或“一些示例”等的描述意指结合该实施例或示例描述的具体特征、结构、材料或者特点包含于本公开的至少一个实施例或示例中。在本说明书中,对上述术语的示意性表述不必须针对的是相同的实施例或示例。而且,描述的具体特征、结构、材料或者特点可以在任一个或多个实施例或示例中以合适的方式结合。此外,在不相互矛盾的情况下,本领域的技术人员可以将本说明书中描述的不同实施例或示例以及不同实施例或示例的特征进行结合和组合。In the description of this specification, descriptions referring to the terms "one embodiment", "some embodiments", "example", "specific examples", or "some examples" mean that specific features described in connection with the embodiment or example , structure, material or characteristic is included in at least one embodiment or example of the present disclosure. In this specification, the schematic representations of the above terms are not necessarily directed to the same embodiment or example. Furthermore, the described specific features, structures, materials or characteristics may be combined in any suitable manner in any one or more embodiments or examples. In addition, those skilled in the art can combine and combine different embodiments or examples and features of different embodiments or examples described in this specification without conflicting with each other.

此外,术语“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括至少一个该特征。在本公开的描述中,“多个”的含义是至少两个,例如两个,三个等,除非另有明确具体的限定。In addition, the terms "first" and "second" are used for descriptive purposes only, and cannot be interpreted as indicating or implying relative importance or implicitly specifying the quantity of indicated technical features. Thus, the features defined as "first" and "second" may explicitly or implicitly include at least one of these features. In the description of the present disclosure, "plurality" means at least two, such as two, three, etc., unless otherwise specifically defined.

流程图中或在此以其他方式描述的任何过程或方法描述可以被理解为,表示包括一个或更多个用于实现定制逻辑功能或过程的步骤的可执行指令的代码的模块、片段或部分,并且本公开的优选实施方式的范围包括另外的实现,其中可以不按所示出或讨论的顺序,包括根据所涉及的功能按基本同时的方式或按相反的顺序,来执行功能,这应被本公开的实施例所属技术领域的技术人员所理解。Any process or method descriptions in flowcharts or otherwise described herein may be understood to represent a module, segment or portion of code comprising one or more executable instructions for implementing custom logical functions or steps of a process , and the scope of preferred embodiments of the present disclosure includes additional implementations in which functions may be performed out of the order shown or discussed, including substantially concurrently or in reverse order depending on the functions involved, which shall It is understood by those skilled in the art to which the embodiments of the present disclosure pertain.

在流程图中表示或在此以其他方式描述的逻辑和/或步骤,例如,可以被认为是用于实现逻辑功能的可执行指令的定序列表,可以具体实现在任何计算机可读介质中,以供指令执行系统、装置或设备(如基于计算机的系统、包括处理器的系统或其他可以从指令执行系统、装置或设备取指令并执行指令的系统)使用,或结合这些指令执行系统、装置或设备而使用。就本说明书而言,"计算机可读介质"可以是任何可以包含、存储、通信、传播或传输程序以供指令执行系统、装置或设备或结合这些指令执行系统、装置或设备而使用的装置。计算机可读介质的更具体的示例(非穷尽性列表)包括以下:具有一个或多个布线的电连接部(电子装置),便携式计算机盘盒(磁装置),随机存取存储器(RAM),只读存储器(ROM),可擦除可编辑只读存储器(EPROM或闪速存储器),光纤装置,以及便携式光盘只读存储器(CDROM)。另外,计算机可读介质甚至可以是可在其上打印所述程序的纸或其他合适的介质,因为可以例如通过对纸或其他介质进行光学扫描,接着进行编辑、解译或必要时以其他合适方式进行处理来以电子方式获得所述程序,然后将其存储在计算机存储器中。The logic and/or steps represented in the flowcharts or otherwise described herein, for example, can be considered as a sequenced listing of executable instructions for implementing logical functions, which can be embodied in any computer-readable medium, For use with instruction execution systems, devices, or devices (such as computer-based systems, systems including processors, or other systems that can fetch instructions from instruction execution systems, devices, or devices and execute instructions), or in conjunction with these instruction execution systems, devices or equipment used. For the purposes of this specification, a "computer-readable medium" may be any device that can contain, store, communicate, propagate or transmit a program for use in or in conjunction with an instruction execution system, device or device. More specific examples (non-exhaustive list) of computer-readable media include the following: electrical connection with one or more wires (electronic device), portable computer disk case (magnetic device), random access memory (RAM), Read Only Memory (ROM), Erasable and Editable Read Only Memory (EPROM or Flash Memory), Fiber Optic Devices, and Portable Compact Disc Read Only Memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program can be printed, since the program can be read, for example, by optically scanning the paper or other medium, followed by editing, interpretation or other suitable processing if necessary. processing to obtain the program electronically and store it in computer memory.

应当理解,本公开的各部分可以用硬件、软件、固件或它们的组合来实现。在上述实施方式中,多个步骤或方法可以用存储在存储器中且由合适的指令执行系统执行的软件或固件来实现。如,如果用硬件来实现和在另一实施方式中一样,可用本领域公知的下列技术中的任一项或他们的组合来实现:具有用于对数据信号实现逻辑功能的逻辑门电路的离散逻辑电路,具有合适的组合逻辑门电路的专用集成电路,可编程门阵列(PGA),现场可编程门阵列(FPGA)等。It should be understood that various parts of the present disclosure may be implemented in hardware, software, firmware or a combination thereof. In the embodiments described above, various steps or methods may be implemented by software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware as in another embodiment, it can be implemented by any one or combination of the following techniques known in the art: a discrete Logic circuits, ASICs with suitable combinational logic gates, Programmable Gate Arrays (PGA), Field Programmable Gate Arrays (FPGA), etc.

本技术领域的普通技术人员可以理解实现上述实施例方法携带的全部或部分步骤是可以通过程序来指令相关的硬件完成,所述的程序可以存储于一种计算机可读存储介质中,该程序在执行时,包括方法实施例的步骤之一或其组合。Those of ordinary skill in the art can understand that all or part of the steps carried by the methods of the above embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium. During execution, one or a combination of the steps of the method embodiments is included.

本公开实施例中,车机首先接收车载VR设备通过无线网络发送的数据包,响应于确定所述数据包为目标订阅数据,根据所述数据包中包含的摄像数据和惯性测量信息,生成目标待显示画面;将所述目标待显示画面通过无线网络发送至所述车载VR设备。由此,以wifi作为传输信息的载体进行通信,可以实现车载VR设备无线方式的数据传输,也即可以保障与车载VR设备之间的无线通信,从而提高了用户的VR体验。此外,在本公开各个实施例中的各功能单元可以集成在一个处理模块中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。所述集成的模块如果以软件功能模块的形式实现并作为独立的产品销售或使用时,也可以存储在一个计算机可读取存储介质中。In the embodiment of the present disclosure, the vehicle machine first receives the data packet sent by the vehicle-mounted VR device through the wireless network, and in response to determining that the data packet is target subscription data, generates a target according to the camera data and inertial measurement information contained in the data packet. The picture to be displayed: sending the target picture to be displayed to the vehicle-mounted VR device through a wireless network. Therefore, using wifi as the carrier of information transmission for communication can realize the wireless data transmission of the vehicle-mounted VR device, that is, can ensure the wireless communication with the vehicle-mounted VR device, thereby improving the user's VR experience. In addition, each functional unit in each embodiment of the present disclosure may be integrated into one processing module, each unit may exist separately physically, or two or more units may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware or in the form of software function modules. If the integrated modules are realized in the form of software function modules and sold or used as independent products, they can also be stored in a computer-readable storage medium.

上述提到的存储介质可以是只读存储器,磁盘或光盘等。尽管上面已经示出和描述了本公开的实施例,可以理解的是,上述实施例是示例性的,不能理解为对本公开的限制,本领域的普通技术人员在本公开的范围内可以对上述实施例进行变化、修改、替换和变型。The storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk, and the like. Although the embodiments of the present disclosure have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as limitations on the present disclosure, and those skilled in the art can understand the above-mentioned embodiments within the scope of the present disclosure. The embodiments are subject to changes, modifications, substitutions and variations.

Claims (10)

1.一种车载VR设备的通信方法,其特征在于,包括:1. A communication method for a vehicle-mounted VR device, comprising: 接收车载VR设备通过无线网络发送的数据包;Receive the data packets sent by the vehicle-mounted VR device through the wireless network; 响应于确定所述数据包为目标订阅数据,根据所述数据包中包含的摄像数据和惯性测量信息,生成目标待显示画面;In response to determining that the data packet is target subscription data, generate a target to-be-displayed picture according to the camera data and inertial measurement information contained in the data packet; 将所述目标待显示画面通过无线网络发送至所述车载VR设备。Sending the target to-be-displayed image to the vehicle-mounted VR device through a wireless network. 2.根据权利要求1所述的方法,其特征在于,在所述接收车载VR设备通过无线网络发送的数据包之前,还包括:2. The method according to claim 1, further comprising: 接收车载VR设备通过无线网络发送的广播消息;Receive the broadcast message sent by the vehicle-mounted VR device through the wireless network; 对所述广播消息进行解析,以确定所述广播消息中包含的厂商信息;Parse the broadcast message to determine the manufacturer information contained in the broadcast message; 在确定所述厂商信息属于预设的白名单信息的情况下,建立与所述车载VR设备之间的无线连接。When it is determined that the manufacturer information belongs to the preset white list information, establish a wireless connection with the vehicle-mounted VR device. 3.根据权利要求2所述的方法,其特征在于,在所述建立与所述车载VR设备之间的无线连接之后,还包括:3. The method according to claim 2, characterized in that, after establishing the wireless connection with the vehicle-mounted VR device, further comprising: 启动车载VR处理器;Start the on-board VR processor; 获取所述VR处理器发送的订阅请求,其中,所述订阅请求中用于订阅车载VR设备发送的摄像数据和惯性测量信息。Obtain the subscription request sent by the VR processor, wherein the subscription request is used to subscribe to the camera data and inertial measurement information sent by the vehicle-mounted VR device. 4.根据权利要求1-3任一所述的方法,其特征在于,所述响应于确定所述数据包为目标订阅数据,根据所述数据包中包含的摄像数据和惯性测量信息,生成目标待显示画面,包括:4. The method according to any one of claims 1-3, wherein in response to determining that the data packet is target subscription data, a target is generated according to the camera data and inertial measurement information contained in the data packet The screen to be displayed includes: 响应于所述数据包中包含摄像数据和惯性测量信息,确定所述数据包为目标订阅数据;In response to the data packet containing camera data and inertial measurement information, determining that the data packet is target subscription data; 根据所述摄像数据中包含的各个图像,确定用户的位移数据;Determine the user's displacement data according to each image contained in the camera data; 根据所述惯性测量信息,确定所述用户的姿态信息;determining posture information of the user according to the inertial measurement information; 基于所述位移数据以及所述姿态信息,对所述图像进行处理,以生成目标待显示画面。Based on the displacement data and the posture information, the image is processed to generate a target image to be displayed. 5.一种车载VR设备的通信装置,其特征在于,包括:5. A communication device for a vehicle-mounted VR device, comprising: 接收模块,用于接收车载VR设备通过无线网络发送的数据包;The receiving module is used to receive the data packet sent by the vehicle-mounted VR device through the wireless network; 生成模块,用于响应于确定所述数据包为目标订阅数据,根据所述数据包中包含的摄像数据和惯性测量信息,生成目标待显示画面;A generating module, configured to generate a target image to be displayed according to the camera data and inertial measurement information contained in the data packet in response to determining that the data packet is target subscription data; 发送模块,用于将所述目标待显示画面通过无线网络发送至所述车载VR设备。A sending module, configured to send the target image to be displayed to the vehicle-mounted VR device through a wireless network. 6.根据权利要求5所述的装置,其特征在于,所述接收模块,还包括:6. The device according to claim 5, wherein the receiving module further comprises: 接收单元,用于接收车载VR设备通过无线网络发送的广播消息;The receiving unit is used to receive the broadcast message sent by the vehicle-mounted VR device through the wireless network; 确定单元,用于对所述广播消息进行解析,以确定所述广播消息中包含的厂商信息;a determining unit, configured to parse the broadcast message to determine the manufacturer information contained in the broadcast message; 建立单元,用于在确定所述厂商信息属于预设的白名单信息的情况下,建立与所述车载VR设备之间的无线连接。The establishment unit is configured to establish a wireless connection with the vehicle-mounted VR device when it is determined that the manufacturer information belongs to preset whitelist information. 7.根据权利要求6所述的装置,其特征在于,所述建立单元,还用于:7. The device according to claim 6, wherein the establishing unit is further configured to: 启动车载VR处理器;Start the on-board VR processor; 获取所述VR处理器发送的订阅请求,其中,所述订阅请求中用于订阅车载VR设备发送的摄像数据和惯性测量信息。Obtain the subscription request sent by the VR processor, wherein the subscription request is used to subscribe to the camera data and inertial measurement information sent by the vehicle-mounted VR device. 8.根据权利要求5-7任一所述的装置,其特征在于,所述生成模块,具体用于:8. The device according to any one of claims 5-7, wherein the generating module is specifically used for: 响应于所述数据包中包含摄像数据和惯性测量信息,确定所述数据包为目标订阅数据;In response to the data packet containing camera data and inertial measurement information, determining that the data packet is target subscription data; 根据所述摄像数据中包含的各个图像,确定用户的位移数据;Determine the user's displacement data according to each image contained in the camera data; 根据所述惯性测量信息,确定所述用户的姿态信息;determining posture information of the user according to the inertial measurement information; 基于所述位移数据以及所述姿态信息,对所述图像进行处理,以生成目标待显示画面。Based on the displacement data and the posture information, the image is processed to generate a target image to be displayed. 9.一种计算机设备,其特征在于,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,所述处理器执行所述程序时,实现如权利要求1-4中任一所述的车载VR设备的通信方法。9. A computer device, characterized in that it comprises a memory, a processor, and a computer program stored on the memory and operable on the processor, and when the processor executes the program, it realizes the process described in claims 1-4. Any one of the communication methods for the vehicle-mounted VR device. 10.一种计算机可读存储介质,存储有计算机程序,其特征在于,所述计算机程序被处理器执行时实现如权利要求1-4中任一所述的车载VR设备的通信方法。10. A computer-readable storage medium storing a computer program, characterized in that, when the computer program is executed by a processor, the communication method for the vehicle-mounted VR device according to any one of claims 1-4 is implemented.
CN202210201030.3A 2022-03-03 2022-03-03 Communication method, device, electronic device and storage medium of vehicle-mounted VR equipment Pending CN115474177A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210201030.3A CN115474177A (en) 2022-03-03 2022-03-03 Communication method, device, electronic device and storage medium of vehicle-mounted VR equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210201030.3A CN115474177A (en) 2022-03-03 2022-03-03 Communication method, device, electronic device and storage medium of vehicle-mounted VR equipment

Publications (1)

Publication Number Publication Date
CN115474177A true CN115474177A (en) 2022-12-13

Family

ID=84363717

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210201030.3A Pending CN115474177A (en) 2022-03-03 2022-03-03 Communication method, device, electronic device and storage medium of vehicle-mounted VR equipment

Country Status (1)

Country Link
CN (1) CN115474177A (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150097864A1 (en) * 2013-10-03 2015-04-09 Honda Motor Co., Ltd. System and method for dynamic in-vehicle virtual reality
CN109076165A (en) * 2016-05-02 2018-12-21 华为技术有限公司 Head-mounted display content capture and shared
US20190050050A1 (en) * 2017-08-10 2019-02-14 Lg Electronics Inc. Mobile device and method of implementing vr device controller using mobile device
CN109766006A (en) * 2019-01-02 2019-05-17 京东方科技集团股份有限公司 Display methods, device and the equipment of virtual reality scenario
CN110706538A (en) * 2019-10-15 2020-01-17 国家电网有限公司 A simulation tower training platform based on virtual reality technology
CN111420391A (en) * 2020-03-04 2020-07-17 青岛小鸟看看科技有限公司 Head-mounted display system and space positioning method thereof

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150097864A1 (en) * 2013-10-03 2015-04-09 Honda Motor Co., Ltd. System and method for dynamic in-vehicle virtual reality
CN109076165A (en) * 2016-05-02 2018-12-21 华为技术有限公司 Head-mounted display content capture and shared
US20190050050A1 (en) * 2017-08-10 2019-02-14 Lg Electronics Inc. Mobile device and method of implementing vr device controller using mobile device
CN109766006A (en) * 2019-01-02 2019-05-17 京东方科技集团股份有限公司 Display methods, device and the equipment of virtual reality scenario
US20200211510A1 (en) * 2019-01-02 2020-07-02 Beijing Boe Optoelectronics Technology Co., Ltd. Method, apparatus, and virtual reality device for displaying virtual reality scene
CN110706538A (en) * 2019-10-15 2020-01-17 国家电网有限公司 A simulation tower training platform based on virtual reality technology
CN111420391A (en) * 2020-03-04 2020-07-17 青岛小鸟看看科技有限公司 Head-mounted display system and space positioning method thereof

Similar Documents

Publication Publication Date Title
JP6422137B2 (en) Perceptual-based predictive tracking for head-mounted displays
CN109741463B (en) Rendering method, device and equipment of virtual reality scene
CN105593924B (en) Image processing apparatus, image processing method, computer program and image display system
BR112016010442B1 (en) IMAGE GENERATION DEVICE AND METHOD, AND STORAGE UNIT
WO2020003860A1 (en) Information processing device, information processing method, and program
CN103777742A (en) Method for providing user interface in display device and display device
CN110351480A (en) Image processing method, device and electronic equipment for electronic equipment
WO2019036102A1 (en) Techniques for predictive prioritization of image portions in processing graphics
CN116400878B (en) Display method, device, electronic device and storage medium of head-mounted display device
CN115474177A (en) Communication method, device, electronic device and storage medium of vehicle-mounted VR equipment
CN116672696A (en) Display method and device for controlling game interface
CN117202142A (en) Method, device, equipment and storage medium for generating six-degree-of-freedom picture of controller
CN115469739A (en) Six-degree-of-freedom picture generation method, device and equipment of controller and storage medium
CN115437493A (en) Image display method and device of vehicle-mounted VR glasses and computer equipment
CN115471640A (en) Method, device and equipment for generating six-degree-of-freedom picture of controller and storage medium
CN115457073A (en) Method, device, equipment and storage medium for generating six-degree-of-freedom image of controller
CN115442581A (en) Vehicle-mounted VR glasses control method, device and computer equipment
CN120378745A (en) Gesture processing method, first master control, second master control, medium and program product
CN116974365A (en) Display position information generation method, apparatus, and computer-readable medium
CN115442578A (en) Vehicle-mounted VR glasses image display method, device and system
CN120359450A (en) Virtual reality display device and control method for virtual reality display device
CN118505482A (en) System, method, apparatus, electronic device, and storage medium for rendering image

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination