[go: up one dir, main page]

CN116233513A - Method, device and equipment for playing virtual gift special effects in virtual reality live broadcast room - Google Patents

Method, device and equipment for playing virtual gift special effects in virtual reality live broadcast room Download PDF

Info

Publication number
CN116233513A
CN116233513A CN202211732809.4A CN202211732809A CN116233513A CN 116233513 A CN116233513 A CN 116233513A CN 202211732809 A CN202211732809 A CN 202211732809A CN 116233513 A CN116233513 A CN 116233513A
Authority
CN
China
Prior art keywords
anchor
virtual
image
gift
live broadcast
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211732809.4A
Other languages
Chinese (zh)
Inventor
曾衍
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Cubesili Information Technology Co Ltd
Original Assignee
Guangzhou Cubesili Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Cubesili Information Technology Co Ltd filed Critical Guangzhou Cubesili Information Technology Co Ltd
Priority to CN202211732809.4A priority Critical patent/CN116233513A/en
Publication of CN116233513A publication Critical patent/CN116233513A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172Classification, e.g. identification
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/2187Live feed
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Databases & Information Systems (AREA)
  • Studio Circuits (AREA)

Abstract

本申请涉及网络直播领域,提供了一种虚拟现实直播间虚拟礼物特效播放处理方法、装置、电子设备和存储介质。本申请能够丰富虚拟现实直播场景中虚拟礼物特效的播放形式。该方法包括:在虚拟现实直播间中展示主播形象,接收针对主播形象上目标部位的虚拟礼物赠送请求,若该主播形象属于真人形象则在主播端识别该目标部位在直播画面对应的二维坐标点集得到目标部位的位置数据,若该主播形象属于虚拟形象则根据该目标部位在虚拟现实直播间的三维坐标点集得到目标部位的位置数据,响应于虚拟礼物赠送请求,根据目标部位的位置数据,在虚拟现实直播间中展示出在主播形象上目标部位播放的虚拟礼物特效。

Figure 202211732809

The present application relates to the field of network live broadcasting, and provides a method, device, electronic equipment and storage medium for processing virtual gifts with special effects in a virtual reality live broadcasting room. This application can enrich the playing form of virtual gift special effects in the virtual reality live broadcast scene. The method includes: displaying the image of the anchor in the virtual reality live broadcast room, receiving a virtual gift request for a target part on the image of the anchor, and identifying the two-dimensional coordinates of the target part on the live broadcast screen at the anchor end if the image of the anchor belongs to a real person Point set to get the position data of the target part, if the anchor image belongs to the virtual image, then according to the three-dimensional coordinate point set of the target part in the virtual reality live broadcast room to get the position data of the target part, in response to the virtual gift giving request, according to the position of the target part Data, in the virtual reality live broadcast room, the virtual gift special effects played on the target part of the anchor image are displayed.

Figure 202211732809

Description

虚拟现实直播间虚拟礼物特效播放处理方法、装置和设备Method, device and equipment for playing virtual gift special effects in virtual reality live broadcast room

技术领域technical field

本申请涉及网络直播技术领域,特别是涉及一种虚拟现实直播间虚拟礼物特效播放处理方法、装置、电子设备和计算机可读存储介质。The present application relates to the technical field of webcasting, and in particular to a method, device, electronic device, and computer-readable storage medium for processing virtual gifts with special effects in a virtual reality live broadcasting room.

背景技术Background technique

随着直播技术的发展,直播间中可供主播和观众进行互动的方式越来越多,例如,观众进入直播间后可以通过赠送虚拟礼物的方式与主播进行互动。虚拟现实直播作为一种新兴的直播方式,其可以使用户沉浸在虚拟现实直播间中,提升直播体验。其中,虚拟现实直播是虚拟现实与直播的结合,通过虚拟现实直播可将用户平时所见的二维平面直播升级为虚拟现实的全景直播,与平常的二维平面直播相比,虚拟现实直播给观众带来身临其境的感觉,可使观众不受固定直播画场景面的约束,可随着视角的自由变化而变化,能够带给观众全新的直播视觉体验。With the development of live broadcast technology, there are more and more ways for the anchor and audience to interact in the live broadcast room. For example, after entering the live broadcast room, the audience can interact with the anchor by giving virtual gifts. As an emerging live broadcast method, virtual reality live broadcast can immerse users in a virtual reality live broadcast room and improve the live broadcast experience. Among them, virtual reality live broadcast is a combination of virtual reality and live broadcast. Through virtual reality live broadcast, the two-dimensional flat live broadcast that users usually see can be upgraded to virtual reality panoramic live broadcast. Compared with ordinary two-dimensional flat live broadcast, virtual reality live broadcast gives The viewer can feel immersive, and the viewer is not restricted by the fixed live broadcast scene, and can change with the free change of the angle of view, which can bring the viewer a brand-new live broadcast visual experience.

而在虚拟现实直播间中进行虚拟礼物赠送时,基于目前的技术所提供的虚拟礼物特效处理方案,通常只能在预先设定的位置处进行虚拟礼物特效的播放,使虚拟现实直播场景中虚拟礼物特效的播放形式受到一定限制。When presenting virtual gifts in a virtual reality live broadcast room, based on the virtual gift special effects processing scheme provided by the current technology, usually only the virtual gift special effects can be played at a preset position, so that the virtual reality in the virtual reality live broadcast scene The playback form of gift special effects is subject to certain restrictions.

发明内容Contents of the invention

基于此,有必要针对上述技术问题,提供一种虚拟现实直播间虚拟礼物特效播放处理方法、装置、电子设备和计算机可读存储介质。Based on this, it is necessary to provide a method, device, electronic device, and computer-readable storage medium for processing virtual gifts with special effects in a virtual reality live broadcast room to address the above technical problems.

第一方面,本申请提供了一种虚拟现实直播间虚拟礼物特效播放处理方法。所述方法包括:In the first aspect, the present application provides a method for processing virtual gifts with special effects in a virtual reality live broadcast room. The methods include:

在虚拟现实直播间中展示主播形象;Display the image of the anchor in the virtual reality live broadcast room;

接收针对所述主播形象上目标部位的虚拟礼物赠送请求;receiving a virtual gift request for a target part on the image of the anchor;

若所述主播形象属于真人形象,则在主播端识别所述主播形象上目标部位在直播画面对应的二维坐标点集,得到所述目标部位的位置数据;If the image of the anchor belongs to the image of a real person, the two-dimensional coordinate point set corresponding to the target part on the live screen of the image of the anchor is recognized at the anchor end, and the position data of the target part is obtained;

若所述主播形象属于虚拟形象,则根据所述主播形象上目标部位在所述虚拟现实直播间的三维坐标点集,得到所述目标部位的位置数据;If the anchor image belongs to the virtual image, the position data of the target part is obtained according to the three-dimensional coordinate point set of the target part on the anchor image in the virtual reality live room;

响应于所述虚拟礼物赠送请求,根据所述目标部位的位置数据,在所述虚拟现实直播间中展示出在所述主播形象上目标部位播放的虚拟礼物特效。In response to the virtual gift giving request, according to the location data of the target location, the virtual gift special effect played on the target location on the anchor image is displayed in the virtual reality live broadcast room.

第二方面,本申请提供了一种虚拟现实直播间虚拟礼物特效播放处理装置。所述装置包括:In the second aspect, the present application provides a processing device for playing virtual gifts with special effects in a virtual reality live broadcast room. The devices include:

主播形象展示模块,用于在虚拟现实直播间中展示主播形象;The anchor image display module is used to display the anchor image in the virtual reality live broadcast room;

赠送请求接收模块,用于接收针对所述主播形象上目标部位的虚拟礼物赠送请求;A gift request receiving module, configured to receive a virtual gift request for a target part on the image of the anchor;

二维位置获取模块,用于若所述主播形象属于真人形象,则在主播端识别所述主播形象上目标部位在直播画面对应的二维坐标点集,得到所述目标部位的位置数据;The two-dimensional position acquisition module is used to identify the two-dimensional coordinate point set corresponding to the target part on the live screen on the anchor image at the anchor end if the anchor image belongs to a real person image, and obtain the position data of the target part;

三维位置获取模块,用于若所述主播形象属于虚拟形象,则根据所述主播形象上目标部位在所述虚拟现实直播间的三维坐标点集,得到所述目标部位的位置数据;The three-dimensional position acquisition module is used to obtain the position data of the target part according to the three-dimensional coordinate point set of the target part on the anchor image in the virtual reality live broadcast room if the anchor image belongs to the virtual image;

礼物特效播放模块,用于响应于所述虚拟礼物赠送请求,根据所述目标部位的位置数据,在所述虚拟现实直播间中展示出在所述主播形象上目标部位播放的虚拟礼物特效。The gift special effect playing module is used to display in the virtual reality live broadcast room the virtual gift special effects played on the target part of the anchor image according to the location data of the target part in response to the virtual gift giving request.

第三方面,本申请提供了一种电子设备。所述电子设备包括存储器和处理器,所述存储器存储有计算机程序,所述处理器执行所述计算机程序时实现以下步骤:In a third aspect, the present application provides an electronic device. The electronic device includes a memory and a processor, the memory stores a computer program, and the processor implements the following steps when executing the computer program:

在虚拟现实直播间中展示主播形象;接收针对所述主播形象上目标部位的虚拟礼物赠送请求;若所述主播形象属于真人形象,则在主播端识别所述主播形象上目标部位在直播画面对应的二维坐标点集,得到所述目标部位的位置数据;若所述主播形象属于虚拟形象,则根据所述主播形象上目标部位在所述虚拟现实直播间的三维坐标点集,得到所述目标部位的位置数据;响应于所述虚拟礼物赠送请求,根据所述目标部位的位置数据,在所述虚拟现实直播间中展示出在所述主播形象上目标部位播放的虚拟礼物特效。Display the image of the anchor in the virtual reality live broadcast room; receive a virtual gift request for the target part of the image of the anchor; if the image of the anchor belongs to a real image, identify the target part of the image of the anchor on the anchor side corresponding to the live screen The two-dimensional coordinate point set of the target part is obtained to obtain the position data of the target part; if the anchor image belongs to the virtual image, then according to the three-dimensional coordinate point set of the target part on the anchor image in the virtual reality live broadcast room, the position data of the target part is obtained The location data of the target part: in response to the virtual gift giving request, according to the location data of the target part, the virtual gift special effect played on the target part on the anchor image is displayed in the virtual reality live broadcast room.

第四方面,本申请提供了一种计算机可读存储介质。所述计算机可读存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时实现以下步骤:In a fourth aspect, the present application provides a computer-readable storage medium. The computer-readable storage medium has a computer program stored thereon, and when the computer program is executed by a processor, the following steps are implemented:

在虚拟现实直播间中展示主播形象;接收针对所述主播形象上目标部位的虚拟礼物赠送请求;若所述主播形象属于真人形象,则在主播端识别所述主播形象上目标部位在直播画面对应的二维坐标点集,得到所述目标部位的位置数据;若所述主播形象属于虚拟形象,则根据所述主播形象上目标部位在所述虚拟现实直播间的三维坐标点集,得到所述目标部位的位置数据;响应于所述虚拟礼物赠送请求,根据所述目标部位的位置数据,在所述虚拟现实直播间中展示出在所述主播形象上目标部位播放的虚拟礼物特效。Display the image of the anchor in the virtual reality live broadcast room; receive a virtual gift request for the target part of the image of the anchor; if the image of the anchor belongs to a real image, identify the target part of the image of the anchor on the anchor side corresponding to the live screen The two-dimensional coordinate point set of the target part is obtained to obtain the position data of the target part; if the anchor image belongs to the virtual image, then according to the three-dimensional coordinate point set of the target part on the anchor image in the virtual reality live broadcast room, the position data of the target part is obtained The location data of the target part: in response to the virtual gift giving request, according to the location data of the target part, the virtual gift special effect played on the target part on the anchor image is displayed in the virtual reality live broadcast room.

上述虚拟现实直播间虚拟礼物特效播放处理方法、装置、电子设备和存储介质,在虚拟现实直播间中展示主播形象,接收针对主播形象上目标部位的虚拟礼物赠送请求,若该主播形象属于真人形象则在主播端识别该目标部位在直播画面对应的二维坐标点集得到目标部位的位置数据,若该主播形象属于虚拟形象则根据该目标部位在虚拟现实直播间的三维坐标点集得到目标部位的位置数据,响应于虚拟礼物赠送请求,根据目标部位的位置数据,在虚拟现实直播间中展示出在主播形象上目标部位播放的虚拟礼物特效。该方案能够提供针对主播形象上目标部位的虚拟礼物赠送及特效播放功能,根据虚拟现实直播间中展示的主播形象为真人形象或虚拟形象,采用对应的方式获取其上目标部位的位置数据,然后根据该位置数据在虚拟现实直播间中展示出在主播形象上目标部位播放的虚拟礼物特效,使得虚拟现实直播间中虚拟礼物可以结合在主播形象上目标部位进行播放,故可随着主播形象及其目标部位在虚拟现实直播间中的位置变化而发生相应跟随移动,丰富了虚拟现实直播场景中虚拟礼物特效的播放形式,使虚拟现实直播间中虚拟礼物的播放具有更生动的表现效果,可应用于元宇宙直播场景下的虚拟礼物特效播放处理中,丰富元宇宙直播中虚拟礼物的样式及其特效的播放形式,有利于促进元宇宙直播中主播和观众的互动。The above-mentioned method, device, electronic device and storage medium for playing virtual gifts with special effects in the virtual reality live broadcast room display the anchor image in the virtual reality live broadcast room, and receive a virtual gift presentation request for the target part of the anchor image. If the anchor image belongs to a real person image Then, at the anchor end, identify the two-dimensional coordinate point set corresponding to the target part in the live broadcast screen to obtain the position data of the target part. If the anchor image belongs to the avatar, the target part is obtained according to the three-dimensional coordinate point set of the target part in the virtual reality live broadcast room In response to the virtual gift giving request, according to the location data of the target part, the virtual gift special effect played on the target part of the anchor image is displayed in the virtual reality live broadcast room. This solution can provide virtual gift giving and special effects playback functions for the target part of the anchor image. According to whether the anchor image displayed in the virtual reality live broadcast room is a real image or a virtual image, the position data of the target part on it is obtained in a corresponding way, and then According to the location data, the special effect of the virtual gift played on the target part of the anchor image is displayed in the virtual reality live room, so that the virtual gift in the virtual reality live room can be played in combination with the target part of the anchor image, so it can follow the anchor image and The position of the target part in the virtual reality live broadcast room changes accordingly to follow the movement, which enriches the playback form of virtual gift special effects in the virtual reality live broadcast scene, and makes the virtual gift play in the virtual reality live broadcast room more vivid. It is applied to the special effects playback processing of virtual gifts in the live broadcast scene of the Metaverse, enriching the styles of virtual gifts and the playback forms of special effects in the live broadcast of the Metaverse, which is conducive to promoting the interaction between the anchor and the audience in the live broadcast of the Metaverse.

附图说明Description of drawings

图1为本申请实施例中虚拟现实直播间虚拟礼物特效播放处理方法的应用场景图;Fig. 1 is the application scenario diagram of the virtual gift special effects playback processing method in the virtual reality live broadcast room in the embodiment of the present application;

图2为本申请实施例中虚拟现实直播间虚拟礼物特效播放处理方法的流程示意图;FIG. 2 is a schematic flow diagram of a processing method for playing virtual gifts with special effects in a virtual reality live broadcast room in an embodiment of the present application;

图3为本申请实施例中在虚拟形象上目标部位播放虚拟礼物特效的步骤的流程示意图;FIG. 3 is a schematic flowchart of the steps of playing virtual gift special effects on the target part of the avatar in the embodiment of the present application;

图4为本申请实施例中控制主播形象动作的步骤的流程示意图;Fig. 4 is a schematic flow chart of the steps of controlling the action of the anchor image in the embodiment of the present application;

图5为本申请具体实例中虚拟现实直播间虚拟礼物特效播放处理方法的流程示意图;Fig. 5 is a schematic flow diagram of a processing method for playing virtual gifts with special effects in a virtual reality live room in a specific example of the present application;

图6为本申请另一具体实例中虚拟现实直播间虚拟礼物特效播放处理方法的流程示意图;Fig. 6 is a schematic flow diagram of a processing method for playing virtual gifts with special effects in a virtual reality live broadcast room in another specific example of the present application;

图7为本申请实施例中虚拟现实直播间虚拟礼物特效播放处理装置的结构框图;FIG. 7 is a structural block diagram of a virtual gift special effect playback processing device in a virtual reality live broadcast room in an embodiment of the present application;

图8为本申请实施例中电子设备的内部结构图。FIG. 8 is an internal structural diagram of an electronic device in an embodiment of the present application.

具体实施方式Detailed ways

为了使本申请的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本申请进行进一步详细说明。应当理解,此处描述的具体实施例仅仅用以解释本申请,并不用于限定本申请。In order to make the purpose, technical solution and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application, and are not intended to limit the present application.

本申请实施例提供的虚拟现实直播间虚拟礼物特效播放处理方法,可以应用于如图1所示的应用场景中,该应用场景可以包括终端和服务器,其中,终端可以具体包括直播间的主播端和多个观众端(如观众端1、观众端2等等),主播端和多个观众端分别可以通过互联网与服务器进行通信,服务器可以为直播间的主播端和多个观众端提供直播相关服务。其中,终端可以但不限于是智能手机、平板电脑和头戴式虚拟现实设备等;服务器可以用独立的服务器或者是多个服务器组成的服务器集群来实现。其中,该应用场景可以是元宇宙直播场景,服务器可以为直播间的主播和观众创建独立的元宇宙场景,搭建出一个与现实世界并行的虚拟空间,通过利用科技手段进行链接与创造出一个现实世界映射与交互的虚拟世界,可以在该虚拟空间中展示如人物、动物等各种三维的虚拟形象,主播和观众在该虚拟空间中可以与三维的虚拟形象进行自由的互动。具体的,直播间的用户可以通过如手机、头戴式虚拟现实设备等终端完成人机交互,实现基本的控制操作,如手势移动切换,选择退出等,终端可以接收并显示服务器发送的如直播视频流、虚拟礼物等数据,为元宇宙场景显示信息,同时为用户提供元宇宙信息。在包含但不限于是元宇宙直播场景中,基于本申请提供的虚拟现实直播间虚拟礼物特效播放处理方法,终端可以通过头戴式虚拟现实设备在虚拟现实直播间中展示主播形象,观众可以在观众端通过头戴式虚拟现实设备发出针对主播形象上目标部位的虚拟礼物赠送请求,终端可根据虚拟现实直播间中展示的主播形象为真人形象或虚拟形象,采用对应的方式获取其上目标部位的位置数据,然后根据该位置数据在虚拟现实直播间中展示出在主播形象上目标部位播放的虚拟礼物特效,使得虚拟现实直播间中虚拟礼物可以结合在主播形象上目标部位进行播放,实现在虚拟现实直播间中针对主播形象上目标部位的虚拟礼物赠送及特效播放,丰富了虚拟现实直播场景中虚拟礼物特效的播放形式,且使虚拟现实直播间中虚拟礼物的播放具有更生动的表现效果,其可应用于元宇宙直播场景下的虚拟礼物特效播放处理中,丰富元宇宙直播中虚拟礼物的样式及其特效的播放形式,有利于促进元宇宙直播中主播和观众的互动。The method for processing virtual gifts with special effects in a virtual reality live broadcast room provided in the embodiment of the present application can be applied to the application scenario shown in Figure 1. The application scenario can include a terminal and a server, wherein the terminal can specifically include the anchor terminal of the live broadcast room With multiple viewers (such as viewer 1, viewer 2, etc.), the host and multiple viewers can communicate with the server through the Internet, and the server can provide live broadcast information for the host and multiple viewers in the live broadcast room. Serve. Wherein, the terminal can be, but not limited to, a smart phone, a tablet computer, a head-mounted virtual reality device, etc.; the server can be implemented by an independent server or a server cluster composed of multiple servers. Among them, the application scenario can be a metaverse live broadcast scene, and the server can create an independent metaverse scene for the host and audience in the live broadcast room, build a virtual space parallel to the real world, and create a real world by using technological means to link and create The virtual world of world mapping and interaction can display various three-dimensional virtual images such as characters and animals in the virtual space, and the anchor and audience can freely interact with the three-dimensional virtual images in the virtual space. Specifically, users in the live broadcast room can complete human-computer interaction through terminals such as mobile phones and head-mounted virtual reality devices, and realize basic control operations, such as gesture movement switching, selection and exit, etc., and the terminal can receive and display the information sent by the server such as live broadcast Video streams, virtual gifts and other data display information for the Metaverse scene and provide users with Metaverse information. In the scene including but not limited to the live broadcast of the Metaverse, based on the virtual gift special effects playback processing method provided by this application, the terminal can display the image of the anchor in the virtual reality live broadcast room through the head-mounted virtual reality device, and the audience can view it in the virtual reality live broadcast room. The viewer sends a virtual gift request for the target part of the host image through the head-mounted virtual reality device, and the terminal can obtain the target part in the corresponding way according to whether the host image displayed in the virtual reality live broadcast room is a real image or a virtual image location data, and then display the virtual gift special effects played on the target part of the anchor image in the virtual reality live broadcast room according to the location data, so that the virtual gift in the virtual reality live broadcast room can be played in combination with the target part of the anchor image, realizing In the virtual reality live broadcast room, the virtual gift presentation and special effect playback for the target part of the anchor image enriches the playback form of virtual gift special effects in the virtual reality live broadcast scene, and makes the virtual gift playback in the virtual reality live broadcast room more vivid. , which can be applied to the special effects playback processing of virtual gifts in the live broadcast scene of the Metaverse, enriching the styles of virtual gifts and the playback forms of special effects in the live broadcast of the Metaverse, which is conducive to promoting the interaction between the anchor and the audience in the live broadcast of the Metaverse.

以下基于如图1所示的应用环境,结合各实施例及相应附图,对本申请的虚拟现实直播间虚拟礼物特效播放处理方法进行说明。Based on the application environment shown in FIG. 1 , in combination with various embodiments and corresponding drawings, the method for processing virtual gifts with special effects in a virtual reality live broadcast room of the present application will be described.

在一个实施例中,如图2所示,提供了一种虚拟现实直播间虚拟礼物特效播放处理方法,该方法应用于如图1中的终端,该方法可以包括以下步骤:In one embodiment, as shown in FIG. 2 , a method for processing virtual gift special effects in a virtual reality live broadcast room is provided. The method is applied to the terminal in FIG. 1 , and the method may include the following steps:

步骤S201,在虚拟现实直播间中展示主播形象。Step S201, displaying the anchor image in the virtual reality live broadcast room.

具体的,终端具体可以是连接头戴式虚拟现实设备的智能手机、平板电脑等终端,也可以是配置有直播应用的头戴式虚拟现实设备,头戴式虚拟现实设备可以包括VR(Virtual Reality,虚拟现实)眼镜和操作手柄,本步骤中,观众端可以通过头戴式虚拟现实设备中虚拟现实眼镜为观众在虚拟现实直播间中展示主播形象,主播形象是指主播在虚拟现实直播间的形象,该主播形象可以是真人形象或三维的虚拟形象,其中,对于虚拟形象,其可以由设计人员按照一定的规范进行规范设计,这些虚拟形象在做出某些动作时会伴随整个虚拟形象的各骨骼关节的运动,骨骼关节会标识其运动的精细程度,一般情况下,精细程度越高的骨骼关节数量跟面数设计会越精细,而虚拟形象做出某些动作时还可能会伴随一些声音、图片等素材资源。Specifically, the terminal may be a terminal such as a smart phone or a tablet computer connected to a head-mounted virtual reality device, or a head-mounted virtual reality device configured with a live application. The head-mounted virtual reality device may include a VR (Virtual Reality , virtual reality) glasses and operating handles. In this step, the audience can display the image of the host in the virtual reality live broadcast room for the audience through the virtual reality glasses in the head-mounted virtual reality device. The anchor image refers to the image of the anchor in the virtual reality live broadcast room. Image, the image of the anchor can be a real image or a three-dimensional virtual image, among which, for the virtual image, it can be designed by the designer according to certain specifications, and these virtual images will be accompanied by the whole virtual image when making certain actions. The movement of each skeletal joint, the skeletal joint will mark the fineness of its movement. In general, the higher the fineness of the skeletal joints and the more detailed the design of the number of faces, and the avatar may also be accompanied by some Sound, picture and other material resources.

步骤S202,接收针对主播形象上目标部位的虚拟礼物赠送请求。Step S202, receiving a virtual gift giving request for a target part on the host image.

具体的,可以在虚拟现实直播间中提供特定虚拟礼物的赠送功能,该特定虚拟礼物可以包括针对主播形象上目标部位的虚拟礼物,示例性的,主播形象上目标部位可以包括脸部、肢体部位等等。本步骤中,可以在虚拟现实直播间中展示可供赠送的针对主播形象上目标部位的一个或多个虚拟礼物,多个虚拟礼物可以分别针对主播形象上不同的目标部位,观众端具体可以通过头戴式虚拟现实设备中虚拟现实眼镜在虚拟现实直播间中展示出针对主播形象上目标部位的虚拟礼物,还可以通过头戴式虚拟现实设备中操作手柄确定观众从中选择并确认赠送的针对主播形象上目标部位的虚拟礼物,得到针对主播形象上目标部位的虚拟礼物赠送请求,该虚拟礼物赠送请求中可以携带该虚拟礼物的标识等相关信息。Specifically, the function of giving a specific virtual gift can be provided in the virtual reality live broadcast room. The specific virtual gift can include a virtual gift for the target part on the anchor image. Exemplarily, the target part on the anchor image can include face and body parts etc. In this step, one or more virtual gifts for the target parts of the host image can be displayed in the virtual reality live broadcast room, and multiple virtual gifts can be respectively aimed at different target parts of the host image. The virtual reality glasses in the head-mounted virtual reality device display the virtual gift for the target part of the anchor’s image in the virtual reality live room, and the viewer can choose and confirm the gift for the anchor through the operation handle in the head-mounted virtual reality device For the virtual gift of the target part on the image, a virtual gift giving request for the target part on the image of the anchor can be obtained, and the virtual gift giving request can carry the identification of the virtual gift and other related information.

步骤S203,若主播形象属于真人形象,则在主播端识别主播形象上目标部位在直播画面对应的二维坐标点集,得到目标部位的位置数据。Step S203, if the image of the anchor belongs to the image of a real person, identify the two-dimensional coordinate point set corresponding to the target part on the live image on the anchor image at the anchor end, and obtain the position data of the target part.

步骤S204,若主播形象属于虚拟形象,则根据主播形象上目标部位在虚拟现实直播间的三维坐标点集,得到目标部位的位置数据。Step S204, if the anchor image belongs to the avatar, the position data of the target part is obtained according to the three-dimensional coordinate point set of the target part on the anchor image in the virtual reality live broadcast room.

步骤S205,响应于虚拟礼物赠送请求,根据目标部位的位置数据,在虚拟现实直播间中展示出在主播形象上目标部位播放的虚拟礼物特效。Step S205, in response to the virtual gift giving request, according to the position data of the target part, display the virtual gift special effect played on the target part on the anchor image in the virtual reality live broadcast room.

上述步骤S203至S205中,根据主播形象属于真人形象或虚拟形象,需要通过对应的方式获取目标部位的位置数据,然后再根据目标部位的位置数据,在虚拟现实直播间中展示出在主播形象上目标部位播放的虚拟礼物特效,如在真人形象直播的主播形象上脸部附近播放虚拟礼物特效,在虚拟形象直播的主播形象上肩部附近播放虚拟礼物特效等等。In the above steps S203 to S205, according to whether the anchor image belongs to a real person image or a virtual image, it is necessary to obtain the position data of the target part in a corresponding way, and then display the position data on the anchor image in the virtual reality live room according to the position data of the target part. The virtual gift special effects played on the target parts, such as playing virtual gift special effects near the face of the anchor image of the real-life live broadcast, playing virtual gift special effects near the shoulders of the anchor image of the virtual image live broadcast, and so on.

具体的,对于主播形象属于真人形象的情况,在步骤S203中,在主播端对主播形象上目标部位在直播画面对应的二维坐标点集进行识别,可以将该二维坐标点集作为目标部位的位置数据,也即,当观众在观众端发起虚拟礼物赠送请求后,该虚拟礼物赠送请求可以通过服务器传递至主播端,由主播端识别出主播形象上目标部位在直播画面对应的二维坐标点集作为目标部位的位置数据。作为一个实施方式,步骤S203的在主播端识别主播形象上目标部位在直播画面对应的二维坐标点集,具体包括:Specifically, for the case that the image of the anchor belongs to the image of a real person, in step S203, at the anchor end, the two-dimensional coordinate point set corresponding to the target part of the anchor image on the live screen is identified, and the two-dimensional coordinate point set can be used as the target part That is, when the viewer initiates a virtual gift request on the audience end, the virtual gift request can be transmitted to the anchor end through the server, and the anchor end can identify the two-dimensional coordinates of the target part on the anchor image corresponding to the live screen The point set serves as the location data of the target part. As an implementation manner, in step S203, identifying the two-dimensional coordinate point set corresponding to the target part on the live image of the anchor image at the anchor end, specifically includes:

根据主播端的全景直播视频数据,识别主播形象上目标部位对应的特征点集;根据特征点集在直播画面对应的二维坐标点集,得到主播形象上目标部位在直播画面对应的二维坐标点集。According to the panoramic live video data of the anchor terminal, identify the feature point set corresponding to the target part on the anchor image; according to the two-dimensional coordinate point set corresponding to the feature point set on the live screen, obtain the two-dimensional coordinate point corresponding to the target part on the anchor image on the live screen set.

本实施例中,对于主播形象属于真人形象的情况,虚拟现实直播间的直播画面可以基于预设球体进行展示,使得观众佩戴虚拟现实眼镜后可以看到包含主播形象的直播画面,该预设球体可以包括多种球体形态,如半球体形态和完整球体形态等。其中,主播可以在合适的直播环境下,按照虚拟现实直播的规范将录制直播的摄像头放在基于所在真实空间的相对中心位置,虚拟现实直播的视频数据主要是全景直播视频数据,然后可以在预设球体的内面渲染全景直播视频数据以获得对应的直播画面,由此,当观众在观众端发起虚拟礼物赠送请求后,可以由在主播端调用用于对主播形象上目标部位(如脸部、肢体部位等)识别的插件,根据拍摄的全景直播视频数据识别主播形象上目标部位对应的特征点集,以及该些特征点集在直播画面对应的二维坐标点集,由此可以将该二维坐标点集([x1,y1],[x2,y2],...,[Xn,Yn]])作为主播形象上目标部位在直播画面对应的二维坐标点集,同时通过目标部位对应的一定量的特征点来表示目标部位来减少一些数据量。In this embodiment, for the case where the image of the anchor belongs to the image of a real person, the live broadcast picture in the virtual reality live broadcast room can be displayed based on a preset sphere, so that the audience can see the live broadcast picture containing the image of the anchor after wearing virtual reality glasses. The preset sphere Various sphere shapes can be included, such as hemisphere shape and full sphere shape, etc. Among them, in a suitable live broadcast environment, the anchor can place the camera that records the live broadcast at a relatively central position based on the real space where it is located in accordance with the specifications of the virtual reality live broadcast. Assume that the inner surface of the sphere renders the panoramic live video data to obtain the corresponding live image. Thus, when the viewer initiates a virtual gift request at the viewer end, the host image can be called by the anchor to target parts (such as face, Body parts, etc.) recognition plug-in, according to the captured panoramic live video data to identify the feature point set corresponding to the target part on the anchor image, and the two-dimensional coordinate point set corresponding to the feature point set on the live screen, so that the two The two-dimensional coordinate point set ([x1,y1],[x2,y2],...,[Xn,Yn]]) is used as the two-dimensional coordinate point set corresponding to the target part on the live broadcast screen on the anchor image, and at the same time, the target part corresponds to A certain amount of feature points to represent the target part to reduce some data volume.

基于此,步骤S205中的根据目标部位的位置数据,在虚拟现实直播间中展示出在主播形象上目标部位播放的虚拟礼物特效,相应包括:Based on this, in step S205, according to the location data of the target part, the virtual gift special effects played on the target part of the anchor image are displayed in the virtual reality live broadcast room, correspondingly including:

在主播端于预设球体的视频画面层渲染全景直播视频数据得到直播画面,于预设球体的特效播放层根据目标部位的位置数据渲染虚拟礼物特效得到特效画面;将直播画面和特效画面混合得到目标直播数据,将目标直播数据发送至虚拟现实直播间中各观众端,以供各观众端在虚拟现实直播间中展示出在主播形象上目标部位播放的虚拟礼物特效。On the anchor side, the panoramic live video data is rendered on the video screen layer of the preset sphere to obtain the live screen, and the virtual gift special effect is rendered on the special effect playback layer of the preset sphere according to the position data of the target part to obtain the special effect screen; the live screen and the special effect screen are mixed to obtain The target live broadcast data, the target live broadcast data is sent to each audience terminal in the virtual reality live broadcast room, so that each audience terminal can display the virtual gift special effect played on the target part of the anchor image in the virtual reality live broadcast room.

本实施例主要是在主播端将直播画面和特效画面进行混合后再同步至虚拟现实直播间中各观众端进行播放,达到各观众端在虚拟现实直播间中同步展示出在主播形象上目标部位播放的虚拟礼物特效的效果。具体的,在主播端中,预设球体可以包括视频画面层和特效播放层,视频画面层可用于渲染全景直播视频数据以获得对应的直播画面,特效播放层则可用于渲染虚拟礼物特效以获得对应的特效画面,无论是平面的虚拟礼物还是立体的虚拟礼物都会渲染在此特效播放层,该特效播放层属于预设球体的视频画面层上一个单独的层。由此,在主播端于预设球体的视频画面层渲染全景直播视频数据得到直播画面,由于已获得主播形象上目标部位在直播画面对应的二维坐标点集作为位置数据,故主播端可于预设球体的特效播放层根据该目标部位的位置数据渲染对应的虚拟礼物特效得到特效画面,该虚拟礼物特效具体可以是根据对应礼物脚本执行对应的动画路径,如亲脸特效,则将对应的虚拟礼物在脸部特征点集位置播放,同理,围绕肢体特效则将对应的虚拟礼物围绕对应的肢体特征点集位置播放,所以此时直播画面与特效画面叠加显示的效果是虚拟礼物特效在主播形象上目标部位处播放。然后,可以在主播端将直播画面和特效画面混合得到目标直播数据,然后将目标直播数据通过服务器推送至虚拟现实直播间中各观众端,各观众端收到目标直播数据后可渲染得到对应的直播画面,从而在虚拟现实直播间中展示出在主播形象上目标部位播放的虚拟礼物特效,此时各观众在各自的观众端看到的直播画面中虚拟礼物特效的播放是实时同步的。This embodiment is mainly to mix the live image and the special effect image at the anchor end and then synchronize them to the viewers in the virtual reality live room for playback, so that each viewer can simultaneously display the target position on the image of the anchor in the virtual reality live room Play the effect of virtual gift special effects. Specifically, on the anchor side, the preset sphere can include a video image layer and a special effect playback layer. The video image layer can be used to render panoramic live video data to obtain the corresponding live broadcast image, and the special effect playback layer can be used to render virtual gift special effects to obtain The corresponding special effect images, whether it is a flat virtual gift or a three-dimensional virtual gift, will be rendered in this special effect playback layer, which belongs to a separate layer on the video image layer of the preset sphere. Thus, on the anchor end, the panoramic live video data is rendered on the video image layer of the preset sphere to obtain the live image. Since the two-dimensional coordinate point set corresponding to the target part on the image of the anchor has been obtained as the position data as the position data, the anchor end can The special effect playback layer of the preset sphere renders the corresponding virtual gift special effect according to the position data of the target part to obtain the special effect screen. The virtual gift special effect can specifically execute the corresponding animation path according to the corresponding gift script. The virtual gift is played at the position of the feature point set of the face. Similarly, the special effect around the body will play the corresponding virtual gift around the position of the feature point set of the body. Play at the target position on the anchor image. Then, the live broadcast images and special effects images can be mixed on the host end to obtain the target live broadcast data, and then the target live broadcast data can be pushed to each viewer end in the virtual reality live broadcast room through the server, and each viewer end can render the target live broadcast data to obtain the corresponding Live screen, so that the virtual gift special effects played on the target part of the anchor image are displayed in the virtual reality live room. At this time, the playback of the virtual gift special effects in the live screen seen by each audience on their respective audience terminals is synchronized in real time.

具体的,对于主播形象属于虚拟形象的情况,在步骤S204中,可直接根据主播形象上目标部位在虚拟现实直播间的三维坐标点集,得到目标部位的位置数据,可以将该三维坐标点集作为目标部位的位置数据。其中,无论是主播形象在虚拟现实直播间进行运动或者静止不动,都可以获得该主播形象在虚拟现实直播间的三维坐标点集(X,Y,Z),故在进行针对其上目标部位的虚拟礼物赠送时,可获取该主播形象上目标部位在虚拟现实直播间的三维坐标点集作为目标部位的位置数据,然后在步骤S205中,可以在虚拟现实直播间的各端根据该目标部位的位置数据,在主播形象上目标部位处播放对应的虚拟礼物特效,即在以虚拟形象直播的场景下,一观众端进行针对主播形象上目标部位的虚拟礼物赠送后,可由服务器通过广播的方式同步触发各端各自进行目标部位的位置数据的获取以及虚拟礼物特效播放,达到在各端在虚拟现实直播间中展示出在主播形象上目标部位播放的虚拟礼物特效的效果。Specifically, for the case where the host image belongs to the virtual image, in step S204, the position data of the target part can be obtained directly according to the three-dimensional coordinate point set of the target part on the anchor image in the virtual reality live room, and the three-dimensional coordinate point set can be as the location data of the target site. Among them, whether the anchor image is moving or standing still in the virtual reality live broadcast room, the three-dimensional coordinate point set (X, Y, Z) of the anchor image in the virtual reality live broadcast room can be obtained, so the target part on it can be When presenting a virtual gift, the three-dimensional coordinate point set of the target part on the anchor image in the virtual reality live room can be obtained as the position data of the target part, and then in step S205, the target part can be obtained at each end of the virtual reality live room. location data, and play the corresponding virtual gift special effects at the target position on the anchor image, that is, in the scene of live broadcast with virtual images, after a viewer end presents a virtual gift for the target position on the anchor image, the server can broadcast Simultaneously trigger each end to obtain the position data of the target part and play the virtual gift special effect, so as to achieve the effect of displaying the virtual gift special effect played on the target part of the anchor image in the virtual reality live room at each end.

对此,在一些实施例中,如图3所示,步骤S205的根据目标部位的位置数据,在虚拟现实直播间中展示出在主播形象上目标部位播放的虚拟礼物特效,可以进一步包括:In this regard, in some embodiments, as shown in FIG. 3 , in step S205, according to the location data of the target part, the virtual gift special effect played on the target part on the anchor image is displayed in the virtual reality live broadcast room, which may further include:

步骤S301,主播形象属于虚拟形象时,获取发出虚拟礼物赠送请求的观众在虚拟现实直播间对应的虚拟观众位置点。Step S301, when the image of the anchor belongs to the avatar, obtain the corresponding virtual viewer's location point in the virtual reality live broadcast room of the viewer who sent the virtual gift request.

具体的,对于主播形象属于虚拟形象的情况,本步骤中,各端可获取发出虚拟礼物赠送请求的观众在虚拟现实直播间对应的虚拟观众位置点。具体的,观众进入虚拟现实直播间中,以虚拟演唱会场景为例,观众可以是置身于虚拟舞台场景下的一个座位上,该座位会有一个坐标点(Xg,Yg,Zg),该坐标点可以作为观众在虚拟现实直播间对应的虚拟观众位置点,而进入虚拟现实直播间的每个观众均可具有对应的虚拟观众位置点,由此在一观众在观众端发起虚拟礼物赠送请求后,各端可获取该观众在虚拟现实直播间对应的虚拟观众位置点。Specifically, for the case where the image of the anchor belongs to the avatar, in this step, each end can obtain the virtual audience location point corresponding to the audience who sent the virtual gift request in the virtual reality live broadcast room. Specifically, when the audience enters the virtual reality live broadcast room, taking the virtual concert scene as an example, the audience can be placed on a seat under the virtual stage scene, and the seat will have a coordinate point (Xg, Yg, Zg). The point can be used as the corresponding virtual audience location point of the audience in the virtual reality live broadcast room, and each audience entering the virtual reality live broadcast room can have a corresponding virtual audience location point. , each end can obtain the corresponding virtual viewer position point of the viewer in the virtual reality live broadcast room.

步骤S302,在虚拟现实直播间中,播放针对主播形象上目标部位的虚拟礼物从虚拟观众位置点移动至主播形象的预设动画。Step S302, in the virtual reality live broadcast room, play a preset animation in which the virtual gift for the target part on the anchor image moves from the virtual audience position to the anchor image.

具体的,在虚拟现实直播间中,当一观众赠送一个针对主播形象上目标部位的虚拟礼物时,在获得该观众的虚拟观众位置点后,在虚拟现实直播间播放预设动画,该预设动画可以是针对主播形象上目标部位的虚拟礼物从虚拟观众位置点出发移动至主播形象附近的动画,其包含的动画效果不限于淡入淡出、缩放、旋转等,其包含的移动路径不限于贝塞尔曲线、随机路径、固定路径等,可从虚拟观众位置点出发位移到主播形象附近。Specifically, in the virtual reality live broadcast room, when a viewer presents a virtual gift aimed at the target part of the anchor image, after obtaining the viewer's virtual audience position point, a preset animation is played in the virtual reality live broadcast room, and the preset The animation can be an animation in which the virtual gift on the target part of the host image moves from the virtual audience position to the vicinity of the host image. The animation effects it contains are not limited to fade in and fade out, scaling, rotation, etc., and the movement paths it contains are not limited to beser Curves, random paths, fixed paths, etc., can be displaced from the virtual audience position to the vicinity of the anchor image.

步骤S303,虚拟礼物移动至主播形象后,根据目标部位的位置数据,在主播形象上目标部位播放对应的虚拟礼物特效。Step S303, after the virtual gift moves to the host image, play the corresponding virtual gift special effect on the target site on the host image according to the location data of the target site.

本步骤中,虚拟礼物从虚拟观众位置点出发移动至主播形象附近后,可根据主播形象上目标部位的位置数据,在该目标部位播放对应的虚拟礼物特效,例如可以让虚拟礼物围绕着主播形象的人脸、肢体等部位做一些动作,可以将其设置为在有限时间内消失,若在较短时间内赠送多个该虚拟礼物,也可以通过在该虚拟礼物上方显示乘以多少个礼物的方式位移过去,以完善虚拟礼物特效在主播形象上目标部位播放的效果。In this step, after the virtual gift moves from the position of the virtual audience to the vicinity of the host image, the corresponding virtual gift special effects can be played on the target site according to the position data of the target site on the host image, for example, the virtual gift can be made to surround the host image You can set it to disappear within a limited time if you do some actions on the face, limbs, etc. The method is shifted to the past to improve the effect of playing the virtual gift special effects on the target part of the anchor image.

基于此,在一些实施例中,步骤S303的在主播形象上目标部位播放对应的虚拟礼物特效之后,还可以包括:Based on this, in some embodiments, after playing the corresponding virtual gift special effect on the target part of the host image in step S303, it may also include:

在主播端检测到主播通过头戴式虚拟现实设备的操作手柄触发与虚拟礼物的碰撞时,在主播端通过头戴式虚拟现实设备向主播产生碰撞反馈。When the anchor end detects that the anchor triggers a collision with the virtual gift through the operating handle of the head-mounted virtual reality device, the anchor end generates collision feedback to the anchor through the head-mounted virtual reality device.

本实施例中,主播可以通过头戴式虚拟现实设备的操作手柄与围绕在自身的主播形象的虚拟礼物进行互动,如通过操作手柄去抓取这些虚拟礼物,抓取时可通过头戴式虚拟现实设备向主播产生反馈,如抓取到虚拟礼物时让头戴式虚拟现实设备的手柄产生震动等等。具体的,在主播形象上目标部位播放对应的虚拟礼物特效之后,主播可以通过头戴式虚拟现实设备的操作手柄触发与虚拟礼物的碰撞,主播端可进行碰撞检测,如通过操作手柄的位置或其发射的射线的位置与虚拟礼物当前所停留的位置进行碰撞检测,若检测操作手柄或其发射的射线与虚拟礼物相交时,则可以确定主播触发与虚拟礼物的碰撞,此时主播端可以通过头戴式虚拟现实设备向主播产生碰撞反馈,如使操作手柄产生震动等等,实现主播与在其主播形象周围播放的虚拟礼物特效中虚拟礼物的交互。在此礼物交互过程中,服务器可以将对应的状态数据通过帧同步或者状态同步的方式将整个交互的过程同步到虚拟现实直播间的其他各端,其他各端收到同步消息后渲染对应的交互画面,此时虚拟现实直播间中各端都可以看到一直交互的过程。In this embodiment, the anchor can interact with the virtual gifts surrounding the anchor image through the operating handle of the head-mounted virtual reality device. For example, to grab these virtual gifts through the operating handle, the head-mounted virtual reality The reality device generates feedback to the anchor, such as making the handle of the head-mounted virtual reality device vibrate when the virtual gift is grabbed, and so on. Specifically, after playing the corresponding virtual gift special effects on the target part of the anchor’s image, the anchor can trigger a collision with the virtual gift through the operating handle of the head-mounted virtual reality device, and the anchor can perform collision detection, such as through the position of the operating handle or Collision detection is performed between the position of the emitted ray and the current position of the virtual gift. If the detected operation handle or the ray emitted intersects with the virtual gift, it can be determined that the anchor triggers a collision with the virtual gift. At this time, the anchor can pass The head-mounted virtual reality device generates collision feedback to the anchor, such as making the operating handle vibrate, etc., to realize the interaction between the anchor and the virtual gift in the virtual gift special effect played around the anchor image. During this gift interaction process, the server can synchronize the corresponding state data to other ends of the virtual reality live room through frame synchronization or state synchronization, and other ends will render the corresponding interaction after receiving the synchronization message At this time, each end in the virtual reality live broadcast room can see the process of continuous interaction.

本实施例的虚拟现实直播间虚拟礼物特效播放处理方法,在虚拟现实直播间中展示主播形象,接收针对主播形象上目标部位的虚拟礼物赠送请求,若该主播形象属于真人形象则在主播端识别该目标部位在直播画面对应的二维坐标点集得到目标部位的位置数据,若该主播形象属于虚拟形象则根据该目标部位在虚拟现实直播间的三维坐标点集得到目标部位的位置数据,响应于虚拟礼物赠送请求,根据目标部位的位置数据,在虚拟现实直播间中展示出在主播形象上目标部位播放的虚拟礼物特效。该方案能够提供针对主播形象上目标部位的虚拟礼物赠送及特效播放功能,根据虚拟现实直播间中展示的主播形象为真人形象或虚拟形象,采用对应的方式获取其上目标部位的位置数据,然后根据该位置数据在虚拟现实直播间中展示出在主播形象上目标部位播放的虚拟礼物特效,使得虚拟现实直播间中虚拟礼物可以结合在主播形象上目标部位进行播放,故可随着主播形象及其目标部位在虚拟现实直播间中的位置变化而发生相应跟随移动,丰富了虚拟现实直播场景中虚拟礼物特效的播放形式,使虚拟现实直播间中虚拟礼物的播放具有更生动的表现效果,可应用于元宇宙直播场景下的虚拟礼物特效播放处理中,丰富元宇宙直播中虚拟礼物的样式及其特效的播放形式,有利于促进元宇宙直播中主播和观众的互动。The virtual gift special effect playback processing method in the virtual reality live broadcast room of this embodiment displays the anchor image in the virtual reality live broadcast room, receives a virtual gift presentation request for the target part on the anchor image, and identifies it at the anchor end if the anchor image belongs to a real person image The position data of the target part is obtained from the two-dimensional coordinate point set corresponding to the target part in the live broadcast screen. If the anchor image belongs to the avatar, the position data of the target part is obtained according to the three-dimensional coordinate point set of the target part in the virtual reality live broadcast room, and the response According to the virtual gift giving request, according to the location data of the target part, the virtual gift special effect played on the target part of the anchor image is displayed in the virtual reality live broadcast room. This solution can provide virtual gift giving and special effects playback functions for the target part of the anchor image. According to whether the anchor image displayed in the virtual reality live broadcast room is a real image or a virtual image, the position data of the target part on it is obtained in a corresponding way, and then According to the location data, the special effect of the virtual gift played on the target part of the anchor image is displayed in the virtual reality live room, so that the virtual gift in the virtual reality live room can be played in combination with the target part of the anchor image, so it can follow the anchor image and The position of the target part in the virtual reality live broadcast room changes accordingly to follow the movement, which enriches the playback form of virtual gift special effects in the virtual reality live broadcast scene, and makes the virtual gift play in the virtual reality live broadcast room more vivid. It is applied to the special effects playback processing of virtual gifts in the live broadcast scene of the Metaverse, enriching the styles of virtual gifts and the playback forms of special effects in the live broadcast of the Metaverse, which is conducive to promoting the interaction between the anchor and the audience in the live broadcast of the Metaverse.

对于主播形象属于真人形象的情况,在一些实施例中,步骤S201的在虚拟现实直播间中展示主播形象,可以包括:基于预设球体展示虚拟现实直播间的直播画面;其中,直播画面中包含主播形象。For the case where the image of the anchor belongs to the image of a real person, in some embodiments, the step S201 of displaying the image of the anchor in the virtual reality live broadcast room may include: displaying the live image of the virtual reality live broadcast room based on a preset sphere; wherein, the live image includes anchor image.

具体的,观众端具体可以是连接头戴式虚拟现实设备的智能手机、平板电脑等终端,也可以是配置有直播应用的头戴式虚拟现实设备,头戴式虚拟现实设备可以包括VR(Virtual Reality,虚拟现实)眼镜和操作手柄,可以通过头戴式虚拟现实设备中虚拟现实眼镜显示直播画面和虚拟礼物,及通过头戴式虚拟现实设备中操作手柄获得来自的观众与虚拟礼物的交互指令,以执行对虚拟礼物的赠送处理。本实施例中,虚拟现实直播间的直播画面可以基于预设球体进行展示,使得观众佩戴虚拟现实眼镜后可以看到包含主播形象的直播画面,该预设球体可以包括多种球体形态,如半球体形态和完整球体形态等。进一步的,可以根据来自主播端的全景直播视频数据对应的度数类型,选取球体形态适配的预设球体及在相应位置摆放虚拟摄像机展示对应的直播画面,保证直播画面展示效果。具体的,主播可以在主播端选择虚拟现实直播,当主播选择虚拟现实直播时,主播可以在合适的直播环境下,按照虚拟现实直播的规范将录制直播的摄像头放在基于所在真实空间的相对中心位置,虚拟现实直播的视频数据主要是全景直播视频数据,其对应的度数类型主要包括180度和360度,当收到相应度数类型的全景直播视频数据后,可以根据该度数类型确定具有与之对应的球体形态的预设球体,如收到180度的全景直播视频数据可以确定透明半球体为预设球体,收到360度的全景直播视频数据可以确定透明完整球体为预设球体,然后可以在预设球体的内面渲染全景直播视频数据,此时,需要在预设球体的内部的预设摆放位置处摆放虚拟摄像机以展示出对应的直播画面,其中,对于球体形态为完整球体形态,预设摆放位置可以是完整球体的中心即将虚拟摄像机放置在完整球体的中心,对于球体形态为半球体形态,预设摆放位置可以是半球体的中心偏内面一定距离的位置,使观看直播画面时具有一定沉浸感。Specifically, the viewer terminal can be a terminal such as a smart phone or a tablet computer connected to a head-mounted virtual reality device, or a head-mounted virtual reality device configured with a live broadcast application. The head-mounted virtual reality device can include a VR (Virtual Reality Reality, virtual reality) glasses and operating handles, which can display live images and virtual gifts through the virtual reality glasses in the head-mounted virtual reality device, and obtain interactive instructions from the audience and virtual gifts through the operating handle in the head-mounted virtual reality device , to perform the processing of the virtual gift. In this embodiment, the live broadcast picture in the virtual reality live broadcast room can be displayed based on a preset sphere, so that the audience can see the live broadcast picture containing the image of the host after wearing virtual reality glasses. The preset sphere can include a variety of spherical shapes, such as hemisphere Body shape and complete spherical shape, etc. Furthermore, according to the degree type corresponding to the panoramic live video data from the anchor terminal, a preset sphere adapted to the sphere shape can be selected and a virtual camera can be placed at the corresponding position to display the corresponding live image to ensure the display effect of the live image. Specifically, the anchor can choose virtual reality live broadcast on the anchor side. When the anchor chooses virtual reality live broadcast, the anchor can place the camera that records the live broadcast in the relative center based on the real space in a suitable live broadcast environment according to the specifications of virtual reality live broadcast. Location, the video data of virtual reality live broadcast is mainly panoramic live video data, and the corresponding degree types mainly include 180 degrees and 360 degrees. After receiving the panoramic live video data of the corresponding degree type, it can be determined according to the degree type. The preset sphere of the corresponding sphere shape, such as receiving 180-degree panoramic live video data, can determine that the transparent hemisphere is the preset sphere, and receiving 360-degree panoramic live video data can determine that the transparent and complete sphere is the default sphere, and then you can Render panoramic live video data on the inner surface of the preset sphere. At this time, it is necessary to place a virtual camera at the preset position inside the preset sphere to display the corresponding live video. The sphere shape is a complete sphere shape , the preset placement position can be the center of a complete sphere, that is, place the virtual camera at the center of a complete sphere. For a sphere whose shape is a hemisphere, the preset placement position can be a certain distance from the center of the hemisphere, so that the viewing There is a certain sense of immersion in live broadcasting.

基于此,在基于预设球体展示虚拟现实直播间的直播画面之后,还可以包括以下步骤:Based on this, after displaying the live video of the virtual reality live room based on the preset sphere, the following steps may also be included:

获取待展示的虚拟礼物对应的空间维度,以及获取直播画面中主播形象所在位置;其中,该待展示的虚拟礼物包含针对主播形象上目标部位的虚拟礼物;根据待展示的虚拟礼物对应的空间维度和主播形象所在位置,在预设球体范围内对应的预设无遮挡位置处展示虚拟礼物。Obtain the spatial dimension corresponding to the virtual gift to be displayed, and obtain the location of the anchor image in the live broadcast screen; wherein, the virtual gift to be displayed includes a virtual gift for the target position on the anchor image; according to the spatial dimension corresponding to the virtual gift to be displayed Display the virtual gift at the preset unobstructed position corresponding to the location of the anchor image within the range of the preset sphere.

其中,对于上述的获取待展示的虚拟礼物对应的空间维度以及获取直播画面中主播形象所在位置,具体的,待展示的虚拟礼物对应的空间维度可以包括平面和立体,即待展示的虚拟礼物可以是二维的平面虚拟礼物,也可以是三维的立体虚拟礼物,待展示的虚拟礼物对应的空间维度可以用空间维度标识进行表示,如2表示平面、3表示立体等等;直播画面中主播形象所在位置是指通过主播端进行直播的主播在直播画面中的位置,该位置可以是主播在直播过程中大致所在的一个位置范围,具体可以通过对直播画面中主播形象进行人像检测的方式进行确定,也可以由主播根据直播时自身大致的活动区域范围进行预先设定,如大致位于房间的某个位置直播等。Among them, for the above-mentioned acquisition of the corresponding spatial dimension of the virtual gift to be displayed and the acquisition of the location of the anchor image in the live broadcast screen, specifically, the spatial dimension corresponding to the virtual gift to be displayed can include plane and three-dimensional, that is, the virtual gift to be displayed can be It is a two-dimensional flat virtual gift, or a three-dimensional virtual gift. The spatial dimension corresponding to the virtual gift to be displayed can be represented by a spatial dimension mark, such as 2 for flat, 3 for three-dimensional, etc.; the image of the anchor in the live broadcast screen The location refers to the position of the host in the live broadcast screen through the host terminal. This position can be a range of the host’s approximate location during the live broadcast process. Specifically, it can be determined by performing portrait detection on the live broadcast screen of the host’s image. , it can also be pre-set by the host according to his approximate activity area during the live broadcast, such as live broadcast at a certain position in the room.

其中,对于上述的根据待展示的虚拟礼物对应的空间维度和主播形象所在位置,在预设球体范围内对应的预设无遮挡位置处展示虚拟礼物,具体的,根据待展示的虚拟礼物对应的空间维度以及主播形象所在位置的不同,可以在预设球体范围内对应的预设无遮挡位置处展示该虚拟礼物。其中,在预设球体范围内展示虚拟礼物可以使得虚拟礼物能够在展示直播画面的基础上展示给观众看到,预设无遮挡位置是指预先设置的可以对主播形象所在位置基本不形成遮挡的用于放置虚拟礼物的位置,可以预先针对平面、立体以及常用的各种主播形象所在位置来对无遮挡位置进行预先设置并不断调整,使之能够满足对主播形象所在位置基本不形成遮挡的条件,如设一种主播形象所在位置为画面中部区域,可以将对应的预设无遮挡位置设置在画面中部区域左侧或右侧的区域等等,然后可以再根据平面和立体的虚拟礼物所占的空间范围对预设无遮挡位置进行一些调整使得虚拟礼物展示后对主播形象所在位置不形成遮挡,由此可以确定多个预设无遮挡位置以供应用。Among them, for the above-mentioned space dimension corresponding to the virtual gift to be displayed and the location of the anchor image, the virtual gift is displayed at the corresponding preset unobstructed position within the range of the preset sphere. Specifically, according to the corresponding location of the virtual gift to be displayed Depending on the spatial dimension and the position of the host image, the virtual gift can be displayed at the corresponding preset unobstructed position within the range of the preset sphere. Among them, displaying the virtual gift within the range of the preset sphere can enable the virtual gift to be displayed to the audience on the basis of displaying the live broadcast screen. The preset unoccluded position refers to a pre-set position that basically does not block the anchor’s image. The position for placing the virtual gift can be pre-set and adjusted continuously for the unobstructed position according to the plane, three-dimensional and commonly used positions of various anchor images, so that it can meet the condition that the position of the anchor image basically does not form occlusion , such as setting the position of an anchor image as the central area of the screen, the corresponding preset unobstructed position can be set in the left or right area of the central area of the screen, etc., and then according to the two-dimensional and three-dimensional virtual gifts Some adjustments are made to the preset unobstructed positions so that the virtual gift does not form an occlusion to the location of the anchor image after the virtual gift is displayed, so that multiple preset unobstructed positions can be determined for application.

基于此,步骤S202的接收针对主播形象上目标部位的虚拟礼物赠送请求,具体包括:Based on this, the receiving in step S202 of the virtual gift giving request for the target part on the anchor image specifically includes:

根据通过头戴式虚拟现实设备的操作手柄触发的与针对主播形象上目标部位的虚拟礼物的交互指令,获取虚拟礼物赠送请求。According to the interactive command triggered by the operating handle of the head-mounted virtual reality device and the virtual gift aimed at the target part on the image of the anchor, the request for giving the virtual gift is obtained.

具体的,观众可以佩戴头戴式虚拟现实设备中虚拟现实眼镜显示直播画面和虚拟礼物,通过头戴式虚拟现实设备中操作手柄发射射线、点击操作手柄中按钮来触发与针对主播形象上目标部位的虚拟礼物的交互指令,观众端可以通过操作手柄获取该些交互指令,从而根据交互指令获取虚拟礼物赠送请求,执行对针对主播形象上目标部位的虚拟礼物的赠送处理,实现虚拟现实直播间的虚拟礼物赠送与播放。Specifically, viewers can wear virtual reality glasses in the head-mounted virtual reality device to display live images and virtual gifts, emit rays through the operating handle in the head-mounted virtual reality device, and click the button in the operating handle to trigger and target the target part of the anchor image. The audience can obtain the interactive instructions of the virtual gift through the operating handle, so as to obtain the virtual gift request according to the interactive instruction, execute the gift processing for the target part of the anchor image, and realize the virtual reality live broadcast room Virtual gift giving and play.

本实施例的方案在预设球体展示虚拟现实直播间的直播画面时,根据待展示的虚拟礼物对应的空间维度和直播画面中主播形象所在位置,在该预设球体内对应的预设无遮挡位置处展示虚拟礼物,通过预设球体内对应的预设无遮挡位置使得各空间维度的虚拟礼物能够在虚拟现实直播间的特定位置处显示出来且避免对主播形成遮挡,保证直播显示,观众佩戴头戴式虚拟现实设备并通过其操作手柄触发与针对主播形象上目标部位的虚拟礼物的交互指令,根据该交互指令获取虚拟礼物赠送请求,执行对该虚拟礼物的赠送处理,由此实现虚拟现实直播间的虚拟礼物赠送与播放,使观众能够在虚拟现实直播场景中通过操作手柄便捷地向主播赠送针对主播形象上目标部位的虚拟礼物进行互动。According to the solution of this embodiment, when the preset sphere displays the live image of the virtual reality live broadcast room, according to the spatial dimension corresponding to the virtual gift to be displayed and the position of the anchor image in the live image, the corresponding preset unobstructed location in the preset sphere The virtual gift is displayed at the position, and the virtual gift of each spatial dimension can be displayed at a specific position in the virtual reality live broadcast room through the preset unobstructed position corresponding to the preset sphere, and avoids occlusion to the anchor, ensuring the live broadcast display, and the audience wears it. The head-mounted virtual reality device triggers an interactive command with the virtual gift on the target part of the anchor image through its operating handle, obtains a virtual gift gift request according to the interactive command, and executes the gift processing of the virtual gift, thereby realizing virtual reality The virtual gift giving and playing in the live broadcast room enables the audience to interact with the anchor by conveniently presenting virtual gifts for the target parts of the anchor’s image through the operation handle in the virtual reality live broadcast scene.

进一步的,基于上述的主播形象属于真人形象的实施例,对于平面虚拟礼物,上述实施例中的根据待展示的虚拟礼物对应的空间维度和主播形象所在位置,在预设球体范围内对应的预设无遮挡位置处展示虚拟礼物,具体包括:Furthermore, based on the above-mentioned embodiment where the image of the anchor belongs to a real person, for a flat virtual gift, in the above embodiment, according to the spatial dimension corresponding to the virtual gift to be displayed and the location of the anchor image, the corresponding preset within the range of the preset sphere Display virtual gifts in unobstructed locations, including:

待展示的虚拟礼物对应的空间维度为平面时,根据主播形象所在位置在预设球体范围内对应的预设无遮挡位置处展示平面礼物栏;该平面礼物栏包含预先划分的多个平面区域;在多个平面区域展示待展示的虚拟礼物。When the spatial dimension corresponding to the virtual gift to be displayed is flat, display the flat gift column at the preset unobstructed position corresponding to the preset sphere according to the location of the anchor image; the flat gift column includes multiple pre-divided flat areas; Display virtual gifts to be displayed in multiple flat areas.

本实施例中,将平面虚拟礼物展示于平面礼物栏以提升平面虚拟礼物在虚拟现实直播间的展示效果并便于观众触发与之的交互。具体的,可以根据主播形象所在位置在预设球体范围内对应的预设无遮挡位置处展示平面礼物栏,即在前述的预先设置无遮挡位置的阶段可以直接对平面礼物栏对应的无遮挡位置进行预先设置,该平面礼物栏包含预先划分的多个平面区域,每个平面区域可以是矩形区域,每个矩形区域可以用于放置待展示的平面虚拟礼物,其中可以包括针对在主播形象上目标部位的虚拟礼物,由此直接设置平面礼物栏对应的预设无遮挡位置可以提高规划各平面虚拟礼物的预设无遮挡位置的效率。具体的,本实施例可以根据主播形象所在位置将平面礼物栏展示在预设球体范围内对应的预设无遮挡位置处,以将其放置在球体空间的一个合适位置,以不遮挡主播位置为主,例如放在球体中心(因为虚拟摄像机在球体中心附近)偏右上或者偏左上的合适位置,保证平面礼物栏展示在球体内且不遮挡主播形象,然后可以将待展示的各平面虚拟礼物展示在平面礼物栏中预先划分的多个平面区域中供观众通过操作手柄进行选择赠送。In this embodiment, the flat virtual gift is displayed in the flat gift column to enhance the display effect of the flat virtual gift in the virtual reality live broadcast room and facilitate the audience to trigger interaction with it. Specifically, the plane gift column can be displayed at the corresponding preset unoccluded position within the preset sphere according to the position of the anchor image, that is, the unoccluded position corresponding to the plane gift column can be directly displayed in the aforementioned stage of presetting the unoccluded position Pre-set, the planar gift column includes a plurality of pre-divided planar areas, each planar area can be a rectangular area, and each rectangular area can be used to place a planar virtual gift to be displayed, which can include a target on the anchor image Therefore, directly setting the preset unobstructed position corresponding to the plane gift column can improve the efficiency of planning the preset unobstructed position of each plane virtual gift. Specifically, in this embodiment, the planar gift column can be displayed at a preset unoccluded position corresponding to the preset sphere range according to the location of the anchor image, so as to place it at a suitable position in the sphere space, so as not to block the anchor position. Mainly, for example, place it in a proper position on the upper right or upper left of the center of the sphere (because the virtual camera is near the center of the sphere) to ensure that the flat gift bar is displayed in the sphere without blocking the image of the anchor, and then the virtual gifts to be displayed on each plane can be displayed In the multiple plane areas pre-divided in the plane gift bar, the audience can choose to give by operating the handle.

而基于此,上述实施例中的根据通过头戴式虚拟现实设备的操作手柄触发的与针对主播形象上目标部位的虚拟礼物的交互指令,获取虚拟礼物赠送请求,具体包括:Based on this, in the above-mentioned embodiment, according to the interactive command triggered by the operating handle of the head-mounted virtual reality device and the virtual gift aimed at the target part on the image of the anchor, the virtual gift giving request is obtained, which specifically includes:

检测操作手柄发射的射线;射线与多个平面区域中目标平面区域相交时,确定展示于目标平面区域的针对主播形象上目标部位的虚拟礼物为所选虚拟礼物;响应于在相交状态下通过操作手柄触发的确认指令,得到虚拟礼物赠送请求。Detect the ray emitted by the operating handle; when the ray intersects the target plane area in multiple plane areas, determine the virtual gift displayed in the target plane area for the target part of the anchor image as the selected virtual gift; in response to passing the operation in the intersecting state The confirmation command triggered by the handle is used to obtain a virtual gift giving request.

具体的,当观众佩戴虚拟现实眼镜,通过虚拟现实眼镜所在的位置及所看到的是虚拟摄像机的位置及方向所看到的,操作手柄的数量可以是两个,可以通过调整操作手柄的位置,使得两个操作手柄位于虚拟摄像机左右的合适位置,如大致在双手所在位置,操作手柄可以具有发射射线、手柄抓取、模拟人手触碰等交互方式。本实施例中,对于平面虚拟礼物,主要通过发射射线和点击为主,在操作手柄发射一条有限长度的射线,一般射线长度不需要超过球体的半径,由此,检测操作手柄发射的射线,检测到射线与平面礼物栏的多个平面区域中目标平面区域相交时,确定展示于目标平面区域的针对主播形象上目标部位的虚拟礼物为所选虚拟礼物,即目标平面区域用于放置针对主播形象上目标部位的虚拟礼物,目标平面区域可以是多个平面区域中的一个或若干个,其中,当平面礼物栏的目标平面区域与操作手柄发射的射线有夹角时,观众端可以确定观众选择了展示于该目标平面区域的虚拟礼物,将该虚拟礼物确定为所选虚拟礼物。此时,观众还可以进一步通过操作手柄点击确认操作触发确认指令,观众端响应于在上述的相交状态下观众通过操作手柄触发的确认指令,得到针对主播形象上目标部位的虚拟礼物的虚拟礼物赠送请求,并由此进行后续的虚拟礼物的赠送及其特效播放处理。Specifically, when the audience wears virtual reality glasses, the position of the virtual reality glasses and what they see is the position and direction of the virtual camera. The number of operating handles can be two, and the position of the operating handle can be adjusted , so that the two operating handles are located at appropriate positions on the left and right of the virtual camera, such as roughly where the hands are, and the operating handles can have interactive modes such as emitting rays, grabbing the handle, and simulating human hand touch. In this embodiment, for the plane virtual gift, mainly by emitting rays and clicking, a ray with a limited length is emitted from the operating handle. Generally, the length of the ray does not need to exceed the radius of the sphere. Therefore, the ray emitted by the operating handle is detected and detected. When the ray intersects the target plane area in the multiple plane areas of the plane gift column, it is determined that the virtual gift for the target part of the anchor image displayed in the target plane area is the selected virtual gift, that is, the target plane area is used to place the target plane area for the anchor image For the virtual gift on the target site, the target plane area can be one or several of the multiple plane areas. When the target plane area of the plane gift column has an included angle with the ray emitted by the operating handle, the viewer can determine the viewer’s choice. If the virtual gift displayed in the target plane area is selected, the virtual gift is determined as the selected virtual gift. At this time, the viewer can further trigger the confirmation instruction by clicking the confirmation operation on the operating handle, and the audience terminal responds to the confirmation instruction triggered by the audience through the operating handle in the above-mentioned intersecting state, and obtains a virtual gift for the virtual gift of the target part on the anchor image Request, and thus carry out subsequent virtual gift giving and special effect playback processing.

另外,基于上述的主播形象属于真人形象的实施例,对于立体虚拟礼物,上述实施例中的根据待展示的虚拟礼物对应的空间维度和主播形象所在位置,在预设球体范围内对应的预设无遮挡位置处展示虚拟礼物,具体包括:In addition, based on the above-mentioned embodiment where the image of the anchor belongs to a real person, for the three-dimensional virtual gift, in the above embodiment, according to the spatial dimension corresponding to the virtual gift to be displayed and the location of the anchor image, the corresponding preset value within the range of the preset sphere Display virtual gifts in unobstructed locations, including:

待展示的虚拟礼物对应的空间维度为立体时,确定主播形象所在位置对应的站立平面;根据主播形象所在位置,在预设球体范围内于站立平面上对应的预设无遮挡位置处展示立体礼物柜;该立体礼物柜包含多个立体礼物放置格;在多个立体礼物放置格中展示待展示的虚拟礼物。When the spatial dimension corresponding to the virtual gift to be displayed is three-dimensional, determine the standing plane corresponding to the position of the anchor image; according to the position of the anchor image, display the three-dimensional gift at the corresponding preset unobstructed position on the standing plane within the range of the preset sphere cabinet; the three-dimensional gift cabinet includes a plurality of three-dimensional gift placement grids; virtual gifts to be displayed are displayed in the plurality of three-dimensional gift placement grids.

本实施例中,将立体虚拟礼物展示于立体礼物柜以提升立体虚拟礼物在虚拟现实直播间的展示效果并便于观众触发与之的交互。具体的,可以先将立体礼物柜放置在球体空间的一个合适位置,以不遮挡主播形象所在位置为主,具体的,先确定主播形象所在位置对应的站立平面,如主播站立的轴向为y轴,站立点为(x0,y1,z0),则主播形象所在位置对应的站立平面为y1所在平面,然后根据主播形象所在位置,在预设球体范围内于该站立平面上对应的预设无遮挡位置处展示立体礼物柜,也即在该站立平面上确定对应的预设无遮挡位置来放置立体礼物柜,使之不对主播形成遮挡,又能让立体礼物柜的展示融入到主播所在的直播画面当中。该立体礼物柜包含多个立体礼物放置格,由此可以进一步将各立体虚拟礼物(包括针对主播形象上目标部位的虚拟礼物)展示立体礼物放置格中供观众通过操作手柄进行选择赠送。In this embodiment, the three-dimensional virtual gift is displayed in the three-dimensional gift cabinet to enhance the display effect of the three-dimensional virtual gift in the virtual reality live broadcast room and facilitate the audience to trigger interaction with it. Specifically, the three-dimensional gift cabinet can be placed in a suitable position in the spherical space first, so as not to block the location of the anchor image. Specifically, first determine the standing plane corresponding to the location of the anchor image. For example, the axis where the anchor stands is y axis, the standing point is (x0, y1, z0), then the standing plane corresponding to the position of the anchor image is the plane where y1 is located, and then according to the position of the anchor image, within the range of the preset sphere, the corresponding preset no Display the three-dimensional gift cabinet at the occluded position, that is, determine the corresponding preset unobstructed position on the standing plane to place the three-dimensional gift cabinet, so that it will not block the anchor, and the display of the three-dimensional gift cabinet can be integrated into the live broadcast where the anchor is located in the screen. The three-dimensional gift cabinet includes a plurality of three-dimensional gift placement grids, so that various three-dimensional virtual gifts (including virtual gifts aimed at target parts on the image of the anchor) can be further displayed in the three-dimensional gift placement grids for the audience to choose and present through the operating handle.

而基于此,上述实施例中的根据通过头戴式虚拟现实设备的操作手柄触发的与针对主播形象上目标部位的虚拟礼物的交互指令,获取虚拟礼物赠送请求,具体包括:Based on this, in the above-mentioned embodiment, according to the interactive command triggered by the operating handle of the head-mounted virtual reality device and the virtual gift aimed at the target part on the image of the anchor, the virtual gift giving request is obtained, which specifically includes:

检测操作手柄发射的射线;射线与多个立体礼物放置格中针对主播形象上目标部位的虚拟礼物相交时,确定该虚拟礼物为所选虚拟礼物;响应于在相交状态下通过操作手柄触发的抓取操作,将所选虚拟礼物从多个立体礼物放置格对应的礼物放置位置移动至操作手柄所在位置对应的礼物观察位置;响应于通过操作手柄触发的确认操作,得到虚拟礼物赠送请求。Detect the ray emitted by the operating handle; when the ray intersects with the virtual gift aimed at the target position on the anchor image in the multiple three-dimensional gift placement grids, it is determined that the virtual gift is the selected virtual gift; The fetch operation is to move the selected virtual gift from the gift placement positions corresponding to the multiple three-dimensional gift placement grids to the gift observation position corresponding to the position of the operating handle; in response to the confirmation operation triggered by the operating handle, a virtual gift giving request is obtained.

具体的,如前所述,当观众佩戴虚拟现实眼镜,通过虚拟现实眼镜所在的位置及所看到的是虚拟摄像机的位置及方向所看到的,可以通过调整操作手柄的位置,使得两个操作手柄位于虚拟摄像机左右的合适位置,如大致在双手所在位置,该位置可以被确定为礼物观察位置,达到模拟人手拿着礼物观察的效果。本实施例中,对于属于立体虚拟礼物的针对主播形象上目标部位的虚拟礼物,可以通过手柄抓取或模拟人手的方式进行交互,当发射射线与多个立体礼物放置格中针对主播形象上目标部位的虚拟礼物相交时,观众端可以确定该虚拟礼物为所选虚拟礼物,此时,观众可以进一步通过操作手柄的按键触发抓取操作,观众端响应于在该相交状态下通过操作手柄触发的该抓取操作,将所选虚拟礼物从多个立体礼物放置格对应的礼物放置位置(即所选虚拟礼物在立体礼物柜中的位置)移动至前述的操作手柄所在位置对应的礼物观察位置,达到将立体虚拟礼物抓取到手柄位置的效果,此时可以通过调整所选虚拟礼物的展示方向等模拟人手拿着这个立体虚拟礼物在不同方向观察其形状大小的效果。接着,观众可以进一步通过操作手柄的按键触发确认操作,观众端响应于通过操作手柄触发的确认操作,得到针对主播形象上目标部位的虚拟礼物的虚拟礼物赠送请求,并由此进行后续的虚拟礼物的赠送及其特效播放处理,提升立体虚拟礼物的赠送体验。Specifically, as mentioned above, when the audience wears virtual reality glasses, what they see through the position of the virtual reality glasses and the position and direction of the virtual camera can be seen by adjusting the position of the operating handle so that the two The operating handle is located at a suitable position on the left and right of the virtual camera, such as roughly where the hands are, and this position can be determined as the gift observation position to achieve the effect of simulating the observation of a human hand holding a gift. In this embodiment, for the virtual gift that belongs to the three-dimensional virtual gift and is aimed at the target part on the anchor image, it can be interacted with by grabbing the handle or simulating the human hand. When the virtual gifts of the parts intersect, the viewer can determine that the virtual gift is the selected virtual gift. At this time, the viewer can further trigger the grabbing operation through the button of the operating handle, and the viewer responds to the This grabbing operation moves the selected virtual gift from the gift placement positions corresponding to the multiple three-dimensional gift placement grids (that is, the position of the selected virtual gift in the three-dimensional gift cabinet) to the gift observation position corresponding to the position of the aforementioned operating handle, To achieve the effect of grabbing the three-dimensional virtual gift to the position of the handle, at this time, you can adjust the display direction of the selected virtual gift to simulate the effect of holding the three-dimensional virtual gift in different directions to observe its shape and size. Then, the viewer can further trigger the confirmation operation through the button of the operating handle. In response to the confirmation operation triggered through the operating handle, the viewer can obtain a virtual gift request for a virtual gift on the target part of the anchor image, and thus carry out subsequent virtual gifts. The presenting and its special effects playback processing can enhance the experience of giving three-dimensional virtual gifts.

上述实施例中的检测操作手柄发射的射线之后,还可以包括:若在检测到射线与立体礼物柜相交时接收到通过操作手柄触发的抓取操作,将立体礼物柜从预设无遮挡位置移动至操作手柄所在位置对应的礼物柜观察位置。After detecting the ray emitted by the operating handle in the above embodiment, it may also include: if a grabbing operation triggered by the operating handle is received when the ray is detected to intersect with the three-dimensional gift cabinet, moving the three-dimensional gift cabinet from the preset unobstructed position Go to the observation position of the gift cabinet corresponding to the position of the operating handle.

本实施例中,观众可以通过操作手柄向立体礼物柜本身发射射线并通过按键触发抓取操作,若观众端检测到射线与立体礼物柜相交且此时还接收到观众通过操作手柄触发的抓取操作,则将该立体礼物柜从预设无遮挡位置移动至前述的操作手柄所在位置对应的礼物柜观察位置,即当抓取礼物时将立体礼物移动到双手所在位置(此时为礼物观察位置),当抓取礼物柜时可以将礼物柜移动到双手所在位置(此时为礼物柜观察位置),由此可供观众观察立体礼物柜中摆放的各立体虚拟礼物,进一步的,当检测到射线与立体礼物柜中针对主播形象上目标部位的虚拟礼物相交时的抓取及确认操作,也可得到针对主播形象上目标部位的虚拟礼物的虚拟礼物赠送请求。In this embodiment, the viewer can emit rays to the three-dimensional gift cabinet itself through the operating handle and trigger the grabbing operation by pressing the button. operation, the three-dimensional gift cabinet is moved from the preset unobstructed position to the observation position of the gift cabinet corresponding to the position of the aforementioned operating handle, that is, when the gift is grasped, the three-dimensional gift is moved to the position where both hands are located (at this time, it is the observation position of the gift ), when grabbing the gift cabinet, the gift cabinet can be moved to the position where both hands are located (at this time, it is the observation position of the gift cabinet), so that the audience can observe the three-dimensional virtual gifts placed in the three-dimensional gift cabinet, and further, when detecting The capture and confirmation operation when the ray intersects with the virtual gift on the target part of the anchor image in the three-dimensional gift cabinet can also obtain the virtual gift giving request for the virtual gift on the target part on the anchor image.

对于主播形象属于虚拟形象的情况,在一些实施例中,如图4所示,在步骤S201的在虚拟现实直播间中展示主播形象之后,还可以包括以下步骤:For the case where the anchor image belongs to the virtual image, in some embodiments, as shown in Figure 4, after the anchor image is displayed in the virtual reality live room in step S201, the following steps may also be included:

步骤S401,通过头戴式虚拟现实设备的传感器组分别采集主播在各预设控制维度对应的动作数据。In step S401, the sensor groups of the head-mounted virtual reality device respectively collect the action data corresponding to each preset control dimension of the anchor.

具体的,在虚拟现实直播间中展示主播形象,该主播形象属于虚拟形象,主播端具体可以是连接头戴式虚拟现实设备的智能手机、平板电脑等终端,也可以是配置有直播应用的头戴式虚拟现实设备,头戴式虚拟现实设备可以包括VR(VirtualReality,虚拟现实)眼镜及其手柄,该VR眼镜及其手柄可以配置和连接有多个传感器,该多个传感器可形成传感器组,在具体场景中,该传感器组中的多个传感器可以包括但不限于是加速度传感器、速度传感器、计步器、方向传感器、陀螺仪、声音传感器、光线传感器等等,本实施例可充分运用头戴式虚拟现实设备配置和连接的传感器组实现主播对主播形象的控制。Specifically, the image of the anchor is displayed in the virtual reality live broadcast room. The image of the anchor belongs to the virtual image, and the anchor end can be a terminal such as a smart phone or a tablet computer connected to a head-mounted virtual reality device, or it can be a headset equipped with a live broadcast application. The wearable virtual reality device, the head-mounted virtual reality device may include VR (Virtual Reality, virtual reality) glasses and a handle thereof, the VR glasses and the handle thereof may be configured and connected with multiple sensors, and the multiple sensors may form a sensor group, In a specific scenario, multiple sensors in the sensor group may include but not limited to acceleration sensors, speed sensors, pedometers, direction sensors, gyroscopes, sound sensors, light sensors, etc., this embodiment can make full use of head The sensor group configured and connected to the wearable virtual reality device realizes the host's control over the host's image.

本步骤中,在直播过程中,主播端可以实时通过头戴式虚拟现实设备的传感器组分别采5集主播在各预设控制维度对应的动作数据,主播端具体可以通过传感器组中相应的传感器获In this step, during the live broadcast, the anchor can collect 5 sets of action data corresponding to the anchor in each preset control dimension through the sensor group of the head-mounted virtual reality device in real time, and the anchor can specifically use the corresponding sensor in the sensor group won

取每一预设控制维度各自对应的动作数据。其中,预设控制维度是指对主播形象的预设控制维度,如行走维度、转动维度、声音维度和关节维度等等,具体的控制维度可以根据可供配置和连接的传感器组的具体情况进行设置,其中,行走维度可以用于对主播形象的行走进行Get the action data corresponding to each preset control dimension. Among them, the preset control dimension refers to the preset control dimension of the anchor image, such as walking dimension, rotation dimension, sound dimension and joint dimension, etc. The specific control dimension can be determined according to the specific conditions of the sensor groups that can be configured and connected. setting, where the walking dimension can be used to carry out the walking of the anchor image

控制,可以通过如计步器、加速度传感器、速度等传感器进行相应的动作数据采集来实现,0转动维度则可以用于对主播形象的转动进行控制,可以通过如方向传感器、陀螺仪等传感器Control can be achieved by collecting corresponding action data through sensors such as pedometers, acceleration sensors, and speeds. The 0-rotation dimension can be used to control the rotation of the anchor image through sensors such as direction sensors and gyroscopes.

进行相应的动作数据采集来实现,声音维度则可以用于对主播形象的声音进行控制,可以通过声音传感器进行相应的动作数据采集来实现,关节维度则可以用于对主播形象的手部等关节进行控制,可以通过如主播在手柄握住的传感器进行相应的动作数据采集来实现。由此,It can be realized by collecting corresponding action data. The sound dimension can be used to control the voice of the anchor image, which can be realized by collecting corresponding action data through the sound sensor. The joint dimension can be used to control the anchor image’s hands and other joints. Control can be achieved by collecting corresponding motion data through the sensors held by the anchor on the handle. thus,

主播端可以通过头戴式虚拟现实设备配置和连接的传感器组中相应的传感器分别采集主播在5各预设控制维度对应的动作数据,预设控制维度的数量可以是一个或者多个,具体可以根据The anchor end can collect the action data corresponding to the anchor in the 5 preset control dimensions through the corresponding sensors in the sensor group configured and connected by the head-mounted virtual reality device. The number of preset control dimensions can be one or more, and can be specifically according to

头戴式虚拟现实设备可供配置和连接的传感器的传感器的具体情况进行设置。The VR headset is available for configuration and sensor-specific setup of connected sensors.

步骤S402,对于任一预设控制维度,若预设控制维度对应的动作数据表征主播在预设控制维度对应的动作变化符合预设控制维度的预设动作变化条件,则获取动作变化对应的动作控制指令。Step S402, for any preset control dimension, if the action data corresponding to the preset control dimension indicates that the anchor’s corresponding action change in the preset control dimension meets the preset action change conditions of the preset control dimension, obtain the action corresponding to the action change Control instruction.

0本步骤中,对于任一预设控制维度,若一预设控制维度对应的动作数据表征该主播在该0 In this step, for any preset control dimension, if the action data corresponding to a preset control dimension

预设控制维度对应的动作变化符合该预设控制维度的预设动作变化条件,则获取前述动作变化对应的动作控制指令,也即当根据动作数据检测到主播做出了符合特定条件的动作变化时,将其转化为动作控制指令。举例来说,以转动维度为例,若转动维度对应的动作数据(转动If the action change corresponding to the preset control dimension meets the preset action change condition of the preset control dimension, then the action control command corresponding to the aforementioned action change is obtained, that is, when it is detected based on the action data that the anchor has made an action change that meets the specific conditions , convert it into motion control instructions. For example, taking the rotation dimension as an example, if the action data corresponding to the rotation dimension (rotation

数据)表征该主播在转动维度对应的转动变化符合该转动维度的预设动作变化条件,如主播5向左转转动的角度大小达到某个阈值时,获取对应的动作控制指令可以是向左转动一定角度的控制指令。其中,该预设动作变化条件及对应的动作控制指令,可以根据实际需求进行设置。data) indicates that the rotation change corresponding to the anchor in the rotation dimension meets the preset action change conditions of the rotation dimension. For example, when the angle of the anchor 5 turning left reaches a certain threshold, the corresponding action control command can be obtained by turning left Move a certain angle of control command. Wherein, the preset action change condition and the corresponding action control instruction can be set according to actual needs.

步骤S403,根据动作控制指令,获取脚本数据库中对应的目标动作脚本。Step S403, according to the action control instruction, obtain the corresponding target action script in the script database.

具体的,可以先配置脚本数据库。其中,对于主播形象来说,其可以由设计人员按照一0定的规范进行规范设计,规范的设计可以保持动作脚本的复用性,这些主播形象在做出某些Specifically, the script database can be configured first. Among them, for the image of the anchor, it can be designed by the designer according to a certain standard, and the standard design can maintain the reusability of the action script.

动作时会伴随整个主播形象的各骨骼关节的运动,骨骼关节会标识其运动的精细程度,一般情况下,精细程度越高的骨骼关节数量跟面数设计会越精细,而且主播形象做出某些动作时还可能会伴随一些声音、图片等素材资源。其中,对于声音素材资源,如背景音乐、表情音乐等,对于图片素材资源,如主播形象的服饰、道具等,而这些素材资源需要预先制作和录制,从而形成素材资源库,素材资源库中包含的各种素材资源可以分别与动作脚本进行关联,达到获得一动作脚本可以从中获取对应的素材资源的目的。具体的,对于动作脚本,不同的主播形象都会有一些特定的动作,且在做出特定动作的时候可能需要搭配一些特定的声音、图片等素材资源进行表现,这些特定的动作、素材资源可以通过代码脚本进行控制跟绑定,例如主播形象具备的行走、站立、举手、唱歌、跳舞等动作,就需要根据主播形象的模型制作中对于其模型的骨骼关节及所需素材资源进行对应的代码脚本编写,并保存下来得到行走、站立、举手、唱歌、跳舞等动作的动作脚本,并设置每一动作脚本的标识及其描述信息,该描述信息具体可以包括该动作脚本对应的动作控制指令等信息,由此可以将动作控制指令与动作脚本进行对应,而为让这些动作脚本在后续便于使用、复用和管理,可以为每一动作脚本设置唯一的标识,定义动作脚本的名字(可以用于描述该动作脚本的动作含义,如行走、站立、举手、唱歌、跳舞等),还可以为每个动作脚本设置其对应的主播形象、对应的直播场景、对应的形象属性、动作控制指令等标签做进一步的分类存储,形成脚本数据库。基于此,本步骤中,主播端获得动作控制指令后,可以向服务器发送携带该动作控制指令的脚本获取请求,服务器可以根据该脚本获取请求中动作控制指令,从脚本数据库中获取该动作控制指令对应的动作脚本作为目标动作脚本,然后返回至主播端,从而主播端可以获得目标动作脚本。The action will be accompanied by the movement of the bones and joints of the entire anchor image, and the bones and joints will mark the fineness of the movement. Generally, the higher the fineness, the more refined the design of the number of bones and joints and the number of faces, and the anchor image will make a certain Some actions may also be accompanied by some sound, pictures and other material resources. Among them, for sound material resources, such as background music, emoticon music, etc., and for picture material resources, such as the clothing and props of the image of the anchor, these material resources need to be pre-produced and recorded to form a material resource library. The material resource library contains Various material resources can be associated with action scripts respectively, so as to achieve the purpose of obtaining corresponding material resources from which an action script can obtain. Specifically, for action scripts, different anchor images will have some specific actions, and some specific sounds, pictures and other material resources may be required to perform specific actions. These specific actions and material resources can be displayed through Code scripts are used to control and bind, such as walking, standing, raising hands, singing, dancing and other actions that the anchor image has, it is necessary to make corresponding codes for the model’s bone joints and required material resources according to the model production of the anchor image Write scripts and save them to get action scripts for walking, standing, raising hands, singing, dancing, etc., and set the identification and description information of each action script. The description information can specifically include the action control instructions corresponding to the action script and other information, so that action control instructions can be associated with action scripts, and in order to make these action scripts easy to use, reuse and manage in the future, a unique identifier can be set for each action script, and the name of the action script can be defined (you can It is used to describe the action meaning of the action script, such as walking, standing, raising hands, singing, dancing, etc.), and can also set the corresponding anchor image, corresponding live broadcast scene, corresponding image attribute, and action control for each action script Tags such as instructions are further classified and stored to form a script database. Based on this, in this step, after the anchor obtains the action control instruction, it can send a script acquisition request carrying the action control instruction to the server, and the server can obtain the action control instruction in the request according to the script, and obtain the action control instruction from the script database The corresponding action script is used as the target action script, and then returned to the anchor, so that the anchor can obtain the target action script.

步骤S404,根据目标动作脚本,控制主播形象执行对应的动作。Step S404, according to the target action script, control the host image to perform the corresponding action.

本步骤中,主播端在主播形象上,通过对不同的目标动作脚本的加载会触发其进行对应的动作渲染,进而使主播形象产生对应的动作,如主播形象可以根据下发的目标动作脚本进行行走的动作。其中,目标动作脚本可以指定该主播形象的哪个骨骼进行运动、往哪个方向移动、移动的坐标是哪里、移动的时间多久等等。具体的,对于动作脚本及主播形象的动作控制,不同的主播形象可以有不同的形状跟关节,因此在对主播形象进行动作控制时,需要获取脚本数据库中预先配置好的基于该些关节运动过程的动作脚本,如主播形象行走过程中,腿部、脚掌、手部、头部、身体等不同关节的运动过程,从而在获得的目标动作脚本为行走的动作脚本时,需要在主播形象上运用行走的动作脚本使其做出行走的动作,又如唱歌的动作脚本,可以预先制作主播形象在唱歌过程中脸部、嘴巴、眼睛等部位的运动过程形成唱歌的动作脚本,还可以加上对应的音频素材资源,再将两者配合运用在主播形象上使其做出唱歌的动作并播放对应的音频素材资源。而且,对于同一个主播形象,可以同时运用多个目标动作脚本,如在行走的过程中可以同时唱歌,在跳舞的过程中也可以同时唱歌等,即可以在一个主播形象上应用多个目标动作脚本;还可以在多个主播形象上运用同个目标动作脚本,例如在虚拟现实直播间中显示有多个主播形象,该多个主播形象可以同时进行行走、唱歌等。In this step, the anchor end triggers corresponding action rendering by loading different target action scripts on the anchor image, and then makes the anchor image generate corresponding actions. For example, the anchor image can be executed according to the delivered target action script. The act of walking. Among them, the target action script can specify which bone of the host image moves, which direction to move, where the moving coordinates are, how long the moving time is, and so on. Specifically, for the action script and the action control of the anchor image, different anchor images may have different shapes and joints. Therefore, when controlling the action of the anchor image, it is necessary to obtain the pre-configured motion process based on these joints in the script database. For example, when the anchor image is walking, the movement process of different joints such as legs, feet, hands, head, and body, so when the obtained target action script is a walking action script, it needs to be used on the anchor image The action script of walking makes it perform the action of walking, and like the action script of singing, you can pre-create the action script of the host image in the process of singing, such as the movement of the face, mouth, eyes and other parts, and you can also add corresponding The audio material resources, and then use the two together on the host image to make it sing and play the corresponding audio material resources. Moreover, for the same anchor image, multiple target action scripts can be used at the same time, such as singing while walking, singing while dancing, etc., that is, multiple target actions can be applied to one anchor image Script; the same target action script can also be used on multiple anchor images, for example, in a virtual reality live broadcast room, multiple anchor images are displayed, and the multiple anchor images can walk, sing, etc. at the same time.

本实施例的方案基于头戴式虚拟现实设备的传感器组采集的各预设控制维度对应的动作数据以及脚本数据库,当主播的动作变化符合预设动作变化条件时将其转化为对应的动作控制指令,并根据动作控制指令获取对应的动作脚本,然后根据动作脚本控制主播形象执行对应的动作,由此能够提高对主播形象控制的敏捷度且节约设备性能,可应用于元宇宙直播场景下用户对其三维虚拟形象的控制当中,使得元宇宙直播中用户对其三维虚拟形象的控制敏捷度更高。The solution of this embodiment is based on the action data and script database corresponding to the preset control dimensions collected by the sensor group of the head-mounted virtual reality device. When the action change of the anchor meets the preset action change conditions, it is converted into the corresponding action control command, and obtain the corresponding action script according to the action control command, and then control the anchor image to perform the corresponding action according to the action script, thereby improving the agility of controlling the anchor image and saving equipment performance, which can be applied to users in the metaverse live broadcast scene In the control of its three-dimensional avatar, the user's control over its three-dimensional avatar in the live broadcast of Yuan Universe is more agile.

基于上述的主播形象属于虚拟形象的实施例,在其中一个实施例中,步骤S404的根据目标动作脚本,控制主播形象执行对应的动作,可以进一步包括:Based on the above-mentioned embodiment where the anchor image belongs to the virtual image, in one embodiment, the step S404 of controlling the anchor image to perform corresponding actions according to the target action script may further include:

根据目标动作脚本,获取素材资源库中对应的目标素材资源;根据目标动作脚本及目标素材资源,控制主播形象执行对应的动作。According to the target action script, the corresponding target material resource in the material resource library is obtained; according to the target action script and the target material resource, the host image is controlled to perform the corresponding action.

本实施例中,如前所述的,对于声音素材资源,如背景音乐、表情音乐等,对于图片素材资源,如主播形象的服饰、道具等,可以预先制作和录制从而形成素材资源库,素材资源库中包含的各种素材资源可以分别与动作脚本进行关联,从而达到获得一动作脚本可以从中获取对应的素材资源的目的。具体的,主播端可以接收服务器发送的目标动作脚本,然后根据该目标动作脚本从素材资源库中下载该目标动作脚本对应的目标素材资源,其中,主播端可以根据该目标动作脚本的标识,从素材资源库中下载与该目标动作脚本的标识对应的素材资源作为目标素材资源。也即,在具体实现中,可以在形成素材资源库时为其中的素材资源设置对应的标识,在形成脚本数据库时为其中的动作脚本设置对应的标识,并将对应的素材资源和动作脚本进行关联,具体可以将素材资源对应的标识与动作脚本对应的标识进行绑定,从而在获得目标动作脚本后可以根据标识的绑定关系从素材资源库中对应的素材资源作为目标素材资源。由此,主播端在获得目标动作脚本及目标素材资源后,可以将目标动作脚本绑定到主播形象中,使得主播形象根据该目标动作脚本和目标素材资源进行对应的动作呈现,进一步丰富主播形象的动作呈现效果。In this embodiment, as mentioned above, for sound material resources, such as background music, emoticon music, etc., and for picture material resources, such as clothing and props of the host image, they can be pre-made and recorded to form a material resource library. Various material resources contained in the resource library can be associated with action scripts respectively, so as to achieve the purpose of obtaining corresponding material resources from which an action script can obtain. Specifically, the host can receive the target action script sent by the server, and then download the target material resource corresponding to the target action script from the material resource library according to the target action script. The material resource corresponding to the identifier of the target action script is downloaded from the material resource library as the target material resource. That is, in a specific implementation, it is possible to set corresponding identifiers for the material resources therein when forming the material resource library, set corresponding identifiers for the action scripts therein when forming the script database, and combine the corresponding material resources and action scripts To associate, specifically, the identifier corresponding to the material resource can be bound to the identifier corresponding to the action script, so that after the target action script is obtained, the corresponding material resource in the material resource library can be used as the target material resource according to the binding relationship of the identifier. Thus, after obtaining the target action script and target material resources, the anchor can bind the target action script to the anchor image, so that the anchor image can perform corresponding actions according to the target action script and target material resources, further enriching the anchor image The action presents the effect.

基于上述的主播形象属于虚拟形象的实施例,在一些实施例中,还可以包括以下步骤:Based on the above-mentioned embodiment that the image of the anchor belongs to the virtual image, in some embodiments, the following steps may also be included:

若预设控制维度对应的动作数据表征主播在虚拟现实直播间中的位置接近预设虚拟边界,则通过头戴式虚拟现实设备触发安全提示反馈,并持续展示预设虚拟边界直至主播离开预设虚拟边界;其中,预设虚拟边界根据主播在真实空间中的安全移动区域进行预先设置。If the action data corresponding to the preset control dimension indicates that the anchor’s position in the virtual reality live broadcast room is close to the preset virtual boundary, the safety prompt feedback will be triggered through the head-mounted virtual reality device, and the preset virtual boundary will continue to be displayed until the anchor leaves the preset A virtual boundary; wherein, the preset virtual boundary is preset according to the anchor's safe movement area in the real space.

本实施例是为主播佩戴头戴式虚拟现实设备进行直播时提供的安全保障方案。具体的,主播开启通过虚拟形象进行直播后,主播可以佩戴头戴式虚拟现实设备,拿起操作手柄,主播端可以通过操作手柄和头戴式虚拟现实设备的传感器组不断地进行动作数据的采集,此时主播端需要设置对操作手柄和头戴式虚拟现实设备配置和连接的如加速度传感器、方向传感器、陀螺仪、声音传感器等传感器的监听,设置完监听后,当数据有变化时,主播端可以不间断地收到相关传感器采集的动作数据。而主播佩戴头戴式虚拟现实设备时,主播在运动,主播端通过对加速度传感器、方向传感器、计步器等传感器的监听,可以获知主播运动的位置等信息,从而转换为其对应的主播形象在虚拟现实直播间中的位置。然而,由于主播在佩戴头戴式虚拟现实设备时,会看不到真实空间中的物体,所以需要预先为主播设置虚拟边界即预设虚拟边界,该预设虚拟边界需要根据主播在真实空间中的安全移动区域进行预先设置,安全移动区域是指主播在直播过程中可以安全移动的区域,具体可以可以由主播根据其真实空间中存在的障碍物等物体进行设置,以防止主播碰撞到物体而受伤,由此,可以为主播在虚拟现实直播间中设置具有圆形边界的预设虚拟边界,该预设虚拟边界的半径可以根据该主播在真实空间中所站的一点与其最近的障碍物之间的距离进行设置,使得该主播位于真实空间中该障碍物所在位置时,其在虚拟现实直播间中的位置也相应处于预设虚拟边界的对应位置处。由此,当预设控制维度对应的动作数据表征主播在虚拟现实直播间中的位置接近预设虚拟边界时,其中,预设控制维度可以为行走维度,当行走维度对应的动作数据表征主播在虚拟现实直播间中的位置接近预设虚拟边界时,例如主播在虚拟现实直播间中的位置与预设虚拟边界的距离小于或等于预设距离阈值时,主播端可以通过头戴式虚拟现实设备触发安全提示反馈,该安全提示反馈可以用于提示主播当前所处的位置接近障碍物,具体可以包括发出声音和产生振动等形式的反馈,此时,主播端还通过头戴式虚拟现实设备持续展示该预设虚拟边界,具体可以以预设透明度来展示该预设虚拟边界,直至主播离开该预设虚拟边界,具体可以当检测到主播在虚拟现实直播间中的位置与预设虚拟边界的距离大于预设距离阈值时,判断其离开预设虚拟边界。而为了进一步提高主播运动的安全性,在其中一些实施例中,对于移动范围较大(如移动的位置大于或等于一定的位置阈值)的运动,主播可以通过触发操作手柄上的方向键使得主播形象在虚拟现实直播间中进行对应的位置移动。This embodiment is a security guarantee solution provided when the anchor wears a head-mounted virtual reality device for live broadcast. Specifically, after the anchor starts live broadcasting through the avatar, the anchor can wear the head-mounted virtual reality device, pick up the operating handle, and the anchor can continuously collect motion data through the operating handle and the sensor group of the head-mounted virtual reality device , at this time, the anchor needs to set the monitoring of the sensors configured and connected to the operating handle and the head-mounted virtual reality device, such as the acceleration sensor, direction sensor, gyroscope, and sound sensor. After setting the monitoring, when the data changes, the anchor The terminal can continuously receive the action data collected by the relevant sensors. When the anchor wears a head-mounted virtual reality device, the anchor is in motion, and the anchor side can obtain information such as the location of the anchor’s movement by monitoring the acceleration sensor, direction sensor, pedometer and other sensors, so as to convert it into the corresponding anchor image Position in the virtual reality studio. However, since the anchor cannot see objects in the real space when wearing a head-mounted virtual reality device, it is necessary to set a virtual boundary for the anchor in advance, that is, a preset virtual boundary. The safe moving area is set in advance. The safe moving area refers to the area where the host can move safely during the live broadcast. Specifically, it can be set by the host according to the obstacles and other objects in the real space to prevent the host from colliding with objects. Injury, thus, the host can set a preset virtual boundary with a circular boundary in the virtual reality live broadcast room, and the radius of the preset virtual boundary can be based on the distance between the point where the anchor stands in the real space and the nearest obstacle. The distance between them is set so that when the anchor is located at the position of the obstacle in the real space, its position in the virtual reality live broadcast room is correspondingly at the corresponding position of the preset virtual boundary. Therefore, when the action data corresponding to the preset control dimension indicates that the anchor's position in the virtual reality live broadcast room is close to the preset virtual boundary, the preset control dimension can be the walking dimension, and when the action data corresponding to the walking dimension indicates that the anchor is in the When the position in the virtual reality live broadcast room is close to the preset virtual boundary, for example, when the distance between the anchor's position in the virtual reality live broadcast room and the preset virtual boundary is less than or equal to the preset distance threshold, the anchor can pass through the head-mounted virtual reality device. Trigger safety prompt feedback, the safety prompt feedback can be used to remind the anchor that the current position is close to the obstacle, which can specifically include feedback in the form of sound and vibration. To display the preset virtual border, specifically, the preset virtual border can be displayed with preset transparency until the host leaves the preset virtual border, specifically, when the anchor’s position in the virtual reality live broadcast room is detected to be within the preset virtual border When the distance is greater than the preset distance threshold, it is judged to leave the preset virtual boundary. In order to further improve the safety of the anchor's movement, in some embodiments, for movements with a large range of movement (such as the moving position is greater than or equal to a certain position threshold), the anchor can trigger the direction keys on the handle to make the anchor The image moves correspondingly in the virtual reality live broadcast room.

基于上述的主播形象属于虚拟形象的实施例,在其中一个实施例中,在步骤S401的通过头戴式虚拟现实设备的传感器组分别采集主播在各预设控制维度对应的动作数据之后,还包括:Based on the above-mentioned embodiment where the image of the anchor belongs to the virtual image, in one embodiment, after the sensor group of the head-mounted virtual reality device in step S401 respectively collects the action data corresponding to the anchor in each preset control dimension, it also includes :

针对任一预设控制维度,根据预设控制维度对应的动作数据,判断动作数据的变化量是否大于预设变化量阈值;若是,则确定预设控制维度对应的动作数据表征主播在预设控制维度对应的动作变化符合预设控制维度的预设动作变化条件。For any preset control dimension, according to the action data corresponding to the preset control dimension, it is judged whether the change of the action data is greater than the preset change threshold; The action change corresponding to the dimension meets the preset action change conditions of the preset control dimension.

本实施例中,在获得各预设控制维度对应的动作数据之后,针对任一预设控制维度,主播端可以根据预设控制维度对应的动作数据,获取该动作数据的变化量,如通过加速度传感器、速度传感器、方向传感器、陀螺仪等传感器采集的动作数据的变化量,并判断其是否大于预设变化量阈值,如转动数据的变化量是否大于预设变化量阈值等,若是,则主播端可以确定该预设控制维度对应的动作数据已表征主播在该预设控制维度对应的动作变化符合预设控制维度的预设动作变化条件,即确定主播有意使得主播形象做出相应的动作,需要将该运动变化转化为相应的动作控制指令以获取目标动作脚本控制主播形象该动作,若动作数据的变化量小于或等于预设变化量阈值,则主播端可以忽略该动作数据,由此提高对主播形象进行控制的准确性。In this embodiment, after obtaining the action data corresponding to each preset control dimension, for any preset control dimension, the host can obtain the change amount of the action data according to the action data corresponding to the preset control dimension, such as through acceleration Sensors, speed sensors, direction sensors, gyroscopes and other sensors collect the change amount of motion data, and judge whether it is greater than the preset change threshold, such as whether the change of rotation data is greater than the preset change threshold, etc., if so, then the anchor The terminal can determine that the action data corresponding to the preset control dimension has indicated that the anchor’s action change corresponding to the preset control dimension meets the preset action change conditions of the preset control dimension, that is, it is determined that the anchor intends to make the anchor’s image take corresponding actions, It is necessary to convert the movement change into a corresponding action control command to obtain the target action script to control the action of the anchor image. If the change of the action data is less than or equal to the preset change threshold, the anchor can ignore the action data, thereby improving The accuracy of controlling the image of the anchor.

作为一个具体实例,对于主播形象属于真人形象的情况,本申请的虚拟现实直播间虚拟礼物特效播放处理方法具体可以包括如图5所示的步骤:As a specific example, for the case where the image of the anchor belongs to the image of a real person, the method for processing virtual gifts with special effects in the virtual reality live broadcast room of the present application may specifically include the steps shown in Figure 5:

当主播选择真人形象的虚拟现实直播时,在合适的场景下,需要按虚拟现实直播的规范将录制的全景摄像头放在基于所在空间的相对中心位置,虚拟现实直播中的视频主要是一个全景的视频,有180度与360度两种,当收到对应度数类型的视频后会将视频直播流渲染在一个透明半球(180度)或者球(360度)的内面,这时可以在半球或者球体度内部摆放虚拟摄像机,若是球体则一般将虚拟摄像机放置在球体的中心,如果是半球体则虚拟摄像机可放置在球体中心偏内。其中,虚拟礼物可以分为两种,一种为平面虚拟礼物,另一种则为立体虚拟礼物,若是平面虚拟礼物放置在平面礼物栏,若是立体礼物则放置在立体礼物柜中。When the anchor chooses a virtual reality live broadcast with a real image, in a suitable scene, the recorded panoramic camera needs to be placed in a relatively central position based on the space where it is located according to the specifications of the virtual reality live broadcast. The video in the virtual reality live broadcast is mainly a panoramic view. There are two kinds of videos, 180 degrees and 360 degrees. When the video of the corresponding degree type is received, the live video stream will be rendered on the inner surface of a transparent hemisphere (180 degrees) or sphere (360 degrees). At this time, it can be in the hemisphere or sphere If it is a sphere, generally place the virtual camera at the center of the sphere; if it is a hemisphere, the virtual camera can be placed inside the center of the sphere. Among them, the virtual gift can be divided into two types, one is a flat virtual gift, and the other is a three-dimensional virtual gift. If it is a flat virtual gift, it is placed in the flat gift column, and if it is a three-dimensional gift, it is placed in the three-dimensional gift cabinet.

其中,对于平面虚拟礼物的摆放,可以将平面礼物栏放置在面向主播视频球体空间的一个合适位置,一般以不遮挡主播的人体位置为主,可以放在球体中心(因为虚拟摄像机在球体中心附近)偏右上或者偏左上的合适位置,保证平面礼物栏在球体内;对于立体礼物柜的摆放,可以将立体礼物柜放置在面向主播视频球体空间的一个合适位置,一般以不遮挡主播的人体位置为主,可以放在球体中心(因为虚拟摄像头在球体中心附近)且根据主播的站立平面/站立轴进行放置。当用户戴上虚拟现实眼镜,虚拟现实眼镜所在的位置及所看到的,为虚拟摄像机的位置及方向,通过调整操作手柄位置,使两个操作手柄位于虚拟摄像头左右的合适位置,操作手柄主要有射线发射、手柄抓取或者模拟人手触碰等交互方式。虚拟现实直播场景下的虚拟礼物选择及赠送交互主要分平面虚拟礼物跟立体虚拟礼物两种,若是平面虚拟礼物,可主要通过过射线发射点击为主,在手柄的起点开始发射一条有限长度的射线,一般射线长度不需要超过球体的半径,当平面礼物栏中针对目标部位的虚拟礼物所在的平面区域与手柄发射所射线有夹角,此时观众再点击确认操作则认为确认赠送这个虚拟礼物;若是立体虚拟礼物,可以通过手柄抓取或者模拟人手的方式进行交互,当发射射线选择立体礼物柜的针对目标部位的虚拟礼物后,通过按手柄的按键,可以将对应的立体虚拟礼物抓取到手柄位置,此时通过调整立体虚拟礼物的坐标到手柄坐标的合适位置,就可以通过模拟人手,拿着这个立体虚拟礼物的方式,看这个礼物不同的方向的形状大小等,也可以通过将整个立体礼物柜抓取过来,同理调整立体礼物柜的坐标到手柄合适的坐标位置,当手柄射线与对应的针对目标部位的立体虚拟礼物相交时,按抓取按键,则认为抓取该立体虚拟礼物,这个时候另外一个手柄可以做点击确认,确认后则可以赠送出这个立体虚拟礼物。服务器收到观众赠送的针对目标部位的虚拟礼物时,会验证用户身份,验证成功之后,可对该用户的余额进行扣费处理,余额不足返回失败并提示用户充值,扣费成功后在当前的虚拟现实直播间内发送送礼成功广播。Among them, for the placement of the flat virtual gift, the flat gift column can be placed in a suitable position facing the video sphere space of the anchor. Generally, the position of the human body that does not block the anchor is the main position, and it can be placed in the center of the sphere (because the virtual camera is in the center of the sphere. Nearby) at a suitable position on the upper right or upper left to ensure that the flat gift bar is inside the sphere; for the placement of the three-dimensional gift cabinet, the three-dimensional gift cabinet can be placed at a suitable position facing the anchor video sphere space, generally so as not to block the anchor The position of the human body is the main one, which can be placed in the center of the sphere (because the virtual camera is near the center of the sphere) and placed according to the anchor's standing plane/standing axis. When the user puts on the virtual reality glasses, the position of the virtual reality glasses and what he sees are the position and direction of the virtual camera. By adjusting the position of the operating handle, the two operating handles are located at the appropriate positions on the left and right of the virtual camera. The operating handle mainly There are interaction methods such as ray emission, handle grabbing, or simulating human hand touch. The virtual gift selection and gift interaction in the virtual reality live broadcast scene are mainly divided into two types: flat virtual gift and three-dimensional virtual gift. If it is a flat virtual gift, it can be mainly through the ray launch click, and a finite length ray is launched from the starting point of the handle. , generally the length of the ray does not need to exceed the radius of the sphere. When the plane area where the virtual gift for the target part in the plane gift bar is located has an included angle with the ray emitted by the handle, and the viewer clicks the confirmation operation at this time, it will be considered that the virtual gift is confirmed to be given; If it is a three-dimensional virtual gift, it can be interacted with by grabbing the handle or simulating a human hand. When the launch ray selects the virtual gift for the target part of the three-dimensional gift cabinet, the corresponding three-dimensional virtual gift can be grabbed by pressing the button on the handle. The position of the handle. At this time, by adjusting the coordinates of the three-dimensional virtual gift to the appropriate position of the coordinates of the handle, you can see the shape and size of the gift in different directions by simulating a human hand and holding the three-dimensional virtual gift. Grab the three-dimensional gift cabinet, and adjust the coordinates of the three-dimensional gift cabinet to the appropriate coordinate position of the handle in the same way. When the handle ray intersects with the corresponding three-dimensional virtual gift for the target part, press the grab button, it is considered that the three-dimensional virtual gift is captured. Gift, at this time the other handle can be clicked to confirm, and after confirmation, this three-dimensional virtual gift can be presented. When the server receives the virtual gift for the target part from the audience, it will verify the user’s identity. After the verification is successful, the user’s balance can be deducted. If the balance is insufficient, it will return failure and prompt the user to recharge. Send a successful gift broadcast in the virtual reality live broadcast room.

其中,主播端收到送礼成功消息后,可以调用人脸识别或者肢体识别插件,通过识别插件会实时识别出来主播直播过程中在一个平面空间的二维坐标点集数组([[x1,y1],[x2,y2],...,[Xn,Yn]]),对应结合主播形象上目标部位的虚拟礼物(平面或者立体礼物)会根据对应礼物脚本执行对应的动画路径,比如亲脸特效,则将对应的虚拟礼物往脸部特征点集位置播放,同理肢体围绕礼物则围绕对应的肢体特征点集位置播放,而无论是平面礼物还是立体礼物这个时候都可以染在直播画面的球体平面一个单独的特效播放层,直播过程中,礼物特效可以跟直播画面实时同步,此时将特效播放层和视频画面层混合成一条直播流,主播端将对应的特效播放层跟随视频流一起推送到各个观众端,这个时候观众在观众端看到的直播画面是礼物特效实时同步的,礼物特效播放成功或者失败均会向服务器上报状态消息,便于记录查找失败的问题快速修复。Among them, after the anchor receives the gift-giving success message, it can call the face recognition or body recognition plug-in, and through the recognition plug-in, it will recognize in real time the two-dimensional coordinate point set array ([[x1,y1] ,[x2,y2],...,[Xn,Yn]]), corresponding to the virtual gift (flat or three-dimensional gift) combined with the target part on the anchor image, the corresponding animation path will be executed according to the corresponding gift script, such as the special effect of kissing the face , the corresponding virtual gift will be played to the position of the feature point set of the face. Similarly, the body around the gift will be played around the position of the corresponding body feature point set. Whether it is a flat gift or a three-dimensional gift, it can be dyed on the sphere of the live screen at this time. There is a separate special effects playback layer on the plane. During the live broadcast, the gift special effects can be synchronized with the live broadcast screen in real time. At this time, the special effect playback layer and the video screen layer are mixed into a live stream, and the anchor will push the corresponding special effect playback layer along with the video stream. At each viewer end, the live broadcast screen that the audience sees on the viewer end is synchronized in real time with the special effects of the gift. A status message will be reported to the server if the special effect of the gift is played successfully or failed, so that the problem of failure to record and search can be quickly repaired.

作为一个具体实例,对于主播形象属于虚拟形象的情况,本申请的虚拟现实直播间虚拟礼物特效播放处理方法具体可以包括如图6所示的步骤:As a specific example, for the situation where the image of the anchor belongs to the virtual image, the method for processing the virtual gift with special effects in the virtual reality live broadcast room of the present application may specifically include the steps shown in Figure 6:

主播可以开启元宇宙直播,一般情况下可以通过绿幕抠像的方式抠出主播的人像,并通过三维虚拟人生成技术,生成模拟主播脸部跟身体特征的虚拟形象,也可以通过直接选择已设计出来的三维的虚拟形象进行直播,无论是哪一种,该虚拟形象会带对应的三维信息。开启直播后可以将虚拟形象放置于一个虚拟的立体空间中,例如在一个演唱会直播场景,可以将主播的虚拟形象放置在演唱会的舞台中,并在虚拟空间中调整虚拟摄像机位置,为了便于计算,一般会将虚拟摄像机放置在(0,0,0)位置,再调整舞台跟虚拟形象的位置,让虚拟摄像机能有较好的角度拍摄到舞台。主播在直播过程中,可以穿带头戴式虚拟现实设备,其可以通过加速度、速度、方向、光线、声音等传感器获取主播的一些数据,并将这些数据转换为虚拟形象在直播过程中的一些肢体的动作或声音。虚拟形象在虚拟空间进行运动的过程中会产生对应的位移、角度或者一些缩放的效果,在三维的虚拟空间中的这些位置数据(X,Y,Z),可以实时获取。The anchor can start the metaverse live broadcast. Under normal circumstances, the portrait of the anchor can be cut out by means of green screen matting, and a virtual image that simulates the face and body characteristics of the anchor can be generated through the 3D virtual human generation technology. The designed 3D avatar will be broadcast live, no matter what kind it is, the avatar will carry the corresponding 3D information. After the live broadcast is turned on, the avatar can be placed in a virtual three-dimensional space. For example, in a live concert scene, the avatar of the anchor can be placed on the stage of the concert, and the virtual camera position can be adjusted in the virtual space. For calculation, the virtual camera is generally placed at the (0,0,0) position, and then the positions of the stage and the avatar are adjusted so that the virtual camera can capture the stage from a better angle. During the live broadcast, the anchor can wear a head-mounted virtual reality device, which can obtain some data of the anchor through sensors such as acceleration, speed, direction, light, and sound, and convert these data into some limbs of the avatar during the live broadcast. movement or sound. During the movement of the avatar in the virtual space, corresponding displacement, angle or some scaling effects will be produced, and these position data (X, Y, Z) in the three-dimensional virtual space can be acquired in real time.

观众进入虚拟直播空间中,以虚拟演唱会场景,观众可以是置身于虚拟舞台场景下的一个座位上,对应的座位会有一个坐标点(Xg,Yg,Zg),当观众赠送一个结合主播的虚拟形象The audience enters the virtual live broadcast space. In the virtual concert scene, the audience can be placed in a seat under the virtual stage scene, and the corresponding seat will have a coordinate point (Xg, Yg, Zg). When the audience presents a avatar

上目标部位的虚拟礼物时,会从观众当前坐的位置出发,将该虚拟礼物通过不限于淡入淡出、5缩放、旋转等等动画效果,将礼物从起始点出发,以不限于贝塞尔曲线、随机路径、固定路When the virtual gift on the target part is placed, it will start from the current sitting position of the audience, and the virtual gift will be set from the starting point through animation effects such as fade in and fade out, 5 zooming, rotation, etc., not limited to the Bezier curve , random path, fixed path

径等方式,位移至主播的虚拟形象附近,此时再结合实时获取的主播的虚拟形象上目标部位的相关位置数据,可以让虚拟礼物围绕着主播的人脸、肢体等部位做一些动作,并可以设定在一个有限时间内消失,若在较短时间内赠送多个,可以通过在虚拟礼物上方显示乘以多少Move to the vicinity of the anchor’s avatar by means of the path, etc. At this time, combined with the relevant location data of the target parts on the anchor’s avatar acquired in real time, the virtual gift can make some movements around the anchor’s face, body and other parts, and It can be set to disappear within a limited period of time. If multiple gifts are given within a short period of time, it can be multiplied by displaying on the top of the virtual gift

个礼物的方式位移过去,主播也可以对围绕在其虚拟形象周围的虚拟礼物产生互动,比如可0以通过手柄去抓取这些礼物,通过操作手柄或者射线的位置跟当前礼物所停留的位置进行碰In the way of a gift, the host can also interact with the virtual gifts around his avatar. For example, he can use the handle to grab these gifts, and control the position of the handle or the ray with the current position of the gift. bump

撞检测,若检测操作手柄或者射线与物体相交时,则可以判断主播触碰到礼物,此时可以让其操作手柄产生震动等。而在该元宇宙直播的礼物交互过程中,服务器会将对应的状态数据通过帧同步或者状态同步的方式将整个交互的过程同步给在当前直播间的其他各端,其他各Collision detection, if it is detected that the operating handle or the ray intersects with the object, it can be judged that the anchor touches the gift, and at this time, the operating handle can be made to vibrate. During the gift interaction process of the Metaverse live broadcast, the server will synchronize the corresponding state data to other ends of the current live broadcast room through frame synchronization or state synchronization.

端收到同步消息后渲染对应的交互画面,这个时候直播间的各用户都可以同步看到一直交互5的过程。After receiving the synchronization message, the terminal renders the corresponding interactive screen. At this time, all users in the live broadcast room can simultaneously see the process of continuous interaction 5.

应该理解的是,虽然如上所述的各实施例所涉及的流程图中的各个步骤按照箭头的指示依次显示,但是这些步骤并不是必然按照箭头指示的顺序依次执行。除非本文中有明确的说明,这些步骤的执行并没有严格的顺序限制,这些步骤可以以其它的顺序执行。而且,如上It should be understood that although the steps in the flow charts involved in the above embodiments are shown sequentially according to the arrows, these steps are not necessarily executed sequentially in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and these steps can be executed in other orders. And, as above

所述的各实施例所涉及的流程图中的至少一部分步骤可以包括多个步骤或者多个阶段,这些0步骤或者阶段并不必然是在同一时刻执行完成,而是可以在不同的时刻执行,这些步骤或者At least some of the steps in the flow charts involved in the above embodiments may include multiple steps or multiple stages, these zero steps or stages are not necessarily executed at the same time, but may be executed at different times, these steps or

阶段的执行顺序也不必然是依次进行,而是可以与其它步骤或者其它步骤中的步骤或者阶段的至少一部分轮流或者交替地执行。The execution sequence of the stages is not necessarily performed sequentially, but may be executed alternately or alternately with other steps or at least a part of steps or stages in other steps.

基于同样的发明构思,本申请实施例还提供了一种用于实现上述所涉及的虚拟现实直播Based on the same inventive concept, the embodiment of the present application also provides a method for realizing the above-mentioned virtual reality live broadcasting

间虚拟礼物特效播放处理方法的虚拟现实直播间虚拟礼物特效播放处理装置。该装置所提供5的解决问题的实现方案与上述方法中所记载的实现方案相似,故下面所提供的一个或多个虚A special effect play processing device for a virtual gift in a virtual reality live broadcast room according to a method for playing virtual gift special effects in a room. The implementation of the solution to the problem provided by the device is similar to the implementation described in the above-mentioned method, so one or more virtual solutions provided below

拟现实直播间虚拟礼物特效播放处理装置实施例中的具体限定可以参见上文中对于虚拟现实直播间虚拟礼物特效播放处理方法的限定,在此不再赘述。For the specific limitations in the embodiments of the virtual gift special effects playback processing device in the virtual reality live broadcast room, please refer to the above-mentioned limitation on the virtual gift special effect playback processing method in the virtual reality live broadcast room, and will not be repeated here.

在一个实施例中,如图7所示,提供了一种虚拟现实直播间虚拟礼物特效播放处理装置,该装置700可以包括:In one embodiment, as shown in FIG. 7 , a device for processing virtual gifts with special effects in a virtual reality live broadcast room is provided. The device 700 may include:

0主播形象展示模块701,用于在虚拟现实直播间中展示主播形象;0 Anchor image display module 701, used to display the image of the anchor in the virtual reality live broadcast room;

赠送请求接收模块702,用于接收针对所述主播形象上目标部位的虚拟礼物赠送请求;A gift request receiving module 702, configured to receive a virtual gift gift request for a target part on the anchor image;

二维位置获取模块703,用于若所述主播形象属于真人形象,则在主播端识别所述主播形象上目标部位在直播画面对应的二维坐标点集,得到所述目标部位的位置数据;The two-dimensional position acquisition module 703 is used to identify the two-dimensional coordinate point set corresponding to the target part on the live screen on the anchor image at the anchor end if the anchor image belongs to a real person image, and obtain the position data of the target part;

三维位置获取模块704,用于若所述主播形象属于虚拟形象,则根据所述主播形象上目标部位在所述虚拟现实直播间的三维坐标点集,得到所述目标部位的位置数据;The three-dimensional position acquisition module 704 is used to obtain the position data of the target part according to the three-dimensional coordinate point set of the target part on the anchor image in the virtual reality live broadcast room if the anchor image belongs to the virtual image;

礼物特效播放模块705,用于响应于所述虚拟礼物赠送请求,根据所述目标部位的位置数据,在所述虚拟现实直播间中展示出在所述主播形象上目标部位播放的虚拟礼物特效。The gift special effect playing module 705 is configured to display in the virtual reality live broadcast room the virtual gift special effects played on the target part of the anchor image according to the location data of the target part in response to the virtual gift giving request.

在一个实施例中,二维位置获取模块703,用于根据主播端的全景直播视频数据,识别所述主播形象上目标部位对应的特征点集;根据所述特征点集在直播画面对应的二维坐标点集,得到所述主播形象上目标部位在直播画面对应的二维坐标点集。In one embodiment, the two-dimensional position acquisition module 703 is used to identify the feature point set corresponding to the target part on the anchor image according to the panoramic live video data of the anchor end; A set of coordinate points to obtain a set of two-dimensional coordinate points corresponding to the target part on the live image of the anchor image.

在一个实施例中,礼物特效播放模块705,用于在所述主播端于预设球体的视频画面层渲染所述全景直播视频数据得到直播画面,于所述预设球体的特效播放层根据所述目标部位的位置数据渲染所述虚拟礼物特效得到特效画面;将所述直播画面和特效画面混合得到目标直播数据,将所述目标直播数据发送至所述虚拟现实直播间中各观众端,以供所述各观众端在所述虚拟现实直播间中展示出在所述主播形象上目标部位播放的虚拟礼物特效。In one embodiment, the gift special effect playing module 705 is used to render the panoramic live video data on the video picture layer of the preset sphere at the anchor end to obtain a live picture, and the special effect playing layer of the preset sphere according to the The location data of the target part renders the special effect of the virtual gift to obtain a special effect picture; mixes the live picture and the special effect picture to obtain the target live data, and sends the target live data to each audience terminal in the virtual reality live room for For each viewer to display in the virtual reality live broadcast room the virtual gift special effect played on the target position of the host image.

在一个实施例中,主播形象展示模块701,用于基于预设球体展示虚拟现实直播间的直播画面;所述直播画面中包含所述主播形象;该装置700还包括:礼物展示模块,用于获取待展示的虚拟礼物对应的空间维度,以及获取所述直播画面中主播形象所在位置;所述待展示的虚拟礼物包含针对主播形象上目标部位的虚拟礼物;根据所述待展示的虚拟礼物对应的空间维度和主播形象所在位置,在所述预设球体范围内对应的预设无遮挡位置处展示所述虚拟礼物;赠送请求接收模块702,用于根据通过头戴式虚拟现实设备的操作手柄触发的与所述针对主播形象上目标部位的虚拟礼物的交互指令,获取所述虚拟礼物赠送请求。In one embodiment, the anchor image display module 701 is used to display the live image of the virtual reality live room based on a preset sphere; the live image includes the image of the anchor; the device 700 also includes: a gift display module for Obtain the spatial dimension corresponding to the virtual gift to be displayed, and obtain the location of the anchor image in the live broadcast screen; the virtual gift to be displayed includes a virtual gift for the target position on the anchor image; according to the corresponding virtual gift to be displayed The spatial dimension and the position of the anchor image, display the virtual gift at the corresponding preset unobstructed position within the range of the preset sphere; the gift request receiving module 702 is configured to The triggered interaction instruction with the virtual gift for the target part on the image of the anchor obtains the request for giving the virtual gift.

在一个实施例中,礼物展示模块,用于所述待展示的虚拟礼物对应的空间维度为平面时,根据所述主播形象所在位置在所述预设球体范围内对应的预设无遮挡位置处展示平面礼物栏;所述平面礼物栏包含预先划分的多个平面区域;在所述多个平面区域展示所述待展示的虚拟礼物;赠送请求接收模块702,用于检测所述操作手柄发射的射线;所述射线与所述多个平面区域中目标平面区域相交时,确定展示于所述目标平面区域的针对主播形象上目标部位的虚拟礼物为所选虚拟礼物;响应于在所述相交状态下通过所述操作手柄触发的确认指令,得到所述虚拟礼物赠送请求。In one embodiment, the gift display module is used for when the spatial dimension corresponding to the virtual gift to be displayed is a plane, according to the location of the anchor image at the corresponding preset unobstructed position within the range of the preset sphere Display a plane gift column; the plane gift column includes a plurality of pre-divided plane areas; display the virtual gift to be displayed in the multiple plane areas; the gift request receiving module 702 is used to detect the Ray; when the ray intersects the target plane area in the plurality of plane areas, it is determined that the virtual gift for the target position on the anchor image displayed in the target plane area is the selected virtual gift; in response to the intersection state Press the confirmation instruction triggered by the operating handle to obtain the virtual gift giving request.

在一个实施例中,礼物展示模块,用于所述待展示的虚拟礼物对应的空间维度为立体时,确定所述主播形象所在位置对应的站立平面;根据所述主播形象所在位置,在所述预设球体范围内于所述站立平面上对应的预设无遮挡位置处展示立体礼物柜;所述立体礼物柜包含多个立体礼物放置格;在所述多个立体礼物放置格中展示所述待展示的虚拟礼物;赠送请求接收模块702,用于检测所述操作手柄发射的射线;所述射线与所述多个立体礼物放置格中针对主播形象上目标部位的虚拟礼物相交时,确定该虚拟礼物为所选虚拟礼物;响应于在所述相交状态下通过所述操作手柄触发的抓取操作,将所述所选虚拟礼物从所述多个立体礼物放置格对应的礼物放置位置移动至所述操作手柄所在位置对应的礼物观察位置;响应于通过所述操作手柄触发的确认操作,得到所述虚拟礼物赠送请求。In one embodiment, the gift display module is used to determine the standing plane corresponding to the position of the anchor image when the spatial dimension corresponding to the virtual gift to be displayed is three-dimensional; according to the position of the anchor image, in the The three-dimensional gift cabinet is displayed at the corresponding preset unblocked position on the standing plane within the range of the preset sphere; the three-dimensional gift cabinet includes a plurality of three-dimensional gift placement grids; the three-dimensional gift cabinet is displayed in the plurality of three-dimensional gift placement grids. The virtual gift to be displayed; the gift request receiving module 702 is used to detect the ray emitted by the operating handle; when the ray intersects with the virtual gift aimed at the target position on the anchor image in the plurality of three-dimensional gift placement grids, determine the The virtual gift is the selected virtual gift; in response to the grabbing operation triggered by the operating handle in the intersecting state, the selected virtual gift is moved from the gift placement position corresponding to the plurality of three-dimensional gift placement grids to The gift observation position corresponding to the position of the operating handle; in response to the confirmation operation triggered by the operating handle, the virtual gift giving request is obtained.

在一个实施例中,礼物特效播放模块705,用于所述主播形象属于虚拟形象时,获取发出所述虚拟礼物赠送请求的观众在所述虚拟现实直播间对应的虚拟观众位置点;在所述虚拟现实直播间中,播放针对所述主播形象上目标部位的虚拟礼物从所述虚拟观众位置点移动至所述主播形象的预设动画;所述虚拟礼物移动至所述主播形象后,根据所述目标部位的位置数据,在所述主播形象上目标部位播放对应的虚拟礼物特效。In one embodiment, the gift special effect playing module 705 is used to obtain the corresponding virtual audience position point in the virtual reality live room of the audience who sent the virtual gift request when the anchor image belongs to the virtual image; In the virtual reality live broadcast room, play a preset animation in which the virtual gift for the target part on the anchor image moves from the virtual audience position to the anchor image; after the virtual gift moves to the anchor image, The location data of the target part, and the corresponding virtual gift special effect is played on the target part on the anchor image.

在一个实施例中,礼物特效播放模块705,还用于在主播端检测到主播通过头戴式虚拟现实设备的操作手柄触发与所述虚拟礼物的碰撞时,在所述主播端通过所述头戴式虚拟现实设备向所述主播产生碰撞反馈。In one embodiment, the gift special effect playing module 705 is further configured to, when the anchor detects that the anchor triggers a collision with the virtual gift through the operating handle of the head-mounted virtual reality device, The wearable virtual reality device generates collision feedback to the anchor.

在一个实施例中,该装置700还包括:形象控制模块,用于通过头戴式虚拟现实设备的传感器组分别采集主播在各预设控制维度对应的动作数据;所述预设控制维度为所述主播形象的预设控制维度;所述主播形象属于虚拟形象;对于任一预设控制维度,若所述预设控制维度对应的动作数据表征所述主播在所述预设控制维度对应的动作变化符合所述预设控制维度的预设动作变化条件,则获取所述动作变化对应的动作控制指令;根据所述动作控制指令,获取脚本数据库中对应的目标动作脚本;根据所述目标动作脚本,控制所述主播形象执行对应的动作。In one embodiment, the apparatus 700 further includes: an image control module, which is used to collect the action data corresponding to the anchor in each preset control dimension through the sensor group of the head-mounted virtual reality device; the preset control dimension is the The preset control dimension of the anchor image; the anchor image belongs to the virtual image; for any preset control dimension, if the action data corresponding to the preset control dimension represents the action corresponding to the anchor in the preset control dimension If the change meets the preset action change condition of the preset control dimension, the action control instruction corresponding to the action change is obtained; according to the action control instruction, the corresponding target action script in the script database is acquired; according to the target action script , to control the host image to perform corresponding actions.

在一个实施例中,该装置700还包括:安全处理模块,用于若所述预设控制维度对应的动作数据表征所述主播在所述虚拟现实直播间中的位置接近预设虚拟边界,则通过所述头戴式虚拟现实设备触发安全提示反馈,并持续展示所述预设虚拟边界直至所述主播离开所述预设虚拟边界;其中,所述预设虚拟边界根据所述主播在真实空间中的安全移动区域进行预先设置。In one embodiment, the device 700 further includes: a security processing module, configured to: if the action data corresponding to the preset control dimension indicates that the anchor's position in the virtual reality live broadcast room is close to a preset virtual boundary, then The safety prompt feedback is triggered by the head-mounted virtual reality device, and the preset virtual boundary is continuously displayed until the anchor leaves the preset virtual boundary; wherein, the preset virtual boundary is based on the presence of the anchor in the real space Preset the safe movement area in .

在一个实施例中,形象控制模块,还用于针对任一预设控制维度,根据所述预设控制维度对应的动作数据,判断所述动作数据的变化量是否大于预设变化量阈值;若是,则确定所述预设控制维度对应的动作数据表征所述主播在所述预设控制维度对应的动作变化符合所述预设控制维度的预设动作变化条件。In one embodiment, the image control module is further configured to, for any preset control dimension, judge whether the change amount of the action data is greater than a preset change threshold value according to the action data corresponding to the preset control dimension; if so , it is determined that the action data corresponding to the preset control dimension indicates that the action change of the anchor corresponding to the preset control dimension meets the preset action change condition of the preset control dimension.

上述虚拟礼物特效播放处理装置中的各个模块可全部或部分通过软件、硬件及其组合来实现。上述各模块可以硬件形式内嵌于或独立于电子设备中的处理器中,也可以以软件形式存储于电子设备中的存储器中,以便于处理器调用执行以上各个模块对应的操作。Each module in the above virtual gift special effect playback processing device can be fully or partially realized by software, hardware and combinations thereof. The above-mentioned modules can be embedded in or independent of the processor in the electronic device in the form of hardware, and can also be stored in the memory of the electronic device in the form of software, so that the processor can invoke and execute the corresponding operations of the above-mentioned modules.

在一个实施例中,提供了一种电子设备,该电子设备可以是终端,其内部结构图可以如图8所示。该电子设备包括通过系统总线连接的处理器、存储器、通信接口、显示屏和输入装置。其中,该电子设备的处理器用于提供计算和控制能力。该电子设备的存储器包括非易失性存储介质、内存储器。该非易失性存储介质存储有操作系统和计算机程序。该内存储器为非易失性存储介质中的操作系统和计算机程序的运行提供环境。该电子设备的通信接口用于与外部的设备进行有线或无线方式的通信,无线方式可通过WIFI、移动蜂窝网络、NFC(近场通信)或其他技术实现。该计算机程序被处理器执行时以实现一种虚拟现实直播间虚拟礼物特效播放处理方法。该电子设备的显示屏可以是液晶显示屏或者电子墨水显示屏,该电子设备的输入装置可以是显示屏上覆盖的触摸层,也可以是电子设备外壳上设置的按键、轨迹球或触控板,还可以是外接的键盘、触控板或鼠标等。In one embodiment, an electronic device is provided. The electronic device may be a terminal, and its internal structure may be as shown in FIG. 8 . The electronic device includes a processor, a memory, a communication interface, a display screen and an input device connected through a system bus. Wherein, the processor of the electronic device is used to provide calculation and control capabilities. The memory of the electronic device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium. The communication interface of the electronic device is used for wired or wireless communication with external devices, and the wireless method can be realized through WIFI, mobile cellular network, NFC (Near Field Communication) or other technologies. When the computer program is executed by the processor, a processing method for playing virtual gifts with special effects in a virtual reality live broadcast room is realized. The display screen of the electronic device may be a liquid crystal display screen or an electronic ink display screen, and the input device of the electronic device may be a touch layer covered on the display screen, or a button, a trackball or a touch pad provided on the housing of the electronic device , and can also be an external keyboard, touchpad, or mouse.

本领域技术人员可以理解,图8中示出的结构,仅仅是与本申请方案相关的部分结构的框图,并不构成对本申请方案所应用于其上的电子设备的限定,具体的电子设备可以包括比图中所示更多或更少的部件,或者组合某些部件,或者具有不同的部件布置。Those skilled in the art can understand that the structure shown in FIG. 8 is only a block diagram of a part of the structure related to the solution of this application, and does not constitute a limitation on the electronic equipment to which the solution of this application is applied. The specific electronic equipment can be More or fewer components than shown in the figures may be included, or some components may be combined, or have a different arrangement of components.

在一个实施例中,还提供了一种电子设备,包括存储器和处理器,存储器中存储有计算机程序,该处理器执行计算机程序时实现上述各方法实施例中的步骤。In one embodiment, an electronic device is also provided, including a memory and a processor, where a computer program is stored in the memory, and the processor implements the steps in the above method embodiments when executing the computer program.

在一个实施例中,提供了一种计算机可读存储介质,其上存储有计算机程序,该计算机程序被处理器执行时实现上述各方法实施例中的步骤。In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the steps in the foregoing method embodiments are implemented.

本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,是可以通过计算机程序来指令相关的硬件来完成,所述的计算机程序可存储于一非易失性计算机可读取存储介质中,该计算机程序在执行时,可包括如上述各方法的实施例的流程。其中,本申请所提供的各实施例中所使用的对存储器、数据库或其它介质的任何引用,均可包括非易失性和易失性存储器中的至少一种。非易失性存储器可包括只读存储器(Read-OnlyMemory,ROM)、磁带、软盘、闪存、光存储器、高密度嵌入式非易失性存储器、阻变存储器(ReRAM)、磁变存储器(MagnetoresistiveRandomAccessMemory,MRAM)、铁电存储器(Ferroelectric RandomAccessMemory,FRAM)、相变存储器(PhaseChangeMemory,PCM)、石墨烯存储器等。易失性存储器可包括随机存取存储器(RandomAccessMemory,RAM)或外部高速缓冲存储器等。作为说明而非局限,RAM可以是多种形式,比如静态随机存取存储器(Static RandomAccessMemory,SRAM)或动态随机存取存储器(DynamicRandomAccessMemory,DRAM)等。本申请所提供的各实施例中所涉及的数据库可包括关系型数据库和非关系型数据库中至少一种。非关系型数据库可包括基于区块链的分布式数据库等,不限于此。本申请所提供的各实施例中所涉及的处理器可为通用处理器、中央处理器、图形处理器、数字信号处理器、可编程逻辑器、基于量子计算的数据处理逻辑器等,不限于此。Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above-mentioned embodiments can be completed by instructing related hardware through computer programs, and the computer programs can be stored in a non-volatile computer-readable memory In the medium, when the computer program is executed, it may include the processes of the embodiments of the above-mentioned methods. Wherein, any reference to storage, database or other media used in the various embodiments provided in the present application may include at least one of non-volatile and volatile storage. Non-volatile memory may include read-only memory (Read-Only Memory, ROM), tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive variable memory (ReRAM), magnetic variable memory (MagnetoresistiveRandomAccessMemory, MRAM), ferroelectric random access memory (FRAM), phase change memory (PhaseChangeMemory, PCM), graphene memory, etc. The volatile memory may include a random access memory (Random Access Memory, RAM) or an external cache memory and the like. As an illustration and not a limitation, the RAM can be in various forms, such as static random access memory (Static Random Access Memory, SRAM) or dynamic random access memory (Dynamic Random Access Memory, DRAM). The databases involved in the various embodiments provided in this application may include at least one of a relational database and a non-relational database. The non-relational database may include a blockchain-based distributed database, etc., but is not limited thereto. The processors involved in the various embodiments provided by this application can be general-purpose processors, central processing units, graphics processors, digital signal processors, programmable logic devices, data processing logic devices based on quantum computing, etc., and are not limited to this.

需要说明的是,本申请所涉及的用户信息(包括但不限于用户设备信息、用户个人信息等)和数据(包括但不限于用于分析的数据、存储的数据、展示的数据等),均为经用户授权或者经过各方充分授权的信息和数据。It should be noted that the user information (including but not limited to user equipment information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all Information and data authorized by the user or fully authorized by all parties.

以上实施例的各技术特征可以进行任意的组合,为使描述简洁,未对上述实施例中的各个技术特征所有可能的组合都进行描述,然而,只要这些技术特征的组合不存在矛盾,都应当认为是本说明书记载的范围。The technical features of the above embodiments can be combined arbitrarily. To make the description concise, all possible combinations of the technical features in the above embodiments are not described. However, as long as there is no contradiction in the combination of these technical features, they should be It is considered to be within the range described in this specification.

以上所述实施例仅表达了本申请的几种实施方式,其描述较为具体和详细,但并不能因此而理解为对本申请专利范围的限制。应当指出的是,对于本领域的普通技术人员来说,在不脱离本申请构思的前提下,还可以做出若干变形和改进,这些都属于本申请的保护范围。因此,本申请的保护范围应以所附权利要求为准。The above-mentioned embodiments only express several implementation modes of the present application, and the description thereof is relatively specific and detailed, but should not be construed as limiting the patent scope of the present application. It should be noted that those skilled in the art can make several modifications and improvements without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application should be determined by the appended claims.

Claims (14)

1.一种虚拟现实直播间虚拟礼物特效播放处理方法,其特征在于,所述方法包括:1. A virtual gift special effect playback processing method in a virtual reality live room, characterized in that the method comprises: 在虚拟现实直播间中展示主播形象;Display the image of the anchor in the virtual reality live broadcast room; 接收针对所述主播形象上目标部位的虚拟礼物赠送请求;receiving a virtual gift request for a target part on the image of the anchor; 若所述主播形象属于真人形象,则在主播端识别所述主播形象上目标部位在直播画面对应的二维坐标点集,得到所述目标部位的位置数据;If the image of the anchor belongs to the image of a real person, the two-dimensional coordinate point set corresponding to the target part on the live screen of the image of the anchor is recognized at the anchor end, and the position data of the target part is obtained; 若所述主播形象属于虚拟形象,则根据所述主播形象上目标部位在所述虚拟现实直播间的三维坐标点集,得到所述目标部位的位置数据;If the anchor image belongs to the virtual image, the position data of the target part is obtained according to the three-dimensional coordinate point set of the target part on the anchor image in the virtual reality live room; 响应于所述虚拟礼物赠送请求,根据所述目标部位的位置数据,在所述虚拟现实直播间中展示出在所述主播形象上目标部位播放的虚拟礼物特效。In response to the virtual gift giving request, according to the location data of the target location, the virtual gift special effect played on the target location on the anchor image is displayed in the virtual reality live broadcast room. 2.根据权利要求1所述的方法,其特征在于,所述在主播端识别所述主播形象上目标部位在直播画面对应的二维坐标点集,包括:2. The method according to claim 1, wherein the identification of the two-dimensional coordinate point set corresponding to the target part on the live image on the anchor image at the anchor end includes: 根据主播端的全景直播视频数据,识别所述主播形象上目标部位对应的特征点集;According to the panoramic live video data of the anchor terminal, identify the feature point set corresponding to the target part on the image of the anchor; 根据所述特征点集在直播画面对应的二维坐标点集,得到所述主播形象上目标部位在直播画面对应的二维坐标点集。According to the two-dimensional coordinate point set corresponding to the feature point set on the live broadcast picture, the two-dimensional coordinate point set corresponding to the target part on the live broadcast picture on the image of the anchor is obtained. 3.根据权利要求2所述的方法,其特征在于,所述根据所述目标部位的位置数据,在所述虚拟现实直播间中展示出在所述主播形象上目标部位播放的虚拟礼物特效,包括:3. The method according to claim 2, characterized in that, according to the location data of the target part, the virtual gift special effect played on the target part on the anchor image is displayed in the virtual reality live broadcast room, include: 在所述主播端于预设球体的视频画面层渲染所述全景直播视频数据得到直播画面,于所述预设球体的特效播放层根据所述目标部位的位置数据渲染所述虚拟礼物特效得到特效画面;Render the panoramic live video data on the video screen layer of the preset sphere at the anchor end to obtain a live broadcast image, and render the virtual gift special effect on the special effect playback layer of the preset sphere according to the position data of the target part to obtain special effects picture; 将所述直播画面和特效画面混合得到目标直播数据,将所述目标直播数据发送至所述虚拟现实直播间中各观众端,以供所述各观众端在所述虚拟现实直播间中展示出在所述主播形象上目标部位播放的虚拟礼物特效。Mixing the live broadcast picture and the special effect picture to obtain target live broadcast data, and sending the target live broadcast data to each audience terminal in the virtual reality live broadcast room for the audience terminals to display in the virtual reality live broadcast room The virtual gift special effect played on the target part of the image of the anchor. 4.根据权利要求1至3中任一项所述的方法,其特征在于,4. The method according to any one of claims 1 to 3, characterized in that, 所述在虚拟现实直播间中展示主播形象,包括:The display of the image of the anchor in the virtual reality live broadcast room includes: 基于预设球体展示虚拟现实直播间的直播画面;所述直播画面中包含所述主播形象;Displaying a live broadcast picture of a virtual reality live broadcast room based on a preset sphere; the live broadcast picture includes the image of the anchor; 所述方法还包括:The method also includes: 获取待展示的虚拟礼物对应的空间维度,以及获取所述直播画面中主播形象所在位置;所述待展示的虚拟礼物包含针对主播形象上目标部位的虚拟礼物;Obtain the spatial dimension corresponding to the virtual gift to be displayed, and obtain the location of the anchor image in the live broadcast screen; the virtual gift to be displayed includes a virtual gift for a target position on the anchor image; 根据所述待展示的虚拟礼物对应的空间维度和主播形象所在位置,在所述预设球体范围内对应的预设无遮挡位置处展示所述虚拟礼物;According to the spatial dimension corresponding to the virtual gift to be displayed and the location of the anchor image, display the virtual gift at a corresponding preset unobstructed position within the range of the preset sphere; 所述接收针对所述主播形象上目标部位的虚拟礼物赠送请求,包括:The receiving a virtual gift request for a target part on the image of the anchor includes: 根据通过头戴式虚拟现实设备的操作手柄触发的与所述针对主播形象上目标部位的虚拟礼物的交互指令,获取所述虚拟礼物赠送请求。The request for giving the virtual gift is obtained according to an interaction instruction with the virtual gift for the target part on the image of the anchor triggered by the operating handle of the head-mounted virtual reality device. 5.根据权利要求4所述的方法,其特征在于,5. The method of claim 4, wherein, 所述根据所述待展示的虚拟礼物对应的空间维度和主播形象所在位置,在所述预设球体范围内对应的预设无遮挡位置处展示所述虚拟礼物,包括:According to the spatial dimension corresponding to the virtual gift to be displayed and the location of the anchor image, displaying the virtual gift at a corresponding preset unobstructed position within the range of the preset sphere includes: 所述待展示的虚拟礼物对应的空间维度为平面时,根据所述主播形象所在位置在所述预设球体范围内对应的预设无遮挡位置处展示平面礼物栏;所述平面礼物栏包含预先划分的多个平面区域;When the spatial dimension corresponding to the virtual gift to be displayed is a plane, a plane gift column is displayed at a corresponding preset unobstructed position within the preset sphere according to the position of the anchor image; the plane gift column contains a preset Divided multiple plane areas; 在所述多个平面区域展示所述待展示的虚拟礼物;displaying the virtual gifts to be displayed in the plurality of planar areas; 所述根据通过头戴式虚拟现实设备的操作手柄触发的与所述针对主播形象上目标部位的虚拟礼物的交互指令,获取所述虚拟礼物赠送请求,包括:The acquisition of the virtual gift request according to the interactive instruction with the virtual gift on the target part of the host image triggered by the operating handle of the head-mounted virtual reality device includes: 检测所述操作手柄发射的射线;detecting rays emitted by the operating handle; 所述射线与所述多个平面区域中目标平面区域相交时,确定展示于所述目标平面区域的针对主播形象上目标部位的虚拟礼物为所选虚拟礼物;When the ray intersects the target plane area in the plurality of plane areas, it is determined that the virtual gift for the target position on the anchor image displayed in the target plane area is the selected virtual gift; 响应于在所述相交状态下通过所述操作手柄触发的确认指令,得到所述虚拟礼物赠送请求。The virtual gift giving request is obtained in response to a confirmation instruction triggered by the operating handle in the intersecting state. 6.根据权利要求4所述的方法,其特征在于,6. The method of claim 4, wherein, 所述根据所述待展示的虚拟礼物对应的空间维度和主播形象所在位置,在所述预设球体范围内对应的预设无遮挡位置处展示所述虚拟礼物,包括:According to the spatial dimension corresponding to the virtual gift to be displayed and the location of the anchor image, displaying the virtual gift at a corresponding preset unobstructed position within the range of the preset sphere includes: 所述待展示的虚拟礼物对应的空间维度为立体时,确定所述主播形象所在位置对应的站立平面;When the spatial dimension corresponding to the virtual gift to be displayed is three-dimensional, determine the standing plane corresponding to the location of the anchor image; 根据所述主播形象所在位置,在所述预设球体范围内于所述站立平面上对应的预设无遮挡位置处展示立体礼物柜;所述立体礼物柜包含多个立体礼物放置格;According to the location of the image of the anchor, a three-dimensional gift cabinet is displayed at a corresponding preset unobstructed position on the standing plane within the range of the preset sphere; the three-dimensional gift cabinet includes a plurality of three-dimensional gift placement grids; 在所述多个立体礼物放置格中展示所述待展示的虚拟礼物;Displaying the virtual gifts to be displayed in the plurality of three-dimensional gift placement grids; 所述根据通过头戴式虚拟现实设备的操作手柄触发的与所述针对主播形象上目标部位的虚拟礼物的交互指令,获取所述虚拟礼物赠送请求,包括:The acquisition of the virtual gift request according to the interactive instruction with the virtual gift on the target part of the host image triggered by the operating handle of the head-mounted virtual reality device includes: 检测所述操作手柄发射的射线;detecting rays emitted by the operating handle; 所述射线与所述多个立体礼物放置格中针对主播形象上目标部位的虚拟礼物相交时,确定该虚拟礼物为所选虚拟礼物;When the ray intersects with the virtual gift aimed at the target position on the anchor image in the plurality of three-dimensional gift placement grids, it is determined that the virtual gift is the selected virtual gift; 响应于在所述相交状态下通过所述操作手柄触发的抓取操作,将所述所选虚拟礼物从所述多个立体礼物放置格对应的礼物放置位置移动至所述操作手柄所在位置对应的礼物观察位置;In response to the grabbing operation triggered by the operating handle in the intersecting state, the selected virtual gift is moved from the gift placement position corresponding to the plurality of three-dimensional gift placement grids to the corresponding position of the operating handle. gift viewing position; 响应于通过所述操作手柄触发的确认操作,得到所述虚拟礼物赠送请求。In response to a confirmation operation triggered by the operating handle, the virtual gift giving request is obtained. 7.根据权利要求1所述的方法,其特征在于,所述根据所述目标部位的位置数据,在所述虚拟现实直播间中展示出在所述主播形象上目标部位播放的虚拟礼物特效,包括:7. The method according to claim 1, characterized in that, according to the location data of the target part, the virtual gift special effect played on the target part on the anchor image is displayed in the virtual reality live broadcast room, include: 所述主播形象属于虚拟形象时,获取发出所述虚拟礼物赠送请求的观众在所述虚拟现实直播间对应的虚拟观众位置点;When the image of the anchor belongs to the avatar, obtain the corresponding virtual audience position point in the virtual reality live broadcast room of the audience who sent the virtual gift request; 在所述虚拟现实直播间中,播放针对所述主播形象上目标部位的虚拟礼物从所述虚拟观众位置点移动至所述主播形象的预设动画;In the virtual reality live broadcast room, playing a preset animation in which a virtual gift for a target part on the anchor image moves from the virtual audience position point to the anchor image; 所述虚拟礼物移动至所述主播形象后,根据所述目标部位的位置数据,在所述主播形象上目标部位播放对应的虚拟礼物特效。After the virtual gift moves to the anchor image, according to the location data of the target location, the corresponding virtual gift special effect is played on the target location on the anchor image. 8.根据权利要求7所述的方法,其特征在于,所述在所述主播形象上目标部位播放对应的虚拟礼物特效之后,所述方法还包括:8. The method according to claim 7, characterized in that, after playing the corresponding virtual gift special effect on the target part of the anchor image, the method further comprises: 在主播端检测到主播通过头戴式虚拟现实设备的操作手柄触发与所述虚拟礼物的碰撞时,在所述主播端通过所述头戴式虚拟现实设备向所述主播产生碰撞反馈。When the anchor end detects that the anchor triggers a collision with the virtual gift through the operating handle of the head-mounted virtual reality device, the anchor end generates collision feedback to the anchor through the head-mounted virtual reality device. 9.根据权利要求1或7或8所述的方法,其特征在于,所述在虚拟现实直播间中展示主播形象之后,所述方法还包括:9. The method according to claim 1, 7 or 8, characterized in that, after the anchor image is displayed in the virtual reality live broadcast room, the method further comprises: 通过头戴式虚拟现实设备的传感器组分别采集主播在各预设控制维度对应的动作数据;所述预设控制维度为所述主播形象的预设控制维度;所述主播形象属于虚拟形象;The sensor groups of the head-mounted virtual reality device respectively collect the action data corresponding to the anchor in each preset control dimension; the preset control dimension is the preset control dimension of the anchor image; the anchor image belongs to the virtual image; 对于任一预设控制维度,若所述预设控制维度对应的动作数据表征所述主播在所述预设控制维度对应的动作变化符合所述预设控制维度的预设动作变化条件,则获取所述动作变化对应的动作控制指令;For any preset control dimension, if the action data corresponding to the preset control dimension indicates that the anchor’s action change corresponding to the preset control dimension meets the preset action change condition of the preset control dimension, obtain An action control instruction corresponding to the action change; 根据所述动作控制指令,获取脚本数据库中对应的目标动作脚本;Obtaining a corresponding target action script in the script database according to the action control instruction; 根据所述目标动作脚本,控制所述主播形象执行对应的动作。According to the target action script, the host image is controlled to perform a corresponding action. 10.根据权利要求9所述的方法,其特征在于,所述方法还包括:10. The method according to claim 9, further comprising: 若所述预设控制维度对应的动作数据表征所述主播在所述虚拟现实直播间中的位置接近预设虚拟边界,则通过所述头戴式虚拟现实设备触发安全提示反馈,并持续展示所述预设虚拟边界直至所述主播离开所述预设虚拟边界;其中,所述预设虚拟边界根据所述主播在真实空间中的安全移动区域进行预先设置。If the action data corresponding to the preset control dimension indicates that the position of the anchor in the virtual reality live broadcast room is close to the preset virtual boundary, trigger a safety prompt feedback through the head-mounted virtual reality device, and continuously display the The preset virtual boundary until the anchor leaves the preset virtual boundary; wherein, the preset virtual boundary is preset according to the safe movement area of the anchor in the real space. 11.根据权利要求9所述的方法,其特征在于,所述通过头戴式虚拟现实设备的传感器组分别采集主播在各预设控制维度对应的动作数据之后,所述方法还包括:11. The method according to claim 9, characterized in that, after the sensor group of the head-mounted virtual reality device respectively collects the anchor's action data corresponding to each preset control dimension, the method further comprises: 针对任一预设控制维度,根据所述预设控制维度对应的动作数据,判断所述动作数据的变化量是否大于预设变化量阈值;For any preset control dimension, according to the action data corresponding to the preset control dimension, determine whether the change amount of the action data is greater than a preset change amount threshold; 若是,则确定所述预设控制维度对应的动作数据表征所述主播在所述预设控制维度对应的动作变化符合所述预设控制维度的预设动作变化条件。If so, it is determined that the action data corresponding to the preset control dimension indicates that the action change of the anchor corresponding to the preset control dimension meets the preset action change condition of the preset control dimension. 12.一种虚拟现实直播间虚拟礼物特效播放处理装置,其特征在于,所述装置包括:12. A processing device for playing virtual gifts with special effects in a virtual reality live broadcast room, characterized in that the device includes: 主播形象展示模块,用于在虚拟现实直播间中展示主播形象;The anchor image display module is used to display the anchor image in the virtual reality live broadcast room; 赠送请求接收模块,用于接收针对所述主播形象上目标部位的虚拟礼物赠送请求;A gift request receiving module, configured to receive a virtual gift request for a target part on the image of the anchor; 二维位置获取模块,用于若所述主播形象属于真人形象,则在主播端识别所述主播形象上目标部位在直播画面对应的二维坐标点集,得到所述目标部位的位置数据;The two-dimensional position acquisition module is used to identify the two-dimensional coordinate point set corresponding to the target part on the live screen on the anchor image at the anchor end if the anchor image belongs to a real person image, and obtain the position data of the target part; 三维位置获取模块,用于若所述主播形象属于虚拟形象,则根据所述主播形象上目标部位在所述虚拟现实直播间的三维坐标点集,得到所述目标部位的位置数据;The three-dimensional position acquisition module is used to obtain the position data of the target part according to the three-dimensional coordinate point set of the target part on the anchor image in the virtual reality live broadcast room if the anchor image belongs to the virtual image; 礼物特效播放模块,用于响应于所述虚拟礼物赠送请求,根据所述目标部位的位置数据,在所述虚拟现实直播间中展示出在所述主播形象上目标部位播放的虚拟礼物特效。The gift special effect playing module is used to display in the virtual reality live broadcast room the virtual gift special effects played on the target part of the anchor image according to the location data of the target part in response to the virtual gift giving request. 13.一种电子设备,包括存储器和处理器,所述存储器存储有计算机程序,其特征在于,所述处理器执行所述计算机程序时实现权利要求1至11中任一项所述的方法的步骤。13. An electronic device comprising a memory and a processor, the memory stores a computer program, wherein the processor implements the method according to any one of claims 1 to 11 when executing the computer program step. 14.一种计算机可读存储介质,其上存储有计算机程序,其特征在于,所述计算机程序被处理器执行时实现权利要求1至11中任一项所述的方法的步骤。14. A computer-readable storage medium, on which a computer program is stored, wherein when the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 11 are realized.
CN202211732809.4A 2022-12-30 2022-12-30 Method, device and equipment for playing virtual gift special effects in virtual reality live broadcast room Pending CN116233513A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211732809.4A CN116233513A (en) 2022-12-30 2022-12-30 Method, device and equipment for playing virtual gift special effects in virtual reality live broadcast room

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211732809.4A CN116233513A (en) 2022-12-30 2022-12-30 Method, device and equipment for playing virtual gift special effects in virtual reality live broadcast room

Publications (1)

Publication Number Publication Date
CN116233513A true CN116233513A (en) 2023-06-06

Family

ID=86588349

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211732809.4A Pending CN116233513A (en) 2022-12-30 2022-12-30 Method, device and equipment for playing virtual gift special effects in virtual reality live broadcast room

Country Status (1)

Country Link
CN (1) CN116233513A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024221332A1 (en) * 2023-04-27 2024-10-31 苍凌互联网技术(深圳)有限公司 Electronic device, live-streaming interaction system and method, storage medium and program product
WO2025156870A1 (en) * 2024-01-22 2025-07-31 中移(杭州)信息技术有限公司 Vr panoramic image output method, vr panoramic live broadcast method, and interaction method

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108388347A (en) * 2018-03-15 2018-08-10 网易(杭州)网络有限公司 Interaction control method and device in virtual reality and storage medium, terminal
CN110493630A (en) * 2019-09-11 2019-11-22 广州华多网络科技有限公司 The treating method and apparatus of virtual present special efficacy, live broadcast system
CN111541909A (en) * 2020-04-30 2020-08-14 广州华多网络科技有限公司 Panoramic live broadcast gift delivery method, device, equipment and storage medium
CN112513782A (en) * 2018-07-31 2021-03-16 株式会社尼康 Display control system, display control method, and display control program
CN113965812A (en) * 2021-12-21 2022-01-21 广州虎牙信息科技有限公司 Live broadcast method, system and live broadcast equipment

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108388347A (en) * 2018-03-15 2018-08-10 网易(杭州)网络有限公司 Interaction control method and device in virtual reality and storage medium, terminal
CN112513782A (en) * 2018-07-31 2021-03-16 株式会社尼康 Display control system, display control method, and display control program
CN110493630A (en) * 2019-09-11 2019-11-22 广州华多网络科技有限公司 The treating method and apparatus of virtual present special efficacy, live broadcast system
CN111541909A (en) * 2020-04-30 2020-08-14 广州华多网络科技有限公司 Panoramic live broadcast gift delivery method, device, equipment and storage medium
CN113965812A (en) * 2021-12-21 2022-01-21 广州虎牙信息科技有限公司 Live broadcast method, system and live broadcast equipment

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024221332A1 (en) * 2023-04-27 2024-10-31 苍凌互联网技术(深圳)有限公司 Electronic device, live-streaming interaction system and method, storage medium and program product
US12261897B2 (en) 2023-04-27 2025-03-25 Cangling Internet Technology (Shenzhen) Co., Ltd. Electronic device, webcast interaction system and method, storage medium, and program product
WO2025156870A1 (en) * 2024-01-22 2025-07-31 中移(杭州)信息技术有限公司 Vr panoramic image output method, vr panoramic live broadcast method, and interaction method

Similar Documents

Publication Publication Date Title
US11948260B1 (en) Streaming mixed-reality environments between multiple devices
US20230386154A1 (en) Methods and system for managing and displaying virtual content in a mixed reality system
US10671239B2 (en) Three dimensional digital content editing in virtual reality
CN113318428B (en) Game display control method, non-volatile storage medium and electronic device
EP3332565B1 (en) Mixed reality social interaction
CN112933606B (en) Game scene conversion method and device, storage medium and computer equipment
JP7503122B2 (en) Method and system for directing user attention to a location-based gameplay companion application - Patents.com
JP2022505998A (en) Augmented reality data presentation methods, devices, electronic devices and storage media
KR20190088545A (en) Systems, methods and media for displaying interactive augmented reality presentations
JP7050883B2 (en) Foveal rendering optimization, delayed lighting optimization, particle foveal adaptation, and simulation model
JP2020523687A (en) Shadow optimization and mesh skin adaptation in foveal rendering system
US10166477B2 (en) Image processing device, image processing method, and image processing program
CN113194329B (en) Live interaction method, device, terminal and storage medium
CN112891940A (en) Image data processing method and device, storage medium and computer equipment
WO2020007182A1 (en) Personalized scene image processing method and apparatus, and storage medium
CN116233513A (en) Method, device and equipment for playing virtual gift special effects in virtual reality live broadcast room
CN113763568A (en) Augmented reality display processing method, device, device and storage medium
CN113315963A (en) Augmented reality display method, device, system and storage medium
CN115997385B (en) Interface display method, device, equipment, medium and product based on augmented reality
CN116132702A (en) Method, device and equipment for processing giving of virtual gift in virtual reality live broadcasting room
CN116320646A (en) Interactive processing method and device for three-dimensional virtual gift in virtual reality live broadcasting room
CN117075771A (en) Screen display methods, devices, equipment and media based on virtual reality space
CN116152423A (en) Virtual reality live broadcasting room illumination processing method, device, equipment and storage medium
CN118349152A (en) Method, device, equipment, medium and program for resetting cover image of virtual object
CN117806448A (en) A data processing method, device, equipment and medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination