CN115690363A - Virtual object display method and device and head-mounted display device - Google Patents
Virtual object display method and device and head-mounted display device Download PDFInfo
- Publication number
- CN115690363A CN115690363A CN202110835220.6A CN202110835220A CN115690363A CN 115690363 A CN115690363 A CN 115690363A CN 202110835220 A CN202110835220 A CN 202110835220A CN 115690363 A CN115690363 A CN 115690363A
- Authority
- CN
- China
- Prior art keywords
- virtual object
- position information
- display
- area
- real
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Processing Or Creating Images (AREA)
Abstract
本发明涉及一种虚拟物体显示方法、装置和头戴式显示装置,通过获取三维场景中真实物体的第一位置信息和虚拟物体的第二位置信息,根据第一位置信息和第二位置信息获取虚拟物体的被遮挡区域,通过对所述虚拟物体的被遮挡区域添加预设标识,在三维场景中显示真实物体、虚拟物体的未被遮挡区域,以及预设标识,提醒用户查看虚拟物体的被遮挡区域,通过添加预设标识的方式使得被真实物体遮挡的虚拟物体展示在用户视野中,避免由于显示不全面影响用户的交互体验。
The present invention relates to a virtual object display method, device and head-mounted display device, by obtaining the first position information of the real object and the second position information of the virtual object in the three-dimensional scene, according to the first position information and the second position information to obtain The occluded area of the virtual object, by adding a preset mark to the occluded area of the virtual object, displays the real object, the non-occluded area of the virtual object, and the preset mark in the three-dimensional scene, reminding the user to view the occluded area of the virtual object In the occlusion area, the virtual object occluded by the real object is displayed in the user's field of vision by adding a preset logo, so as to avoid affecting the user's interactive experience due to incomplete display.
Description
技术领域technical field
本发明涉及显示领域,尤其是涉及一种虚拟物体显示方法、装置和头戴式显示装置。The present invention relates to the field of display, in particular to a virtual object display method, device and head-mounted display device.
背景技术Background technique
增强现实(Augmented Reality)技术是一种将虚拟信息与真实世界巧妙融合的技术,广泛运用了多媒体、三维建模、实时跟踪及注册、智能交互、传感等多种技术手段,将计算机生成的文字、图像、三维模型、音乐、视频等虚拟信息模拟仿真后,应用到真实世界中,两种信息互为补充,从而实现对真实世界的“增强”。Augmented Reality (Augmented Reality) technology is a technology that ingeniously integrates virtual information with the real world. It uses a variety of technical means such as multimedia, 3D modeling, real-time tracking and registration, intelligent interaction, and sensing to integrate computer-generated Text, images, 3D models, music, video and other virtual information are simulated and applied to the real world, and the two kinds of information complement each other, thereby realizing the "enhancement" of the real world.
随着增强现实技术的发展迭代,AR设备逐渐成熟,走进各行各业中,在娱乐,工业等方面扮演着越来越重要的角色,人们对于虚拟物体和真实物体之间的交互需求也越来越高,当虚拟物体与真实物体之间相互遮挡时,通常以真实物体作为遮挡物,以虚拟物体作为被遮挡物,优先显示真实物体的方式展示,然而,上述方式可能造成被遮挡的虚拟物体显示不全面,被遮挡的内容不容易被注意到,影响用户的操作体验,比如要对虚拟物体进行操控时,由于被遮挡部分显示不全可能会造成用户对被遮挡部分判断错误,从而发生误操作。With the development and iteration of augmented reality technology, AR equipment has gradually matured and entered all walks of life, playing an increasingly important role in entertainment, industry, etc. People's demand for interaction between virtual objects and real objects is also increasing When the virtual object and the real object are mutually occluded, the real object is usually used as the occluder, the virtual object is used as the occluded object, and the real object is displayed first. However, the above method may cause the occluded virtual Objects are not fully displayed, and the occluded content is not easy to be noticed, which affects the user's operating experience. For example, when manipulating a virtual object, the incomplete display of the occluded part may cause the user to misjudge the occluded part, resulting in erroneous operate.
发明内容Contents of the invention
本申请实施例提供了一种虚拟物体显示方法、装置和头戴式显示装置,能够使用户把握得被遮挡内容,提高用户的交互体验。Embodiments of the present application provide a virtual object display method and device, and a head-mounted display device, which enable users to grasp occluded content and improve user interaction experience.
第一方面,本申请实施例提供了一种虚拟物体显示方法,应用于电子设备上,所述电子设备用于显示包括至少一个真实物体和至少一个虚拟物体的三维场景;In a first aspect, an embodiment of the present application provides a method for displaying a virtual object, which is applied to an electronic device, and the electronic device is used to display a three-dimensional scene including at least one real object and at least one virtual object;
所述虚拟物体显示方法包括以下步骤:The method for displaying virtual objects includes the following steps:
获取所述真实物体的第一位置信息;Acquiring first position information of the real object;
获取所述虚拟物体的第二位置信息;Acquiring second position information of the virtual object;
根据所述第一位置信息和所述第二位置信息,获取所述虚拟物体的被遮挡区域;Acquiring an occluded area of the virtual object according to the first position information and the second position information;
对所述虚拟物体的被遮挡区域添加预设标识;Adding a preset mark to the covered area of the virtual object;
显示所述三维场景,在所述三维场景中所述真实物体、所述虚拟物体的未被遮挡区域,以及所述预设标识被显示。The three-dimensional scene is displayed, in which the real object, the non-occluded area of the virtual object, and the preset identification are displayed.
第二方面,本申请实施例提供了一种虚拟物体显示装置,应用于电子设备上,所述电子设备用于显示包括至少一个真实物体和至少一个虚拟物体的三维场景;In the second aspect, the embodiment of the present application provides a virtual object display device, which is applied to an electronic device, and the electronic device is used to display a three-dimensional scene including at least one real object and at least one virtual object;
所述虚拟物体显示装置包括:The virtual object display device includes:
第一位置获取模块,用于获取所述真实物体的第一位置信息;A first position acquiring module, configured to acquire first position information of the real object;
第二位置获取模块,用于获取所述虚拟物体的第二位置信息;a second position acquiring module, configured to acquire second position information of the virtual object;
被遮挡区域获取模块,用于根据所述第一位置信息和所述第二位置信息,获取所述虚拟物体的被遮挡区域;An occluded area acquiring module, configured to acquire an occluded area of the virtual object according to the first position information and the second position information;
预设标识添加模块,用于对所述虚拟物体的被遮挡区域添加预设标识;A preset logo adding module, configured to add a preset logo to the occluded area of the virtual object;
显示模块,用于显示所述三维场景,在所述三维场景中所述真实物体、所述虚拟物体的未被遮挡区域,以及所述预设标识被显示。A display module, configured to display the three-dimensional scene, in which the real object, the unoccluded area of the virtual object, and the preset logo are displayed.
第三方面,本申请实施例提供了一种头戴式显示装置,包括:电子设备、存储器、处理器以及存储在所述存储器中并可被所述处理器执行的计算机程序,所述电子设备用于显示包括至少一个真实物体和至少一个虚拟物体的三维场景,所述处理器执行所述计算机程序时实现如上述任意一项所述的虚拟物体显示方法的步骤。In a third aspect, an embodiment of the present application provides a head-mounted display device, including: an electronic device, a memory, a processor, and a computer program stored in the memory and executable by the processor. The electronic device For displaying a three-dimensional scene including at least one real object and at least one virtual object, when the processor executes the computer program, it realizes the steps of the virtual object display method described in any one of the above.
第四方面,本申请实施例提供了一种计算机可读存储介质,其上储存有计算机程序,该计算机程序被处理器执行时实现如上述任意一项所述的显示调整方法的步骤。In a fourth aspect, the embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the display adjustment method described in any one of the above are implemented.
在本申请实施例中,通过获取三维场景中真实物体的第一位置信息和虚拟物体的第二位置信息,根据第一位置信息和第二位置信息获取虚拟物体的被遮挡区域,通过对所述虚拟物体的被遮挡区域添加预设标识,在三维场景中显示真实物体、虚拟物体的未被遮挡区域,以及预设标识,提醒用户查看虚拟物体的被遮挡区域,通过添加预设标识的方式使得被真实物体遮挡的虚拟物体展示在用户视野中,避免由于显示不全面影响用户的交互体验。In the embodiment of the present application, by obtaining the first position information of the real object and the second position information of the virtual object in the three-dimensional scene, the occluded area of the virtual object is obtained according to the first position information and the second position information, and the The occluded area of the virtual object is added with a preset logo, and the real object, the unoccluded area of the virtual object, and the preset logo are displayed in the 3D scene to remind the user to view the occluded area of the virtual object. By adding the preset logo, the Virtual objects that are blocked by real objects are displayed in the user's field of vision to avoid affecting the user's interactive experience due to incomplete display.
为了更好地理解和实施,下面结合附图详细说明本发明。For better understanding and implementation, the present invention will be described in detail below in conjunction with the accompanying drawings.
附图说明Description of drawings
图1为本申请一个实施例的虚拟物体显示方法的应用环境示意框图;FIG. 1 is a schematic block diagram of an application environment of a virtual object display method according to an embodiment of the present application;
图2为本申请实施例1的虚拟物体显示方法的流程图;FIG. 2 is a flow chart of the virtual object display method in Embodiment 1 of the present application;
图3为本申请实施例1中利用虚拟物体显示方法对被遮挡的虚拟物体进行标识的示意图;FIG. 3 is a schematic diagram of identifying an occluded virtual object using a virtual object display method in Embodiment 1 of the present application;
图4为本申请实施例2的虚拟物体显示装置的结构示意图;FIG. 4 is a schematic structural diagram of a virtual object display device according to Embodiment 2 of the present application;
图5为本申请实施例3的头戴式显示装置的结构示意图。FIG. 5 is a schematic structural diagram of a head-mounted display device according to Embodiment 3 of the present application.
具体实施方式Detailed ways
为使本申请的目的、技术方案和优点更加清楚,下面将结合附图对本申请实施例方式作进一步地详细描述。In order to make the purpose, technical solution and advantages of the present application clearer, the embodiments of the present application will be further described in detail below in conjunction with the accompanying drawings.
应当明确,所描述的实施例仅仅是本申请实施例一部分实施例,而不是全部的实施例。基于本申请实施例中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其它实施例,都属于本申请实施例保护的范围。It should be clear that the described embodiments are only some of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the embodiments of the present application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the embodiments of the present application.
在本申请实施例使用的术语是仅仅出于描述特定实施例的目的,而非旨在限制本申请实施例。在本申请实施例和所附权利要求书中所使用的单数形式的“一种”、“所述”和“该”也旨在包括多数形式,除非上下文清楚地表示其他含义。还应当理解,本文中使用的术语“和/或”是指并包含一个或多个相关联的列出项目的任何或所有可能组合。The terms used in the embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to limit the embodiments of the present application. The singular forms "a", "said" and "the" used in the embodiments of this application and the appended claims are also intended to include plural forms unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and includes any and all possible combinations of one or more of the associated listed items.
下面的描述涉及附图时,除非另有表示,不同附图中的相同数字表示相同或相似的要素。以下示例性实施例中所描述的实施方式并不代表与本申请相一致的所有实施方式。相反,它们仅是如所附权利要求书中所详述的、本申请的一些方面相一致的装置和方法的例子。在本申请的描述中,需要理解的是,术语“第一”、“第二”、“第三”等仅用于区别类似的对象,而不必用于描述特定的顺序或先后次序,也不能理解为指示或暗示相对重要性。对于本领域的普通技术人员而言,可以根据具体情况理解上述术语在本申请中的具体含义。When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with aspects of the present application as recited in the appended claims. In the description of the present application, it should be understood that the terms "first", "second", "third", etc. are only used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence, nor can they be Read as indicating or implying relative importance. Those of ordinary skill in the art can understand the specific meanings of the above terms in this application according to specific situations.
此外,在本申请的描述中,除非另有说明,“若干个”是指两个或两个以上。“和/或”,描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。字符“/”一般表示前后关联对象是一种“或”的关系。In addition, in the description of the present application, unless otherwise specified, "several" means two or more. "And/or" describes the association relationship of associated objects, indicating that there may be three types of relationships, for example, A and/or B may indicate: A exists alone, A and B exist simultaneously, and B exists independently. The character "/" generally indicates that the contextual objects are an "or" relationship.
请参阅图1,其为本申请一个实施例提供的一种虚拟物体显示方法的应用环境示意框图。如图1所示,本申请实施例的虚拟物体显示方法的应用环境包括一种电子设备100,电子设备100显示包括至少一个真实物体和至少一个虚拟物体的三维场景,其中,虚拟物体110被真实物体120遮挡。Please refer to FIG. 1 , which is a schematic block diagram of an application environment of a method for displaying a virtual object provided by an embodiment of the present application. As shown in FIG. 1 , the application environment of the virtual object display method of the embodiment of the present application includes an
该电子设备100包括:至少一个处理器、至少一个存储器,至少一个网络接口,用户接口、至少一个通信总线和显示设备。The
其中,所述网络接口可选的可以包括标准的有线接口、无线接口(如WI-FI接口)。Wherein, the network interface may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface).
其中,用户接口主要用于为用户提供输入的接口,获取用户输入的数据,可选的,所述用户接口还可以包括标准的有线接口、无线接口。Wherein, the user interface is mainly used to provide an input interface for the user and obtain the data input by the user. Optionally, the user interface may also include a standard wired interface and a wireless interface.
其中,所述通信总线用于实现这些组件之间的连接通信。Wherein, the communication bus is used to realize connection and communication between these components.
其中,所述处理器可以包括一个或者多个处理核心。处理器利用各种接口和线路连接整个电子设备内的各个部分,通过运行或执行存储在存储器内的指令、程序、代码集或指令集,以及调用存储在存储器内的数据,执行电子设备100的各种功能和处理数据。可选的,处理器可以采用数字信号处理(Digital Signal Processing,DSP)、现场可编程门阵列(Field-Programmable Gate Array,FPGA)、可编程逻辑阵列(Programmable Logic Array,PLA)中的至少一种硬件形式来实现。处理器可集成中央处理器(Central ProcessingUnit,CPU)、图像处理器(Graphics Processing Unit,GPU)和调制解调器等中的一种或几种的组合。其中,CPU主要处理操作系统、用户界面和应用程序等;GPU用于负责显示屏所需要显示的内容的渲染和绘制;调制解调器用于处理无线通信。可以理解的是,上述调制解调器也可以不集成到处理器中,单独通过一块芯片进行实现。Wherein, the processor may include one or more processing cores. The processor uses various interfaces and lines to connect various parts of the entire electronic device, and executes the functions of the
其中,存储器可以包括随机存储器(Random Access Memory,RAM),也可以包括只读存储器(Read-Only Memory)。可选的,该存储器包括非瞬时性计算机可读介质(non-transitory computer-readable storage medium)。存储器可用于存储指令、程序、代码、代码集或指令集。存储器可包括存储程序区和存储数据区,其中,存储程序区可存储用于实现操作系统的指令、用于至少一个功能的指令(比如触控功能、声音播放功能、图像播放功能等)、用于实现上述各个方法实施例的指令等;存储数据区可存储上面各个方法实施例中涉及到的数据等。存储器可选的还可以是至少一个位于远离前述处理器的存储装置。Wherein, the memory may include random access memory (Random Access Memory, RAM), and may also include read-only memory (Read-Only Memory). Optionally, the memory includes a non-transitory computer-readable storage medium. Memory may be used to store instructions, programs, code, sets of codes, or sets of instructions. The memory may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing the operating system, instructions for at least one function (such as touch function, sound playback function, image playback function, etc.), Instructions and the like for implementing the above method embodiments; the storage data area can store the data and the like involved in the above method embodiments. Optionally, the memory may also be at least one storage device located away from the aforementioned processor.
所述处理器可以用于调用存储器中存储的虚拟物体显示方法的应用程序,并具体执行本申请实施例中虚拟物体显示方法的步骤。The processor can be used to call the application program of the virtual object display method stored in the memory, and specifically execute the steps of the virtual object display method in the embodiment of the present application.
本申请的显示设备是一种实现AR技术(增强现实技术)且可佩戴在人体头部进行展示的可穿戴式设备,它通过计算机技术将虚拟的信息叠加到真实世界,使真实的环境和虚拟的物体能够实时地叠加到同一个画面中,实现两种信息的相互补充,并通过显示设备在用户的眼前进行画面展示。显示设备用于显示包括至少一个真实物体和至少一个虚拟物体的三维场景,在一个实施例中,显示设备可以是AR眼镜为例,本领域技术人员容易理解,本申请的显示设备还可以为头盔形态的AR设备。The display device of this application is a wearable device that implements AR technology (augmented reality technology) and can be worn on the human head for display. It superimposes virtual information on the real world through computer technology, making the real environment and virtual environment Objects can be superimposed on the same screen in real time to realize the mutual complementarity of the two kinds of information, and the screen can be displayed in front of the user's eyes through the display device. The display device is used to display a three-dimensional scene including at least one real object and at least one virtual object. In one embodiment, the display device can be AR glasses as an example. Those skilled in the art can easily understand that the display device of the present application can also be a helmet form of AR equipment.
在一个实施例中,显示设备能够与终端设备配合使用以形成可穿戴系统,显示设备能够通过有线或者无线的方式与终端设备连接。其中,终端设备用于输出图像信息、音频信息和控制指令传输给所述显示设备,并用于接收显示设备输出的信息。本领域技术人员容易理解,本申请的终端设备可以是任何具备通信和存储功能的设备,例如智能手机、平板电脑、笔记本电脑、便携电话机、视频电话、数码静物相机、电子书籍阅读器、便携多媒体播放器(PMP)、移动医疗装置等智能终端。具体地,终端设备首先基于图像模型渲染出虚拟图像。然后,终端设备根据自身与显示设备之间相对位置关系,自动调整虚拟图像的形状和/或角度,使得调整后的虚拟图像符合显示设备的显示需求。之后,终端设备将经过调整的虚拟图像发送给显示设备,以供显示设备将该经过调整的虚拟图像叠加到现实场景中,供用户观看。在其它实施例中,显示设备内部设有可用于具备上述终端设备所实现功能的集成芯片,使得显示设备可以单独使用,即用户将显示设备穿戴至用户头部即可观测AR图像。In one embodiment, the display device can be used in cooperation with the terminal device to form a wearable system, and the display device can be connected to the terminal device in a wired or wireless manner. Wherein, the terminal device is used to output image information, audio information and control instructions to the display device, and is used to receive information output by the display device. Those skilled in the art can easily understand that the terminal device of the present application can be any device with communication and storage functions, such as smart phones, tablet computers, notebook computers, portable phones, video phones, digital still cameras, e-book readers, portable Smart terminals such as multimedia players (PMP), mobile medical devices, etc. Specifically, the terminal device first renders a virtual image based on the image model. Then, the terminal device automatically adjusts the shape and/or angle of the virtual image according to the relative positional relationship between itself and the display device, so that the adjusted virtual image meets the display requirements of the display device. Afterwards, the terminal device sends the adjusted virtual image to the display device, so that the display device superimposes the adjusted virtual image on the real scene for viewing by the user. In other embodiments, the display device is provided with an integrated chip that can be used to implement the functions of the above-mentioned terminal device, so that the display device can be used alone, that is, the user can observe the AR image by wearing the display device on the user's head.
实施例1Example 1
如图2所示,本申请实施例提供了一种虚拟物体显示方法,该方法应用于上述电子设备上,所述电子设备用于显示包括至少一个真实物体和至少一个虚拟物体的三维场景;As shown in FIG. 2, an embodiment of the present application provides a method for displaying a virtual object, the method is applied to the above-mentioned electronic device, and the electronic device is used to display a three-dimensional scene including at least one real object and at least one virtual object;
该虚拟物体显示方法包括以下步骤:The virtual object display method includes the following steps:
步骤S1:获取所述真实物体的第一位置信息;Step S1: Obtain the first position information of the real object;
真实物体为在真实空间存在的真实物体。The real object is a real object existing in a real space.
在本申请实施例中,为了更好地描述上述真实物体/虚拟物体在该三维场景内的具体位置,该三维场景设有一坐标系,该坐标系以一个真实物体的中心点作为原点,以通过原点且平行于地面的水平面作为XY平面,以垂直于地面的方向作为Z轴,通过获取真实物体的各个特征点在该坐标系上的位置,即可得到真实物体的第一位置信息。In the embodiment of the present application, in order to better describe the specific position of the above-mentioned real object/virtual object in the three-dimensional scene, the three-dimensional scene is provided with a coordinate system, and the coordinate system takes the center point of a real object as the origin, so as to pass The horizontal plane with the origin and parallel to the ground is used as the XY plane, and the direction perpendicular to the ground is used as the Z axis. By obtaining the positions of each feature point of the real object on the coordinate system, the first position information of the real object can be obtained.
第一位置信息用于指示真实物体在该坐标系的所在位置。具体地,可以根据真实物体在真实空间的位置信息,确定该真实物体与坐标系原点的真实物体的相对位置关系,确定真实物体在三维场景内的位置信息。The first location information is used to indicate the location of the real object in the coordinate system. Specifically, according to the position information of the real object in the real space, the relative position relationship between the real object and the real object at the origin of the coordinate system can be determined, and the position information of the real object in the three-dimensional scene can be determined.
在一个实施例中,真实物体在真实空间的位置信息可以通过在真实物体上设置位置传感器对真实物体在真实空间内的地理位置信息进行追踪得到;在另一个实施例中,也可以利用拍摄装置拍摄真实物体图像,根据真实物体图像,利用空间定位技术识别真实物体处于真实空间的位置信息,其中,摄像装置可以是取得彩色图像的彩色照相机(也称为“RGB照相机”)以及从多个不同方向同时对真实物体进行摄像的立体照相机等;空间定位技术是指以地理信息系统、遥感、全球定位系统为研究对象,内容包括空间信息、空间模型、空间分析和空间决策等。全球定位系统和遥感分别用于获取点、面空间信息或监测其变化,地理信息系统用于空间数据的存储、分析和处理。In one embodiment, the location information of the real object in the real space can be obtained by setting a position sensor on the real object to track the geographic location information of the real object in the real space; in another embodiment, a shooting device can also be used Take images of real objects, and use spatial positioning technology to identify the position information of real objects in real space according to the images of real objects. Stereo cameras that take pictures of real objects at the same time; spatial positioning technology refers to geographic information systems, remote sensing, and global positioning systems as research objects, including spatial information, spatial models, spatial analysis, and spatial decision-making. Global positioning system and remote sensing are used to obtain point and area spatial information or monitor its changes respectively, and geographic information system is used for storage, analysis and processing of spatial data.
步骤S2:获取所述虚拟物体的第二位置信息Step S2: Obtaining the second position information of the virtual object
虚拟物体可以为三维虚拟物体、二维图案、图片、文字或视频等需要在三维场景内显示的内容数据。其中,虚拟物体响应于用户的虚拟物体生成请求生成,其中,虚拟物体生成请求可以包括待生成的虚拟物体的位置、展示方式、三维模型、标识或尺寸等构造数据。虚拟物体可以通过程序生成或通过读取存储器中的数据在预设位置显示。The virtual object may be content data that needs to be displayed in a three-dimensional scene, such as a three-dimensional virtual object, a two-dimensional pattern, a picture, a text, or a video. Wherein, the virtual object is generated in response to a user's virtual object generation request, wherein the virtual object generation request may include structural data such as the position, display mode, three-dimensional model, logo or size of the virtual object to be generated. Virtual objects can be generated by programs or displayed at preset positions by reading data from memory.
第二位置信息用于指示虚拟物体在该坐标系内的所在位置,第二位置信息可以包括该虚拟物体的一个或多个特征点所在的位置。在一个实施例中,待生成的虚拟物体的位置指的是虚拟物体与真实物体的相对位置,在本申请实施例中,由于真实物体在坐标系的第一位置信息已知,根据虚拟物体与真实物体的相对位置即可得到虚拟物体在所述坐标系上的第二位置信息。The second position information is used to indicate the position of the virtual object in the coordinate system, and the second position information may include the position of one or more feature points of the virtual object. In one embodiment, the position of the virtual object to be generated refers to the relative position of the virtual object and the real object. In the embodiment of the present application, since the first position information of the real object in the coordinate system is known, according to the virtual object and The relative position of the real object can be used to obtain the second position information of the virtual object on the coordinate system.
步骤S3:根据所述第一位置信息和所述第二位置信息,获取所述虚拟物体的被遮挡区域;Step S3: According to the first position information and the second position information, acquire the occluded area of the virtual object;
被遮挡区域为虚拟物体受到真实物体遮挡的一部分,当虚拟物体与真实物体的位置信息发生重叠时,虚拟物体将被遮挡,被遮挡区域为位置信息发生重叠的区域。The occluded area is a part of the virtual object that is occluded by the real object. When the position information of the virtual object and the real object overlap, the virtual object will be occluded, and the occluded area is the area where the position information overlaps.
具体地,可以根据第一位置信息和第二位置信息中对真实物体和虚拟物体各特征点的位置信息进行比较,判断是否存在重合特征点,重合特征点所在的区域即为该虚拟物的被遮挡区域。Specifically, it is possible to compare the position information of each feature point of the real object and the virtual object according to the first position information and the second position information to determine whether there are overlapping feature points, and the area where the overlapping feature points are located is the virtual object's object Block out the area.
在一个实施例中,虚拟物体响应于用户的虚拟物体生成请求而生成。其中,虚拟物体生成请求可以包括待生成的虚拟物体的位置、展示方式、三维模型、标识或尺寸等信息。In one embodiment, the virtual object is generated in response to a user's virtual object generation request. Wherein, the virtual object generation request may include information such as the position, display mode, three-dimensional model, logo or size of the virtual object to be generated.
获取所述虚拟物体的第二位置信息的步骤包括:The step of obtaining the second position information of the virtual object includes:
响应于虚拟物体生成请求,根据所述第一位置信息,获取虚拟物体的第二位置信息;其中,所述虚拟物体生成请求包括所述待生成虚拟物体与真实物体的相对位置信息。In response to the virtual object generation request, second position information of the virtual object is acquired according to the first position information; wherein the virtual object generation request includes relative position information of the virtual object to be generated and the real object.
其中,第二位置信息为第一位置信息与相对位置信息之和。根据虚拟物体的第二位置信息,结合虚拟物体的展示方式、三维模型、标识或尺寸等信息,在三维场景内对应的位置上生成虚拟物体。Wherein, the second position information is the sum of the first position information and the relative position information. According to the second position information of the virtual object, combined with information such as the display mode, 3D model, logo or size of the virtual object, the virtual object is generated at a corresponding position in the 3D scene.
步骤S4:对所述虚拟物体的被遮挡区域添加预设标识。Step S4: Adding a preset mark to the covered area of the virtual object.
对所述虚拟物体的被遮挡区域添加的预设标识可以是对被遮挡区域添加的图标、文字、颜色或线条等,其具体的标识方式可以根据被遮挡区域的形状或实际需求,以最容易将被遮挡区域与普通区域进行区分的样式进行设置。The preset identification added to the occluded area of the virtual object can be an icon, text, color or line added to the occluded area, and the specific identification method can be based on the shape of the occluded area or the actual demand. Set the style that distinguishes the masked area from the normal area.
在一个实施例中,储存若干种预设标识样式,并响应于用户的选择指令,选取其中一个预设标识样式对所述虚拟物体的被遮挡区域进行标识。In one embodiment, several preset marking styles are stored, and in response to a user's selection instruction, one of the preset marking styles is selected to mark the occluded area of the virtual object.
被遮挡区域包括各重合特征点的位置信息,在对被遮挡区域添加预设标识时,将该被遮挡区域的各重合点的位置信息设置或替换为预设的标识样式,使得被显示区域在显示时显示为预设的标识样式。The occluded area includes the position information of each coincident feature point. When adding a preset mark to the occluded area, the position information of each coincident point in the occluded area is set or replaced with a preset mark style, so that the displayed area is in Displayed in the default logo style.
步骤S5:显示所述三维场景,在所述三维场景中所述真实物体、所述虚拟物体的未被遮挡区域,以及所述预设标识被显示。Step S5: displaying the 3D scene, in which the real object, the unoccluded area of the virtual object, and the preset logo are displayed.
具体地,真实物体在三维场景内显示的可以是真实物体的三维模型,该三维模型可以根据真实物体的构造数据构建,第一位置信息用于确定真实物体的三维模型的显示位置,并在三维场景内显示。其中,真实物体的构造数据包括真实物体形状轮廓、长、宽、高、形状、颜色图案、部件等可用于描述真实物体的构造的数据,构造数据可以根据通过对实际物体进行测量得到,或者也可以通过拍摄真实物体的图像,利用图像识别算法识别得到。Specifically, what the real object displays in the 3D scene can be a 3D model of the real object, and the 3D model can be constructed according to the construction data of the real object, and the first position information is used to determine the display position of the 3D model of the real object, and in the 3D displayed in the scene. Wherein, the structural data of the real object includes data such as the shape outline, length, width, height, shape, color pattern, and parts of the real object that can be used to describe the structure of the real object. The structural data can be obtained by measuring the actual object, or It can be obtained by taking images of real objects and using image recognition algorithms to identify them.
未被遮挡区域即为虚拟物体中与真实物体之间不重合的区域,对于未被遮挡区域,直接根据虚拟物体的构造数据生成的三维模型进行显示;对于重合的被遮挡区域,在该位置内优先显示真实物体的三维模型,虚拟物体的被遮挡区域可以不显示,也可以作为底层显示在真实物体的图层下,预设标识可以显示在被遮挡区域内,也可以显示在被遮挡区域边缘或外围,例如,当预设标识为一图标时,该图标可以显示在被遮挡区域的上方,用于提示此处存在被遮挡内容,提醒用户查看。The unoccluded area is the area that does not overlap with the real object in the virtual object. For the unoccluded area, the 3D model generated directly according to the construction data of the virtual object is displayed; for the overlapped occluded area, within this position The 3D model of the real object is displayed first. The occluded area of the virtual object can not be displayed, or it can be displayed under the layer of the real object as the bottom layer. The preset logo can be displayed in the occluded area or on the edge of the occluded area. Or the periphery, for example, when the preset identifier is an icon, the icon can be displayed above the covered area to remind the user to view the covered content.
在本申请实施例中,通过获取三维场景中真实物体的第一位置信息和虚拟物体的第二位置信息,根据第一位置信息和第二位置信息获取虚拟物体的被遮挡区域,通过对所述虚拟物体的被遮挡区域添加预设标识,在三维场景中显示真实物体、虚拟物体的未被遮挡区域,以及预设标识,提醒用户查看虚拟物体的被遮挡区域,通过添加预设标识的方式使得被真实物体遮挡的虚拟物体展示在用户视野中,避免由于显示不全面影响用户的交互体验。In the embodiment of the present application, by obtaining the first position information of the real object and the second position information of the virtual object in the three-dimensional scene, the occluded area of the virtual object is obtained according to the first position information and the second position information, and the The occluded area of the virtual object is added with a preset logo, and the real object, the unoccluded area of the virtual object, and the preset logo are displayed in the 3D scene to remind the user to view the occluded area of the virtual object. By adding the preset logo, the Virtual objects that are blocked by real objects are displayed in the user's field of vision to avoid affecting the user's interactive experience due to incomplete display.
在一个实施例中,对所述虚拟物体的被遮挡区域添加预设标识的步骤具体包括:In one embodiment, the step of adding a preset mark to the occluded area of the virtual object specifically includes:
获取所述第一位置信息和所述第二位置信息的重叠部分作为遮挡位置信息;Acquiring an overlapping portion of the first position information and the second position information as occlusion position information;
根据所述遮挡位置信息,获取所述虚拟物体在所述被遮挡区域的轮廓线;Acquiring the outline of the virtual object in the occluded area according to the occlusion position information;
根据预设的第一标识方式,对所述虚拟物体在所述被遮挡区域的轮廓线进行标识。Mark the outline of the virtual object in the occluded area according to a preset first marking manner.
第一标识方式包括标识的样式、颜色、透明度、对比度和亮度等显示方式。The first identification mode includes display modes such as the style, color, transparency, contrast, and brightness of the identification.
在一个实施例中,第一标识方式指的是虚拟物体轮廓线的样式,包括虚线和实线两种线条样式。在其它实施例中,对虚拟物体的被遮挡区域添加标识还可以是提醒存在被遮挡区域或者用于描述被遮挡区域的大小、颜色等属性信息的图标或数字标识,其中,图标标识可以从预先存储的图标样式中选取,可以用于提醒存在被遮挡区域,数字标识可以用于指示被遮挡区域的面积。In one embodiment, the first identification mode refers to the style of the contour line of the virtual object, including two line styles of dotted line and solid line. In other embodiments, adding a mark to the occluded area of the virtual object can also be an icon or a digital mark that reminds that the occluded area exists or is used to describe attribute information such as the size and color of the occluded area. Select from the stored icon styles, which can be used to remind that there is an occluded area, and the digital mark can be used to indicate the area of the occluded area.
具体地,对所述虚拟物体在所述被遮挡区域的轮廓线进行标识包括:Specifically, identifying the contour line of the virtual object in the occluded area includes:
将所述虚拟物体在所述被遮挡区域的轮廓线以虚线的方式进行标识。The outline of the virtual object in the occluded area is marked with a dotted line.
在一个实施例中,显示所述三维场景中的虚拟物体的未被遮挡区域的步骤包括:In one embodiment, the step of displaying the unoccluded area of the virtual object in the three-dimensional scene includes:
获取所述虚拟物体的未被遮挡区域的轮廓线;Acquiring the outline of the unoccluded area of the virtual object;
将所述虚拟物体的未被遮挡区域的轮廓线以实线的方式进行标识。The outline of the unoccluded area of the virtual object is marked with a solid line.
被遮挡区域的轮廓线可以根据被遮挡区域的位置信息和虚拟物体的轮廓线的位置信息确定两者的重合部分得到。在另一个实施例中,也可以借助摄像装置拍摄当前三维场景图像,利用canny算法等图像轮廓提取算法实现虚拟物体的未被遮挡区域的轮廓线的提取,再从虚拟物体的轮廓线剔除提取的轮廓线,得到被遮挡区域的轮廓线。The contour line of the occluded area can be obtained by determining the overlapping part of the position information of the occluded area and the contour line of the virtual object. In another embodiment, the current three-dimensional scene image can also be taken by means of a camera device, and the contour line of the unoccluded area of the virtual object can be extracted by using an image contour extraction algorithm such as the canny algorithm, and then the extracted contour line can be removed from the contour line of the virtual object. Contour, get the contour of the occluded area.
在一个实施例中,在对所述虚拟物体的被遮挡区域添加预设标识的步骤之前,还包括:In one embodiment, before the step of adding a preset identification to the occluded area of the virtual object, it further includes:
判断所述虚拟物体是否存在被遮挡区域;judging whether the virtual object has an occluded area;
若是,则获取所述虚拟物体的轮廓线;If so, then obtain the outline of the virtual object;
按照预设的第二标识方式,对所述虚拟物体的轮廓线进行标识。The outline of the virtual object is marked according to a second preset marking manner.
虚拟物体的轮廓线可以根据虚拟物体信息中的三维模型或尺寸等信息获取。The outline of the virtual object can be obtained according to information such as a three-dimensional model or size in the information of the virtual object.
第二标识方式包括线条的样式、颜色、透明度、对比度和亮度等显示方式,例如,可以通过调高虚拟物体的显示亮度或对比度的方式使其更容易被用户注意到。The second identification method includes display methods such as line style, color, transparency, contrast, and brightness. For example, the display brightness or contrast of the virtual object can be increased to make it easier for the user to notice.
在一个实施例中中,所述预设的第二标识方式包括第一亮度,对所述虚拟物体的轮廓线进行标识的步骤包括:In one embodiment, the preset second marking method includes first brightness, and the step of marking the outline of the virtual object includes:
将所述虚拟物体的轮廓线的亮度调整为第一亮度。Adjusting the brightness of the outline of the virtual object to the first brightness.
通过调整虚拟物体整体的轮廓线的亮度,使得存在被遮挡区域的虚拟物体更容易被识别。By adjusting the brightness of the overall contour line of the virtual object, the virtual object with the occluded area can be recognized more easily.
其中,第一亮度可以为虚拟物体上最明亮处的亮度。在一个实施例中,第一亮度大于虚拟物体上各点的亮度,虚拟物体的轮廓线以最高的亮度(高光)的方式显示;在其它实施例中,也可以通过将虚拟物体的轮廓线调整为白色高亮的方式,更有利于吸引用户的注意力,同时,仅对虚拟物体的轮廓线进行标识,可以有效降低标识对原有虚拟物体显示效果的影响。Wherein, the first brightness may be the brightness of the brightest part on the virtual object. In one embodiment, the first brightness is greater than the brightness of each point on the virtual object, and the outline of the virtual object is displayed in the form of the highest brightness (highlight); in other embodiments, it is also possible to adjust the outline of the virtual object The method of highlighting in white is more conducive to attracting the user's attention. At the same time, only the outline of the virtual object is marked, which can effectively reduce the impact of the mark on the display effect of the original virtual object.
如图3所示,在一个实施例中,虚拟物体为一球体,真实物体为一正方体,球体有一部分被正方体所遮挡,利用本申请实施例所述虚拟物体显示方法进行标识后可以看出:该球体的轮廓线显示为白色高亮,球体在被遮挡区域的轮廓线被标识为虚线,该球体不在被遮挡区域的轮廓线被标识为实线。用户可以准确获取被遮挡球体的整体轮廓和位置,有利于提高用户与该球体进行交互,提高用户体验。As shown in Figure 3, in one embodiment, the virtual object is a sphere, the real object is a cube, and a part of the sphere is blocked by the cube. After using the virtual object display method described in the embodiment of the present application for identification, it can be seen that: The outline of the sphere is highlighted in white, the outline of the sphere in the occluded area is marked as a dotted line, and the outline of the sphere not in the occluded area is marked as a solid line. The user can accurately obtain the overall outline and position of the occluded sphere, which is conducive to improving the user's interaction with the sphere and improving user experience.
实施例2Example 2
如图4所示,本申请实施例还提供了一种虚拟物体显示装置,应用于电子设备上,所述电子设备用于显示包括至少一个真实物体和至少一个虚拟物体的三维场景;As shown in FIG. 4, the embodiment of the present application also provides a virtual object display device, which is applied to an electronic device, and the electronic device is used to display a three-dimensional scene including at least one real object and at least one virtual object;
所述虚拟物体显示装置包括:The virtual object display device includes:
第一位置获取模块1,用于获取所述真实物体的第一位置信息;A first position acquiring module 1, configured to acquire first position information of the real object;
第二位置获取模块2,用于获取所述虚拟物体的第二位置信息;A second position acquiring module 2, configured to acquire second position information of the virtual object;
被遮挡区域获取模块3,用于根据所述第一位置信息和所述第二位置信息,获取所述虚拟物体的被遮挡区域;An occluded area acquiring module 3, configured to acquire an occluded area of the virtual object according to the first position information and the second position information;
预设标识添加模块4,用于对所述虚拟物体的被遮挡区域添加预设标识;A preset logo adding module 4, configured to add a preset logo to the occluded area of the virtual object;
显示模块5,用于显示所述三维场景,在所述三维场景中所述真实物体、所述虚拟物体的未被遮挡区域,以及所述预设标识被显示。The display module 5 is configured to display the three-dimensional scene, in which the real object, the non-occluded area of the virtual object, and the preset logo are displayed.
需要说明的是,上述实施例提供的虚拟物体显示装置在执行虚拟物体显示方法时,仅以上述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将设备的内部结构划分为不同的功能模块,以完成以上描述的全部或者部分功能。另外,上述实施例提供的虚拟物体显示装置与虚拟物体显示方法属于同一构思,其体现实现过程详见实施例1,这里不再赘述。It should be noted that when the virtual object display device provided by the above-mentioned embodiments executes the virtual object display method, the division of the above-mentioned functional modules is used as an example for illustration. In practical applications, the above-mentioned functions can be assigned to different function modules according to needs Module completion means that the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the virtual object display device provided in the above embodiment and the virtual object display method belong to the same idea, and the implementation process thereof is detailed in Embodiment 1, and will not be repeated here.
实施例3Example 3
如图5所示,本申请实施例还提供了一种可安装或佩戴在用户的头部上的头戴式显示装置200,包括:至少一个处理器201、至少一个存储器202和显示设备203。As shown in FIG. 5 , the embodiment of the present application also provides a head-mounted
其中,处理器201可以包括一个或者多个处理核心。处理器201利用各种接口和线路连接整个头戴式显示装置200内的各个部分,通过运行或执行存储在存储器202内的指令、程序、代码集或指令集,以及调用存储在存储器202内的数据,执行头戴式显示装置200的各种功能和处理数据。可选的,处理器201可以采用数字信号处理(Digital SignalProcessing,DSP)、现场可编程门阵列(Field-Programmable Gate Array,FPGA)、可编程逻辑阵列(Programmable Logic Array,PLA)中的至少一种硬件形式来实现。处理器201可集成中央处理器(Central Processing Unit,CPU)、图像处理器(Graphics ProcessingUnit,GPU)和调制解调器等中的一种或几种的组合。其中,CPU主要处理操作系统、用户界面和应用程序等;GPU用于负责显示屏所需要显示的内容的渲染和绘制;调制解调器用于处理无线通信。可以理解的是,上述调制解调器也可以不集成到处理器201中,单独通过一块芯片进行实现。Wherein, the
其中,存储器202可以包括随机存储器(Random Access Memory,RAM),也可以包括只读存储器(Read-Only Memory)。可选的,该存储器202包括非瞬时性计算机可读介质(non-transitory computer-readable storage medium)。存储器202可用于存储指令、程序、代码、代码集或指令集。存储器202可包括存储程序区和存储数据区,其中,存储程序区可存储用于实现操作系统的指令、用于至少一个功能的指令(比如触控功能、声音播放功能、图像播放功能等)、用于实现上述各个方法实施例的指令等;存储数据区可存储上面各个方法实施例中涉及到的数据等。存储器202可选的还可以是至少一个位于远离前述处理器201的存储装置。Wherein, the
所述处理器201可以用于调用存储器202中存储的虚拟物体显示方法的应用程序,并具体执行上述任意一项所述的虚拟物体显示方法的步骤。The
显示设备203是一种实现AR技术(增强现实技术)且可佩戴在人体头部进行展示的可穿戴式设备,它通过计算机技术将虚拟的信息叠加到真实世界,使真实的环境和虚拟的物体能够实时地叠加到同一个画面中,实现两种信息的相互补充,并通过显示设备在用户的眼前进行画面展示。在本申请实施例中,显示设备203用于显示包括至少一个真实物体和至少一个虚拟物体的三维场景。The
在一个实施例中,显示设备203能够与终端设备配合使用以形成可穿戴系统,显示设备203能够通过有线或者无线的方式与终端设备连接。其中,终端设备用于输出图像信息、音频信息和控制指令传输给所述显示设备,并用于接收显示设备输出的信息。本领域技术人员容易理解,本申请的终端设备可以是任何具备通信和存储功能的设备,例如智能手机、平板电脑、笔记本电脑、便携电话机、视频电话、数码静物相机、电子书籍阅读器、便携多媒体播放器(PMP)、移动医疗装置等智能终端。具体地,终端设备首先基于图像模型渲染出虚拟图像。然后,终端设备根据自身与显示设备203之间相对位置关系,自动调整虚拟图像的形状和/或角度,使得调整后的虚拟图像符合显示设备的显示需求。之后,终端设备将经过调整的虚拟图像发送给显示设备,以供显示设备将该经过调整的虚拟图像叠加到现实场景中,供用户观看。在其它实施例中,显示设备203内部设有可用于具备上述终端设备所实现功能的集成芯片,使得显示设备203可以单独使用,即用户将显示设备203穿戴至用户头部即可观测AR图像。In one embodiment, the
在一个实施例中,头戴式显示装置200还包括至少一个网络接口204,用户接口205以及至少一个通信总线206。In one embodiment, the head-mounted
其中,所述网络接口204可选的可以包括标准的有线接口、无线接口(如WI-FI接口)。Wherein, the
其中,用户接口205主要用于为用户提供输入的接口,获取用户输入的数据,可选的,所述用户接口205还可以包括标准的有线接口、无线接口。Wherein, the
其中,所述通信总线206用于实现这些组件之间的连接通信。Wherein, the
本申请实施例还提供了一种计算机可读存储介质,其上储存有计算机程序,该计算机程序被处理器执行时实现如上述任意一项所述的虚拟物体显示方法的步骤。The embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the method for displaying a virtual object as described in any one of the above are implemented.
本申请实施例可采用在一个或多个其中包含有程序代码的存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。计算机可读储存介质包括永久性和非永久性、可移动和非可移动媒体,可以由任何方法或技术来实现信息存储。信息可以是计算机可读指令、数据结构、程序的模块或其他数据。计算机的存储介质的例子包括但不限于:相变内存(PRAM)、静态随机存取存储器(SRAM)、动态随机存取存储器(DRAM)、其他类型的随机存取存储器(RAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、快闪记忆体或其他内存技术、只读光盘只读存储器(CD-ROM)、数字多功能光盘(DVD)或其他光学存储、磁盒式磁带,磁带磁盘存储或其他磁性存储设备或任何其他非传输介质,可用于存储可以被计算设备访问的信息。Embodiments of the present application may take the form of a computer program product implemented on one or more storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) having program code embodied therein. Computer-readable storage media includes both volatile and non-volatile, removable and non-removable media, and can be implemented by any method or technology for storage of information. Information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for computers include, but are not limited to: phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Flash memory or other memory technology, Compact Disc Read-Only Memory (CD-ROM), Digital Versatile Disc (DVD) or other optical storage, Magnetic tape cartridge, tape disk storage or other magnetic storage device or any other non-transmission medium that can be used to store information that can be accessed by a computing device.
本发明并不局限于上述实施方式,如果对本发明的各种改动或变形不脱离本发明的精神和范围,倘若这些改动和变形属于本发明的权利要求和等同技术范围之内,则本发明也意图包含这些改动和变形。The present invention is not limited to the above-mentioned embodiments, if the various changes or deformations of the present invention do not depart from the spirit and scope of the present invention, if these changes and deformations belong to the claims of the present invention and the equivalent technical scope, then the present invention is also It is intended that such modifications and variations are included.
Claims (10)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110835220.6A CN115690363A (en) | 2021-07-23 | 2021-07-23 | Virtual object display method and device and head-mounted display device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110835220.6A CN115690363A (en) | 2021-07-23 | 2021-07-23 | Virtual object display method and device and head-mounted display device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115690363A true CN115690363A (en) | 2023-02-03 |
Family
ID=85044975
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110835220.6A Pending CN115690363A (en) | 2021-07-23 | 2021-07-23 | Virtual object display method and device and head-mounted display device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115690363A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116030228A (en) * | 2023-02-22 | 2023-04-28 | 杭州原数科技有限公司 | A web-based mr virtual screen display method and device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103472909A (en) * | 2012-04-10 | 2013-12-25 | 微软公司 | Realistic occlusion for a head mounted augmented reality display |
| CN103489214A (en) * | 2013-09-10 | 2014-01-01 | 北京邮电大学 | Virtual reality occlusion handling method, based on virtual model pretreatment, in augmented reality system |
| CN110554770A (en) * | 2018-06-01 | 2019-12-10 | 苹果公司 | Static shelter |
| CN111651031A (en) * | 2019-03-04 | 2020-09-11 | 广东虚拟现实科技有限公司 | Display method, device, terminal device and storage medium for virtual content |
| CN112241199A (en) * | 2019-07-19 | 2021-01-19 | 华为技术有限公司 | Interaction method and device in virtual reality scene |
-
2021
- 2021-07-23 CN CN202110835220.6A patent/CN115690363A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103472909A (en) * | 2012-04-10 | 2013-12-25 | 微软公司 | Realistic occlusion for a head mounted augmented reality display |
| CN103489214A (en) * | 2013-09-10 | 2014-01-01 | 北京邮电大学 | Virtual reality occlusion handling method, based on virtual model pretreatment, in augmented reality system |
| CN110554770A (en) * | 2018-06-01 | 2019-12-10 | 苹果公司 | Static shelter |
| CN111651031A (en) * | 2019-03-04 | 2020-09-11 | 广东虚拟现实科技有限公司 | Display method, device, terminal device and storage medium for virtual content |
| CN112241199A (en) * | 2019-07-19 | 2021-01-19 | 华为技术有限公司 | Interaction method and device in virtual reality scene |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116030228A (en) * | 2023-02-22 | 2023-04-28 | 杭州原数科技有限公司 | A web-based mr virtual screen display method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11651563B1 (en) | Dockable billboards for labeling objects in a display having a three dimensional perspective of a virtual or real environment | |
| US11620792B2 (en) | Fast hand meshing for dynamic occlusion | |
| US12100098B2 (en) | Simple environment solver using planar extraction | |
| JP6780642B2 (en) | Information processing equipment, information processing methods and programs | |
| WO2020207191A1 (en) | Method and apparatus for determining occluded area of virtual object, and terminal device | |
| CN109743892B (en) | Display method and device for virtual reality content | |
| WO2018188499A1 (en) | Image processing method and device, video processing method and device, virtual reality device and storage medium | |
| US10331209B2 (en) | Gaze direction mapping | |
| JP6250024B2 (en) | Calibration apparatus, calibration program, and calibration method | |
| WO2014128747A1 (en) | I/o device, i/o program, and i/o method | |
| WO2014128751A1 (en) | Head mount display apparatus, head mount display program, and head mount display method | |
| CN111308707A (en) | Picture display adjusting method and device, storage medium and augmented reality display equipment | |
| CN111651031B (en) | Display method, device, terminal device and storage medium of virtual content | |
| US12505624B2 (en) | Method and apparatus for presenting object annotation information, electronic device, and storage medium | |
| US12079945B2 (en) | XR preferred movement along planes | |
| CN116030228B (en) | Method and device for displaying mr virtual picture based on web | |
| CN115690363A (en) | Virtual object display method and device and head-mounted display device | |
| US20210096652A1 (en) | Finger Orientation Touch Detection | |
| CN111913564B (en) | Virtual content manipulation method, device, system, terminal equipment and storage medium | |
| EP3088991A1 (en) | Wearable device and method for enabling user interaction | |
| US11281337B1 (en) | Mirror accessory for camera based touch detection | |
| CN116228514A (en) | Rendering data processing method, rendering data processing device, computer equipment, rendering data processing medium and rendering data processing program product | |
| CN120707713A (en) | Image processing method, electronic device, chip system and readable storage medium | |
| CN116310024A (en) | Virtual model rendering method, device, computer equipment and storage medium | |
| CN117234282A (en) | Data processing method, device, electronic equipment, head-mounted equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |
