CN114415998A - A display method, electronic device and medium - Google Patents

Abstract

The application discloses a display method, an electronic device and a medium, wherein the method comprises the following steps: acquiring at least a first projection of a first object and a second projection of a second object in at least a first direction; wherein the first direction comprises a direction of a display device to the first object and/or the second object; the first object comprising an object between the display device and the second object; determining a target display mode based on the first projection and the second projection; and displaying the first object and the second object based on the target display mode.

Description

A display method, electronic device and medium

technical field

The present application relates to the technical field of data processing, and in particular, to a display method, an electronic device, and a medium.

Background technique

Some objects are occluded when there are multiple objects in the space.

SUMMARY OF THE INVENTION

Embodiments of the present application provide a display method, an electronic device, and a medium.

The technical solutions provided by the embodiments of the present application are as follows:

The embodiment of the present application first provides a display method, and the method includes:

Obtain at least a first projection of a first object and a second projection of a second object in at least a first direction; wherein the first direction includes a direction from the display device to the first object and/or the second object; the first object, including an object between the display device and the second object;

determining a target display mode based on the first projection and the second projection;

Based on the target display manner, the first object and the second object are displayed.

In an implementation manner, the determining the target display mode based on the first projection and the second projection includes:

If the first condition is satisfied, the feature information of the second object is acquired; wherein, the first condition includes that the second projection is a subset of the first projection;

Determining that the target display mode is: displaying the first object in the first direction, and displaying feature information of the second object in a second direction; wherein the second direction is the same as the first direction. The included angle between the directions is greater than an angle threshold; the angle threshold is the included angle between a tangent from the display device to the first projection and the first direction.

In an implementation manner, the acquiring feature information of the second object includes:

obtaining location information of the second object;

Based on the location information of the second object, the feature information of the second object is acquired.

In one embodiment, the first object and the second object include virtual objects, and the display device includes a virtual reality (Virtual Reality, VR)/Augmented Reality (Augmented Reality, or AR) device; the Obtaining feature information of the second object based on the location information of the second object, including:

Based on the position information of the second object, determine the target position information of the virtual collection device;

The characteristic information of the second object collected by the virtual collection device set based on the target position information is acquired.

In an implementation manner, the feature information of the second object includes perspective projection information of the second object, and determining the target position information of the virtual acquisition device based on the position information of the second object includes:

Based on the position information of the second object, the relative positional relationship between the virtual acquisition device relative to each of the at least one second object is adjusted in a third direction; wherein the third direction and the The included angle between the first directions is less than 90 degrees;

The target location information is determined based on the relative location relationship and location information of the second object.

In an implementation manner, the feature information of the second object includes orthogonal projection information of the second object; and determining the target position information of the virtual acquisition device based on the position information of the second object includes:

acquiring the field of view angle information of the virtual acquisition device;

The target position information is determined based on the position information of the second object and the field of view angle information.

In an implementation manner, the determining the target display mode based on the first projection and the second projection includes:

If the second condition is satisfied, it is determined that the target display mode is: displaying the first object, displaying the edge of the first object in a first color, and displaying the second object that is not blocked by the first object part; wherein, the second condition includes that the first projection is a proper subset of the second projection.

In an implementation manner, the determining the target display mode based on the first projection and the second projection includes:

If the third condition is satisfied, it is determined that the target display mode is: displaying the first object, displaying the edge of the first object in a second color, and displaying the second object that is not blocked by the first object part; wherein, the third condition includes that the first projection intersects the second projection, and the first projection is not a subset of the second projection, and the second projection is not the A subset of the first projection.

Embodiments of the present application further provide an electronic device, which can implement the display method described in any of the foregoing.

Embodiments of the present application further provide a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor of an electronic device, the display as described in any preceding one can be realized. method.

It can be seen from the above that, in the display method provided by the embodiment of the present application, after the first projection of the first object and the second projection of the second object are obtained, the target display mode can be determined based on the first projection and the second projection, and the target display mode can be determined based on the target The display mode displays the first object and the second object. In this way, the display method provided by the embodiment of the present application can not only clearly display the first object and the second object, but also, due to the consistency of the first projection and the second projection with the actual object characteristics of the first object and the second object, Therefore, the target display mode determined based on the first projection and the second projection can more accurately reflect the actual characteristics of the first object and the second object, thereby solving the technology in the related art that multiple objects that occlude each other cannot be objectively displayed question.

Description of drawings

1 is a schematic flowchart of a display method provided by an embodiment of the present application;

2 is a schematic structural diagram of a relative positional relationship between a display device, a first object, and a second object according to an embodiment of the present application;

3 is a schematic structural diagram of the relative positions of a first object and a second object according to an embodiment of the present application;

4A is a schematic diagram of a first principle of selecting a virtual object in the related art;

4B is a schematic diagram of a second principle of selecting a virtual object in the related art;

5A is a schematic diagram of a structure that cannot be selected because a virtual object is blocked in the related art;

5B is a first structural schematic diagram of the projection of the virtual object corresponding to FIG. 5A;

5C is a second structural schematic diagram of the projection of the virtual object corresponding to FIG. 5A;

5D is a schematic diagram of the operation principle of the user selecting a virtual object that is completely occluded in the related art;

FIG. 6 is a schematic structural diagram of a virtual collection device setting provided by an embodiment of the present application;

7A is a schematic diagram of perspective projection in the related art;

7B is a first schematic structural diagram of target location information provided by an embodiment of the present application;

8A is a schematic diagram of the principle of orthogonal projection in the related art;

8B is a second schematic structural diagram of target location information provided by an embodiment of the present application;

FIG. 8C is a schematic diagram of the principle of determining target location information according to an embodiment of the present application;

8D-1 is a schematic diagram of a first structure of a DF provided by an embodiment of the present application;

8D-2 is a schematic diagram of the second structure of the DF provided by the embodiment of the present application;

FIG. 9 is a schematic structural diagram of a display method provided by an embodiment of the present application;

10 is a schematic structural diagram of displaying multiple virtual objects around a cursor point according to an embodiment of the present application;

11A is a schematic diagram of a first structure of a first projection, a second projection, and a third projection satisfying a third condition provided by an embodiment of the present application;

FIG. 11B is a schematic diagram of the second structure of the first projection, the second projection, and the third projection satisfying the third condition provided by the embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application.

It should be understood that the specific embodiments described herein are only used to explain the present application, but not to limit the present application.

In practical applications, in scenarios such as travel, shopping, medical treatment, and dining, the environment where the user is located may contain multiple objects, and these objects may block the user's sight. Due to the occlusion of these objects, the user cannot know or accurately know the state or situation of other objects.

In the related art, the state or situation of other objects usually requires the user to change his position, such as standing at a high place. However, this method sometimes cannot solve the problem. The vehicle being driven cannot switch from the current lane to another lane, and the vehicle driven by the user cannot move from the road to a higher position. Therefore, the related art lacks a technical solution for the user to obtain the state or condition of the occluded object.

Based on the above problems, embodiments of the present application provide a display method, an electronic device, and a medium.

The display method provided by the embodiment of the present application can not only display the first object and the second object, but also determines how to display the first object and the second object according to the first projection of the first object and the second projection of the second object, Therefore, the target display mode can be more suitable for the actual line-of-sight projection characteristics of the first object and the second object, thereby solving the technical problem of the related art that multiple objects that are occluded from each other cannot be displayed.

It should be noted that the display method provided by the embodiments of the present application may be implemented by a processor of a display device, and the above-mentioned processor may be an application specific integrated circuit (ASIC), a digital signal processor (Digital Signal Processor, DSP), Digital Signal Processing Device (DSPD), Programmable Logic Device (Programmable Logic Device, PLD), Field Programmable Gate Array (Field Programmable Gate Array, FPGA), Central Processing Unit (Central Processing Unit, CPU) ), at least one of a controller, a microcontroller, and a microprocessor.

FIG. 1 is a schematic flowchart of a display method provided by an embodiment of the present application. As shown in FIG. 1 , the process may include steps 101 to 103:

Step 101: Obtain at least a first projection of a first object and a second projection of a second object in at least a first direction.

Wherein, the first direction includes the direction from the display device to the first object and/or the second object; the first object includes the object between the display device and the second object.

FIG. 2 is a schematic structural diagram of a relative positional relationship between a display device, a first object, and a second object according to an embodiment of the present application.

As shown in FIG. 2 , the object adjacent to the display device 201 is the first object 202 , the first object 202 is located between the display device 201 and the second object 203 , and in the direction in which the second object 203 is away from the display device 201 , A third object 204 may also be included; for example, the third object 204 may be one of the plurality of second objects 203 .

As can be seen from FIG. 2 , the geometric centers of the first object 202 , the second object 203 and the third object 204 may be located on the same straight line. The second object 203 and the third object 204 blocked by the first object 202 .

In one embodiment, the display device may be a device with a projection function, so that the display device can obtain the first projection and the second projection in at least a first direction; in this case, the first direction may be from the display device to the first The orientation of the object and/or the second object.

In an implementation manner, the display device itself may not have a projection function, and the first projection and the second projection may be obtained by the display device through a first device with which a communication connection is established. Exemplarily, the above-mentioned communication connection may be a wired connection or a wireless connection; Exemplarily, the above-mentioned first device may be a portable device, or may be a device set at at least one location in the current situation of the display device; such as , when the user is queuing for registration, the first device may be set at a position parallel to the registration queue and higher than the height of the people in the registration queue, and the first device may have a projection function at this time; exemplarily, the first device may also be A second device used for providing public services in a public place, for example, the second device may be any device among a base station device, a Bluetooth ranging device, a wireless routing device, and a near field communication (Near Field Communication, NFC).

In one embodiment, the first projection and the second projection may also be obtained from other directions, and the other directions may include the direction from the first device to the first object and/or the second object, and may also include the second object The direction to the first object and/or the second object.

In one embodiment, the number of the second objects may be multiple.

In one embodiment, the first direction may be determined according to the relative positional relationship between the first object and the second object; exemplarily, in the case where the first object and multiple objects in the second object are in the same straight line , the first direction may be the direction from the display device to the first object, or the direction from the display device to the first object and the second object; the position of the first object and the positions of the plurality of objects in the second object are not in the same line In the case of a straight line, the first direction may be the direction from the display device to the second object; for example, at this time, the second object may be the target object.

In one embodiment, the first object and the second object may be objects of the same type, for example, both the first object and the second object may be pedestrians, and the first object and the second object may both be buildings or vehicles; exemplary Yes, the types of the first object and the second object may be different, for example, the first object is a vehicle, and the second object is a pedestrian.

In one embodiment, the shapes of the first projection and the second projection may be different, for example, the first projection is a triangle, and the second projection is an irregular circle; for example, the first projection and the second projection may be formed by A binary segmentation image obtained by performing object detection and object recognition on the first image and the second image, wherein the first image may be image data including the first object, and the second image may be image data including the second object; Example Alternatively, the first projection and the second projection may also be shadows obtained by projecting sunlight or light onto the first object and the second object.

Step 102: Determine the target display mode based on the first projection and the second projection.

In one embodiment, the target display mode may include virtually adjusting the relative positional relationship between the first object and the second object in a digital manner, so that both the first object and the second object are clearly visible;

Exemplarily, the target display manner may also be determined based on a user's trigger. For example, the display device may load a list of object information to be displayed, and based on the information of at least one object to be displayed, such as a second object, in the information list of objects to be displayed by the user. The selection result is displayed, and an object in the selection result, such as a second object, is displayed; for example, the user can also select or set a display mode of at least one object to be displayed selected by the user.

Exemplarily, the target display mode may also include immediate display or delayed display; exemplary, the target display mode may also include whether to display through a display device or through other devices; if the target display mode is to be displayed through other devices, display The device may send the first projection and the second projection to other devices; for example, the other devices may be smart wearable devices or computer devices.

Exemplarily, the target display manner may further include changing the display manner of the relative brightness or contrast of the first object and the second object.

Exemplarily, the target display manner may further include a form of changing the area size of the first projection and/or the second projection, so as to highlight the object features of the first object and/or the second object.

In an implementation manner, the target display mode is determined based on the first projection and the second projection, which may be implemented in any of the following ways:

The target display mode is determined based on the shape fitting degree of the first projection and the second projection; exemplarily, the shape fitting degree may include the similarity between the first projection and the second projection.

The target display mode is determined based on the display parameters selected or set by the user for any one of the first projection and the second projection; exemplarily, the display parameters may include at least one of shape change, zoom, highlight, and color annotation a parameter.

Step 103: Display the first object and the second object based on the target display mode.

It can be seen from the above that, in the display method provided by the embodiment of the present application, after the first projection of the first object and the second projection of the second object are obtained, the target display mode can be determined based on the first projection and the second projection, and the target display mode can be determined based on the target The display mode displays the first object and the second object. In this way, the display method provided by the embodiment of the present application can not only clearly display the first object and the second object, but also, due to the consistency of the first projection and the second projection with the actual object characteristics of the first object and the second object, Therefore, the target display mode determined based on the first projection and the second projection can more accurately reflect the actual characteristics of the first object and the second object, thereby solving the technology in the related art that multiple objects that occlude each other cannot be objectively displayed question.

Based on the foregoing embodiments, in the display method provided by the embodiments of the present application, the target display mode is determined based on the first projection and the second projection, which can be achieved through steps A1 to A2:

Step A1: Obtain feature information of the second object if the first condition is satisfied.

The first condition includes that the second projection is a subset of the first projection.

In an implementation manner, the second projection is a subset of the first projection, which may include the second projection being a proper subset of the first projection. In this case, the shape of the second projection may be the same as that of the first projection, and the second projection The shape of the projection may also be different from the shape of the first projection; for example, the second projection may be the same size as the shape of the first projection. It should be noted that if the first condition is satisfied, it can mean that the second projection is completely covered by the first projection, and at this time, the user's line of sight from the display device cannot be projected to the second object.

FIG. 3 is a schematic structural diagram of the relative positions of the first object 202 and the second object 203 according to an embodiment of the present application.

As shown in FIG. 3 , the geometric centers of the first object 202 , the second object 203 and the third object 204 are on the same straight line, and in the direction perpendicular to the first direction, the cross section of the first object 202 can cover the second object The cross-sections of the object 203 and the third object 204 in this direction, that is, the second projection is a subset of the first projection; the direction shown by the arrow in FIG. 3 is the first direction from the display device 201 to the first object 202, from the figure 3, it can be seen that the first object 202 completely blocks the second object 203 and the third object 204 in the first direction, so that the second object 203 and the third object 204 cannot be seen from the position where the display device 201 is located.

In one embodiment, the feature information of the second object may include features such as shape, outline, whether it is solid, and whether it moves.

In an implementation manner, the feature information of the second object may be obtained by continuously tracking and analyzing the second projection; exemplarily, based on the second projection and the acquisition method of the second projection, the second object may be determined location and shape.

In an implementation manner, the feature information of the second object may be embodied in any form such as text, picture, audio, and video.

Exemplarily, the feature information of the second object may be acquired by the display device itself, or acquired by other devices such as the first device or the second device and sent to the display device; exemplary, the feature information of the second object , which may include the same or similar ways of acquiring the second projection as described in the foregoing embodiments, which will not be repeated here.

Step A2: Determine the target display mode as: displaying the first object in the first direction, and displaying the feature information of the second object in the second direction.

The angle between the second direction and the first direction is greater than the angle threshold; the angle threshold is the angle between the tangent from the display device to the first projection and the first direction.

In one embodiment, the tangent from the display device to the first projection may include a tangent from the geometric center of the display device to the edge of the first projection.

In one embodiment, when the first projection is an irregular geometric shape, the angle threshold may be all included angles between the tangent from the geometric center of the display device to the edge of the first projection and the first direction The included angle of the largest angle in .

In an implementation manner, displaying the first object in the first direction and displaying the feature information of the second object in the second direction may be implemented in the following manner:

The first object is displayed in the first direction, and feature information of the second object is displayed on the plane on which the first object is displayed and adjacent to the first object. The feature information of the second object may include the second object and the first object. Distance information between the object and/or the display device; wherein the line connecting the feature information of the second object to the geometric center point of the display device may be a second direction relative to the plane on which the first object is displayed.

It can be seen from the above that, in the display method provided by the embodiment of the present application, if the second projection of the second object is a subset of the first projection of the first object, the feature information of the second object is acquired, and the second object is displayed in the first direction. The first object is displayed, and feature information of the second object is displayed in the second direction. Because the included angle between the second direction and the first direction is greater than the angle threshold, the feature information of the second object cannot be at least partially blocked or covered by the first object, so that the user at the display device can clearly obtain the first object and feature information of the second object.

Based on the foregoing embodiments, in the display method provided by the embodiments of the present application, acquiring the feature information of the second object may be implemented through steps B1 to B2:

Step B1: Acquire location information of the second object.

In one embodiment, the position information of the second object may include position information of the second object relative to the first object; exemplarily, the position information of the second object may also include the position information of the second object relative to the display device. Location information; exemplarily, the location information of the second object may also include location information of the second object relative to the first reference object, wherein the first reference object may include the first device and/or the first reference object in the foregoing embodiment. Second equipment.

In an implementation manner, the location information of the second object may be obtained in any of the following ways:

The location information of the second object is acquired by using the ranging signal of the specified frequency transmitted by the display device and the echo signal corresponding to the ranging signal received by the display device.

The location information of the second object is obtained by using ranging signals transmitted by at least three ranging devices to at least one object and echo signals corresponding to these ranging signals; exemplarily, the at least three ranging devices may include The wireless signal processing device, such as a base station, a wireless router, and a Bluetooth ranging device, etc., in this case, the acquired location information of the second object may include precise longitude and latitude information.

Step B2: Obtain feature information of the second object based on the position information of the second object.

In an implementation manner, the feature information of the second object may be obtained in any of the following ways:

The distance information of the second object relative to the display device is determined based on the position information of the second object, then the influence degree information of the second object relative to the display device is determined based on the distance information, and the feature information of the second object is obtained based on the influence degree information. For example, in a traffic jam environment, the vehicle on which the display device is set may be the first vehicle, the first object may be the second vehicle adjacent to the first vehicle, and the second object may be the third vehicle, wherein the second vehicle is located in the first vehicle. Between a vehicle and a third vehicle; at this time, if the degree of influence of the third vehicle on the first vehicle is determined to be the first degree based on the position information of the third vehicle, the image data including the second object and the first degree can be obtained. more detailed information such as the volume and size of the second object, and determine the information as the feature information of the second object; if the information on the degree of influence of the third vehicle on the first vehicle is determined based on the position information of the third vehicle as the second degree, this Image data containing the second object can be acquired, and the image data containing the second object can be determined as the feature information of the second object; exemplarily, the first degree can be greater than the second degree, that is, the more the influence degree information is. High, the more types of acquired feature information of the second object can be, and the more refined the feature information of the second object can be.

Based on the position information of the second object and the user's display requirements for the second object input by the user obtained by the display device, obtain the feature information of the second object; for example, determine the distance of the second object from the display device based on the position information of the second object. The distance is greater than the distance threshold, but the display requirement for the second object input by the user obtained by the display device is refined display. The feature information of the second object is collected in multiple dimensions.

It can be seen from the above that, in the display method provided by the embodiment of the present application, the feature information of the second object can be obtained based on the position information of the second object. In this way, the feature information of the second object is directly associated with the position information of the second object, so that The feature information of the second object displayed in the target display mode can better fit the relative positional relationship between the second object and the display device.

In this embodiment of the present application, the first object and the second object include virtual objects; and the display device includes a VR/AR device.

In one embodiment, the AR device may include AR smart glasses, an AR smartphone, etc.; exemplarily, the AR smart glasses may include head-mounted AR glasses.

In one embodiment, the VR device may include a device that requires the cooperation of other electronic devices to realize the VR function; exemplarily, the other electronic devices may include computer equipment or portable intelligent terminal equipment; The device that can realize the VR function only with the cooperation of the electronic device may also include a controller.

In one embodiment, the VR device may include an all-in-one device provided with a VR processor and a display device; for example, a head-mounted VR display device with an independent processor, which has its own storage space and independent computing. , data input and output functions, can independently realize the VR function.

In the virtual reality space, people's operational demands on virtual objects are constantly increasing, and these operational demands often start from the virtual objects that people choose. In the related art, virtual objects are usually selected by means of ray or gaze interaction.

In practical applications, under the condition that the AR/VR device is AR/VR glasses, if the user wears AR/VR glasses, the AR/VR glasses can select virtual objects through the gaze point. Among them, the gaze point is located at a fixed position directly in front of the AR/VR glasses, and the gaze point also moves when the user moves his head. Usually, AR/VR glasses can process the gaze point according to the user's gaze time. For example, when the user shakes his head, the gaze point can move with it. When the user gazes at a virtual object, if the gaze time is long Beyond the time threshold, the AR/VR device triggers a selection or hit operation on a virtual object.

FIG. 4A is a schematic diagram of a first principle of selecting a virtual object in the related art. As shown in FIG. 4A , the virtual object 401 is in the virtual space 402 , and the first ray 403 starts from the AR/VR glasses to the virtual object 401 . Similarly, in FIG. 4A , if the user wears the AR/VR glasses and stares at the virtual object 401 for a length of time exceeding the time threshold, the AR/VR glasses trigger the gaze vector from the AR/VR glasses to the virtual object 401, and the gaze vector will Collision detection in virtual space 402 determines whether virtual object 401 is selected. That is, in FIG. 4A , the first ray 403 may also be a gaze vector.

FIG. 4B is a schematic diagram of a second principle of selecting a virtual object in the related art. As shown in FIG. 4B , in the AR/VR device, a controller 404 may also be provided, and the controller 404 may be a handle, which is used to select and/or control the virtual object 401 through control logic. By default, when the controller 404 enables the ray function, the second ray 405 will take the controller 404 as the origin and the direction of the controller 404 towards the virtual object 401 as the target direction to emit the second ray 405 . Collision detection for the virtual object 401 can be implemented in the space, and if a collision is detected, it may indicate that the controller 404 hits or selects the virtual object 401 . In Figure 4B, the second ray 405 may also be a gaze vector.

It can be seen from the above that, in the related art, whether it is the way of selecting a virtual object by rays or staring, it can only be realized by collision detection of rays in a virtual space. For example, if the distribution of the first object and the second object in the virtual space is shown in Figure 2, theoretically speaking, the rays can collide with three required objects at the same time, which means that the AR/VR device can detect the virtual There are multiple objects, but each virtual object cannot be displayed independently for the user to select.

FIG. 5A is a schematic diagram of a structure that cannot be selected because a virtual object is blocked in the related art.

In FIG. 5A , the user 501 may wear an AR/VR device, and the ray or gaze vector starts from the gaze point 502 for collision detection in the virtual space, and detects that the first object 202 , the second object 203 and the third object 204 are densely distributed , and the second object 203 and the third object 204 are completely blocked by the first object 202 , and the AR/VR device cannot completely display the second object 203 and the third object 204 .

FIG. 5B is a first structural schematic diagram of the projection of the virtual object corresponding to FIG. 5A . As shown in FIG. 5B , the projection of the first object 202 is the first projection 503 , the projection of the second object 203 is the second projection 504 , and the projection of the third object 204 is the third projection 505 . In 5B, the second projection 504 and the third projection 505 are both proper subsets of the first projection 503 , that is, the second object 203 and the third object 204 are completely occluded by the first object 202 .

FIG. 5C is a second structural schematic diagram of the projection of the virtual object corresponding to FIG. 5A . As shown in FIG. 5C , the projection of the first object 202 is the first projection 503 , the projection of the second object 203 is the second projection 504 , and the projection of the third object 204 is the third projection 505 . In 5B, although the first projection 503 is a proper subset of the third projection 505, that is, the third object 205 is not occluded by the first object 202, the second projection 504 is a proper subset of the first projection 503, that is, The second object 203 is completely occluded by the first object 202, so the user cannot select and operate the second object 203 through the AR/VR device.

FIG. 5D is a schematic diagram of an operation principle of a user selecting a completely occluded virtual object in the related art. As shown in FIG. 5D , in the related art, in order to be able to select the second object 203 and the third object 204 occluded by the first object 202 , the user 501 needs to adjust the head posture or change the position by walking, thereby changing the ray direction Or the direction of the gaze vector. However, the way the user adjusts the head posture or changes the position brings inconvenience to the user's AR/VR experience.

Therefore, although the virtual object selection method in the related art provides the user with an intuitive and natural virtual object selection experience, and can also reduce the user's fatigue in virtual object selection, the above virtual object selection method has a relatively low distribution of virtual objects in the virtual space. It is more effective when it is sparse or uniform. In the case of many virtual objects, the virtual object selection method in the related art still cannot meet the user's virtual object selection requirements.

In order to solve the above problems, in the display method provided by the embodiment of the present application, the feature information of the second object is acquired based on the position information of the second object, which can be achieved through steps C1 to C2:

Step C1: Based on the position information of the second object, determine the target position information of the virtual collection device.

In an embodiment, the position information of the second object may be determined by means of collision detection performed in the virtual space by rays or gaze vectors.

In an implementation manner, the virtual capture device may be a virtual image capture device; exemplarily, the number of virtual image capture devices may be multiple, for example, in the first object, the second object, and the first object of the third object One virtual image capturing device is provided on the side, and another virtual image capturing device may be provided on the second side opposite to the first side.

In one embodiment, the virtual image acquisition device may acquire image data including the second object and the third object, and determine the image data as feature information of the second object and feature information of the third object.

In one embodiment, the virtual image acquisition apparatus can perform an image acquisition operation for the second object and/or the third object under the control of the AR/VR device, and collects images including the second object and/or the third object. The image data of the three objects is sent to the AR/VR device.

In one embodiment, the target position information may include relative position information of the virtual collection device relative to any one of the first object to the second object; exemplarily, the target position information may include the virtual collection device relative to the first object to the second object. The relative position of the line connecting the geometric centers of an object and the second object, such as the aforementioned first side and second side; exemplarily, the target position information may also include relative position information of the virtual acquisition device relative to the display device.

Step C2: Acquire feature information of the second object collected by the virtual collection device set based on the target location information.

In one embodiment, the feature information of the second object may be the second object obtained by analyzing the image data collected by at least two virtual collection devices, and extracting the depth information of the second object from the image data. The three-dimensional structure and/or shape information.

FIG. 6 is a schematic structural diagram of setting of a virtual collection device provided by an embodiment of the present application. As shown in FIG. 6 , the first virtual capture device 601 and the second virtual capture device 602 may both be virtual image capture devices; exemplarily, the virtual image capture device may be a virtual camera; exemplarily, the first virtual capture device 601 The second virtual acquisition device 602 can be arranged on the second side opposite to the first side.

Exemplarily, the three-dimensional structure and/or shape information of the second object may be the first feature information 603 in FIG. 6 , and the three-dimensional structure and/or shape information of the third object may be the first feature information 603 in FIG. 6 . Second feature information 604 .

Exemplarily, the target display manner may be to display the first object 202, and display the second feature information 603 and the third feature information 604 at positions adjacent to the first object.

It can be seen from the above that, in the display method provided by the embodiment of the present application, under the condition that the first object and the second object virtual object and the display device are AR/VR devices, it is still possible to determine the location of the virtual acquisition device based on the position information of the second object. target position information, and then realize the display of the first object and the second object through the feature information of the second image collected by the image collection device set based on the target position information.

Based on the foregoing embodiments, in the identification method provided by the embodiments of the present application, the feature information of the second object includes perspective projection information of the second object.

Exemplarily, the perspective projection information of the second object may include a perspective projection image including the second object acquired by the virtual acquisition device.

FIG. 7A is a schematic diagram showing the principle of perspective projection in the related art. As shown in FIG. 7A , the first image capturing device 701 may be a fluoroscopic image capturing device. Exemplarily, the first image capturing device 701 may be a virtual fluoroscopic image capturing device.

In FIG. 7A , the first image acquisition device 701 acquires images of the first sphere 702 and the second sphere 703 by means of perspective projection, and the obtained first image 704 includes a first circle 705 corresponding to the first sphere 702 , and The second circle 706 corresponding to the second sphere 703, and since the distance between the first sphere 702 and the first image acquisition device 701 is greater than the distance between the second sphere 703 and the first image acquisition device 701, therefore , although the size of the first sphere 702 and the second sphere 703 are the same, by means of the perspective projection operation of the first image acquisition device 701, the size of the first circle 705 and the second circle 706 are different, and the area of the second circle 706 It should be larger than the area of the first circle 705 , that is, in the first image 704 obtained by perspective projection, the area of the circle decreases with the increase of the distance between the sphere and the first image acquisition device 701 , that is, it presents The visual perspective effect of near big and far small.

Correspondingly, in the identification method provided in the embodiment of the present application, determining the target position information of the virtual collection device based on the position information of the second object can be achieved through steps D1 to D2:

Step D1: Based on the position information of the second object, adjust the relative positional relationship of the virtual acquisition device with respect to each of the at least one second object in the third direction.

Wherein, the included angle between the third direction and the first direction is less than 90 degrees.

In an embodiment, the above-mentioned relative positional relationship may include whether the virtual acquisition device is located on the first side or the second side of the at least one second object, and the distance between the virtual acquisition device and each of the at least one second object; In the case where the number of virtual collection devices is at least two, it may also include whether each virtual collection device is symmetrically arranged with respect to the at least one second object.

Exemplarily, the above-mentioned relative positional relationship may be determined according to the position information of the second object and the field of view angle of the virtual collection device. In this case, the above-mentioned relative positional relationship may enable the virtual collection device to obtain at least one first Perspective images of all objects in the two objects; exemplarily, the relative positional relationship may include a single position of the virtual acquisition device relative to the at least one second object overall distribution, for example, the virtual acquisition device is fixed relative to the at least one second object. in the first position.

Exemplarily, the position of the virtual acquisition device may be flexibly adjusted according to the position of each object in the at least one second object, so that in the image data acquired by the virtual acquisition device, each object in the at least one second object will not block each other. , at this time, the relative position relationship may include a set of positions, for example, relative to the first object in the at least one second object, the virtual acquisition device may be set in the second position, relative to the at least one second object in the first object. For the second object, the virtual acquisition device may be set at a third position, and the second position may be different from the third position.

Exemplarily, the position of the virtual acquisition device may be adjusted so that the image data obtained by the virtual acquisition device for each image acquisition only includes an image of one virtual object, and the acquisition of the image data of the first object in the at least one second object ends. Thereafter, the virtual acquisition device may be moved to the next position to enable the virtual acquisition device to acquire image data including a second of the at least one second object.

Exemplarily, the position of each image data collection of the virtual collection device may be set according to the position information of the second object. For example, the first position of the second object relative to the AR/VR device may be determined according to the position information of the second object. distance information, and adjust the position of the virtual collection device relative to the second object according to the first distance information. Exemplarily, the distance between the virtual collection device and the second object may be proportional to the first distance information, that is, the second object The farther the distance is relative to the AR/VR device, the farther the distance between the virtual acquisition device set opposite to the second object and the second object can be. Each second object of , can present the visual perspective effect of near big and far small.

Step D2: Determine the target position information based on the relative position relationship and the position information of the second object.

In an implementation manner, the target location information may include coordinate information of a location, and in this case, the virtual acquisition device may be fixedly set at a location corresponding to the coordinate information relative to the at least one second object.

In one embodiment, the target position information may include a set of position coordinate information; in this case, the virtual collection device may move the position and collect image data according to each coordinate information in the target position information.

FIG. 7B is a schematic diagram of a first structure of target location information provided by an embodiment of the present application. As shown in FIG. 7B , the target position information may include a first target position and a second target position.

As shown in FIG. 7B , the first virtual acquisition device 707 may be a virtual perspective projection device; the first object 202 , the second object 203 and the third object 204 are distributed on the gaze vector 709 ; the first virtual acquisition device 707 may be in the third Move in the direction 710; wherein, the first target position information may include that the distance of the first virtual acquisition device 707 relative to the second object 203 is the second distance, and the line connecting with the geometric center of the second object 203 is perpendicular to the gaze vector 709; after the first virtual acquisition device 707 performs image acquisition on the second image 203 to obtain the first image data 711, the first virtual acquisition device 707' can be moved to the second target position; exemplarily, the second target position, It can be the position of the first virtual collection device 707 ′ relative to the third object 204 at a third distance, and the line connecting with the geometric center of the third object 204 is perpendicular to the gaze vector 709 . Image acquisition of the third image 204 is performed to obtain the second image data 712 ; for example, depth feature extraction may be performed on the first image data 711 and the second image data 712 to obtain the first three-dimensional structure 713 and the second three-dimensional structure 714 . Exemplarily, the first three-dimensional structure 713 and the second three-dimensional structure 714 may be consistent with the three-dimensional structure features of the second object 203 and the third object 204 , respectively.

Exemplarily, after the first three-dimensional structure 713 and the second three-dimensional structure 714 are obtained, the first three-dimensional structure 713 and the second three-dimensional structure 714 may be displayed in sequence at positions adjacent to the first object 202 , so as to realize the detection of the first object. 202 , a visual display of the second object 203 and the third object 204 .

Exemplarily, as shown in FIG. 7B , during the process of collecting the second image data 712 by the first virtual collecting device 707 ′, if there is a fourth object 715 between the first virtual collecting device 707 ′ and the third object 204 , , the fourth object 715 can be removed before the first virtual collection device 707 ′ collects the second image data 712 .

It can be seen from the above that in the display method provided by the embodiment of the present application, under the condition that the first object and the second object are virtual objects and the display device is an AR/VR device, the location information of the virtual acquisition device can be determined based on the position information of the second object. The target position information, so that the perspective projection information collected by the virtual collection device set at the target position information can reflect the morphological characteristics of the second object more intuitively and vividly, so that the first object and the second object can be displayed more comprehensively and objectively. object.

Based on the foregoing embodiments, in the display method provided by the embodiments of the present application, the feature information of the second object includes orthogonal projection information of the second object.

In one embodiment, the orthogonal projection information of the second object may include the same cross-sectional area and the same shape as the second object perpendicular to the direction collected by the virtual acquisition device disposed in any direction facing the second object projection.

FIG. 8A is a schematic diagram of the principle of orthogonal projection in the related art. As shown in FIG. 8A , the first image capturing device 801 may be a fluoroscopic image capturing device, and exemplarily, the second image capturing device 801 may be a virtual fluoroscopic image capturing device.

In FIG. 8A , the second image acquisition device 801 acquires images of the third sphere 802 and the fourth sphere 803 by means of perspective projection, and the obtained third image 804 includes a third circle 805 corresponding to the third sphere 802 , and a fourth circle 806 corresponding to the fourth sphere 803 , and although the positions of the third sphere 802 and the fourth sphere 803 are different with respect to the second image acquisition device 801 , due to the orthogonal projection of the second image acquisition device 801 However, the relative size of the third circle 805 and the fourth circle 806 does not change due to the distance between the third sphere 802 and the fourth sphere 803 And the relative size of the fourth sphere 803 remains the same.

Correspondingly, determining the target position information of the virtual collection device based on the position information of the second object can be achieved through steps E1 to E2:

Step E1, acquiring the field of view angle information of the virtual acquisition device.

In one embodiment, the field of view angle information of the virtual capture device may include a horizontal field of view angle and a vertical field of view angle.

Step E2: Determine the target position information based on the position information of the second object and the field of view angle information.

In one embodiment, the target location information may be determined in any of the following ways:

Based on the location information of the second object, the distribution state of the second object is determined, and then the target location information is determined based on the distribution state of the second object and the field of view angle information. Exemplarily, the virtual acquisition device set based on the target position information can completely acquire the orthogonal projection information of each second object; Exemplarily, the distribution state of the second object may include the second object in at least one direction. distribution means, such as horizontal and/or vertical distribution.

FIG. 8B is a schematic diagram of the second structure of the target position information provided by the embodiment of the application. As shown in FIG. 8B , the second virtual collection device 807 set based on the target position information can collect the data of the second object 203 and the third object 204 Orthogonal projection information, respectively obtain the third image data 808 and the fourth image data 809; exemplarily, the second virtual acquisition device 807 can be set outside the virtual object range 810; exemplarily, the third image can also be separately The data 808 and the fourth image data 809 are processed to obtain the third three-dimensional structure 811 and the fourth three-dimensional structure 812; for example, the third three-dimensional structure 811 and the fourth three-dimensional structure can be displayed in sequence at the adjacent positions of the first object 202 812. Exemplarily, between the second virtual acquisition device 807 and the second object 203 or the third object 204, there may be other virtual objects 813, and the second virtual acquisition device 807 acquires the third image data 808 and the fourth image data. Before 809, other virtual objects 813 may be eliminated.

FIG. 8C is a schematic diagram of the principle of determining target location information according to an embodiment of the present application. As shown in Figure 8C, point E can be the position of the staring point, point C is the target position information to be determined and can be marked as (x, y, z), point A is the position of the first object, and can be marked as d1(x1, y1, z1), point B can be the position of the third object, and the coordinates of the position can be (x2, y2, z2). In practical applications, point B can be the distance from the AR/VR device in at least one second object. The position of the farthest virtual object; point D can be the geometric center position of point A and point B; DF can be the normal vector perpendicular to the plane where the AR/VR device or controller is located.

FIG. 8D-1 is a schematic diagram of a first structure of a DF provided by an embodiment of the present application. In FIG. 8D-1 , the AR/VR device may be worn on the user's head, and DF may include a vector whose origin is the AR/VR device worn by the user and is perpendicular to the first direction 709 .

FIG. 8D-2 is a schematic diagram of the second structure of the DF provided by the embodiment of the present application. In FIG. 8D-2 , the starting point of the first direction 709 and DF may both be the controller 404 , where DF is perpendicular to the first direction 709 .

Exemplarily, DF can be recorded as a normalized vector (x3, y3, z3); α is the field of view angle of the second image acquisition device 807, based on the above data, the position of point D can be obtained as ((x1+ x2)/2, (y1+y2)/2, (z1+z2)/2); the DC vector is perpendicular to both DF and AB, so the DC vector DC' can be obtained by calculating the vector cross product shown in formula (1). :

DC'=[x2-x1,y2-y1,z2-z1]×[x3,y3,z3](1)

In order to facilitate the calculation, DC' can be recorded as (x4, y4, z4), and in order to normalize DC', the length len of DC' can be calculated by formula (2):

len=Sqrt(x4*x4, y4*y4, z4*z4) (2)

In formula (2), Sqrt is the square root operation. After obtaining len, DC' can be normalized to obtain the vector representation of DC: DC=(x4/len, y4/len, z4/len), and DC' The vector representation of is denoted as (x5, y5, z5). Exemplarily, the length of BD can be denoted as k, and its length is half of the length of AB, and k can be calculated by formula (3):

k=Sqrt((x2-x1)*(x2-x1)+(y2-y1)*(y2-y1)+(z2-z1)*(z2-z1))/2(3)

Thus, the length r of CD can be obtained by formula (4):

r=k/tan(α/2) (4)

From this, the coordinates of point C are obtained by formula (5):

(x,y,z)=[(x1+x2)/2,(y1+y2)/2,(z1+z2)/2]+r*[x5,y5,z5](5)

FIG. 9 is a schematic structural diagram of a display method provided by an embodiment of the present application. As shown in FIG. 9 , the display device can unfold the feature information 901 of the second object and the feature information 902 of the third object in sequence on the side of the first object 202 and clearly present it to the user 501 , and in the above-mentioned second object During the display process of the feature information 901 and the feature information 902 of the third object, the user 501 does not need to change the posture of the head, nor does it need to change the position by walking.

Exemplarily, after the feature information 901 of the second object and the feature information 902 of the third object are expanded in turn, by means of ray translation, the user can select the second object and/or the third object to perform an interactive operation, and the user can also Cancel the display of the second object and/or the third object; exemplarily, when the gaze direction changes, the first projection and the second projection may also change accordingly, at this time, the feature information 901 of the second object and the third object The display of the feature information 902 is stopped, and the display device updates the feature information of the second object and the feature information of the third object based on the new projection, so as to realize the real-time tracking display of the virtual object.

It can be seen from the above that, in the display method provided by the embodiment of the present application, under the condition that the first object uses the second object as a virtual object and the display device is an AR/VR device, the orthogonal projection of the second object can be collected by the virtual collection device. information, and display the feature information of the second object and the first object, so that the second object can still be displayed clearly and completely even when the second object is blocked by the first object, which is convenient for the user to use the AR/VR device for virtual objects. to make a selection.

Based on the foregoing embodiments, in the display method provided by the embodiments of the present application, the target display mode is determined based on the first projection and the second projection, which may also be implemented in the following ways:

If the second condition is satisfied, the target display mode is determined as: displaying the first object, displaying the edge of the first object in the first color, and displaying the part of the second object that is not blocked by the first object.

Wherein, the second condition includes that the first projection is a proper subset of the second projection.

In one embodiment, the first projection is a proper subset of the second projection, which can indicate that a part of the second object is blocked by the first object, that is, from the perspective of the display device, it can be seen that the second object is not covered by the first object. In another partial area occluded by an object, in this case, in order to highlight the relative relationship between the first object and the second object, the edge of the first object may be displayed in a first color, thereby distinguishing the first object from the second object.

In one embodiment, the first color may be a color different from the color of the first object and the color of the second object; for example, the color of the first object may be visible from the perspective of the display device The color presented by the first object; the color of the second object may be the color presented by the second object that can be seen from the display device. For example, if the color of the first object is green and the color of the second object is red, then the first color may be yellow.

In one embodiment, the target display mode may also be to display the first object, display the edge of the first object in a first pattern, and display the part of the second object that is not blocked by the first object; The pattern may be different from the pattern of the first object and the pattern of the second image; for example, the pattern of the first object may be the pattern presented by the first object that can be seen from the display device; the pattern of the second object The pattern may be a pattern presented by the second object that can be seen from the perspective of the display device.

In one embodiment, the target display mode may also be to display the first object with the first brightness, display the second object with the second brightness, and display the nth object with the nth brightness; n Brightness can be different. Among them, n is an integer greater than or equal to 1 and less than the number of virtual objects.

In an implementation manner, the target display mode may further include enlarging an area of the second object that is not blocked by the first object, and displaying the area in a highlighted form, thereby expanding the selectable and operable operations of the second object by the display device area.

It can be seen from the above that the display method provided by the embodiment of the present application can display the edge of the first object in the first color in the case that the second object is not completely blocked by the first object, so as to highlight the first object and the front of the second object. The relative positional relationship is convenient for the user to observe the first object and the second object.

Exemplarily, when the first object and the second object are both virtual objects and the display device is an AR/VR device, when the user changes the position of the cursor point by staring or ray, the AR/VR device can calculate the relationship between the cursor point and the virtual object. The distance between objects. If the distance between the cursor point and the virtual object is greater than the distance threshold, the virtual objects around the cursor can be displayed by highlighting or setting an outline of the first color for the virtual object.

FIG. 10 is a schematic structural diagram of displaying multiple virtual objects around a cursor point according to an embodiment of the present application. In FIG. 10 , taking the first projection 503 , the second projection 504 and the third projection 505 as examples, the display effects of the first object, the second object and the third object satisfying the third condition are shown.

As shown in FIG. 10 , when the display device detects that the first object, the second object and the third object exist around the cursor 1001, the first object and the second object can be displayed by setting the first projection 503 as dense diagonal lines. The projection 504 is set to display the second object in the form of a square, and the third projection 505 is set to display the third object in the form of sparse oblique lines, thereby realizing the clear display of the first object to the third object; exemplarily, The display device can also set the cursor 1001 as a dot pattern different from the first projection 503, the second projection 504 and the third projection 505, and can also set a specified color for the cursor 1001 to remind the user where the cursor 1001 is. When the user moves the cursor 1001 to different patterns or color areas, selection operations on different virtual objects can be realized. Exemplarily, the specified color may be different from the color of the virtual object around the cursor 1001 .

In the related art, if multiple virtual objects are mutually occluded and the unoccluded area in the virtual object is small, the user cannot accurately select the occluded virtual object, and the user can only change the head posture or The way of moving the position changes the display effect of the virtual object, so as to improve the user's selection efficiency of the virtual object.

However, in the display method provided by the embodiment of the present application, if the second object and/or a partial area of the third object is blocked by the first object, the display device can still display the edge of the first object and the lack of the second object based on the first color. The displayed part, in this way, can play a prompting role for the user on the selection area of the second object, thereby reducing the probability that the user selects the virtual object by mistake, and improving the user's operation efficiency on the virtual object.

Based on the foregoing embodiments, in the display method provided by the embodiments of the present application, the target display mode is determined based on the first projection and the second projection, which may also be implemented in the following ways:

If the third condition is satisfied, it is determined that the target display mode is: displaying the first object, displaying the edge of the first object in the second color, and displaying the part of the second object that is not blocked by the first object.

The third condition includes that the first projection and the second projection intersect, and the first projection is not a subset of the second projection, and the second projection is not a subset of the first projection.

FIG. 11A is a schematic diagram of a first structure of a first projection 503 , a second projection 504 , and a third projection 505 that satisfy the third condition provided by an embodiment of the present application. It can be seen from FIG. 10A that the first projection 503 intersects the second projection 504 and the third projection 505, but the first projection 503 is not a subset of the second projection 504, and the second projection 504 is not the first projection A subset of 503, ie the first object partially occludes the second object.

FIG. 11B is a schematic diagram of the second structure of the first projection 503 , the second projection 504 , and the third projection 505 that satisfy the third condition provided by the embodiment of the present application. It can be seen from FIG. 10B that the first projection 503 intersects the second projection 504 and the third projection 505, but the first projection 503 is not a subset of the second projection 504, and the second projection 504 is not the first projection A subset of 503, ie the first object partially occludes the second object. Similarly, the third object also partially occludes the second object.

In an implementation manner, the manner of determining the second color may be the same as or similar to the manner of determining the first color, and details are not described herein again.

In one embodiment, the target display mode may also be to display the first object, display the edge of the first object in a second pattern, and display the part of the second object that is not blocked by the first object; The pattern may be different from the pattern of the first object and the pattern of the second image; for example, the pattern of the first object may be the pattern presented by the first object that can be seen from the display device; the pattern of the second object The pattern may be a pattern presented by the second object that can be seen from the perspective of the display device.

In the case where the first object to the third object are virtual objects, the display effect of the display device on the plurality of virtual objects is as shown in FIG. 10 . The above-mentioned display manner can clearly distinguish multiple virtual objects with a short distance, thereby reducing the probability of the user selecting the virtual object by mistake, and improving the operation efficiency of the user on the virtual object.

Based on the foregoing embodiments, the embodiments of the present application further provide an electronic device, which can implement the display method described in any of the previous embodiments.

Exemplarily, the electronic device may be the display device described in the foregoing embodiments; Exemplarily, the electronic device may be an AR/VR device; Exemplarily, the electronic device may be implemented only by data interaction with the controller The device with AR/VR function may also be an all-in-one device capable of independently realizing AR/VR function.

Based on the foregoing embodiments, the embodiments of the present application also provide a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor of an electronic device, it can implement any of the foregoing. display method described above.

The above descriptions of the various embodiments tend to emphasize the differences between the various embodiments, and the similarities or similarities can be referred to each other. For the sake of brevity, details are not repeated herein.

The methods disclosed in each method embodiment provided in this application can be combined arbitrarily without conflict to obtain a new method embodiment.

The features disclosed in each product embodiment provided in this application can be combined arbitrarily without conflict to obtain a new product embodiment.

The features disclosed in each method or device embodiment provided in this application can be combined arbitrarily without conflict to obtain a new method embodiment or device embodiment.

It should be noted that the above-mentioned computer-readable storage medium may be a read-only memory (Read Only Memory, ROM), a programmable read-only memory (Programmable Read-Only Memory, PROM), an erasable programmable read-only memory (Erasable Programmable read only memory, ROM) Read-Only Memory (EPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Magnetic Random Access Memory (FRAM), Flash Memory (Flash Memory) , magnetic surface memory, optical disk, or memory such as Compact Disc Read-Only Memory (CD-ROM); it can also be a variety of electronic devices including one or any combination of the above memories, such as mobile phones, computers, tablet devices, personal digital assistants, etc.

It should be noted that, herein, the terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion, such that a process, method, article or device comprising a series of elements includes not only those elements, It also includes other elements not expressly listed or inherent to such a process, method, article or apparatus. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in a process, method, article or apparatus that includes the element.

The above-mentioned serial numbers of the embodiments of the present application are only for description, and do not represent the advantages or disadvantages of the embodiments.

From the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general hardware nodes, and of course hardware can also be used, but in many cases the former is better implementation. Based on this understanding, the technical solution of the present application can be embodied in the form of a software product in essence or in a part that contributes to the prior art, and the computer software product is stored in a storage medium (such as ROM/RAM, magnetic disk, CD-ROM), including several instructions to make a terminal device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in the various embodiments of this application.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present application. It will be understood that each flow and/or block in the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a general purpose computer, special purpose computer, embedded processor, or heat generating module of other programmable data processing devices to produce a machine such that the instructions executed by the heat generating module of the computer or other programmable data processing device generate Means for implementing the functions specified in a flow or flow of a flowchart and/or a block or blocks of a block diagram.

These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory result in an article of manufacture comprising instruction means, the instructions The apparatus implements the functions specified in the flow or flow of the flowcharts and/or the block or blocks of the block diagrams.

These computer program instructions can also be loaded on a computer or other programmable data processing device to cause a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process such that The instructions provide steps for implementing the functions specified in the flow or blocks of the flowcharts and/or the block or blocks of the block diagrams.

The above are only the preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made by using the contents of the description and drawings of the present application, or directly or indirectly applied in other related technical fields , are similarly included within the scope of patent protection of this application.

Claims (10)

1. A display method, the method comprising: Obtain at least a first projection of a first object and a second projection of a second object in at least a first direction; wherein the first direction includes a direction from the display device to the first object and/or the second object; the first object, including an object between the display device and the second object; determining a target display mode based on the first projection and the second projection; Based on the target display manner, the first object and the second object are displayed. 2. The method according to claim 1, wherein the determining the target display mode based on the first projection and the second projection comprises: If the first condition is satisfied, the feature information of the second object is acquired; wherein, the first condition includes that the second projection is a subset of the first projection; Determining that the target display mode is: displaying the first object in the first direction, and displaying feature information of the second object in a second direction; wherein the second direction is the same as the first direction. The included angle between the directions is greater than an angle threshold; the angle threshold is the included angle between a tangent from the display device to the first projection and the first direction. 3. The method according to claim 2, wherein the acquiring feature information of the second object comprises: obtaining location information of the second object; Based on the location information of the second object, the feature information of the second object is acquired. 4. The method of claim 3, wherein the first object and the second object include virtual objects, and the display device includes a virtual reality VR/augmented reality AR device; the second object is based on the second object. The position information of the object, and the feature information of the second object is obtained, including: Based on the position information of the second object, determine the target position information of the virtual collection device; The characteristic information of the second object collected by the virtual collection device set based on the target position information is acquired. 5 . The method according to claim 4 , wherein the feature information of the second object includes perspective projection information of the second object, and determining the position of the virtual acquisition device based on the position information of the second object. 6 . Target location information, including: Based on the position information of the second object, the relative positional relationship between the virtual acquisition device relative to each of the at least one second object is adjusted in a third direction; wherein the third direction and the The included angle between the first directions is less than 90 degrees; The target location information is determined based on the relative location relationship and location information of the second object. 6. The method according to claim 4, wherein the feature information of the second object comprises orthogonal projection information of the second object; the target of the virtual acquisition device is determined based on the position information of the second object Location information, including: acquiring the field of view angle information of the virtual acquisition device; The target position information is determined based on the position information of the second object and the field of view angle information. 7. The method according to claim 1, wherein the determining the target display mode based on the first projection and the second projection comprises: If the second condition is satisfied, it is determined that the target display mode is: displaying the first object, displaying the edge of the first object in a first color, and displaying the second object that is not blocked by the first object part; wherein, the second condition includes that the first projection is a proper subset of the second projection. 8. The method according to claim 1, wherein the determining the target display mode based on the first projection and the second projection comprises: If the third condition is satisfied, it is determined that the target display mode is: displaying the first object, displaying the edge of the first object in a second color, and displaying the second object that is not blocked by the first object part; wherein, the third condition includes that the first projection intersects the second projection, and the first projection is not a subset of the second projection, and the second projection is not the A subset of the first projection. 9. An electronic device capable of implementing the display method according to any one of claims 1 to 8. 10. A computer-readable storage medium, wherein a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor of an electronic device, any one of claims 1 to 8 can be implemented. display method.

Images