CN113791750A

CN113791750A - Virtual content display method and device and computer readable storage medium

Info

Publication number: CN113791750A
Application number: CN202111123906.9A
Authority: CN
Inventors: 马海刚; 马维宁; 甘泰玮
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2021-09-24
Filing date: 2021-09-24
Publication date: 2021-12-14
Anticipated expiration: 2041-09-24
Also published as: CN113791750B

Abstract

The embodiment of the invention discloses a virtual content display method and device and a computer readable storage medium. Specifically, the method can receive a virtual content acquisition instruction triggered by the augmented reality client based on the target identification; analyzing the virtual content acquisition instruction to obtain authority identification information and target link information of a target identification; carrying out authority verification processing on the authority identification information; when the authority passes the verification, acquiring target virtual content corresponding to the target link information according to the authority mapping relation between the preset link information and the preset virtual content; the target virtual content is sent to the augmented reality client to cause the augmented reality client to display the virtual content. The display efficiency of the virtual content can be improved through the embodiment of the application.

Description

Virtual content display method and device and computer readable storage medium

Technical Field

The present application relates to the field of communications technologies, and in particular, to a method and an apparatus for displaying virtual content, and a computer-readable storage medium.

Background

The Augmented Reality (AR) technology is a technology that skillfully fuses virtual information and the real world, and a plurality of technical means such as multimedia, three-dimensional modeling, real-time tracking and registration, intelligent interaction, sensing and the like are widely applied, and virtual information such as characters, images, three-dimensional models, music, videos and the like generated by a computer is applied to the real world after being simulated, and the two kinds of information complement each other, so that the real world is enhanced.

In the prior art, virtual content of the AR is often required to be displayed by means of a logo (Marker) trigger. For example, the user may scan the identification through the application to trigger the virtual content of the AR to be displayed. During the research and practice process of the prior art, the applicant of the present application finds that often only one virtual content can be bound to one identifier, which results in the waste of resources. Further, as the virtual content increases, the identification also becomes correspondingly greater, which may reduce the display efficiency of the virtual content.

Content of application

The embodiment of the application provides a virtual content display method, a virtual content display device and a computer readable storage medium, which can improve the display efficiency of virtual content.

The embodiment of the application provides a virtual content display method, which comprises the following steps:

receiving a virtual content acquisition instruction triggered by an augmented reality client based on a target identification;

analyzing the virtual content acquisition instruction to obtain authority identification information and target link information of the target identification;

carrying out authority verification processing on the authority identification information;

when the authority passes the verification, acquiring target virtual content corresponding to the target link information according to a mapping relation between preset link information and preset virtual content;

sending the target virtual content to the augmented reality client to cause the augmented reality client to display the virtual content.

Correspondingly, an embodiment of the present application further provides a virtual content display apparatus, including:

the first receiving unit is used for receiving a virtual content acquisition instruction triggered by the augmented reality client based on the target identification mark;

the first analysis unit is used for analyzing the virtual content acquisition instruction to obtain authority identification information and target link information of the target identification;

the authority verification unit is used for performing authority verification processing on the authority identification information;

the first acquisition unit is used for acquiring target virtual content corresponding to the target link information according to the authority mapping relation between the preset link information and the preset virtual content when the authority verification passes;

a first sending unit, configured to send the target virtual content to the augmented reality client, so that the augmented reality client displays the virtual content.

In an embodiment, the obtaining unit includes:

the matching subunit is used for matching the target link information with the preset link information to obtain a matching result;

and the determining subunit is configured to determine, according to the matching result, the target virtual content corresponding to the target link information based on the mapping relationship.

In one embodiment, the virtual content display apparatus further includes:

the second receiving unit is used for receiving a virtual content uploading instruction sent by a virtual content development end, wherein the virtual content uploading instruction carries at least one to-be-uploaded virtual content and configuration information corresponding to each to-be-uploaded virtual content;

the generating unit is used for generating an identification mark corresponding to each virtual content to be uploaded according to the virtual content uploading instruction;

the binding unit is used for binding the virtual content to be uploaded and the identification mark to obtain the bound virtual content;

the configuration unit is used for configuring the at least one bound virtual content based on the configuration information to obtain at least one configured virtual content;

and the storage unit is used for storing the at least one configured virtual content into a target virtual content storage library and sending the identification mark to the virtual content development end.

In one embodiment, the configuration unit includes:

the first obtaining subunit is configured to obtain link information of the bound virtual content, where the link information represents an identification identifier corresponding to the bound virtual content;

the authority association subunit is used for carrying out authority association processing on the bound virtual content and the link information based on the authority configuration information to obtain the virtual content after authority association;

the periodic configuration subunit is configured to perform periodic configuration processing on the virtual content and the link information after the permission association based on the periodic configuration information to obtain a periodically configured virtual content;

and the distribution binding subunit is configured to perform distribution binding processing on the periodically configured virtual content and the link information based on the distribution configuration information, so as to obtain the configured virtual content.

In one embodiment, the permission association subunit includes:

the first analysis module is used for analyzing the authority configuration information to obtain at least one authority access condition;

and the first construction module is used for constructing a permission mapping relation between the link information and the virtual content to be uploaded based on the permission access condition to obtain the virtual content after permission association.

In one embodiment, the periodic configuration subunit includes:

the second analysis module is used for analyzing the period configuration information to obtain a display period;

the adding module is used for adding a publishing time point for the virtual content after the authority association based on the display period;

and the establishing module is used for establishing a publishing mapping relation between the link information and the virtual content after the authority association based on the publishing time point to obtain the periodically configured virtual content.

In one embodiment, the distribution binding subunit includes:

the third analysis module is used for analyzing the distribution configuration information to obtain at least one distribution object identifier and virtual content corresponding to the distribution object identifier;

the binding module is used for binding the at least one distribution object identifier and the link information to obtain bound link information;

and the second construction module is used for constructing a distribution mapping relation between the bound link information and the periodically configured virtual content based on the virtual content corresponding to the distribution object identifier to obtain the configured virtual content.

In one embodiment, the generating unit includes:

the detection subunit is used for carrying out identification mark detection processing on the virtual content to be uploaded;

the identification subunit is configured to identify the virtual content to be uploaded when the virtual content to be uploaded does not carry an identification identifier, so as to obtain content information of the virtual content to be uploaded;

the encryption subunit is used for encrypting the content information to obtain encrypted content information;

and the generating subunit is used for generating the identification mark based on the encrypted content information.

In one embodiment, the identifier unit comprises:

the format recognition module is used for carrying out format recognition on the virtual content to be uploaded when the virtual content to be uploaded does not carry a recognition identifier, so as to obtain format information of the virtual content to be uploaded;

the format conversion module is used for carrying out format conversion processing on the virtual content to be uploaded based on the format information of the virtual content to be uploaded to obtain the virtual content after the format conversion;

and the content identification module is used for identifying the content of the virtual content after the format conversion to obtain the content information.

In one embodiment, the virtual content display apparatus further includes:

a third receiving unit, configured to receive a binding relationship update instruction, where the binding relationship update instruction carries virtual content to be updated;

the first identification unit is used for identifying the virtual content to be updated to obtain link information corresponding to the updated virtual content;

the screening unit is used for screening out the virtual content corresponding to the link information from the target virtual content repository;

and the updating unit is used for updating the virtual content corresponding to the link information into the virtual content to be updated to obtain the updated virtual content.

In one embodiment, the virtual content display apparatus further includes:

a fourth receiving unit, configured to receive a configuration information update instruction, where the configuration information update instruction carries update configuration information;

the second identification unit is used for identifying the updated configuration information to obtain the identification information of the updated configuration information;

the extracting unit is used for extracting virtual content to be configured and link information corresponding to the virtual content to be configured based on the identification information;

and the configuration updating unit is used for performing configuration updating processing on the virtual content to be configured and the link information corresponding to the virtual content to be configured based on the updating configuration information to obtain the virtual content after configuration updating.

Embodiments of the present application also provide a computer program product or computer program comprising computer instructions stored in a computer-readable storage medium. The computer instructions are read by a processor of a computer device from a computer-readable storage medium, and the computer instructions are executed by the processor to cause the computer device to perform the method provided in the various alternatives of the above aspect.

Accordingly, an embodiment of the present application further provides a computer-readable storage medium, where instructions are stored, and when executed by a processor, the instructions implement the virtual content display method provided in any of the embodiments of the present application.

The method and the device can receive a virtual content acquisition instruction triggered by the augmented reality client based on the target identification; analyzing the virtual content acquisition instruction to obtain authority identification information and target link information of a target identification; carrying out authority verification processing on the authority identification information; when the authority passes the verification, acquiring target virtual content corresponding to the target link information according to the authority mapping relation between the preset link information and the preset virtual content; the target virtual content is sent to the augmented reality client to cause the augmented reality client to display the virtual content. The display efficiency of the virtual content can be improved through the embodiment of the application.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 is a schematic view of a scene provided by a virtual content display method according to an embodiment of the present application;

fig. 2 is a schematic flow chart provided by a virtual content display method according to an embodiment of the present application;

fig. 3 is a scene schematic diagram of an AR cloud platform provided in an embodiment of the present application;

fig. 4 is a schematic view of another scenario of an AR cloud platform provided in an embodiment of the present application;

fig. 5 is a schematic view of another scenario of an AR cloud platform provided in an embodiment of the present application;

fig. 6 is a schematic view of another scenario of an AR cloud platform provided in an embodiment of the present application;

fig. 7 is a scene schematic diagram of an AR cloud platform interface provided in an embodiment of the present application;

fig. 8 is a schematic view of another scenario of an AR cloud platform interface provided in an embodiment of the present application;

fig. 9 is a scene schematic diagram of an AR cloud platform interface provided in an embodiment of the present application;

fig. 10 is a scene schematic diagram of an AR cloud platform interface provided in an embodiment of the present application;

fig. 11 is a scene schematic diagram of an AR cloud platform interface provided in an embodiment of the present application;

fig. 12 is a scene schematic diagram of an AR cloud platform interface provided in an embodiment of the present application;

fig. 13 is a schematic flowchart of a virtual content display method provided in an embodiment of the present application;

fig. 14 is a schematic view of a scene provided by a virtual content display device according to an embodiment of the present application;

fig. 15 is a schematic view of a further scene provided by a virtual content display device according to an embodiment of the present application;

fig. 16 is a schematic structural diagram of a terminal according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The embodiment of the application provides a virtual content display method, which can be executed by a virtual content display device, and the virtual content display device can be integrated in an electronic device. The electronic device may include at least one of a terminal and a server.

It is understood that the virtual article display method of the present embodiment may be executed on a server, or may be executed by both a terminal and a server.

The terminal may include, but is not limited to, a mobile phone, a computer, an intelligent voice interaction device, an intelligent appliance, a vehicle-mounted terminal, and the like.

The server may be an interworking server or a background server among a plurality of heterogeneous systems, an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, a cloud server providing basic cloud computing services such as cloud service, a cloud database, cloud computing, cloud functions, cloud storage, network service, cloud communication, middleware service, domain name service, security service, big data and artificial intelligence platforms, and the like.

It should be noted that the embodiments of the present application can be applied to various scenarios, including but not limited to cloud technology, artificial intelligence, smart traffic, driving assistance, and the like.

In an embodiment, as shown in fig. 1, taking the electronic terminal as a server as an example, the virtual article display system provided in the embodiment of the present application may include a terminal 10, a server 11, and the like; the terminal 10 and the server 11 are connected via a network, such as a wired or wireless network connection. Wherein the virtual good display device is integrated in the server. An augmented reality client may be integrated on the terminal 10.

In one embodiment, the server 11 may be configured to: receiving a virtual content acquisition instruction triggered by an augmented reality client based on a target identification; analyzing the virtual content acquisition instruction to obtain authority identification information and target link information of a target identification; carrying out authority verification processing on the authority identification information; when the authority passes the verification, acquiring target virtual content corresponding to the target link information according to the authority mapping relation between the preset link information and the preset virtual content; the target virtual content is sent to the augmented reality client to cause the augmented reality client to display the virtual content.

In one embodiment, the terminal 10 may be configured to: receiving the virtual content sent by the server 11, loading and rendering the virtual content, thereby realizing the virtual content in the correct real client.

The virtual content display method provided by the embodiment of the application relates to Computer Vision (CV) in the field of Artificial Intelligence (AI), and particularly relates to the technical field of Augmented Reality (AR) in Computer Vision. The embodiment of the application can realize the combination of the display of the virtual article and the augmented reality technology, thereby enriching the display mode of the virtual article, expanding the interactive form between a user and the virtual article and increasing the interest of the virtual article.

Among them, Artificial Intelligence (AI) is a theory, method, technique and application system that simulates, extends and expands human Intelligence using a digital computer or a machine controlled by a digital computer, senses the environment, acquires knowledge and uses the knowledge to obtain the best result. In other words, artificial intelligence is a comprehensive technique of computer science that attempts to understand the essence of intelligence and produce a new intelligent machine that can react in a manner similar to human intelligence. Artificial intelligence is the research of the design principle and the realization method of various intelligent machines, so that the machines have the functions of perception, reasoning and decision making. The artificial intelligence technology is a comprehensive subject and relates to the field of extensive technology, namely the technology of a hardware level and the technology of a software level. The artificial intelligence infrastructure generally includes technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing technologies, operation/interaction systems, mechatronics, and the like. The artificial intelligence software technology mainly comprises a computer vision technology, a voice processing technology, a natural language processing technology, machine learning/deep learning and other directions.

Among them, Computer Vision technology (CV) is a science for studying how to make a machine "see", and more specifically, it refers to machine Vision for identifying, measuring, etc. a target by using a Computer instead of human eyes, and further performing image processing, so that an image is processed by a Computer to be an image more suitable for human eyes or transmitted to an instrument for detection. As a scientific discipline, computer vision research-related theories and techniques attempt to build artificial intelligence systems that can capture information from images or multidimensional data. Computer vision technologies generally include technologies such as image processing, image recognition, three-dimensional object reconstruction, virtual reality, augmented reality, and the like, and also include common biometric technologies such as face recognition, human body posture recognition, and the like.

The Augmented Reality (AR) technology is a technology that skillfully fuses virtual information and a real scene, and a plurality of technical means such as multimedia, three-dimensional modeling, real-time tracking and registration, intelligent interaction, sensing and the like are widely applied, and virtual information such as characters, images, three-dimensional models, music, videos and the like generated by a computer is simulated and applied to the real scene, so that the real scene is enhanced.

The following are detailed below. It should be noted that the following description of the embodiments is not intended to limit the preferred order of the embodiments.

In an embodiment, the virtual content display apparatus may be integrated on a computer device such as a terminal or a server, so as to implement the virtual content display method provided in the embodiment of the present application. Specifically, the computer device may receive a virtual content acquisition instruction triggered by the augmented reality client based on the target identification; analyzing the virtual content acquisition instruction to obtain authority identification information and target link information of a target identification; carrying out authority verification processing on the authority identification information; when the authority passes the verification, acquiring target virtual content corresponding to the target link information according to the authority mapping relation between the preset link information and the preset virtual content; the target virtual content is sent to the augmented reality client to cause the augmented reality client to display the virtual content. By the embodiment of the application, different target virtual contents can be displayed by different authority identification information, so that the target virtual contents corresponding to the target identification can be dynamically changed without generating an identification mark for each virtual content, the required storage capacity of the virtual content display device is reduced, and the display efficiency of the virtual contents is improved.

The embodiments of the present application will be described in terms of a virtual content display apparatus, which may be integrated in a computer device, where the computer device may be a server or a terminal.

As shown in fig. 2, a virtual content display method is provided, and the specific process includes:

101. and receiving a virtual content acquisition instruction triggered by the augmented reality client based on the target identification.

The client may include a computer connected to the network, which is controlled and managed by the network server and can share various resources on the network. For example, a client may include a web browser, an application, an applet, and so on.

The application programs may include application software on various terminals, among others. For example, the Application program may include various mobile phone software (APP), tablet Application software, Application software on a notebook Computer, Application software on a Personal Computer (PC), Application software on a wearable electronic device, and the like.

Among them, the applet (Mini Program) is an application that can be used without downloading and installing. In order to provide more diversified business services to users, developers can develop corresponding applets for applications (such as instant messaging applications, shopping applications, mail applications, and the like) of the terminal, the applets can be embedded into the applications of the terminal as sub-applications, and the corresponding business services can be provided for the users by running the sub-applications (i.e., the corresponding applets) in the applications. Wherein the augmented reality client comprises a client having augmented reality functionality

Wherein the augmented reality client may comprise a client having augmented reality functionality. For example, an augmented reality client may include an APP with augmented reality functionality. As another example, an augmented reality client may include an applet with augmented reality functionality. As another example, the augmented reality client may include glasses with augmented reality functionality, and so on.

The Augmented Reality (AR) technology is a technology that skillfully fuses virtual information and the real world, and a plurality of technical means such as multimedia, three-dimensional modeling, real-time tracking and registration, intelligent interaction, sensing and the like are widely applied, virtual contents such as characters, images, three-dimensional models, music, videos and the like generated by a computer are applied to the real world after being simulated, and the two kinds of information complement each other, so that the real world is enhanced.

In one embodiment, the AR includes three major technical points, which are three-dimensional registration (tracking registration technology), virtual reality fusion display, and human-computer interaction. The method comprises the steps of firstly carrying out data acquisition on a real scene through a camera and a sensor, transmitting the data into a processor to carry out analysis and reconstruction on the real scene, updating spatial position change data of a user in a real environment in real time through accessories such as an AR (augmented reality) head display or a camera, a gyroscope, a sensor and the like on intelligent mobile equipment, obtaining the relative position of a virtual scene and the real scene, realizing the alignment of a coordinate system, carrying out fusion calculation on the virtual scene and the real scene, and finally presenting a synthetic image of the virtual scene and the real scene to the user. The user can acquire control signals through AR head display or interactive accessories on the intelligent mobile device, such as a microphone, an eye movement tracker, an infrared sensor, a camera, a sensor and other devices, and perform corresponding human-computer interaction and information updating to realize augmented reality interactive operation. The three-dimensional registration is the core of the AR technology, that is, two-dimensional or three-dimensional objects in a real scene are used as markers, and the virtual content and the real scene information are aligned and matched, that is, the position, size, motion path, and the like of the virtual object must be perfectly matched with the real environment, so as to achieve the goal of generating virtual reality and real reality.

In an embodiment, identifying the identifier may include an identifier that bitwise matches the virtual content with the real scene information. By identifying the identifier, the virtual content and the real scene information can be matched, so that the virtual content and the real scene can be perfectly fused.

In one embodiment, the identification may be a two-dimensional object. For example, the identification mark may include a pattern which is regularly distributed in a plane by using a certain geometric figure, is black and white, and records data symbol information. For example, the identification mark may include a two-dimensional code, and the like. For another example, the identification may include a Quick matrix Response code (QR code) and an applet code, and so on.

The target identification mark comprises an identification mark corresponding to a specific virtual content. A specific virtual content can be displayed through the target identification.

Wherein the virtual content may include content generated by electronic device rendering that may be integrated with the real world. The virtual content may be two-dimensional content or three-dimensional content. For example, virtual content may include three-dimensional images, three-dimensional videos, and three-dimensional texts, among others. As another example, the virtual content may include two-dimensional images, two-dimensional videos, and two-dimensional texts, and so on. As another example, virtual content may include content in the format of.3 ds,. ma,. x,. 3dm,. c4d, and.obj.

In an embodiment, the augmented reality client may be integrated on a terminal having a camera. For example, an augmented reality client may be integrated on a cell phone with a camera. After the object scans the target identification through the camera started by the augmented reality client, the virtual content display device receives a virtual content acquisition instruction. Wherein, when the discernment sign is the two-dimensional code, when the augmented reality client is APP, after the user can open cell-phone scanning two-dimensional code through APP, virtual content display device just can receive virtual content and obtain the instruction.

In an embodiment, in order to better implement the virtual content display method provided in the embodiment of the present application, the embodiment of the present application correspondingly provides a virtual content display system. Wherein the virtual content display system may be as shown in fig. 3.

As shown in fig. 3, the virtual content display system may include a client, a presentation medium, a Software Development Kit (SDK), and an AR cloud platform.

In an embodiment, the AR cloud platform may be a platform that provides technical support for the virtual content display method provided in the embodiment of the present application. Through the AP cloud platform, the virtual content display process can be configured, managed, stored and the like, developers are not required to develop the virtual content display process, and the virtual content display efficiency is improved. For example, through the AR cloud platform, a mapping relationship between the virtual content and the identification can be configured, and so on. Also for example, through the AR cloud platform, a recognition identifier may also be generated, and so on.

The AR cloud platform comprises a material management module, an operation management module, a technical platform module and a technical sharing module.

The material management module is responsible for managing the virtual content. For example, the material management module supports the mainstream content standard files (such as 3D. 3ds/. ma/. x/.3dm/. c4D/. obj, etc.), and the mainstream content standard files are automatically converted into VRML or WRL after arriving at the server. In addition, the material management module also supports standard material files such as characters, pictures, videos and the like. Through the material management module, the management operations such as starting and stopping, erecting and setting up the materials, checking the contents and the like can be realized.

The operation management module is responsible for managing the two-dimension code, the relationship between the two-dimension code and the virtual content. In addition, the operation management module can also realize user (equivalent to object) management, application management, authority management, distribution management, period management and release management.

For example, the two-dimension code management submodule of the operation management module can provide functions of manually uploading the two-dimension code, generating the two-dimension code after encrypting according to information content, generating the two-dimension code after automatically converting link according to link, randomly generating the two-dimension code, generating the two-dimension code in batches, binding a specified user/user group and the like. And can edit and delete the two-dimensional code, start the functional operation of stopping using, putting on the shelf and putting off the shelf and the like.

For another example, the operation management module may perform binding management on the virtual content displayed when the two-dimensional code is identified and tracked. The method can perform operation management such as designated binding, designated user display (different contents are displayed by different users of the same marker), editing and deleting, starting and stopping, putting on and putting off shelves and the like.

For another example, the user management submodule of the operation management module may manage the application user, and may add, delete, check, establish, manage, etc. the user group.

For another example, the application management submodule of the operation management module can provide management of adding and deleting application functions, secret id/key generation, enabling and disabling applications and the like for management of different applications under the same tenant.

For another example, the distribution management submodule of the operation management module can manage and operate the distribution of the virtual content to a specific user group. For example: the method comprises the steps of distributing advertisement virtual content aiming at marks in a user group of the infant education APP, distributing special price commodity introduction virtual content aiming at a VIP group in the shopping APP and the like.

For another example, the delivery and distribution of the virtual content may be periodically managed by a period management submodule of the operation management module. For example, the virtual content of the APP in preschool education, professional training and magazine subscription can be scheduled in advance through periodic management if the virtual content needs to be updated every monday, and the APP corresponds to the display of different virtual content in different time intervals for the same marker.

Wherein the technology platform can be the technology support of other platforms. The functions of material distribution, material conversion, application authentication, material storage, tenant management and the like can be realized through the technical platform.

The technology sharing module can enable the technology supported by the technical platform to be realized in the material management module and the operation management module. For example, the material management module can be made available through the technology sharing module, and the files in the c4d format are converted into WRL files or VRML files. For another example, by the technology sharing module, the operation management module can realize the functions of batch import and batch operation.

In one embodiment, the SDK may be a software development kit that implements AR functionality. The SDK can realize the functions of using the identification mark as AR tracking, automatic positioning, tracking, analyzing the two-dimension code link, downloading virtual content corresponding to the link to an AR cloud platform, tracking the two-dimension code, calculating the angle, depth, deformation, orientation, perspective and the like between a camera and the two-dimension code, calculating how the virtual content is displayed (perspective effect, size, chartlet and the like of the virtual content), finishing the rendering of the virtual content and the like. Through the SDK, a client developer can develop a client with AR function. When the augmented reality client is developed, a developer can integrate the SDK into the augmented reality client to realize the AR function without debugging the two-dimensional code content, showing the effect, virtual content, registering the two-dimensional code to be tracked and other technical details, so that the development efficiency of the augmented reality client is improved.

Wherein, the SDK can support identification tracking and resolution. For example, the SDK may enable tracking and parsing of QR codes, applets, and other two-dimensional codes. In addition, the SDK can also support the functions of 3D posture calculation, projection matrix calculation, server hand-held authentication, material downloading, material rendering, material loading and caching, virtual reality synthesis, virtual reality display and the like.

In one embodiment, the presentation medium may comprise a presentation medium of virtual content. For example, virtual content may be displayed on a cell phone in a fused manner with a real scene. For another example, the virtual content may be displayed in a fused manner with the real scene through the AR glasses.

In an embodiment, the virtual content display apparatus may be integrated with an AR cloud platform, so that the virtual content display method provided in the embodiment of the present application may be implemented based on the AR cloud platform.

For example, by using the AR cloud platform, the same user may scan the same identification to possibly display different virtual contents. For example, as shown in fig. 4, when the application user a scans the two-dimensional code by the application C, one virtual content is displayed, and when the application user a scans the two-dimensional code by the application D, another virtual content is displayed.

For another example, virtual content uploaded by a different virtual content originator may be received through the AR cloud platform. For example, as shown in fig. 5, the AR cloud platform may receive virtual content uploaded by an application operator, and implement material management, operation management, and the like on the virtual content. In addition, the AR cloud platform can also receive virtual content uploaded by advertisers, and material management, operation management and the like of the virtual content are achieved.

For another example, the user may also author virtual content through the AR cloud platform and store the authored content in the AR cloud platform. For example, as shown in fig. 6, application user a and application user C may author virtual content through client application a and store the authored content in the cloud platform. For another example, as shown in fig. 6, the author may author virtual content through an authoring application C and store the authored content in the cloud platform.

For another example, the application user a can make virtual content on the APP through the "authoring application" and upload the virtual content to the platform through the SDK, and bind the content to, for example, one of the marks on the hand of the user B, so that effects similar to "private information mutual transfer" and "private card" between the AB can be achieved.

In an embodiment, the AR cloud platform further has a visual operation platform, so that an AR cloud platform administrator can manage and control the AR cloud platform.

For example, as shown in FIG. 7, a visual interface for material management is provided. Through the material management platform, an AR cloud platform administrator can manage materials in the AR cloud platform.

For another example, as shown in FIG. 8, a visual interface is provided to add material. When the virtual content development end needs to add materials, the materials can be added through the visual interface.

As another example, as shown in FIG. 9, a visual management platform for identifying indicia is provided. Through the material management platform, an AR cloud platform administrator can manage the identification marks in the AR cloud platform.

As another example, as shown in FIG. 10, a visual interface is provided for creating the new mark. When the virtual content development end needs to build a mark, the mark can be added through the visual interface.

For another example, as shown in fig. 11, a visual management platform for managing material delivery tasks is provided. By the material delivery task management platform, an AR cloud platform administrator can manage delivery tasks in the AR cloud platform.

For another example, as shown in fig. 12, a visual interface for newly creating a task to be delivered is provided, so that the virtual content developer can deliver the new task through the visual interface.

In an embodiment, the client may be integrated with an SDK, have an augmented reality function, and may obtain the virtual content through the identification mark and display the virtual content. For example, the client may include an application with augmented reality functionality. As another example, the client may include an AR enabled content authoring platform, and the like.

102. And analyzing the virtual content acquisition instruction to obtain the authority identification information and the target link information of the target identification.

In an embodiment, the virtual content reality method provided by the embodiment of the application can realize that different authority identification information can display different target virtual content. Therefore, after the virtual content display device receives the virtual content acquisition instruction, the virtual content acquisition instruction can be analyzed to obtain the authority identification information and the target link information of the target identification.

The authority identification information includes information that can identify the augmented reality client and an object that triggers the virtual content acquisition instruction. That is, it can be known through the authority identification information who triggered the virtual content acquisition instruction through which augmented reality client. For example, through the authority identification information, the virtual content display device is that the object a triggers a virtual content acquisition instruction through the augmented reality client a.

In an embodiment, the rights identification information may include client identification information and object identification information. The client identification information may include information that identifies the augmented reality client. For example, the client identification information may be a port number of the augmented reality client, and so on. The object identification information may include information that identifies the object. For example, the object identification information may include a login account number of the object to login to the augmented reality client, and so on.

In an embodiment, the rights identification information may be signature information (SecretId). Where SecretId may be used to identify the identity of the client. With the SecretId, the virtual content display apparatus can know which client requests to display the virtual content.

In an embodiment, link information may be generated for the identification, and the link information of the identification and the identification are bound, so that the virtual content may be obtained through the link information, thereby saving storage space. The link information may be information having an identification function for identifying the identifier. For example, the link information may be an address character or a character string, or the like. For example, the link information may be a Uniform Resource Locator (URL), or the like.

In an embodiment, the virtual content obtaining instruction may be analyzed in multiple ways to obtain the authority identification information and the target link information of the target identification.

For example, the virtual content acquisition instruction may be traversed to obtain the rights identification information and the target link information of the target identification.

As another example, the virtual content acquisition instruction typically has a particular information format that specifies where in the virtual content acquisition instruction, what information is stored. Therefore, the positions where the authority identification information and the target link information are stored can be directly located through the information format, and the information on the positions is read, so that the target link information of the authority identification information and the target identification is obtained.

103. And carrying out authority verification processing on the authority identification information.

In an embodiment, the virtual content display method provided by the embodiment of the application can realize that different authority identification information can display different target virtual content, so that authority verification processing can be performed on the authority identification information, and whether the authority identification information has the authority to display the virtual content is determined according to the authority verification processing result.

In an embodiment, since the authority identification information may include the client identification information and the object identification information, when the authority identification information is subjected to the authority verification processing, the authority verification processing may be performed on the client identification information and the object identification information.

For example, whether the augmented reality client has the right to display the virtual content corresponding to the target identification identifier and whether the object has the right to display the virtual content corresponding to the target identification identifier can be determined through the client identification information and the object identification information.

In one embodiment, there are many ways to perform the authorization verification process on the authorization identification information.

For example, the AR cloud platform may store a preset authority access condition, and then may perform authority verification processing on the client identification information and the object identification information through the preset authority access condition.

For example, when the preset permission access condition sets only the permission of the augmented reality client, the client identification information may be matched with the preset access condition. When the matching is passed, the augmented reality client has the authority of displaying the virtual content corresponding to the target identification mark.

For another example, when the preset permission access condition sets the permission of the augmented reality client and the object, the client identification information and the object identification information may be matched with the preset access condition. When the matching is passed, the augmented reality client and the object are indicated to have the authority of displaying the virtual content corresponding to the target identification mark.

In addition, the AR cloud platform can also use a signature method to carry out authority verification processing on the authority identification information.

For example, when the rights identification information is SecretId, the AR cloud platform may perform rights verification processing on the rights identification information using a verification key (SecretKey). Wherein, the secretekey may be a key stored in the AR cloud platform in advance for verifying SecretId.

104. And when the authority passes the verification, acquiring the target virtual content corresponding to the target link information according to the mapping relation between the preset link information and the preset virtual content.

In an embodiment, when the right verification passes, the virtual content display device may obtain the target virtual content corresponding to the target link information according to a mapping relationship between the preset link information and the preset virtual content.

The mapping relation between the preset link information and the preset virtual content defines the association relation between the link information and the virtual content. Through the mapping relation between the preset link information and the preset virtual content, which link information can display which virtual content can be known.

In an embodiment, the mapping relationship between the preset link information and the preset virtual content may have various forms. For example, the mapping relationship may be presented in the form of a table. For another example, the mapping relationship may be presented in the form of a graph.

In an embodiment, the step "obtaining the target virtual content corresponding to the target link information according to a mapping relationship between the preset link information and the preset virtual content when the right verification passes" may include:

matching the target link information with preset link information to obtain a matching result;

and determining the target virtual content corresponding to the target link information based on the mapping relation according to the matching result.

For example, a plurality of pieces of preset link information are stored in the AR cloud platform. Then, the target link information may be matched with the several pieces of preset link information. When the target link information matches the preset link information a, the preset virtual content corresponding to the preset link information a may be determined as the target virtual content based on the mapping relationship.

105. And sending the target virtual content to the augmented reality client so that the augmented reality client displays the target virtual content.

In an embodiment, after the virtual content display device determines the target virtual content, the virtual content display device may send the target virtual content to the augmented reality client to cause the augmented reality client to render the target virtual content.

For example, when the augmented reality client integrates the SDK proposed in the embodiment of the present application, the virtual content display apparatus may transmit the target virtual content to the SDK. The SDK may then render the target virtual content proximate to the identification through the perspective projection matrix. For example, when the identification mark is a two-dimensional code, the SDK may render the target virtual content near the two-dimensional code through a perspective projection matrix, so that a cell phone screen, a computer screen, or an HMD (head mounted display, AR glasses, stereoscopic projection, etc.) presents the rendering result.

In an embodiment, the AR cloud platform provided in the embodiment of the present application has a visual control page, and through the visual control page, a developer can upload virtual content to the AR cloud platform and configure the virtual content.

Therefore, in an embodiment, before the step of receiving the virtual content acquisition instruction triggered by the augmented reality client based on the target identification, "the method may include:

receiving a virtual content uploading instruction sent by a virtual content development end, wherein the virtual content uploading instruction carries at least one to-be-uploaded virtual content and configuration information corresponding to each to-be-uploaded virtual content;

generating an identification mark corresponding to each virtual content to be uploaded according to the virtual content uploading instruction;

binding the virtual content to be uploaded and the identification mark to obtain the bound virtual content;

configuring the at least one bound virtual content based on the configuration information to obtain at least one configured virtual content;

and storing the at least one configured virtual content in a target virtual content storage library, and sending the identification to the virtual content development end.

The virtual content to be uploaded comprises virtual content which is prepared by the virtual content development end to be uploaded to the virtual content display device.

The configuration information may include content configured by the virtual content development end for the virtual content to be uploaded. Through the configuration information, the virtual content to be uploaded can be displayed according to the intention of the virtual content development end.

In an embodiment, the virtual content display method provided in the embodiment of the present application can realize that different objects scan the same identifier to display different virtual contents, or that the same object scans the same identifier at different times to display different virtual contents. Accordingly, the configuration information may include at least one of authority configuration information, cycle configuration information, distribution configuration information, and the like.

The permission configuration information may include information that the virtual content development end configures for display permission of the virtual content. Through the rights configuration information, the virtual content developer can define what virtual content different augmented reality clients will display and what virtual content different objects will display. For example, the rights configuration information may define that virtual content a is displayed for object a and virtual content B is displayed for object B. For another example, the rights configuration information may define that virtual content a is displayed for augmented reality client a and virtual content is displayed for augmented reality client B.

The period configuration information may include information that the virtual content development end configures for a display period of the virtual content. Through the period configuration information, the virtual content originating terminal can specify what virtual content is displayed at what time. For example, through the period configuration information, the virtual content development end may specify that the virtual content a is displayed in month 1, the virtual content B is displayed in month 2, and the virtual content C is displayed in month 3.

The distribution configuration information may include information that the virtual content development end configures for a display scene of the virtual content. For example, advertisement virtual content is distributed for marks in a user group of the infant education APP, special commodity introduction virtual content is distributed for a VIP group in the shopping APP, and the like.

In an embodiment, since the AR cloud platform may provide a function of generating an identification identifier for the virtual content development terminal, after receiving the virtual content uploading instruction, the virtual content display apparatus may generate an identification identifier corresponding to each to-be-uploaded virtual content according to the virtual content uploading instruction.

When the virtual content development end uploads the virtual content to be uploaded, the identification mark may be generated for the virtual content to be uploaded. Therefore, the virtual content display device can perform identifier detection processing on the to-be-uploaded content, so as to judge whether the to-be-uploaded virtual content has an identifier. And when the virtual content to be uploaded does not carry the identification mark, generating the identification mark for the virtual content to be uploaded. Specifically, the step of generating the identification identifier corresponding to each to-be-uploaded virtual content according to the virtual content uploading instruction includes:

carrying out identification detection processing on the virtual content to be uploaded;

when the virtual content to be uploaded does not carry the identification mark, identifying the virtual content to be uploaded to obtain the content information of the virtual content to be uploaded;

encrypting the content information to obtain encrypted content information;

and generating an identification mark based on the encrypted content information.

The content information of the virtual content may include information capable of embodying the characteristics of the virtual content. For example, when the virtual content is an image, the content information of the virtual content may include pixel values of the virtual content, color channel information, and the like. For another example, when the virtual content is text, the content information of the virtual content may include a font of the virtual content, a size of the text, semantic information of the text, and the like.

In an embodiment, when the virtual content to be uploaded carries the identification mark, the virtual content to be uploaded and the identification mark may be bound to obtain the bound virtual content. Then, configuring the at least one bound virtual content based on the configuration information to obtain at least one configured virtual content; and storing the at least one configured virtual content in a target virtual content storage library, and sending the identification to the virtual content development end.

In an embodiment, when the virtual content to be uploaded is subjected to the identification detection processing to obtain that the virtual content to be uploaded does not carry the identification identifier, the virtual content to be uploaded may be identified to obtain the content information of the virtual content to be uploaded. And then, encrypting the content information to obtain the encrypted content information. Next, an identification is generated based on the encrypted content information.

There may be a plurality of methods for identifying the virtual content to be uploaded.

For example, when the virtual content to be uploaded is an image, tools such as an Open Source Computer Vision Library (OpenCV) and the like may be used to identify the virtual content to be uploaded, so as to obtain content information of the virtual content to be uploaded.

OpenCV is a (open source) distribution-based cross-platform computer vision library, which can run on Linux, Windows, and Mac OS operating systems. The method is light and efficient, is composed of a series of C functions and a small number of C + + classes, provides interfaces of languages such as Python, Ruby, MATLAB and the like, and realizes a plurality of general algorithms in the aspects of image processing and computer vision.

For another example, when the virtual content to be uploaded is a text, the virtual content to be uploaded may be recognized by using a method such as Optical Character Recognition (OCR), so as to obtain content information of the virtual content to be uploaded.

In one embodiment, the virtual content to be uploaded may be in a variety of different formats. For example, some virtual content to be uploaded may be in the.3 ds format and some virtual content to be uploaded may be in the.ma format. Therefore, in order to improve the efficiency of processing the virtual content to be uploaded, the format of the virtual content to be uploaded can be converted, so that the virtual content after format conversion is obtained. Specifically, the step "when the virtual content to be uploaded does not carry the identification mark, identifying the virtual content to be uploaded to obtain the content information of the virtual content to be uploaded" includes:

when the virtual content to be uploaded does not carry the identification mark, carrying out format identification on the virtual content to be uploaded to obtain format information of the virtual content to be uploaded;

based on the format information of the virtual content to be uploaded, carrying out format conversion processing on the virtual content to be uploaded to obtain the virtual content after format conversion;

and performing content identification on the virtual content after format conversion to obtain content information.

In one embodiment, the virtual content to be uploaded generally has a corresponding name, and the name has a format suffix name of the virtual content to be uploaded. Therefore, the suffix name of the virtual content to be uploaded can be identified, and the format information of the virtual content to be uploaded is obtained.

For example, when the format of the virtual content to be uploaded is.3 ds, the suffix name of the virtual content to be uploaded will have the name of.3 ds. For another example, when the format of the virtual content to be uploaded is.ma, the suffix name of the virtual content to be uploaded will have the name of.ma. Therefore, the format information of the virtual content to be uploaded can be obtained by identifying the suffix name of the virtual content to be uploaded.

In an embodiment, after the format information of the virtual content to be uploaded is obtained, format conversion processing may be performed on the virtual content to be uploaded to obtain the virtual content after format conversion. For example, virtual content in the formats of.3 ds,. ma,. x,. 3dm,. c4d, and.obj, etc. may be converted into a VRML format or a WRL format.

The format conversion processing can be performed on the virtual content to be uploaded in various ways to obtain the format-converted virtual content. For example, format conversion software or a format conversion function may be adopted to perform format conversion processing on the virtual content to be uploaded, so as to obtain the format-converted virtual content. For another example, when the format of the virtual content to be uploaded cannot be directly converted into the target format, the format of the virtual content to be uploaded may be converted into the transition format, and then the format of the virtual content to be uploaded may be converted from the transition format into the target format.

In an embodiment, after obtaining the format-converted virtual content, content identification may be performed on the format-converted virtual content to obtain content information.

In an embodiment, in order to improve the reliability of the virtual content and the identification mark, avoid intentional destruction or theft of the abnormal part, and the like, the content information may be encrypted to obtain the encrypted content information.

For example, the content information may be encrypted by using a symmetric Algorithm (DES), an International Data Encryption Algorithm (IDEA), a Digital Signature Algorithm (DSA), or a Digest Algorithm (Message-Digest Algorithm, MD5), to obtain encrypted content information.

In an embodiment, after obtaining the encrypted content information, an identification may be generated based on the encrypted content information.

For example, when the identification mark is a two-dimensional code, the encrypted content information may be encoded to obtain encoded information. By encoding the encrypted content information, the encrypted content information can be converted into a binary numerical value, and then a two-dimensional code is generated based on binary data, so that the efficiency and the accuracy are improved. For example, when the encrypted content information is "0123456", the encrypted content information may be converted to "00010000001000000000110001010110011000011" by the encoding process. For another example, when the encrypted content information is "AC-42", the encrypted content information may be converted into "00100000001010011100111011100111001000010" by an encoding process.

The encoded information may then be normalized to obtain normalized information. For example, an end or padding may be added to the encoded information, a bit rearrangement may be performed, an error correction code may be added, and so on.

Next, a two-dimensional code may be generated based on the standardized information. For example, the data code and the error correction code in the standardized information may be alternately stacked, where 0 may be identified by a white square and 1 may be identified by a black square. The initial two-dimensional code may be generated by stacking. Next, a positioning Pattern and a reference line (Timing Pattern) may be added to the initial two-dimensional code, so as to obtain a target two-dimensional code.

In an embodiment, after the identification of the virtual content to be uploaded is generated, the virtual content to be uploaded and the identification may be bound to obtain the bound virtual content.

Because the identification mark is often an image, a memory required for storing the identification mark in the AR cloud platform is large. Therefore, after the identification mark of the virtual content to be uploaded is generated, the link information can be generated for the identification mark, the link information and the virtual content are bound, and the bound virtual content and the link information are stored in the AR cloud platform, so that the storage space is saved.

In an embodiment, after the bound virtual content is obtained, configuration processing may be performed on at least one bound virtual content based on the configuration information, so as to obtain at least one configured virtual content.

The configuration information may include permission configuration information, period configuration information, and distribution configuration information, so that the bound virtual content may be configured based on the permission configuration information, the period configuration information, and the distribution configuration information to obtain at least one configured virtual content. Specifically, the step of configuring the at least one bound virtual content based on the configuration information to obtain the at least one configured virtual content may include:

acquiring link information of the bound virtual content, wherein the link information represents an identification mark corresponding to the bound virtual content;

based on the authority configuration information, carrying out authority association processing on the bound virtual content and the link information to obtain the virtual content after authority association;

based on the periodic configuration information, performing periodic configuration processing on the virtual content and the link information after the authority association to obtain the virtual content after the periodic configuration;

and distributing and binding the periodically configured virtual content and the link information based on the distribution configuration information to obtain the configured virtual content.

In an embodiment, the step "performing, based on the permission configuration information, permission association processing on the bound virtual content and the link information to obtain the permission-associated virtual content" may include:

analyzing the authority configuration information to obtain at least one authority access condition;

and constructing a permission mapping relation between the link information and the virtual content to be uploaded based on the permission access condition to obtain the virtual content after permission association.

The access restriction condition may include a condition configured by the virtual content development end and restricting display of the virtual content. By limiting the access conditions, it may be limited what augmented reality clients will display what virtual content and what objects will display what virtual content.

For example, after the permission configuration information is analyzed, 5 permission access conditions are obtained, where the 5 permission access conditions are that the augmented reality client a corresponds to the virtual content 1 to be uploaded, the user group C in the augmented reality client B corresponds to the virtual content 2 to be uploaded, the user group D in the augmented reality client B corresponds to the virtual content 3 to be uploaded, the user group F in the augmented reality client B corresponds to the virtual content 4 to be uploaded, and the augmented reality client C corresponds to the virtual content 5 to be uploaded.

Therefore, based on the permission access condition, the virtual content display device can construct the permission mapping relation between the link information and the virtual content to be uploaded, and obtain the virtual content after permission association.

For example, when the right access condition is that the augmented reality client a corresponds to the virtual content 1 to be uploaded, the virtual content display apparatus may add a right mapping relationship between the augmented reality client a and the link information of the virtual content 1 in a preset mapping table.

For another example, when the right access condition is that the user group C in the augmented reality client B corresponds to the virtual content 2 to be uploaded, the virtual content display apparatus may add the link information of the augmented reality client B and the virtual content 2 and the right mapping relationship between the link information of the user group C and the virtual content 2 to the preset right mapping table.

In an embodiment, the step "performing, based on the periodic configuration information, periodic configuration processing on the virtual content and the link information after the authority association to obtain the periodically configured virtual content" may include:

analyzing the period configuration information to obtain a display period;

adding a publishing time point for the virtual content after the authority association based on the display period;

and establishing a publishing mapping relation between the link information and the virtual content after the authority association based on the publishing time point to obtain the periodically configured virtual content.

Wherein the display period includes information that plays a designated role in a display time of the virtual content. For example, the display period may be "virtual content 1: month 1, virtual content 2: month 2 ", which shows that the virtual content 1 is displayed at month 1 and the virtual content 2 is displayed at month 2. For another example, the display content may be "virtual content 1: day 14, 2 month, virtual content 2: day 1/10 month ", indicating that virtual content 1 will be displayed on day 14/2 month, and virtual content 2 will be displayed on day 1/10 month.

In an embodiment, after the display period is obtained, a publishing time point may be added to the virtual content after the rights association based on the display period.

For example, when the display period is "virtual content 1: 1 month ", a distribution time point of 1.1 to 1.31 may be added to the virtual content 1, showing that the virtual content 1 is displayed in the period of 1 month and 1 day to 1 month and 31 days. For another example, when the display period is "virtual content 1: day 2 month and 14 ", a distribution time point of 2.14 may be added to the virtual content 1, showing that the virtual content 1 is displayed in the period of day 2 month and 14.

In an embodiment, a publishing mapping relationship between the link information and the virtual content after the authority association may be established based on the publishing time point, so as to obtain the periodically configured virtual content.

For example, a publishing time point may be added to the virtual content after the link information and the rights are associated, so as to establish a publishing mapping relationship between the link information and the virtual content after the rights are associated.

For another example, the release mapping relationship between the link information and the virtual content after the rights association may be established in the preset time mapping table. The preset time mapping table has a time publishing point, so that the virtual content can be added with the link information and the authority association at the corresponding time publishing point.

In an embodiment, the step "performing distribution binding processing on the periodically configured virtual content and the link information based on the distribution configuration information to obtain the configured virtual content" may include:

analyzing the distribution configuration information to obtain at least one distribution object identifier and virtual content corresponding to the distribution object identifier;

binding at least one distribution object identifier and link information to obtain bound link information;

and constructing a distribution mapping relation between the bound link information and the periodically configured virtual content based on the virtual content corresponding to the distribution object identifier to obtain the configured virtual content.

The distribution configuration information may include information that the virtual content development end configures for a display scene of the virtual content. For example, advertisement virtual content is distributed for marks in a user group of the infant education APP, special commodity introduction virtual content is distributed for a VIP group in the shopping APP, and the like. Therefore, the distributed binding processing can be performed on the periodically configured virtual content and the link information based on the distribution configuration information, so as to obtain the configured virtual content.

In one embodiment, when the configuration information includes only the rights configuration information, the virtual content display apparatus may perform rights configuration only on the virtual content. For another example, when the configuration information includes only the rights configuration information or the period configuration information, the virtual content display apparatus may perform rights configuration and period configuration only on the virtual content, and the like. It should be noted that, the embodiment of the present application does not limit the configuration of the virtual content.

In an embodiment, after performing configuration processing on the bound virtual content, the virtual content display apparatus may store at least one configured virtual content in the target virtual content repository, and send the identification to the virtual content development end.

In an embodiment, since the AR cloud platform can manage different tenants, it can also manage different applications under the same tenant. Therefore, at least one preset development end information repository and a preset client end information repository corresponding to each preset development end information repository are arranged in the AR cloud platform. The preset development information storage library can store information of development terminals, and the preset client information storage library can store information of each development terminal in the clients. For example, the AR cloud platform has 2 preset development side information repositories, which are a preset development side information repository a and a preset development side information repository B, respectively. The preset development end information storage library a is used for storing the information of the virtual content development end a, and the preset development end information storage library B is used for storing the information of the virtual content development end B. The preset development end information repository a includes 3 preset client information repositories, which are a preset client information repository a1, a preset client information repository a2, and a preset client information repository A3. The preset client information repository a1 is configured to store information of the augmented reality client a1 in the virtual content development end a, the preset client information repository a2 is configured to store information of the augmented reality client a2 in the virtual content development end a, and the preset client information repository A3 is configured to store information of the augmented reality client A3 in the virtual content development end a.

Therefore, when the configured target virtual content is stored in the target virtual content repository, the development end information and the client end information of the configured virtual content can be obtained. Then, based on the developer information, a target developer information repository of configured virtual content is determined. Next, a target virtual content repository is determined in a preset client information repository of the target development side information repository based on the client information. Specifically, the step of storing at least one configured virtual content in the target virtual content repository includes:

acquiring development end information and client information of the configured virtual content;

determining a target development end information repository in at least one preset development end information repository based on development end information, wherein the target development end information repository comprises at least one preset client information repository;

screening out a target virtual content repository from at least one preset client information repository based on client information;

and storing the configured virtual content to a target virtual content storage library.

The development side information may include information indicating to which virtual content development side the virtual content belongs. The client information may specify to which augmented reality client of the virtual content originator the virtual content belongs.

In an embodiment, after the developer information and the client information of the configured virtual content are obtained, the developer information and the preset developer information may be matched, and a target developer information repository is determined in at least one preset developer information repository according to a matching result. Then, the client information and the preset client information can be matched, and the target virtual content repository is screened out from the preset client information repository in the target development end information repository according to the matching result. Next, the configured virtual content may be stored in a target virtual content store.

In an embodiment, the embodiment of the application allows the virtual content bound by the link information to be updated, so that different virtual contents can be displayed by a user scanning the same identification mark at different times. Specifically, the virtual content display method provided in the embodiment of the present application further includes:

receiving a binding relationship updating instruction, wherein the binding relationship updating instruction carries virtual content to be updated;

identifying the virtual content to be updated to obtain link information corresponding to the updated virtual content;

screening out virtual content corresponding to the link information from a target virtual content repository;

and updating the virtual content corresponding to the link information into the virtual content to be updated to obtain the updated virtual content.

In an embodiment, after the link information corresponding to the updated virtual content is obtained, the link information corresponding to the updated virtual content may be matched with the preset link information of the virtual content in the target virtual content library, and the virtual content corresponding to the link information may be screened out according to the matching result. Then, the virtual content corresponding to the link information may be updated to the virtual content to be updated, so as to obtain the updated virtual content. For example, the virtual content to be updated may replace the original virtual content.

In an embodiment, the embodiment of the present application further allows the configuration information of the virtual content to be changed, so that the authority mapping relationship, the publishing mapping relationship, and the distribution mapping relationship between the virtual content and the link information are changed. Specifically, the virtual content display method provided in the embodiment of the present application further includes:

receiving a configuration information updating instruction, wherein the configuration information updating instruction carries updating configuration information;

identifying the updated configuration information to obtain the identification information of the updated configuration information;

extracting virtual content to be configured and link information corresponding to the virtual content to be configured based on the identification information;

and based on the updating configuration information, performing configuration updating processing on the virtual content to be configured and the link information corresponding to the virtual content to be configured to obtain the virtual content after configuration updating.

Wherein, the update configuration information may include at least one of update authority configuration information, update cycle configuration information, and update distribution configuration information. For example, the update configuration information may include update right configuration information, update cycle configuration information, and update distribution configuration information. For another example, the update configuration information may include only the update authority configuration information, or only the update cycle configuration information, or only the update distribution configuration information. Also for example, the update configuration information may include update authority configuration information and update cycle configuration information

Wherein the identification information of the update configuration information may include information that specifies to which virtual content the update configuration information is directed.

In an embodiment, after the identification information is obtained, the virtual content to be configured and the link information corresponding to the virtual content to be configured may be extracted based on the identification information. And based on the update configuration information, performing configuration update processing on the virtual content to be configured and the link information corresponding to the virtual content to be configured to obtain the virtual content after configuration update.

For example, when the update configuration information may include update permission configuration information, update cycle configuration information, and update distribution configuration information, a permission mapping relationship, a distribution mapping relationship, and a distribution mapping relationship between the virtual content to be configured and the link information corresponding to the virtual content to be configured may be changed to obtain the configured and updated virtual content.

For another example, when the update configuration information may include the update permission configuration information, the permission mapping relationship between the virtual content to be configured and the link information corresponding to the virtual content to be configured may be modified to obtain the virtual content after configuration update.

The embodiment of the application provides a virtual content display method, which comprises the following steps: receiving a virtual content acquisition instruction triggered by an augmented reality client based on a target identification; analyzing the virtual content acquisition instruction to obtain authority identification information and target link information of a target identification; carrying out authority verification processing on the authority identification information; when the authority passes the verification, acquiring target virtual content corresponding to the target link information according to the mapping relation between the preset link information and the preset virtual content; and sending the target virtual content to the augmented reality client so that the augmented reality client displays the target virtual content. By the virtual content display method provided by the embodiment of the application, different target virtual contents can be displayed when different objects scan the same target identification mark, or different target virtual contents can be displayed when the same object scans the same target identification mark at different time. By the method provided by the embodiment of the application, one identification mark can be bound with a plurality of different virtual contents, so that an identification mark does not need to be generated for each virtual content, resources are saved, and the virtual content display efficiency is improved.

Secondly, the embodiment of the application can also receive a virtual content uploading instruction sent by the virtual content development end, wherein the virtual content uploading instruction carries at least one to-be-uploaded virtual content and configuration information corresponding to each to-be-uploaded virtual content; generating an identification mark corresponding to each virtual content to be uploaded according to the virtual content uploading instruction; binding the virtual content to be uploaded and the identification mark to obtain the bound virtual content; configuring the at least one bound virtual content based on the configuration information to obtain at least one configured virtual content; and storing the at least one configured virtual content in a target virtual content storage library, and sending the identification to the virtual content development end. According to the embodiment of the application, the AR cloud platform provides an instruction for configuring the virtual content for the virtual content development terminal, so that the authority mapping relation, the issuing mapping relation, the distribution configuration relation and the like of the virtual content and the link information can be configured. Through the AR cloud platform, the virtual content development end can enable the augmented reality client to rapidly realize the augmented reality function, and therefore the virtual content display efficiency is improved.

In addition, the virtual content display method provided by the embodiment of the application can support various augmented reality application scenes. For example, newspapers, magazines, education, children's animations, printed post-publication newspapers and magazines, are all disposable contents that do not refresh over time. By adopting the scheme, the two-dimension code can be directly issued, the annual fee is collected for the user, the operation platform of the system is configured with new content (pictures, videos and 3D animations) which are triggered and replaced monthly, so that the user can have the latest content to watch as long as scanning the fixed two-dimension code through the APP (login verification annual fee member). For another example, the method provided by the embodiment of the application can be applied to professional training with strong operability in machinery, medicine and the like. AR markers can be placed in the scene and operational steps such as car repair, surgery, etc. can be learned through the HMD head-mounted display.

The method described in the above examples is further illustrated in detail below by way of example.

The method of the embodiment of the present application will be described by taking an example in which the virtual content display method is integrated on a server.

In an embodiment, as shown in fig. 13, a method for displaying virtual content includes the following specific processes:

301. the server receives a virtual content uploading instruction sent by a virtual content development end, wherein the virtual content uploading instruction carries at least one to-be-uploaded virtual content and configuration information corresponding to each to-be-uploaded virtual content.

For example, a virtual content development end wants to develop an APP with augmented reality function. At this time, the virtual content development end may configure the virtual content through the AR cloud platform. For example, the virtual content originator may upload the virtual content to the AR cloud platform and configure the virtual content through the AR cloud platform.

When the virtual content development end uploads the virtual content to the AR cloud platform, the server receives a virtual content uploading instruction.

In an embodiment, the AR cloud platform provides a visual interface for the virtual content development end to configure the virtual content, so that after the virtual content development end uploads the virtual content to the AR cloud platform, the virtual content can be configured through the visual interface. Therefore, the server can also receive the virtual content to be uploaded and the configuration information corresponding to each virtual content to be uploaded.

302. And the server generates an identification mark corresponding to each virtual content to be uploaded according to the virtual content uploading instruction.

303. And the server binds the virtual content to be uploaded and the identification mark to obtain the bound virtual content.

304. And the server performs configuration processing on the at least one bound virtual content based on the configuration information to obtain at least one configured virtual content.

305. And the server stores the at least one configured virtual content into a target virtual content storage library and sends the identification to the virtual content development end.

After the server sends the identification to the virtual content development end, the virtual content development end can distribute the identification to the object subscribed to the service, so that the object can watch the virtual content provided by the virtual content development end on the augmented reality client.

306. And the server receives a virtual content acquisition instruction triggered by the augmented reality client based on the target identification.

Wherein the augmented reality client may be an APP developed by the virtual content developer.

The target identification mark is assumed to be a target two-dimensional code.

For example, when the object wants to watch the virtual content, the object may scan the target two-dimensional code through the APP, and at this time, the server may receive a virtual content obtaining instruction triggered by the augmented reality client based on the target two-dimensional code.

The SDK provided by the embodiment of the application is integrated in the augmented reality client, when an object can scan a target two-dimensional code through the APP, the SDK can identify the target two-dimensional code frame by frame, and calculate the three-dimensional posture and the perspective projection matrix of the target two-dimensional code. In addition, the SDK can also analyze the two-dimensional code to obtain the target link information of the two-dimensional code.

307. And the server analyzes the virtual content acquisition instruction to obtain the authority identification information and the target link information of the target identification.

308. And the server carries out authority verification processing on the authority identification information.

309. And when the authority passes the verification, the server acquires the target virtual content corresponding to the target link information according to the mapping relation between the preset link information and the preset virtual content.

310. The server sends the target virtual content to the augmented reality client to cause the augmented reality client to display the target virtual content.

The embodiment of the application provides a virtual content display method, which comprises the following steps: the method comprises the steps that a server receives a virtual content obtaining instruction triggered by an augmented reality client based on a target identification mark; the server analyzes the virtual content acquisition instruction to obtain authority identification information and target link information of a target identification; the server carries out authority verification processing on the authority identification information; when the authority passes the verification, the server acquires target virtual content corresponding to the target link information according to the mapping relation between the preset link information and the preset virtual content; the server sends the target virtual content to the augmented reality client to cause the augmented reality client to display the target virtual content. By the virtual content display method provided by the embodiment of the application, different target virtual contents can be displayed when different objects scan the same target identification mark, or different target virtual contents can be displayed when the same object scans the same target identification mark at different time. By the method provided by the embodiment of the application, one identification mark can be bound with a plurality of different virtual contents, so that an identification mark does not need to be generated for each virtual content, resources are saved, and the virtual content display efficiency is improved.

Secondly, the embodiment of the application can also realize that the server receives a virtual content uploading instruction sent by the virtual content development end, and the virtual content uploading instruction carries at least one to-be-uploaded virtual content and configuration information corresponding to each to-be-uploaded virtual content; the server generates an identification mark corresponding to each virtual content to be uploaded according to the virtual content uploading instruction; binding the virtual content to be uploaded and the identification mark to obtain the bound virtual content; the server carries out configuration processing on the at least one bound virtual content based on the configuration information to obtain at least one configured virtual content; and the server stores the at least one configured virtual content into a target virtual content storage library and sends the identification to the virtual content development end. According to the embodiment of the application, the AR cloud platform provides an instruction for configuring the virtual content for the virtual content development terminal, so that the authority mapping relation, the issuing mapping relation, the distribution configuration relation and the like of the virtual content and the link information can be configured. Through the AR cloud platform, the virtual content development end can enable the augmented reality client to rapidly realize the augmented reality function, and therefore the virtual content display efficiency is improved.

In order to better implement the virtual content display method provided by the embodiment of the present application, in an embodiment, a virtual content display apparatus is further provided, and the virtual content display apparatus may be integrated in a computer device. The terms are the same as those in the above virtual content display method, and details of implementation may refer to the description in the method embodiment.

In an embodiment, there is provided a virtual content display apparatus, which may be specifically integrated in a computer device, as shown in fig. 14, the virtual content display apparatus includes: the first receiving unit 401, the first parsing unit 402, the right verifying unit 403, the first obtaining unit 404, and the first sending unit 406 are specifically as follows:

a first receiving unit 401, configured to receive a virtual content obtaining instruction triggered by an augmented reality client based on a target identification;

a first parsing unit 402, configured to parse the virtual content obtaining instruction to obtain authority identification information and target link information of the target identification;

a permission verification unit 403, configured to perform permission verification processing on the permission identification information;

a first obtaining unit 404, configured to obtain, when the permission verification passes, a target virtual content corresponding to the target link information according to a permission mapping relationship between preset link information and preset virtual content;

a first sending unit 405, configured to send the target virtual content to the augmented reality client, so that the augmented reality client displays the virtual content.

In an embodiment, the first obtaining unit 404 includes:

In one embodiment, as shown in fig. 15, the virtual content display apparatus further includes:

a second receiving unit 501, configured to receive a virtual content upload instruction sent by a virtual content development end, where the virtual content upload instruction carries at least one to-be-uploaded virtual content and configuration information corresponding to each to-be-uploaded virtual content;

a generating unit 502, configured to generate, according to the virtual content uploading instruction, an identification identifier corresponding to each to-be-uploaded virtual content;

a binding unit 503, configured to perform binding processing on the to-be-uploaded virtual content and the identifier, so as to obtain bound virtual content;

a configuration unit 504, configured to perform configuration processing on the at least one bound virtual content based on the configuration information, so as to obtain at least one configured virtual content;

a storage unit 505, configured to store the at least one configured virtual content in a target virtual content repository, and send the identifier to the virtual content development end.

In an embodiment, the configuration unit 504 includes:

In one embodiment, the permission association subunit includes:

In one embodiment, the periodic configuration subunit includes:

In one embodiment, the distribution binding subunit includes:

In an embodiment, the generating unit 502 includes:

In one embodiment, the identifier unit comprises:

In one embodiment, the virtual content display apparatus further includes:

The embodiment of the present application further provides a computer device, where the computer device may include a terminal or a server, for example, the terminal may be a mobile phone, a tablet computer, or the like; also for example, the computer device may be a server, etc. As shown in fig. 16, it shows a schematic structural diagram of a terminal according to an embodiment of the present application, specifically:

the computer device may include components such as a processor 701 of one or more processing cores, memory 702 of one or more computer-readable storage media, a power supply 703, and an input unit 704. Those skilled in the art will appreciate that the computer device configuration illustrated in FIG. 16 does not constitute a limitation of computer devices, and may include more or fewer components than those illustrated, or some components may be combined, or a different arrangement of components. Wherein:

the processor 701 is a control center of the computer apparatus, connects various parts of the entire computer apparatus using various interfaces and lines, and performs various functions of the computer apparatus and processes data by running or executing software programs and/or modules stored in the memory 702 and calling data stored in the memory 702, thereby monitoring the computer apparatus as a whole. Optionally, processor 701 may include one or more processing cores; preferably, the processor 701 may integrate an application processor and a modem processor, wherein the application processor mainly handles operating system, user pages, application programs, and the like, and the modem processor mainly handles wireless communication. It will be appreciated that the modem processor described above may not be integrated into the processor 701.

The memory 702 may be used to store software programs and modules, and the processor 701 executes various functional applications and data processing by operating the software programs and modules stored in the memory 702. The memory 702 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data created according to use of the computer device, and the like. Further, the memory 702 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, the memory 702 may also include a memory controller to provide the processor 701 with access to the memory 702.

The computer device further includes a power supply 703 for supplying power to the various components, and preferably, the power supply 703 is logically connected to the processor 701 through a power management system, so that functions of managing charging, discharging, and power consumption are implemented through the power management system. The power supply 703 may also include any component including one or more of a dc or ac power source, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and the like.

The computer device may also include an input unit 704, the input unit 704 being operable to receive input numeric or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.

Although not shown, the computer device may further include a display unit and the like, which are not described in detail herein. Specifically, in this embodiment, the processor 701 in the computer device loads the executable file corresponding to the process of one or more application programs into the memory 702 according to the following instructions, and the processor 701 runs the application program stored in the memory 702, thereby implementing various functions as follows:

The above operations can be implemented in the foregoing embodiments, and are not described in detail herein.

According to an aspect of the application, a computer program product or computer program is provided, comprising computer instructions, the computer instructions being stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the method provided in the various alternative implementations of the above embodiments.

It will be understood by those skilled in the art that all or part of the steps of the methods of the above embodiments may be performed by a computer program, which may be stored in a computer-readable storage medium and loaded and executed by a processor, or by related hardware controlled by the computer program.

To this end, embodiments of the present application further provide a storage medium, in which a computer program is stored, where the computer program can be loaded by a processor to execute the steps in any one of the virtual content display methods provided in the embodiments of the present application. For example, the computer program may perform the steps of:

Since the computer program stored in the storage medium can execute the steps in any of the virtual content display methods provided in the embodiments of the present application, the beneficial effects that can be achieved by any of the virtual content display methods provided in the embodiments of the present application can be achieved, which are detailed in the foregoing embodiments and will not be described again here.

The foregoing detailed description is directed to a virtual content display method provided in an embodiment of the present application, and a specific example is applied in the detailed description to explain the principles and embodiments of the present application, and the description of the foregoing embodiment is only used to help understand the method and the core ideas of the present application; meanwhile, for those skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims

1. A method for displaying virtual content, comprising:

sending the target virtual content to the augmented reality client to enable the augmented reality client to display the target virtual content.

2. The method of claim 1, wherein when the authority verification passes, acquiring the target virtual content corresponding to the target link information according to a mapping relationship between preset link information and preset virtual content, comprises:

matching the target link information with the preset link information to obtain a matching result;

3. The method of claim 1, wherein the method further comprises:

and storing the at least one configured virtual content into a target virtual content storage library, and sending the identification to the virtual content development end.

4. The method of claim 3, wherein the configuration information includes rights configuration information, period configuration information, and distribution configuration information; the configuring the at least one bound virtual content based on the configuration information to obtain at least one configured virtual content includes:

based on the authority configuration information, carrying out authority association processing on the bound virtual content and the link information to obtain authority-associated virtual content;

5. The method of claim 4, wherein the performing, based on the permission configuration information, permission association processing on the virtual content to be uploaded and the link information to obtain virtual content after permission association comprises:

6. The method of claim 4, wherein the performing, based on the periodic configuration information, periodic configuration processing on the virtual content after the permission association and the link information to obtain a periodic configured virtual content comprises:

analyzing the period configuration information to obtain a display period;

7. The method of claim 4, wherein the performing distribution binding processing on the periodically configured virtual content and the link information based on the distribution configuration information to obtain the configured virtual content comprises:

binding the at least one distribution object identifier and the link information to obtain bound link information;

8. The method according to claim 3, wherein the generating an identification identifier corresponding to each virtual content to be uploaded according to the virtual content uploading instruction comprises:

when the virtual content to be uploaded does not carry an identification mark, identifying the virtual content to be uploaded to obtain content information of the virtual content to be uploaded;

encrypting the content information to obtain encrypted content information;

and generating the identification mark based on the encrypted content information.

9. The method of claim 8, wherein when the virtual content to be uploaded does not carry an identification mark, identifying the virtual content to be uploaded to obtain the content information of the virtual content to be uploaded comprises:

when the virtual content to be uploaded does not carry an identification mark, carrying out format identification on the virtual content to be uploaded to obtain format information of the virtual content to be uploaded;

based on the format information of the virtual content to be uploaded, carrying out format conversion processing on the virtual content to be uploaded to obtain format-converted virtual content;

and performing content identification on the format-converted virtual content to obtain the content information.

10. The method of claim 3, wherein said storing the at least one configured virtual content in a target virtual content store comprises:

acquiring development end information and client end information of the configured virtual content;

determining a target development side information repository in at least one preset development side information repository based on the development side information, wherein the target development side information repository comprises at least one preset client side information repository;

screening the target virtual content repository from the at least one preset client information base based on the client information;

storing the configured virtual content to the target virtual content repository.

11. The method of claim 3, wherein the method further comprises:

screening out virtual content corresponding to the link information from the target virtual content repository;

12. The method of claim 3, wherein the method further comprises:

13. A virtual content display apparatus, comprising:

14. An electronic device comprising a memory and a processor; the memory stores an application program, and the processor is configured to execute the application program in the memory to perform the operations of the virtual content display method according to any one of claims 1 to 12.

15. A computer readable storage medium storing instructions adapted to be loaded by a processor to perform the steps of the virtual content display method according to any one of claims 1 to 12.

16. A computer program product comprising a computer program or instructions, characterized in that the computer program or instructions, when executed by a processor, implement the steps in the virtual content display method of any of claims 1 to 12.