CN118840512A - Route display processing method and device based on AR - Google Patents

Abstract

The embodiments of this specification provide an AR-based route display processing method and device, wherein an AR-based route display processing method includes: performing AR scanning on an AR entity object configured at a preset location point, identifying the object image obtained by the scan and submitting the identified location code to a server; receiving and displaying a destination identification list returned by the server for the location code; submitting a user destination identification selected by the user through the destination identification list to the server; receiving and displaying an AR real scene image obtained by the server rendering a real scene map of the preset location point and a target guidance route.

Description

AR-based route display processing method and device

This invention patent application is a divisional application of the Chinese invention patent application with application date of January 19, 2021, application number 202110068710.8, and name “AR-based route display processing method and device”.

Technical Field

This document relates to the field of data processing technology, and in particular to an AR-based route display processing method and device.

Background Art

With the development of Internet technology and navigation technology, many applications on mobile terminals (such as navigation devices, mobile phones, tablet computers, etc.) can provide navigation services for users. For example, when a user is driving a vehicle, these applications can calculate a reasonable driving route and navigate for the user based on the user's current location and destination, which brings great convenience to the user's travel. A common one is AR navigation, which is a clever fusion of virtual information and real information. It simulates and applies virtual information such as computer-generated text and images to the real world, thereby achieving "enhancement" of the real world. It is to add real-time navigation information to real road conditions to guide users forward more intuitively.

Summary of the invention

One or more embodiments of the present specification provide an AR-based route display processing method. The AR-based route display processing method is applied to a user terminal, and includes: performing AR scanning on an AR entity object configured at a preset location point, identifying the object image obtained by the scan, and submitting the identified location code to a server. Receive and display a destination identification list returned by the server for the location code. Submit the user destination identification selected by the user through the destination identification list to the server. Receive and display an AR real scene image obtained by the server rendering the real scene map of the preset location point and the target guidance route.

One or more embodiments of the present specification provide an AR-based route guidance processing method, which is applied to a server, and includes: receiving a location code submitted by a user terminal after performing an AR scan and identifying an AR entity object configured at a preset location point. Based on the location code, determine a destination identification list corresponding to the preset location point and send it to the user terminal, and receive a user destination identification submitted by the user terminal. Determine a real-life image of the preset location point, and determine a target guidance route based on the preset location point and the user destination identification. Perform rendering processing based on the real-life image and the target guidance route, and send the rendered AR real-life image to the user terminal.

One or more embodiments of the present specification provide an AR-based route display processing device, which runs on a user terminal and includes: a location submission module, configured to perform an AR scan on an AR entity object configured at a preset location point, identify the object image obtained by the scan, and submit the identified location code to a server. A list display module, configured to receive and display a destination identification list returned by the server for the location code. A destination submission module, configured to submit a user destination identification selected by the user through the destination identification list to the server. An image display module, configured to receive and display an AR real-scene image obtained by the server rendering a real-scene map of the preset location point and a target guidance route.

One or more embodiments of the present specification provide an AR-based route guidance processing device, which runs on a server and includes: a location receiving module, configured to receive a location code submitted by a user terminal after performing AR scanning and identification on an AR entity object configured at a preset location point. A list sending module, configured to determine a destination identification list corresponding to the preset location point based on the location code and send it to the user terminal, and receive a user destination identification submitted by the user terminal. A route determination module, configured to determine a real-life image of the preset location point, and determine a target guidance route based on the preset location point and the user destination identification. An image rendering module, configured to perform rendering processing based on the real-life image and the target guidance route, and send the rendered AR real-life image to the user terminal.

One or more embodiments of the present specification provide an AR-based route display processing device, which is applied to a user terminal, including: a processor; and a memory configured to store computer-executable instructions, which, when executed, cause the processor to: perform an AR scan on an AR entity object configured at a preset location point, identify the scanned object image, and submit the identified location code to a server. Receive and display a destination identification list returned by the server for the location code. Submit the user destination identification selected by the user through the destination identification list to the server. Receive and display an AR real scene image obtained by the server rendering the real scene map of the preset location point and the target guidance route.

One or more embodiments of the present specification provide an AR-based route guidance processing device, which is applied to a server and includes: a processor; and a memory configured to store computer-executable instructions, which, when executed, cause the processor to: receive a location code submitted by a user terminal after performing an AR scan and identification on an AR entity object configured at a preset location point. Based on the location code, determine a destination identification list corresponding to the preset location point and send it to the user terminal, and receive a user destination identification submitted by the user terminal. Determine a real-life image of the preset location point, and determine a target guidance route based on the preset location point and the user destination identification. Perform rendering processing based on the real-life image and the target guidance route, and send the rendered AR real-life image to the user terminal.

One or more embodiments of the present specification provide a storage medium for storing computer-executable instructions, which implement the following process when executed: performing an AR scan on an AR physical object configured at a preset location point, identifying the object image obtained by the scan and submitting the identified location code to a server. Receive and display a destination identifier list returned by the server for the location code. Submit a user destination identifier selected by the user through the destination identifier list to the server. Receive and display an AR real scene image obtained by the server rendering a real scene map of the preset location point and a target guidance route.

One or more embodiments of the present specification provide another storage medium for storing computer-executable instructions, which implement the following process when executed: receiving a location code submitted by a user terminal after performing an AR scan and identification on an AR entity object configured at a preset location point. Based on the location code, determine a list of destination identifiers corresponding to the preset location point and send it to the user terminal, and receive a user destination identifier submitted by the user terminal. Determine a real-life image of the preset location point, and determine a target guidance route based on the preset location point and the user destination identifier. Perform rendering processing based on the real-life image and the target guidance route, and send the rendered AR real-life image to the user terminal.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to more clearly illustrate one or more embodiments of this specification or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in this specification. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

FIG1 is a processing flow chart of a route display processing method based on AR provided in one or more embodiments of this specification;

FIG2 is a schematic diagram of an AR entity object provided by one or more embodiments of this specification;

FIG3 is a schematic diagram of a destination recommendation page provided by one or more embodiments of this specification;

FIG4 is a schematic diagram of an AR real scene image provided by one or more embodiments of this specification;

FIG5 is a processing flow chart of an AR-based route display processing method applied to a subway station scene provided by one or more embodiments of this specification;

FIG6 is a processing flow chart of a route guidance processing method based on AR provided in one or more embodiments of this specification;

FIG7 is a processing flow chart of an AR-based route guidance processing method applied to a subway station scene provided by one or more embodiments of this specification;

FIG8 is a schematic diagram of an AR-based route display processing device provided by one or more embodiments of this specification;

FIG9 is a schematic diagram of an AR-based route guidance processing device provided by one or more embodiments of this specification;

FIG10 is a schematic diagram of the structure of an AR-based route display processing device provided by one or more embodiments of this specification;

FIG11 is a schematic diagram of the structure of an AR-based route guidance processing device provided in one or more embodiments of this specification.

DETAILED DESCRIPTION

In order to enable those skilled in the art to better understand the technical solutions in one or more embodiments of this specification, the technical solutions in one or more embodiments of this specification will be clearly and completely described below in conjunction with the drawings in one or more embodiments of this specification. Obviously, the described embodiments are only part of the embodiments of this specification, not all of them. Based on one or more embodiments of this specification, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of this document.

This specification provides an AR-based route display processing method embodiment:

Referring to Figure 1, it shows a processing flow chart of an AR-based route display processing method provided in the present embodiment, referring to Figure 2, it shows a schematic diagram of an AR entity object provided in the present embodiment, referring to Figure 3, it shows a schematic diagram of a destination recommendation page provided in the present embodiment, referring to Figure 4, it shows a schematic diagram of an AR real scene image provided in the present embodiment; referring to Figure 5, it shows a processing flow chart of an AR-based route display processing method provided in the present embodiment and applied to a subway station scene.

The execution subject of the AR-based route display processing method provided in this embodiment is the user terminal, and the execution subject of an AR-based route guidance processing method embodiment provided in this specification is the server. The AR-based route display processing method applied to the user terminal provided in this embodiment and the AR-based route guidance processing method applied to the server provided in the following method embodiment cooperate with each other during the execution process. Therefore, please refer to the corresponding content of the following method embodiment when reading this embodiment.

1 , the AR-based route display processing method provided in this embodiment is applied to a user terminal and specifically includes the following steps S102 to S108 .

Step S102: AR scan the AR entity object configured at the preset position point, identify the scanned object image and submit the identified position code to the server.

In actual applications, common navigation is affected by GPS positioning signals and, in some cases, data networks. For example, navigation may be delayed in areas with weak GPS signals, forcing users to look for locations with strong GPS signals or the routes recommended to users may deviate, giving users a poor user experience.

The AR-based route display processing method provided in the present embodiment provides users with clear and accurate indoor and outdoor information and route guidance through pre-shot real-life images and augmented reality. Specifically, the recommended destination information is determined based on the location information obtained after the user terminal performs an AR scan on an AR entity object configured at a preset location point. When the user selects the user destination through the user terminal, the AR real-life image and other display content displayed to the user are determined based on the user destination information and displayed to the user through the user terminal, thereby providing users with AR navigation, improving the effectiveness of guiding human traffic, saving user navigation time, and further improving user experience.

The preset position point (i.e., the preset anchor point) described in this embodiment refers to the specific location where the AR entity object is configured, that is, the shooting location of the real scene image; it should be noted that the preset position point described in this embodiment includes an indoor position point determined according to an appropriate position indoors. In addition, the preset position point can also be set up in certain special environments, such as subway stations, high-speed rail stations, shopping malls, etc. The AR entity object is a material that marks the position of the preset position point, including a label with a logo that can be posted in a subway station, as shown in Figure 2; it should be noted that this embodiment saves costs by posting the AR entity object. The position code of the AR entity object refers to the code of the position corresponding to the preset position point.

In a specific implementation, an AR scan is performed on an AR entity object at a preset location point, the scanned object image is identified, and the identified location code is submitted to the server. The server generates a query request based on the location code and sends it to a third-party server. The third-party server queries the destination identification list corresponding to the location code based on the query request and returns it to the server. The server receives the destination identification list and sends it to the user terminal.

For example, AR materials posted at anchor point 1 in the subway station are scanned by AR, and the object image obtained by the scan is identified to obtain a position code, which is then sent to the server. After receiving the position code, the server generates a query request based on the position code and sends it to a third-party server. The third-party server queries the destination identification list corresponding to anchor point 1 based on the query request and returns it to the server. The server receives the destination identification list and sends it to the user terminal.

In addition, during the AR scanning process, the user terminal can also perform AR scanning on the AR physical object to obtain scanning data, and send the scanning data to the server, and the server obtains the position code based on the scanning data, wherein the scanning data may include the object image obtained by the scan; after receiving the scanning data, the server detects whether the scanning data is associated with the pre-stored identification object. If so, the data is processed based on the associated identification object. If not, it indicates that the scanning data submitted by the user terminal has no associated identification object, and a reminder of scanning failure is sent to the user terminal.

Step S104: receiving and displaying a destination identifier list returned by the server for the location code.

The destination identifier list includes a list of recommended destination identifiers corresponding to the location code determined according to the location code.

In a specific implementation, the destination identifier list determined and sent by the receiving server based on the location code is received. In order to enhance the user's perception of the destination identifier and further enhance the user experience, the destination identifiers are displayed in a classified manner. In an optional implementation manner provided in this embodiment, the destination identifier list is received and displayed in the following manner:

receiving the destination identification list;

Classify the destination identifiers included in the destination identifier list according to preset classification conditions;

A destination recommendation page is generated and displayed based on the classification result of the classification process.

Specifically, the destination identification list sent by the server is received and classified according to the destination type. After the type is switched, the corresponding content is displayed first and the remaining content is folded.

As shown in Figure 3, the destination identification list determined and sent by the server according to the position code of anchor point 1 in the subway station includes 12 destination identifications, namely toilets, service center, convenience store, barrier-free elevator, Hall 4, Hall 5, West Registration Hall, visitor check-in counter, exhibitor check-in counter, commercial area inside the exhibition hall, bus hub and ticket purchase and recharge. In order to improve the intuitiveness of the displayed content, the destinations are divided into two categories, one is in-station services and the other is exhibition information. Among them, toilets, service center, convenience store and barrier-free elevator are in-station services, and Hall 4, Hall 5, West Registration Hall, visitor check-in counter, exhibitor check-in counter, commercial area inside the exhibition hall, bus hub and ticket purchase and recharge are exhibition information. The classification result is generated into a destination recommendation page for display. After the user selects the corresponding type, the corresponding destination identification is displayed.

It should be noted that the classification processing of the destination identifiers in the destination identifier list can also be performed by the server. Specifically, the server receives the destination identifier list sent by a third-party server and classifies the destination identifiers according to preset classification conditions, and then generates a destination recommendation page based on the results of the classification processing and sends it to the user terminal.

Step S106: submitting the user destination identifier selected by the user through the destination identifier list to the server.

The user destination identifier refers to the identifier of the destination selected by the user through the destination recommendation page displayed on the user terminal.

In the specific implementation, after the user uses AR scanning to scan the AR entity object at the preset location point, it jumps to the sub-application installed in the application and displays the destination recommendation page, that is, the destination selection page. The user can select the destination he wants to go to through the destination selection page. The user terminal submits the destination identifier selected by the user to the server. The server generates a query request with the preset location point as the starting point and the user destination identifier as the end point and sends it to the third-party server, then receives the route data packet returned by the third-party server, and then determines the target guidance route according to the route data packet.

For example, when the user selects the bus hub as the destination at anchor point 1, the user submits the identifier of the bus hub to the server. The server generates a query request with anchor point 1 as the starting point and the bus hub as the end point and sends it to the third-party server. The third-party server queries for the route data packet with anchor point 1 as the starting point and the bus hub as the end point and sends it to the server. The server receives the route data packet.

Step S108, receiving and displaying an AR real scene image obtained by rendering the real scene image of the preset location point and the target guidance route by the server.

The real-life map includes a 360-degree real-life map taken at the preset location; in addition, it may also include real-life maps taken at other angles. The target guidance route refers to a marking line with a direction mark that takes the preset location as the starting point and the location corresponding to the user destination identifier as the end point, as shown in 407 in Figure 4; optionally, the target guidance route is determined based on the preset location and the user destination identifier. In order to make the target guidance route more accurate, the target guidance route is rendered in the real-life map according to the determined route data. In an optional implementation provided by this embodiment, an AR real-life image obtained by the server rendering the real-life map and the target guidance route determined according to the route data packet of the target guidance route is received and displayed; wherein the target guidance route is a marking line with a direction mark, and the direction mark points from the preset location to the user destination identifier.

The AR real scene image refers to a real scene image obtained by rendering according to the real scene map and the identification line, and can display an image of the corresponding direction according to the direction of the user terminal. The AR real scene image is rendered with at least one of the following: a recommended destination logo, a recommended location point logo. In addition, in order to enable the user to have a more intuitive perception of the destination throughout the journey, an optional implementation provided by this embodiment receives and displays the AR real scene image rendered with a destination display area corresponding to the user destination logo; as shown in Figure 4, 401 is a destination display area; wherein the display content of the destination display area includes at least one of the following: the user destination logo, specific information of the user destination corresponding to the user destination logo, and the distance from the user destination. It should be noted that other prompt information can also be rendered in the AR real scene image, and the display content can also include other guidance information, such as the closest exit.

In order to enhance the user's perception of the AR real scene image and enable the user to perceive the AR real scene image more accurately in all directions, in an optional implementation provided by this embodiment, the AR real scene image is received and displayed in the following manner: first, the AR real scene image is received; then, the display area of the AR real scene image is adjusted based on the direction change data of the gyroscope of the user terminal, and the adjusted AR real scene image is displayed. In specific implementation, the gyroscope plug-in and compass plug-in embedded in the user terminal are used to determine the current orientation of the user terminal, and the AR real scene image of this direction is loaded, and when the positive direction of the user terminal is opposite to the target guidance route, the user is reminded to turn.

In actual applications, the user may change the destination or have other needs while moving forward. In order to enable the user to change the destination as needed during the display of the AR real scene image and further improve the user's perception of the environment, in an optional implementation manner provided in this embodiment, the AR real scene image is received and displayed in the following manner:

Receiving and displaying the AR real scene image rendered with a corresponding recommended destination identifier in a corresponding direction;

submitting a destination change request to the server when detecting that the recommended destination identifier is triggered;

Receive and display the recommended AR real scene image obtained by the server rendering the real scene image and the recommended guidance route.

In specific implementation, the AR real scene image is marked with other destination logos planned for recommendation, and the recommended destination logo needs to be visually weakened compared to the user destination logo or the next preset location point; the recommended destination logo is pre-existing in the real scene image and is displayed in the corresponding direction and at the corresponding position, and the recommended destination logo will be gradually displayed or gradually disappear according to the change of the direction of the user terminal. The user can switch the destination by clicking on the recommended destination logo displayed in the AR real scene image. When the user clicks on any recommended destination logo, the distance to the recommended point and the destination switching reminder are displayed to the user. When the user submits a confirmation instruction based on the switching reminder, a destination change request is submitted to the server. Based on the destination change request, the server renders the real scene image and the recommended guidance route determined with the preset location point as the starting point and the recommended destination logo as the end point, and sends the rendered recommended AR real scene image to the user terminal, which receives and displays the recommended AR real scene image according to the direction of the user terminal. It should be noted that when the recommended destination includes the user's destination, the recommended destination is not displayed.

As shown in FIG4 , the user uses the user terminal to perform an AR scan on the AR entity object at anchor point 1 in the subway station and selects the barrier-free elevator as the destination. The preset data resource package 1 with anchor point 1 as the starting point and the barrier-free elevator as the end point includes four recommended destinations: toilet, No. 1 ticket office, No. 1 bus stop and No. 4 exhibition hall. Therefore, the corresponding directions and positions in the AR real scene image displayed to the user are marked with the logos of the four recommended destinations. When the user triggers the destination logo 402 of the toilet, the distance to the toilet is displayed to the user and a change reminder is displayed. When the user triggers the confirmation instruction, a destination change request is submitted to the server. Based on the change request, the server queries the third-party server for a data resource package with anchor point 1 as the starting point and the toilet as the end point. The data resource package includes the distance, special information, route, and arrows marked in the route, etc., and rendering is performed according to the data resource package and the real scene image at anchor point 1, and the recommended AR real scene image obtained by rendering is sent to the user terminal. The user terminal determines the content of the recommended AR real scene image displayed according to the direction of the gyroscope.

In actual applications, due to building occlusion or other influencing factors, the real-life image taken at a preset location point cannot cover the entire area. In order to avoid showing the user an incomplete target guidance route through a real-life image of a single preset location point, thereby giving the user a bad route guidance experience, the corner is also taken as a preset location point for real-life image shooting, and the logo of the AR material at the corner is displayed in the process of showing the AR real-life image to the user. When the user submits a switching instruction, the location point of the corner is switched to the AR real-life image of the first location point. Specifically, in an optional implementation provided by this embodiment, the AR real-life image is received and displayed in the following manner:

Receiving and displaying a first identifier of an AR entity object rendered with a first position point and the AR real scene image of a first switching control; the first position point is a preset position point whose distance from the target guidance route is less than a preset threshold;

submitting a real scene image change request to the server when detecting that the first switching control is triggered;

Receive and display a first AR real scene image returned by the server; the first AR real scene image is obtained by rendering by the server a real scene image of the first location point and a first guidance route determined based on the first location point and the user destination identifier.

In specific implementation, when the user is driving along the target guidance route, if he passes through other preset location points, the logo of another preset location point closest to the current location point needs to be displayed in the AR real scene image, and the first switching control (i.e., forward control) can be triggered to switch to the next AR real scene image; specifically, when the first switching control is triggered, a real scene image change request is sent to the server, and the server receives the first AR real scene image rendered based on the real scene image change request. It should be noted that after the switch, the display content of the destination display area in the AR real scene image does not change, and the preset location point at the time of departure, that is, the information of the preset location point when performing AR scanning, is retained.

For example, a user uses a user terminal to perform an AR scan on the AR entity object at anchor point 1 in the subway station and selects an accessible elevator as the destination. The guidance route starting from anchor point 1 and ending at the barrier-free elevator passes through anchor point 2. In order to more intuitively display the guidance route to the barrier-free elevator, the material identification of anchor point 2 is displayed to the user. The user can switch to the AR real scene image corresponding to anchor point 2 by triggering the forward switch control.

In actual applications, in the process of going from the preset location point to the location corresponding to the user destination identifier, it may be necessary to pass through one or more intermediate location points, and the intermediate location point refers to the relay location point passed by the user on the path from the preset location point to the user destination. In order to enable the user to update to the intermediate location point in time and improve the user's perception of the guided route, in an optional implementation manner provided by this embodiment, when the target guided route passes through the intermediate location point, the intermediate identifier of the AR entity object at the intermediate location point and the first switching control are rendered in the AR real scene image;

submitting a first switching instruction to the server when detecting that the first switching control is triggered;

Receive and display the intermediate AR real scene image returned by the server based on the first switching instruction, wherein the intermediate AR real scene image is rendered based on the real scene image of the intermediate position point and the first guidance route determined with the intermediate position point as the starting point and the user destination identifier as the end point.

In order to avoid the AR real scene image being changed due to the user's wrong walking or misoperation, thereby affecting the user's experience of AR real scene image navigation, in an optional implementation manner provided by this embodiment, the first switching control and the second switching control are rendered in the intermediate AR real scene image;

submitting a second switching instruction to the server when detecting that the second switching control is triggered;

Receive and display the AR real scene image obtained by the server rendering the real scene map of the intermediate position point and the second guidance route determined based on the intermediate position point and the second position point.

During specific implementation, if there are multiple intermediate positions in the target guidance route, a text reminder needs to be rendered in the AR real scene image to remind the user that they can switch to view the AR real scene images of the intermediate positions; specifically, when the user terminal displays the starting AR real scene image, there needs to be a prompt in the starting AR real scene image to guide the user to the next intermediate position point, and a first switching control is configured, which switches to the intermediate AR real scene image after clicking; when the user terminal displays the intermediate AR real scene image, there needs to be a prompt in the intermediate AR real scene image to guide the user to the next intermediate position point or the ending position point, and the first switching control and the second switching control (i.e., the back control) are configured, and the first switching control switches to the next intermediate AR real scene image or the ending AR real scene image after clicking, and the second switching control switches to the previous intermediate AR real scene image or the starting AR real scene image after clicking.

As shown in FIG4 , the user uses the user terminal to perform an AR scan on the AR entity object at anchor point 1 in the subway station and selects the barrier-free elevator as the destination. The determined target guidance route with anchor point 1 as the starting point and the barrier-free elevator as the end point passes through three anchor points, namely anchor point 1, anchor point 3 and anchor point 4. When the starting AR real scene image of anchor point 1 is displayed to the user, the AR material identifier 403 and the forward control 404 of anchor point 3 are displayed to the user at the corresponding position. When the user triggers the forward control 404 on the starting AR real scene image display page, a forward switching instruction is submitted to the server, and the intermediate AR real scene image of anchor point 3 returned by the server based on the forward switching instruction is received; the AR material identifier 403 of anchor point 4 is displayed to the user at the position corresponding to the intermediate AR real scene image. The AR real scene image display page includes a forward control 404 and a back control 405. When the user triggers the forward control 404 on the middle AR real scene image display page, the forward switching instruction is submitted to the server, and the server returns the ending AR real scene image of the anchor point 4 based on the forward switching instruction. When the user triggers the back control 405 on the middle AR real scene image display page, the back switching instruction is submitted to the server, and the server returns the starting AR real scene image of the anchor point 1 based on the back switching instruction. The back control 405 is displayed in the ending AR real scene image. When the user triggers the back control on the ending AR real scene image display page, the back switching instruction is submitted to the server, and the server returns the middle AR real scene image of the anchor point 3 based on the back switching instruction.

It should be noted that in order to avoid user disgust caused by multiple recommended destinations in the starting AR real scene image and the intermediate AR real scene image and reduce the user experience, this embodiment provides an optional implementation mode. When the AR real scene image is the starting AR real scene image, an AR real scene image rendered with a recommended destination logo is received and displayed; when the AR real scene image is the intermediate AR real scene image, an AR real scene image without a recommended destination logo is received and displayed.

For example, recommended destination logos are rendered in the starting AR real-scene image, such as displaying four recommended destinations of the restroom, ticket office No. 1, bus stop No. 1 and exhibition hall No. 4 at the corresponding positions. However, when switching to the middle AR real-scene image or the terminating AR real-scene image, only the display content of the destination display area and the route and arrow information are displayed, and the recommended destination information is not displayed.

In addition, when receiving the AR real scene image, at least one of the following items sent by the server is also received: the intermediate AR real scene image, the recommended AR real scene image and the first AR real scene image. Therefore, when the recommended destination identifier rendered in the AR real scene image is triggered, the recommended AR real scene image obtained by rendering the real scene map and the recommended guidance route is displayed; when the first switching control rendered in the AR real scene image is triggered, the first AR real scene image of the first location point is displayed; the first AR real scene image is obtained by rendering the real scene map of the first location point and the first guidance route determined based on the first location point and the user destination identifier; wherein, the first location point is a preset location point whose distance from the target guidance route is less than a preset threshold.

It should be noted that, as shown in FIG. 4 , there is a navigation closing control 406 at the bottom of the AR real scene image. When the user clicks it, a new page is jumped, and an AR scanning entry control and an exit control are provided.

In conjunction with FIG5 , the AR-based route display processing method provided by this embodiment is further described by taking the application of the AR-based route display processing method provided by this embodiment in a subway station scene as an example. Referring to FIG5 , the AR-based route display processing method applied to a subway station scene specifically includes steps S502 to S516.

Step S502: Perform AR scanning on the AR materials configured at the preset anchor points in the subway station.

Step S504: Identify the scanned object image and submit the identified position code to the server.

Step S506: receiving the destination identification list sent by the server.

Step S508: classify the destination identifiers included in the destination identifier list.

Step S510: Generate and display a destination recommendation page based on the classification result of the classification process.

Step S512: submitting the user destination identifier selected by the user through the destination recommendation page to the server.

Step S514, receiving an AR real scene image obtained by the server rendering the real scene image of the preset anchor point and the target guidance route.

Step S516: adjust and display the AR real scene image according to the direction change data of the gyroscope.

To summarize, the AR-based route display processing method provided in this embodiment first performs an AR scan on the AR entity object configured at the preset location point, identifies the object image obtained by the scan and submits the identified location code to the server, then receives and displays the destination identification list determined and returned by the server for the location code, submits the user destination identification selected by the user through the destination identification list to the server, and finally receives and displays the AR real scene image obtained by the server rendering the real scene map of the preset location point and the target guidance route, thereby using the pre-stored information to provide AR navigation for the user terminal, so that the user can perceive the route information in a timely and accurate manner even in areas with weak GPS signals, thereby improving the convenience of the user, saving costs, and also improving the effectiveness of crowd control to a certain extent.

This specification provides an AR-based route guidance processing method embodiment:

Referring to FIG. 6 , a processing flow chart of an AR-based route guidance processing method provided in the present embodiment is shown, and referring to FIG. 7 , a processing flow chart of an AR-based route guidance processing method applied to a subway station scenario provided in the present embodiment is shown.

6 , the AR-based route guidance processing method provided in this embodiment is applied to a server and specifically includes the following steps S602 to S608 .

Step S602: receiving a position code submitted by a user terminal after performing AR scanning and recognition on an AR entity object configured at a preset position point.

The AR-based route guidance processing method provided in this embodiment provides users with clear and accurate indoor and outdoor information and route guidance through pre-shot real-life images and augmented reality. Specifically, after performing an AR scan on an AR entity object configured at a preset location point according to the user terminal, the location information submitted by the user terminal is received, and the recommended destination information is determined to a third-party server based on the location information. When the user selects the user destination through the user terminal, the AR real-life image and other display content to be displayed to the user are determined to the third-party server based on the user destination information and displayed to the user through the user terminal, thereby providing users with AR navigation, improving the effectiveness of guiding human traffic, saving user navigation time, and further improving user experience.

The preset position point (i.e., the preset anchor point) described in this embodiment refers to the specific location where the AR entity object is configured, that is, the shooting location of the real scene image; it should be noted that the preset position point described in this embodiment includes an indoor position point determined according to an appropriate position indoors. In addition, the preset position point can also be set up in certain special environments, such as subway stations, high-speed rail stations, shopping malls, etc. The AR entity object is a material that marks the position of the preset position point, including a label with a logo that can be posted in a subway station, as shown in Figure 2; it should be noted that this embodiment saves costs by posting the AR entity object. The position code of the AR entity object refers to the code of the position corresponding to the preset position point.

In a specific implementation, the user terminal performs an AR scan on an AR entity object at a preset location point, identifies the object image obtained by the scan and submits the identified location code to the server, which receives the location code obtained and submitted by the user terminal after identifying the object image obtained by the AR scan of the AR entity object.

For example, the user terminal AR scans the AR material posted at the anchor point 1 in the subway station, and receives the position code obtained and submitted after the user terminal recognizes the object image obtained by the AR scanning of the AR material.

In addition, the system can also receive scan data obtained and submitted by a user terminal through AR scanning of an AR entity object, and obtain a position code based on the scan data, wherein the scan data may include an image of the object obtained by the scan; after receiving the scan data, it is detected whether the scan data is associated with a pre-stored identification object. If so, data processing is performed based on the associated identification object. If not, it indicates that the scan data submitted by the user terminal has no associated identification object, and a reminder of scan failure is sent to the user terminal.

Step S604: based on the location code, determine a destination identifier list corresponding to the preset location point, send the list to the user terminal, and receive a user destination identifier submitted by the user terminal.

The destination identifier list includes a list of recommended destination identifiers corresponding to the location code determined according to the location code; the user destination identifier refers to the identifier of the destination selected by the user through the destination recommendation page displayed on the user terminal.

In specific implementation, the destination identification list is established and stored by a third-party server. In order to realize data communication so that the user terminal can perceive the destination identification list, in an optional implementation manner provided by this embodiment, based on the location code, the destination identification list corresponding to the preset location point is determined and sent to the user terminal. During the execution process, the following operations are specifically performed:

Generate a query request based on the location code and send it to a third-party server; the third-party server queries a destination identifier list corresponding to the location code based on the query request and returns it to the server;

The destination identification list returned by the third-party server is received and sent to the user terminal.

For example, a query request is generated based on the location code of anchor point 1 in the subway station and sent to a third-party server. The third-party server finds that the destination identification list corresponding to anchor point 1 includes 12 destination identifications, namely, toilets, service centers, convenience stores, barrier-free elevators, Hall 4, Hall 5, West Registration Hall, visitor check-in counter, exhibitor check-in counter, commercial area within the exhibition hall, bus hub, and ticket purchase and recharge. The 12 destination identifications are sent to the server in the form of a list. When the server receives the destination identification list, it sends the destination identification list to the user terminal.

When the user terminal receives the destination identification list, in order to enhance the user's perception of the destination identification and further enhance the user experience, the destination identification will be displayed in a classified manner; the destination identification will be classified according to the destination type, and after the type is switched, the corresponding content will be displayed first, and the remaining content will be folded. It should be noted that the classification processing of the destination identification in the destination identification list can also be performed by the server. Specifically, the destination identification list sent by the third-party server is received and the destination identification is classified according to the preset classification conditions, and then a destination recommendation page is generated based on the results of the classification processing and sent to the user terminal.

In the specific implementation, after the user uses AR scanning to scan the AR physical object at the preset location point, it jumps to the sub-application installed in the application and displays the destination recommendation page, that is, the destination selection page. The user can select the destination he wants to go through the destination selection page. In order to provide the user with difficult route guidance, the user destination identifier selected by the user submitted by the user terminal is received.

Step S606, determining a real-life image of the preset location point, and determining a target guidance route according to the preset location point and the user destination identifier.

The real scene image includes a 360-degree real scene image taken at the preset location point; in addition, it may also include a real scene image taken at other angles. In an optional implementation provided by this embodiment, the real scene image is determined in the following manner: first, a real scene image query request is generated based on the location code and sent to a third-party server; then, the real scene image returned by the third-party server based on the real scene image query request is received.

The target guidance route is determined based on the preset location point and the user destination identifier, and refers to a marked line with a direction identifier determined with the preset location point as the starting point and the location corresponding to the user destination identifier as the end point; the target guidance route refers to a marked line with a direction identifier determined with the preset location point as the starting point and the location corresponding to the user destination identifier as the end point. In an optional implementation provided by this embodiment, the target guidance route is determined in the following manner: first, a query request is generated with the preset location point as the starting point and the user destination identifier as the end point and sent to a third-party server; then, a route data packet of the target guidance route returned by the third-party server is received; and finally, the target guidance route is determined based on the route data packet.

Continuing with the above example, the user selects the bus hub as the destination, receives the preset location point location code and the user destination identifier sent by the user terminal, generates a query request with anchor point 1 as the starting point and the bus hub as the end point, and generates a real-life map query request with the location code of anchor point 1 and sends it to a third-party server. The third-party server queries the route data packet with anchor point 1 as the starting point and the bus hub as the end point, as well as the real-life map of anchor point 1, and sends them to the server. The server receives the route data packet and determines the target guidance route based on the route data packet. In addition, a query request can be generated based on the anchor point number of anchor point 1 and sent to the third-party server to receive the corresponding real-life map and the target guidance route.

It should be noted that the determination of the real-life image and the determination of the target guidance route can be queried to a third-party server through a query request. For example, a query request with a preset location point as the starting point and a location corresponding to the user destination identifier as the end point is generated and sent to the third-party server, the real-life image of the preset location point and the route data packet returned by the third-party server are received, and the target guidance route is determined based on the route data packet. For another example, a query request is generated with the location number of the preset location point and the user destination identifier and sent to the third-party server, the real-life image of the preset location point and the route data packet returned by the third-party server are received, and the target guidance route is determined based on the route data packet.

In addition, the information of the preset location points exists in the third-party server in the form of multiple data resource packages. For each preset location point, the corresponding destination identifier and at least one data resource package corresponding to each destination identifier are stored. If there are intermediate location points, the intermediate data resource package is also stored; the data resource package includes at least one of the following: destination description, distance, specific information, navigation line, arrow and recommended destination identifier. In the process of querying the third-party server for the list of destination identifiers corresponding to the preset location points, all information corresponding to the preset location points returned by the third-party server can be received, and then the corresponding target guidance route can be determined according to the user destination identifier submitted by the user terminal.

Step S608: Rendering is performed based on the real scene image and the target guidance route, and the rendered AR real scene image is sent to the user terminal.

The AR real-scene image refers to a real-scene image obtained by rendering according to the real-scene map and the identification line, and can display an image in the corresponding direction according to the direction of the user terminal. The AR real-scene image is rendered with at least one of the following: a recommended destination logo, a recommended location point logo. In addition, in order to enable the user to have a more intuitive perception of the destination throughout the entire journey, an optional implementation provided by this embodiment is to send the AR real-scene image rendered with the destination display area corresponding to the user destination logo to the user terminal; wherein the display content of the destination display area includes at least one of the following: the user destination logo, specific information of the user destination corresponding to the user destination logo, and the distance to the user destination. It should be noted that other prompt information can also be rendered in the AR real-scene image, and the display content can also include other guidance information, such as the nearest exit.

In actual applications, the user may change the destination or have other needs while moving forward. In order to enable the user to change the destination as needed during the display of the AR real scene image and further improve the user's perception of the environment, in an optional implementation manner provided in this embodiment, the rendered AR real scene image is sent to the user terminal through the following steps:

Sending the AR real scene image rendered with the corresponding recommended destination identifier in the corresponding direction to the user terminal;

receiving a destination change request submitted by the user terminal when the recommended destination identifier is triggered;

Rendering is performed based on the real scene image and the recommended guidance route, and the recommended AR real scene image obtained by rendering is sent to the user terminal.

In specific implementation, the AR real scene image is marked with other destination logos that are planned to be recommended, and the recommended destination logo needs to be visually weakened compared to the user destination logo or the next preset location point; the recommended destination logo is pre-existing in the real scene image and is displayed in the corresponding direction and at the corresponding position, and the recommended destination logo will gradually display or disappear according to the change of the direction of the user terminal. The user can switch the destination by clicking on the recommended destination logo displayed in the AR real scene image. When the user clicks on any recommended destination logo, the distance to the recommended point and the destination switching reminder are displayed to the user. When the user submits a confirmation instruction based on the switching reminder, a destination change request submitted by the user terminal is received. Based on the destination change request, the real scene image and the recommended guide route determined with the preset location point as the starting point and the recommended destination logo as the end point are rendered, and the recommended AR real scene image obtained by rendering is sent to the user terminal, and the user terminal receives and displays the recommended AR real scene image according to the direction of the user terminal. It should be noted that in the case where the recommended destination includes the user destination, the recommended destination is not displayed.

For example, a user uses a user terminal to perform an AR scan on the AR entity object at anchor point 1 in the subway station and selects an accessible elevator as the destination. The preset data resource package 1 with anchor point 1 as the starting point and the accessible elevator as the end point includes four recommended destinations: the toilet, ticket office No. 1, bus stop No. 1 and exhibition hall No. 4. Therefore, the corresponding directions and positions in the AR real-scene image displayed to the user are marked with the logos of the four recommended destinations. When the user triggers the destination logo of the toilet, a destination change request submitted by the user terminal is received. Based on the change request, a data resource package with anchor point 1 as the starting point and the toilet as the end point is queried from a third-party server. The data resource package includes distance, special information, route, and arrows marked in the route, etc., and rendering is performed based on the data resource package and the real-scene image at anchor point 1, and the recommended AR real-scene image obtained by rendering is sent to the user terminal. The user terminal determines the content of the recommended AR real-scene image displayed according to the direction of the gyroscope.

In actual applications, due to building occlusion or other influencing factors, the real scene image taken at a preset location point cannot cover the entire area. In order to avoid showing the user an incomplete target guidance route through the real scene image of a single preset location point, thereby bringing a bad route guidance experience to the user, in an optional implementation manner provided by this embodiment, a first identifier of an AR entity object at a first location point and the AR real scene image of a first switching control are rendered in the AR image; the first location point is a preset location point whose distance from the target guidance route is less than a preset threshold;

When the first switching control is triggered, receiving a real scene image change request submitted by the user terminal;

Based on the real scene image change request, the real scene image of the first location point and the first guidance route determined based on the first location point and the user destination identifier are rendered, and the first AR real scene image obtained by rendering is sent to the user terminal.

In specific implementation, when the user is driving along the target guidance route, if he passes through other preset location points, it is necessary to render the logo of another preset location point closest to the current location point in the AR real scene image, and switch to the next AR real scene image by triggering the first switching control (i.e., forward control); specifically, when the first switching control is triggered, a real scene image change request sent by the user terminal is received, and based on the real scene image change request, the first AR real scene image is rendered and sent to the user terminal. It should be noted that after the switch, the display content of the destination display area in the AR real scene image does not change, and the preset location point at the time of departure, that is, the information of the preset location point when performing AR scanning, is retained.

For example, a user uses a user terminal to perform an AR scan on the AR entity object at anchor point 1 in a subway station and selects an accessible elevator as the destination. The guidance route starting from anchor point 1 and ending at the barrier-free elevator passes through anchor point 2. In order to more intuitively display the guidance route to the barrier-free elevator, the material identification of anchor point 2 is displayed to the user. The user can switch to the AR real scene image corresponding to anchor point 2 by triggering the forward switch control.

In actual applications, in the process of going from the preset location point to the location corresponding to the user destination identifier, it may be necessary to pass through one or more intermediate location points, and the intermediate location point refers to the relay location point passed by the user in the path from the preset location point to the user destination. In order to enable the user to update to the intermediate location point in time and improve the user's perception of the guidance route, in an optional implementation manner provided by this embodiment, when the target guidance route passes through the intermediate location point, the intermediate identifier of the AR entity object at the intermediate location point and the first switching control are rendered in the AR real scene image;

When the first switching control is triggered, receiving a first switching instruction submitted by the user terminal;

Based on the first switching instruction, the real scene image of the intermediate position point and the first guidance route determined with the intermediate position point as the starting point and the user destination identifier as the end point are rendered, and the rendered intermediate AR real scene image is sent to the user terminal.

In order to avoid the AR real scene image being changed due to the user's wrong walking or misoperation, thereby affecting the user's experience of AR real scene image navigation, in an optional implementation manner provided by this embodiment, the first switching control and the second switching control are rendered in the intermediate AR real scene image;

receiving a second switching instruction submitted by the user terminal when detecting that the second switching control is triggered;

Based on the second switching instruction, the real scene image of the intermediate position point and the second guidance route determined based on the intermediate position point and the second position point are rendered, and the rendered AR real scene image is sent to the user terminal.

During specific implementation, if there are multiple intermediate positions in the target guidance route, a text reminder needs to be rendered in the AR real scene image to remind the user that they can switch to view the AR real scene images of the intermediate positions; specifically, when the user terminal displays the starting AR real scene image, there needs to be a prompt in the starting AR real scene image to guide the user to the next intermediate position point, and a first switching control is configured, which switches to the intermediate AR real scene image after clicking; when the user terminal displays the intermediate AR real scene image, there needs to be a prompt in the intermediate AR real scene image to guide the user to the next intermediate position point or the ending position point, and the first switching control and the second switching control (i.e., the back control) are configured, and the first switching control switches to the next intermediate AR real scene image or the ending AR real scene image after clicking, and the second switching control switches to the previous intermediate AR real scene image or the starting AR real scene image after clicking.

For example, a user uses a user terminal to perform an AR scan on the AR entity object at anchor point 1 in the subway station and selects an accessible elevator as the destination. The determined target guidance route with anchor point 1 as the starting point and the accessible elevator as the end point passes through three anchor points, namely anchor point 1, anchor point 3 and anchor point 4. When the starting AR real scene image of anchor point 1 is displayed to the user, the AR material identifier and forward control of anchor point 3 are displayed to the user at the corresponding position. When the user triggers the forward control on the starting AR real scene image display page, a forward switching instruction submitted by the user terminal is received, and an intermediate AR real scene image of anchor point 3 determined based on the forward switching instruction is sent to the user terminal; the AR material identifier and forward control of anchor point 4 are displayed to the user at the position corresponding to the intermediate AR real scene image. Control and back control, when the user triggers the forward control on the intermediate AR real-scene image display page, receive the forward switching instruction submitted by the user terminal, and send the terminating AR real-scene image of the anchor point 4 determined based on the forward switching instruction to the user terminal; when the user triggers the back control on the intermediate AR real-scene image display page, receive the back switching instruction submitted by the user terminal, and send the starting AR real-scene image of the anchor point 1 determined based on the back switching instruction to the user terminal; display the back control in the terminating AR real-scene image, when the user triggers the back control on the terminating AR real-scene image display page, receive the back switching instruction submitted by the user terminal, and send the intermediate AR real-scene image of the anchor point 3 determined based on the back switching instruction to the user terminal.

It should be noted that in order to avoid user disgust caused by multiple recommended destinations in the starting AR real scene image and the intermediate AR real scene image and reduce the user experience, this embodiment provides an optional implementation mode. When the AR real scene image is the starting AR real scene image, an AR real scene image rendered with a recommended destination logo is sent to the user terminal; when the AR real scene image is the intermediate AR real scene image, an AR real scene image without a recommended destination logo is sent to the user terminal.

Continuing with the above example, the recommended destination logo is rendered in the starting AR real-scene image, such as displaying the four recommended destinations of restroom, ticket office No. 1, bus stop No. 1 and exhibition hall No. 4 at the corresponding positions. However, when switching to the middle AR real-scene image or the ending AR real-scene image, only the display content of the destination display area and the route and arrow information are displayed, and the recommended destination information is not displayed.

In conjunction with FIG7 , the AR-based route display processing method provided by this embodiment is further described by taking the application of the AR-based route display processing method provided by this embodiment in a subway station scene as an example. Referring to FIG7 , the AR-based route display processing method applied to a subway station scene specifically includes steps S702 to S714.

Step S702: receiving a position code of a preset anchor point submitted by a user terminal.

Step S704: query a third-party server for a destination identification list according to the location code.

Step S706: Send the destination identification list to the user terminal.

Step S708: receiving a user destination identifier submitted by the user terminal.

Step S710, taking the preset anchor point as the starting point and the user destination identifier as the end point, querying a third-party server for a real-view image and a route data packet.

Step S712, determining the target guidance route according to the route data packet.

Step S714: Render the real scene image and the target guidance route, and send the rendered AR real scene image to the user terminal.

To summarize, the AR-based route display processing method provided in this embodiment first receives the location code submitted by the user terminal after AR scanning and identification of the AR entity object configured at the preset location point, and then determines the destination identification list corresponding to the preset location point based on the location code and sends it to the user terminal, and receives the user destination identification submitted by the user terminal, and then determines the real scene map of the preset location point and determines the target guidance route according to the preset location point and the user destination identification, and finally performs rendering processing based on the real scene map and the target guidance route, and sends the rendered AR real scene image to the user terminal, so as to provide AR navigation for users in areas with weak GPS signals, improve the user experience of AR navigation, and save costs by pre-shooting real scene maps.

An embodiment of an AR-based route display processing device provided in this specification is as follows:

In the above-mentioned embodiment, an AR-based route display processing method applied to a user terminal is provided. Correspondingly, an AR-based route display processing device running on a user terminal is also provided, which is described below in conjunction with the accompanying drawings.

Referring to FIG. 8 , it shows a schematic diagram of an AR-based route display processing device provided in this embodiment.

Since the device embodiment corresponds to the method embodiment, the description is relatively simple, and the relevant parts can refer to the corresponding description of the method embodiment provided above. The device embodiment described below is only illustrative.

This embodiment provides an AR-based route display processing device, which runs on a user terminal and includes:

The position submission module 802 is configured to perform AR scanning on the AR physical object configured at the preset position point, identify the scanned object image and submit the identified position code to the server;

A list display module 804 is configured to receive and display a destination identification list returned by the server for the location code;

A destination submission module 806, configured to submit the user destination identifier selected by the user through the destination identifier list to the server;

The image display module 808 is configured to receive and display the AR real scene image obtained by the server rendering the real scene image of the preset location point and the target guidance route.

Optionally, the target guidance route is determined based on the preset location point and the user destination identifier; wherein the target guidance route is a marked line with a direction identifier that takes the preset location point as a starting point and ends at the user destination identifier.

Optionally, the image display module 808 includes:

The data packet determination submodule is configured to receive and display an AR real scene image obtained by the server rendering the real scene map and the target guidance route determined according to the route data packet of the target guidance route; wherein, the target guidance route is a marking line with a direction mark, and the direction mark points from the preset position point to the user destination mark.

Optionally, the image display module 808 includes:

The display area display submodule is configured to receive and display the AR real scene image rendered with the destination display area corresponding to the user destination identifier; wherein the display content of the destination display area includes at least one of the following: the user destination identifier, specific information of the user destination corresponding to the user destination identifier, and the distance between the user destination and the destination.

Optionally, the image display module 808 includes:

An image receiving submodule, configured to receive the AR real scene image;

The direction determination submodule is configured to adjust the display area of the AR real scene image based on the direction change data of the gyroscope of the user terminal, and display the adjusted AR real scene image.

Optionally, the list display module 804 includes:

A list receiving submodule, configured to receive the destination identification list;

A classification submodule, configured to classify the destination identifiers included in the destination identifier list according to a preset classification condition;

The recommendation page generation submodule is configured to generate and display a destination recommendation page based on the classification result of the classification process.

Optionally, the image display module 808 includes:

A recommendation mark display submodule is configured to receive and display the AR real scene image rendered with a corresponding recommended destination mark in a corresponding direction;

a destination change request submission submodule, configured to submit a destination change request to the server when detecting that the recommended destination identifier is triggered;

The recommended image receiving submodule is configured to receive and display the recommended AR real scene image obtained by the server rendering the real scene image and the recommended guidance route.

Optionally, the image display module 808 includes:

A location point identification display submodule is configured to receive and display a first identification of an AR entity object rendered with a first location point and the AR real scene image of a first switching control; the first location point is a preset location point whose distance from the target guidance route is less than a preset threshold;

An image change request submission submodule is configured to submit a real-view image change request to the server when detecting that the first switching control is triggered;

The first image receiving submodule is configured to receive and display a first AR real scene image returned by the server; the first AR real scene image is obtained by the server rendering a real scene image of the first location point and a first guidance route determined based on the first location point and the user destination identifier.

Optionally, the target guidance route passes through the middle position point; a middle mark of an AR entity object at the middle position point and a first switching control are rendered in the AR real scene image;

submitting a first switching instruction to the server when detecting that the first switching control is triggered;

Receive and display the intermediate AR real scene image returned by the server based on the first switching instruction, wherein the intermediate AR real scene image is rendered based on the real scene image of the intermediate position point and the first guidance route determined with the intermediate position point as the starting point and the user destination identifier as the end point.

Optionally, the first switching control and the second switching control are rendered in the intermediate AR real scene image;

submitting a second switching instruction to the server when detecting that the second switching control is triggered;

Receive and display the AR real scene image obtained by the server rendering the real scene map of the intermediate position point and the second guidance route determined based on the intermediate position point and the second position point.

Optionally, the image display module 808 includes:

a starting image receiving submodule, configured to receive and display an AR real scene image rendered with a recommended destination identifier when the AR real scene image is a starting AR real scene image;

The intermediate image receiving submodule is configured to receive and display the AR real scene image without rendering the recommended destination mark when the AR real scene image is an intermediate AR real scene image.

Optionally, the AR-based route display processing device further includes:

A recommended image display module is configured to display a recommended AR real scene image obtained by rendering the real scene image and the recommended guidance route when the recommended destination identifier rendered in the AR real scene image is triggered;

The first image display module is configured to display a first AR real-scene image of a first location point when a first switching control rendered in the AR real-scene image is triggered; the first AR real-scene image is obtained by rendering a real-scene image of the first location point and a first guidance route determined based on the first location point and the user destination identifier; wherein the first location point is a preset location point whose distance from the target guidance route is less than a preset threshold.

An embodiment of an AR-based route guidance processing device provided in this specification is as follows:

In the above-mentioned embodiment, an AR-based route guidance processing method applied to a server is provided, and correspondingly, an AR-based route guidance processing device running on the server is also provided, which is described below with reference to the accompanying drawings.

Referring to FIG. 9 , it shows a schematic diagram of an AR-based route guidance processing device provided in this embodiment.

Since the device embodiment corresponds to the method embodiment, the description is relatively simple, and the relevant parts can refer to the corresponding description of the method embodiment provided above. The device embodiment described below is only illustrative.

This embodiment provides an AR-based route guidance processing device, which runs on a server and includes:

The position receiving module 902 is configured to receive a position code submitted by a user terminal after performing AR scanning and recognition on an AR entity object configured at a preset position point;

The list sending module 904 is configured to determine the destination identifier list corresponding to the preset location point based on the location code and send it to the user terminal, and receive the user destination identifier submitted by the user terminal;

The route determination module 906 is configured to determine a real view of the preset location point, and determine a target guidance route according to the preset location point and the user destination identifier;

The image rendering module 908 is configured to perform rendering processing based on the real scene image and the target guidance route, and send the rendered AR real scene image to the user terminal.

Optionally, the position receiving module 902 is specifically configured to receive a position code obtained and submitted after the user terminal recognizes an object image obtained by performing AR scanning on the AR entity object.

Optionally, the list sending module 904 includes:

A request generation submodule is configured to generate a query request based on the location code and send it to a third-party server; the third-party server queries a destination identifier list corresponding to the location code based on the query request and returns it to the server;

The list receiving submodule is configured to receive the destination identification list returned by the third-party server and send it to the user terminal.

Optionally, the route determination module 906 includes:

A real-view image query request sending submodule is configured to generate a real-view image query request based on the location code and send it to a third-party server;

The real scene image receiving submodule is configured to receive the real scene image returned by the third-party server based on the real scene image query request.

Optionally, the route determination module 906 includes:

A query request sending submodule is configured to generate a query request with the preset location point as a starting point and the user destination identifier as an end point and send the query request to a third-party server;

A data packet receiving submodule is configured to receive a route data packet of the target guidance route returned by the third-party server;

The route generation submodule is configured to determine the target guidance route based on the route data packet.

Optionally, a first identifier of an AR entity object of the first position point and the first switching control are rendered in the AR image; the first position point is a preset position point whose distance from the target guidance route is less than a preset threshold;

When the first switching control is triggered, receiving a real scene image change request submitted by the user terminal;

Based on the real scene image change request, the real scene image of the first location point and the first guidance route determined based on the first location point and the user destination identifier are rendered, and the first AR real scene image obtained by rendering is sent to the user terminal.

Optionally, the target guidance route passes through the intermediate position point;

Rendering an intermediate identifier of an AR entity object at an intermediate position point and a first switching control in the AR real scene image;

When the first switching control is triggered, receiving a first switching instruction submitted by the user terminal;

Based on the first switching instruction, the real scene image of the intermediate position point and the first guidance route determined with the intermediate position point as the starting point and the user destination identifier as the end point are rendered, and the rendered intermediate AR real scene image is sent to the user terminal.

Optionally, the first switching control and the second switching control are rendered in the intermediate AR real scene image;

receiving a second switching instruction submitted by the user terminal when detecting that the second switching control is triggered;

Based on the second switching instruction, the real scene image of the intermediate position point and the second guidance route determined based on the intermediate position point and the second position point are rendered, and the rendered AR real scene image is sent to the user terminal.

Optionally, the image rendering module 908 includes:

a starting image rendering submodule, configured to send the AR real scene image rendered with the recommended destination identifier to the user terminal when the AR real scene image is the starting AR real scene image;

The intermediate image rendering submodule is configured to send the AR real scene image without rendering the recommended destination mark to the user terminal when the AR real scene image is an intermediate AR real scene image.

Optionally, the image rendering module 908 includes:

A recommendation mark rendering submodule is configured to send the AR real scene image rendered with a corresponding recommended destination mark in a corresponding direction to the user terminal;

a destination change submodule, configured to receive a destination change request submitted by the user terminal when the recommended destination identifier is triggered;

The recommended image rendering submodule is configured to perform rendering processing based on the real scene image and the recommended guidance route, and send the recommended AR real scene image obtained by rendering to the user terminal.

Optionally, the image rendering module 908 includes:

The display area rendering submodule is configured to send the AR real scene image rendered with the destination display area corresponding to the user destination identifier to the user terminal; wherein the display content of the destination display area includes at least one of the following: the user destination identifier, specific information of the user destination corresponding to the user destination identifier, and the distance between the user destination and the user destination.

An embodiment of an AR-based route display processing device provided in this specification is as follows:

Corresponding to the above-described AR-based route display processing method, based on the same technical concept, one or more embodiments of this specification also provide an AR-based route display processing device, which is used to execute the above-mentioned AR-based route display processing method. Figure 10 is a structural schematic diagram of an AR-based route display processing device provided by one or more embodiments of this specification.

As shown in FIG10 , the AR-based route display processing device may have relatively large differences due to different configurations or performances, and may include one or more processors 1001 and memory 1002, and the memory 1002 may store one or more storage applications or data. Among them, the memory 1002 may be a short-term storage or a persistent storage. The application stored in the memory 1002 may include one or more modules (not shown in the figure), and each module may include a series of computer executable instructions in the AR-based route display processing device. Furthermore, the processor 1001 may be configured to communicate with the memory 1002, and execute a series of computer executable instructions in the memory 1002 on the AR-based route display processing device. The AR-based route display processing device may also include one or more power supplies 1003, one or more wired or wireless network interfaces 1004, one or more input and output interfaces 1005, one or more keyboards 1006, and the like.

In a specific embodiment, the AR-based route display processing device includes a memory and one or more programs, wherein the one or more programs are stored in the memory, and the one or more programs may include one or more modules, and each module may include a series of computer-executable instructions for the AR-based route display processing device, and the one or more programs are configured to be executed by one or more processors, including computer-executable instructions for performing the following:

Perform AR scanning on the AR physical object configured at the preset location point, identify the scanned object image and submit the identified location code to the server;

receiving and displaying a destination identifier list returned by the server for the location code;

submitting the user destination identifier selected by the user through the destination identifier list to the server;

Receive and display the AR real scene image obtained by the server rendering the real scene map of the preset location point and the target guidance route.

Optionally, the receiving and displaying the AR real scene image obtained by the server rendering the real scene image of the preset location point and the target guidance route includes:

Receiving and displaying the AR real scene image rendered with a corresponding recommended destination identifier in a corresponding direction;

submitting a destination change request to the server when detecting that the recommended destination identifier is triggered;

Receive and display the recommended AR real scene image obtained by the server rendering the real scene image and the recommended guidance route.

Optionally, the receiving and displaying the AR real scene image obtained by the server rendering the real scene image of the preset location point and the target guidance route includes:

Receiving and displaying a first identifier of an AR entity object rendered with a first position point and the AR real scene image of a first switching control; the first position point is a preset position point whose distance from the target guidance route is less than a preset threshold;

submitting a real scene image change request to the server when detecting that the first switching control is triggered;

Receive and display a first AR real scene image returned by the server; the first AR real scene image is obtained by rendering by the server a real scene image of the first location point and a first guidance route determined based on the first location point and the user destination identifier.

Optionally, the target guidance route passes through the middle position point; the middle mark of the AR entity object at the middle position point and the first switching control are rendered in the AR real scene image;

submitting a first switching instruction to the server when detecting that the first switching control is triggered;

Receive and display the intermediate AR real scene image returned by the server based on the first switching instruction, wherein the intermediate AR real scene image is rendered based on the real scene image of the intermediate position point and the first guidance route determined with the intermediate position point as the starting point and the user destination identifier as the end point.

Optionally, the first switching control and the second switching control are rendered in the intermediate AR real scene image;

submitting a second switching instruction to the server when detecting that the second switching control is triggered;

Receive and display the AR real scene image obtained by the server rendering the real scene map of the intermediate position point and the second guidance route determined based on the intermediate position point and the second position point.

An embodiment of an AR-based route guidance processing device provided in this specification is as follows:

Corresponding to the above-described AR-based route guidance processing method, based on the same technical concept, one or more embodiments of this specification also provide an AR-based route guidance processing device, which is used to execute the above-mentioned AR-based route guidance processing method. Figure 11 is a structural schematic diagram of an AR-based route guidance processing device provided by one or more embodiments of this specification.

As shown in FIG11 , the AR-based route guidance processing device may have relatively large differences due to different configurations or performances, and may include one or more processors 1101 and memory 1102, and the memory 1102 may store one or more storage applications or data. Among them, the memory 1102 may be a short-term storage or a persistent storage. The application stored in the memory 1102 may include one or more modules (not shown in the figure), and each module may include a series of computer executable instructions in the AR-based route guidance processing device. Furthermore, the processor 1101 may be configured to communicate with the memory 1102, and execute a series of computer executable instructions in the memory 1102 on the AR-based route guidance processing device. The AR-based route guidance processing device may also include one or more power supplies 1103, one or more wired or wireless network interfaces 1104, one or more input and output interfaces 1105, one or more keyboards 1106, and the like.

In a specific embodiment, the AR-based route guidance processing device includes a memory and one or more programs, wherein the one or more programs are stored in the memory, and the one or more programs may include one or more modules, and each module may include a series of computer executable instructions for the AR-based route guidance processing device, and the one or more programs are configured to be executed by one or more processors, including computer executable instructions for performing the following:

Receiving a location code submitted by a user terminal after performing AR scanning and recognition on an AR entity object configured at a preset location point;

Based on the location code, determine a destination identifier list corresponding to the preset location point and send it to the user terminal, and receive a user destination identifier submitted by the user terminal;

Determine a real-life image of the preset location point, and determine a target guidance route according to the preset location point and the user destination identifier;

Rendering is performed based on the real scene image and the target guidance route, and the rendered AR real scene image is sent to the user terminal.

Optionally, a first identifier of an AR entity object of the first position point and the first switching control are rendered in the AR image; the first position point is a preset position point whose distance from the target guidance route is less than a preset threshold;

When the first switching control is triggered, receiving a real scene image change request submitted by the user terminal;

Based on the real scene image change request, the real scene image of the first location point and the first guidance route determined based on the first location point and the user destination identifier are rendered, and the first AR real scene image obtained by rendering is sent to the user terminal.

Optionally, the target guidance route passes through the intermediate position point;

Rendering an intermediate identifier of an AR entity object at an intermediate position point and a first switching control in the AR real scene image;

When the first switching control is triggered, receiving a first switching instruction submitted by the user terminal;

Based on the first switching instruction, the real scene image of the intermediate position point and the first guidance route determined with the intermediate position point as the starting point and the user destination identifier as the end point are rendered, and the rendered intermediate AR real scene image is sent to the user terminal.

Optionally, the first switching control and the second switching control are rendered in the intermediate AR real scene image;

receiving a second switching instruction submitted by the user terminal when detecting that the second switching control is triggered;

Based on the second switching instruction, the real scene image of the intermediate position point and the second guidance route determined based on the intermediate position point and the second position point are rendered, and the rendered AR real scene image is sent to the user terminal.

Optionally, sending the rendered AR real scene image to the user terminal includes:

Sending the AR real scene image rendered with the destination display area corresponding to the user destination identifier to the user terminal;

The display content of the destination display area includes at least one of the following: the user destination identifier, specific information of the user destination corresponding to the user destination identifier, and the distance between the user destination and the user destination.

An embodiment of a storage medium provided in this specification is as follows:

Corresponding to the AR-based route display processing method described above, based on the same technical concept, one or more embodiments of this specification also provide a storage medium.

The storage medium provided in this embodiment is used to store computer executable instructions, and the computer executable instructions implement the following process when executed:

Perform AR scanning on the AR physical object configured at the preset location point, identify the scanned object image and submit the identified location code to the server;

receiving and displaying a destination identifier list returned by the server for the location code;

submitting the user destination identifier selected by the user through the destination identifier list to the server;

Receive and display the AR real scene image obtained by the server rendering the real scene map of the preset location point and the target guidance route.

Optionally, the receiving and displaying the AR real scene image obtained by the server rendering the real scene image of the preset location point and the target guidance route includes:

Receiving and displaying the AR real scene image rendered with a corresponding recommended destination identifier in a corresponding direction;

submitting a destination change request to the server when detecting that the recommended destination identifier is triggered;

Receive and display the recommended AR real scene image obtained by the server rendering the real scene image and the recommended guidance route.

Optionally, the receiving and displaying the AR real scene image obtained by the server rendering the real scene image of the preset location point and the target guidance route includes:

Receiving and displaying a first identifier of an AR entity object rendered with a first position point and the AR real scene image of a first switching control; the first position point is a preset position point whose distance from the target guidance route is less than a preset threshold;

submitting a real scene image change request to the server when detecting that the first switching control is triggered;

Receive and display a first AR real scene image returned by the server; the first AR real scene image is obtained by rendering by the server a real scene image of the first location point and a first guidance route determined based on the first location point and the user destination identifier.

Optionally, the target guidance route passes through the middle position point; a middle mark of an AR entity object at the middle position point and a first switching control are rendered in the AR real scene image;

submitting a first switching instruction to the server when detecting that the first switching control is triggered;

Receive and display the intermediate AR real scene image returned by the server based on the first switching instruction, wherein the intermediate AR real scene image is rendered based on the real scene image of the intermediate position point and the first guidance route determined with the intermediate position point as the starting point and the user destination identifier as the end point.

Optionally, the first switching control and the second switching control are rendered in the intermediate AR real scene image;

submitting a second switching instruction to the server when detecting that the second switching control is triggered;

Receive and display the AR real scene image obtained by the server rendering the real scene map of the intermediate position point and the second guidance route determined based on the intermediate position point and the second position point.

Another storage medium embodiment provided in this specification is as follows:

Corresponding to the AR-based route guidance processing method described above, based on the same technical concept, one or more embodiments of this specification also provide a storage medium.

The storage medium provided in this embodiment is used to store computer executable instructions, and the computer executable instructions implement the following process when executed:

Receiving a location code submitted by a user terminal after performing AR scanning and recognition on an AR entity object configured at a preset location point;

Based on the location code, determine a destination identifier list corresponding to the preset location point and send it to the user terminal, and receive a user destination identifier submitted by the user terminal;

Determine a real-life image of the preset location point, and determine a target guidance route according to the preset location point and the user destination identifier;

Rendering is performed based on the real scene image and the target guidance route, and the rendered AR real scene image is sent to the user terminal.

Optionally, a first identifier of an AR entity object of the first position point and the first switching control are rendered in the AR image; the first position point is a preset position point whose distance from the target guidance route is less than a preset threshold;

When the first switching control is triggered, receiving a real scene image change request submitted by the user terminal;

Based on the real scene image change request, the real scene image of the first location point and the first guidance route determined based on the first location point and the user destination identifier are rendered, and the first AR real scene image obtained by rendering is sent to the user terminal.

Optionally, the target guidance route passes through the intermediate position point;

Rendering an intermediate identifier of an AR entity object at an intermediate position point and a first switching control in the AR real scene image;

When the first switching control is triggered, receiving a first switching instruction submitted by the user terminal;

Based on the first switching instruction, the real scene image of the intermediate position point and the first guidance route determined with the intermediate position point as the starting point and the user destination identifier as the end point are rendered, and the rendered intermediate AR real scene image is sent to the user terminal.

Optionally, the first switching control and the second switching control are rendered in the intermediate AR real scene image;

receiving a second switching instruction submitted by the user terminal when detecting that the second switching control is triggered;

Based on the second switching instruction, the real scene image of the intermediate position point and the second guidance route determined based on the intermediate position point and the second position point are rendered, and the rendered AR real scene image is sent to the user terminal.

Optionally, sending the rendered AR real scene image to the user terminal includes:

Sending the AR real scene image rendered with the destination display area corresponding to the user destination identifier to the user terminal;

The display content of the destination display area includes at least one of the following: the user destination identifier, specific information of the user destination corresponding to the user destination identifier, and the distance between the user destination and the user destination.

It should be noted that the embodiments of the storage medium in this specification and the embodiments of the user resource processing method in this specification are based on the same inventive concept, so the specific implementation of this embodiment can refer to the implementation of the aforementioned corresponding method, and the repeated parts will not be repeated.

The above describes the characteristic embodiments of this specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the drawings do not necessarily require the characteristic order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

In the 1930s, improvements to a technology could be clearly distinguished as hardware improvements (for example, improvements to the circuit structure of diodes, transistors, switches, etc.) or software improvements (improvements to the method flow). However, with the development of technology, many improvements to the method flow today can be regarded as direct improvements to the hardware circuit structure. Designers almost always obtain the corresponding hardware circuit structure by programming the improved method flow into the hardware circuit. Therefore, it cannot be said that an improvement in a method flow cannot be implemented using a hardware entity module. For example, a programmable logic device (PLD) (such as a field programmable gate array (FPGA)) is such an integrated circuit whose logical function is determined by the user's programming of the device. Designers can "integrate" a digital system on a PLD by programming it themselves, without having to ask a chip manufacturer to design and produce a dedicated integrated circuit chip. Moreover, nowadays, instead of manually making integrated circuit chips, this kind of programming is mostly implemented by "logic compiler" software, which is similar to the software compiler used when developing and writing programs, and the original code before compilation must also be written in a characteristic programming language, which is called hardware description language (HDL). There is not only one HDL, but many kinds, such as ABEL (Advanced Boolean Expression Language), AHDL (Altera Hardware Description Language), Confluence, CUPL (Cornell University Programming Language), HDCal, JHDL (Java Hardware Description Language), Lava, Lola, MyHDL, PALASM, RHDL (Ruby Hardware Description Language), etc. The most commonly used ones are VHDL (Very-High-Speed Integrated Circuit Hardware Description Language) and Verilog. Those skilled in the art should also know that it is only necessary to program the method flow slightly in the above-mentioned hardware description languages and program it into the integrated circuit, and then it is easy to obtain the hardware circuit that implements the logic method flow.

The controller can be implemented in any appropriate manner, for example, the controller can take the form of a microprocessor or processor and a computer-readable medium storing a computer-readable program code (such as software or firmware) that can be executed by the (micro)processor, a logic gate, a switch, an application-specific integrated circuit (ASIC), a programmable logic controller, and an embedded microcontroller. Examples of controllers include, but are not limited to, the following microcontrollers: ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20, and Silicone Labs C8051F320. The memory controller can also be implemented as part of the control logic of the memory. Those skilled in the art also know that in addition to implementing the controller in a purely computer-readable program code manner, the controller can be implemented in the form of a logic gate, a switch, an application-specific integrated circuit, a programmable logic controller, and an embedded microcontroller by logically programming the method steps. Therefore, this controller can be considered as a hardware component, and the devices included therein for implementing various functions can also be regarded as structures within the hardware component. Or even, the devices for implementing various functions can be regarded as both software modules for implementing the method and structures within the hardware component.

The systems, devices, modules or units described in the above embodiments may be implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer. Specifically, the computer may be, for example, a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.

For the convenience of description, the above devices are described in terms of functions and are divided into various units. Of course, when implementing the embodiments of this specification, the functions of each unit can be implemented in the same or multiple software and/or hardware.

It should be understood by those skilled in the art that one or more embodiments of this specification may be provided as a method, system or computer program product. Therefore, one or more embodiments of this specification may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, this specification may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

This specification is described with reference to the flowchart and/or block diagram of the method, device (system), and computer program product according to the embodiment of this specification. It should be understood that each process and/or box in the flowchart and/or block diagram, as well as the combination of the process and/or box in the flowchart and/or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device produce a device for implementing the functions specified in one process or multiple processes in the flowchart and/or one box or multiple boxes in the block diagram.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to operate in a characteristic manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device that implements the functions specified in one or more processes in the flowchart and/or one or more boxes in the block diagram.

These computer program instructions may also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, whereby the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more processes in the flowchart and/or one or more boxes in the block diagram.

In a typical configuration, a computing device includes one or more processors (CPU), input/output interfaces, network interfaces, and memory.

The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and/or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

One or more embodiments of the present specification may be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform characteristic tasks or implement characteristic abstract data types. One or more embodiments of the present specification may also be practiced in distributed computing environments where tasks are performed by remote processing devices connected through a communication network. In a distributed computing environment, program modules may be located in local and remote computer storage media, including storage devices.

Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

The above description is only an embodiment of this document and is not intended to limit this document. For those skilled in the art, this document may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this document should be included in the scope of the claims of this document.

Claims (24)

1. A route display processing method based on AR is applied to a user terminal and comprises the following steps:

receiving and displaying an AR live-action image obtained by rendering a live-action image of a preset position point and a target guide route by a server, wherein the target guide route passes through a middle position point, and the middle position point is a relay position point which is passed by a user in a path from the preset position point to a user destination;

Submitting a first switching instruction to the server under the condition that a first switching control of a rendered intermediate position point in the AR real image is triggered is detected;

And receiving and displaying an intermediate AR real image returned by the server based on the first switching instruction, wherein the intermediate AR real image is obtained by rendering a first guide route determined by taking the intermediate position point as a starting point and taking a user destination identifier as an end point based on the real image of the intermediate position point.

2. The AR-based route presentation processing method of claim 1, the live-action image being a pre-photographed image.

3. The AR-based route presentation processing method of claim 1, prior to receiving and presenting the AR live-action image, the method comprising:

AR scanning is carried out on the AR entity object configured by the preset position points, an object image obtained through scanning is identified, and the position code obtained through identification is submitted to the server;

receiving and displaying a destination identification list returned by the server for the position codes;

submitting the user destination identification selected by a user through the destination identification list to the server.

4. The AR-based route presentation processing method of claim 1, the target guide route being determined based on the preset location point and the user destination identification;

the target guiding route is an identification line with direction identification, wherein the identification line takes the preset position point as a starting point and the user destination identification as an end point.

5. The AR-based route display processing method according to claim 1, wherein the receiving and displaying the AR live-action image obtained by rendering the live-action image of the preset location point and the target guiding route by the server includes:

Receiving and displaying an AR live-action image obtained by rendering the live-action image and a target guide route determined according to a route data packet of the target guide route by the server;

the target guiding route is an identification line with a direction identification, and the direction identification points to the user destination identification from the preset position point.

6. The AR-based route display processing method according to claim 1, wherein the receiving and displaying the AR live-action image obtained by rendering the live-action image of the preset location point and the target guiding route by the server includes:

Receiving and displaying the AR live-action image rendered with a destination display area corresponding to the user destination identifier;

Wherein the display content of the destination display area includes at least one of: the user destination identification, the specific information of the user destination corresponding to the user destination, and the distance between the user destination.

7. The AR-based route display processing method according to claim 1, wherein the receiving and displaying the AR live-action image obtained by rendering the live-action image of the preset location point and the target guiding route by the server includes:

Receiving the AR live-action image;

And adjusting the display area of the AR real scene image based on the direction change data of the gyroscope of the user terminal, and displaying the AR real scene image after adjustment.

8. The AR-based route presentation processing method of claim 1, the receiving and presenting a list of destination identifications returned by the server for the location codes, comprising:

receiving the destination identification list;

Classifying the destination identifiers contained in the destination identifier list according to preset classification conditions;

and generating a destination recommendation page based on the classification result of the classification processing and displaying the destination recommendation page.

9. The AR-based route display processing method according to claim 1, wherein the receiving and displaying the AR live-action image obtained by rendering the live-action image of the preset location point and the target guiding route by the server includes:

Receiving and displaying the AR live-action image rendered with the corresponding recommendation destination identifier in the corresponding direction;

Submitting a destination change request to the server if the recommended destination identification is detected to be triggered;

And receiving and displaying a recommended AR live-action image obtained by rendering the live-action image and the recommended guide route by the server.

10. The AR-based route display processing method according to claim 1, wherein the receiving and displaying the AR live-action image obtained by rendering the live-action image of the preset location point and the target guiding route by the server includes:

Receiving and displaying a first identification of an AR entity object rendered with a first position point and the AR real image of a first switching control; the first position point is a preset position point with the distance from the target guiding route being smaller than a preset threshold value;

Submitting a live-action diagram change request to the server under the condition that the first switching control is detected to be triggered;

Receiving and displaying a first AR live-action image returned by the server; the first AR live-action image is obtained by rendering, by the server, a live-action image of the first location point and a first guide route determined based on the first location point and the user destination identification.

11. The AR-based route display processing method of claim 10, further comprising:

submitting a second switching instruction to the server under the condition that the triggering of the second switching control is detected;

Receiving and displaying an AR live-action image obtained by rendering the live-action image of the middle position point and a second guide route determined based on the middle position point and the second position point by the server;

the first switching control and the second switching control are rendered in the intermediate AR live-action image.

12. The AR-based route display processing method according to claim 1, wherein the receiving and displaying the AR live-action image obtained by rendering the live-action image of the preset location point and the target guiding route by the server includes:

receiving and displaying the AR real image rendered with the recommended destination identifier under the condition that the AR real image is the initial AR real image;

And receiving and displaying the AR real image which is not rendered and recommended to the destination identification under the condition that the AR real image is an intermediate AR real image.

13. The AR-based route display processing method according to claim 1, wherein after the step of rendering the AR live-action image obtained by the receiving and displaying server for the live-action image of the preset location point and the target guiding route is performed, the method further comprises:

displaying a recommended AR live-action image obtained by rendering the live-action image and a recommended guiding route under the condition that a recommended destination identifier rendered in the AR live-action image is triggered;

displaying a first AR live-action image of a first position point under the condition that a first switching control rendered in the AR live-action image is triggered; the first AR live-action image is obtained by rendering a live-action image of the first location point and a first guide route determined based on the first location point and the user destination identifier;

the first position point is a preset position point with a distance smaller than a preset threshold value from the target guiding route.

14. A route guidance processing method based on AR is applied to a server and comprises the following steps:

Rendering based on a live view image of a preset position point and a target guiding route, and sending an AR live view image obtained by rendering to a user terminal, wherein the target guiding route passes through an intermediate position point, and the intermediate position point is a relay position point which is passed by a user in a path from the preset position point to a user destination;

Rendering a first switching control of the intermediate position point in the AR real image;

receiving a first switching instruction submitted by the user terminal under the condition that the first switching control is triggered;

And based on the first switching instruction, rendering the live-action image of the intermediate position point and a first guiding route determined by taking the intermediate position point as a starting point and taking a user destination identifier as an end point, and sending an intermediate AR live-action image obtained by rendering to the user terminal.

15. The AR-based route guidance processing method according to claim 14, comprising, before rendering the real view based on the preset location point and the target guidance route:

receiving a position code submitted by the user terminal after AR scanning and recognition of the AR entity object configured by the preset position point;

Based on the position codes, determining a destination identification list corresponding to the preset position points to send to the user terminal, and receiving user destination identifications submitted by the user terminal;

and determining a live view diagram of the preset position point, and determining a target guiding route according to the preset position point and the user destination identifier.

16. The AR-based route guidance processing method according to claim 15, wherein the determining, based on the location code, that the destination identifier list corresponding to the preset location point is sent to the user terminal includes:

Generating a query request based on the position code and sending the query request to a third party server; the third party server queries a destination identification list corresponding to the position code based on the query request and returns the destination identification list to the server;

And receiving the destination identification list returned by the third-party server and sending the destination identification list to the user terminal.

17. The AR-based route guidance processing method of claim 15, the determining a live-action view of the preset location point, comprising:

Generating a live-action map query request based on the position code and sending the live-action map query request to a third-party server;

and receiving a live-action diagram returned by the third-party server based on the live-action diagram query request.

18. The AR-based route guidance processing method of claim 15, the determining a target guidance route according to the preset location point and the user destination identification, comprising:

generating a query request by taking the preset position point as a starting point and taking the user destination mark as an end point, and sending the query request to a third party server;

Receiving a route data packet of the target guide route returned by the third party server;

The target guiding route is determined based on the route data packet.

19. An AR-based route display processing apparatus, operating in a user terminal, comprising:

The image display module is configured to receive and display an AR live-action image obtained by rendering a live-action image of a preset position point and a target guide route by a server, wherein the target guide route passes through a middle position point, and the middle position point is a relay position point which is passed by a user in a path from the preset position point to a user destination;

Submitting a first switching instruction to the server under the condition that a first switching control of a rendered intermediate position point in the AR real image is triggered is detected;

And receiving and displaying an intermediate AR real image returned by the server based on the first switching instruction, wherein the intermediate AR real image is obtained by rendering a first guide route determined by taking the intermediate position point as a starting point and taking a user destination identifier as an end point based on the real image of the intermediate position point.

20. An AR-based route guidance processing device, operating on a server, comprising:

The image rendering module is configured to perform rendering processing based on a live-action image of a preset position point and a target guiding route, and send an AR live-action image obtained by rendering to the user terminal, wherein the target guiding route passes through an intermediate position point, and the intermediate position point is a relay position point which is passed by a user in a path from the preset position point to a user destination;

Rendering a first switching control of the intermediate position point in the AR real image;

receiving a first switching instruction submitted by the user terminal under the condition that the first switching control is triggered;

And based on the first switching instruction, rendering the live-action image of the intermediate position point and a first guiding route determined by taking the intermediate position point as a starting point and taking a user destination identifier as an end point, and sending an intermediate AR live-action image obtained by rendering to the user terminal.

21. An AR-based route presentation processing device applied to a user terminal, comprising:

A processor; and

A memory configured to store computer-executable instructions that, when executed, cause the processor to:

receiving and displaying an AR live-action image obtained by rendering a live-action image of a preset position point and a target guide route by a server, wherein the target guide route passes through a middle position point, and the middle position point is a relay position point which is passed by a user in a path from the preset position point to a user destination;

Submitting a first switching instruction to the server under the condition that a first switching control of a rendered intermediate position point in the AR real image is triggered is detected;

And receiving and displaying an intermediate AR real image returned by the server based on the first switching instruction, wherein the intermediate AR real image is obtained by rendering a first guide route determined by taking the intermediate position point as a starting point and taking a user destination identifier as an end point based on the real image of the intermediate position point.

22. An AR-based route guidance processing device applied to a server, comprising:

A processor; and

A memory configured to store computer-executable instructions that, when executed, cause the processor to:

Rendering based on a live view image of a preset position point and a target guiding route, and sending an AR live view image obtained by rendering to a user terminal, wherein the target guiding route passes through an intermediate position point, and the intermediate position point is a relay position point which is passed by a user in a path from the preset position point to a user destination;

Rendering a first switching control of the intermediate position point in the AR real image;

receiving a first switching instruction submitted by the user terminal under the condition that the first switching control is triggered;

And based on the first switching instruction, rendering the live-action image of the intermediate position point and a first guiding route determined by taking the intermediate position point as a starting point and taking a user destination identifier as an end point, and sending an intermediate AR live-action image obtained by rendering to the user terminal.

23. A storage medium storing computer-executable instructions that when executed implement the following:

receiving and displaying an AR live-action image obtained by rendering a live-action image of a preset position point and a target guide route by a server, wherein the target guide route passes through a middle position point, and the middle position point is a relay position point which is passed by a user in a path from the preset position point to a user destination;

Submitting a first switching instruction to the server under the condition that a first switching control of a rendered intermediate position point in the AR real image is triggered is detected;

And receiving and displaying an intermediate AR real image returned by the server based on the first switching instruction, wherein the intermediate AR real image is obtained by rendering a first guide route determined by taking the intermediate position point as a starting point and taking a user destination identifier as an end point based on the real image of the intermediate position point.

24. A storage medium storing computer-executable instructions that when executed implement the following:

Rendering based on a live view image of a preset position point and a target guiding route, and sending an AR live view image obtained by rendering to a user terminal, wherein the target guiding route passes through an intermediate position point, and the intermediate position point is a relay position point which is passed by a user in a path from the preset position point to a user destination;

Rendering a first switching control of the intermediate position point in the AR real image;

receiving a first switching instruction submitted by the user terminal under the condition that the first switching control is triggered;

And based on the first switching instruction, rendering the live-action image of the intermediate position point and a first guiding route determined by taking the intermediate position point as a starting point and taking a user destination identifier as an end point, and sending an intermediate AR live-action image obtained by rendering to the user terminal.