CN116021530A - Explanation robot, exhibit explanation method and exhibit explanation system thereof - Google Patents

Abstract

The present invention provides an explaining robot, its exhibit explaining method, and an exhibit explaining system, and relates to the technical field of intelligent robots. Data, among which, the exhibit data is used to describe the exhibits to be explained; control the voice player of the explaining robot to play the explaining voice; in the process of playing the explaining voice by the voice player, synchronously send the exhibit data to the client device connected to the explaining robot , so that the client device saves exhibit data. The technical solution provided by the present invention can enable the viewer to obtain and store relevant data of the exhibits in time through their own client devices on the spot when the robot explains the exhibits, so as to facilitate the review of the exhibits anytime and anywhere after the end of the exhibition.

Description

Explain the robot and its exhibits explaining method, exhibits explaining system

technical field

The invention relates to the technical field of intelligent robots, in particular to an explaining robot, an exhibit explaining method, and an exhibit explaining system.

Background technique

In museums, science and technology museums, exhibitions and other scenes, explaining the exhibits in the exhibition hall can convey the knowledge and information carried by the exhibits to the viewers, so as to achieve the purpose of exhibits exhibition.

In the related technology, the exhibits in the exhibition hall can be explained by an explainer. This manual way of explaining needs to arrange and train the explainers, which will occupy more human resources. With the advancement of science and technology and the development of artificial intelligence technology, the emergence of explaining robots can replace manual explaining, which brings great convenience to the explaining of exhibits in the exhibition hall. However, the current explaining robot only provides on-site audio explanations for the exhibits. If visitors need to review the exhibits after the exhibition, they need to record the relevant information of the exhibits in time by taking pictures and shorthand on the spot. For some special exhibits, camera equipment is not allowed during the exhibition, such as some cultural relics in museums, some art works in art galleries, etc., which makes it impossible to review the exhibits after the exhibition ends.

Contents of the invention

Aiming at the problems existing in the prior art, the present invention provides an explaining robot, an exhibit explaining method, and an exhibit explaining system.

The present invention provides an exhibit explaining method for an explaining robot, comprising:

Obtaining the exhibit label information of the exhibit to be explained, and determining the explanation voice and exhibit data of the exhibit to be explained based on the exhibit label information; wherein, the exhibit data is used to describe the exhibit to be explained;

Control the voice player of the explanation robot to play the explanation voice;

During the process of playing the explanation voice by the voice player, synchronously sending the exhibit data to a client device communicatively connected with the explanation robot, so that the client device saves the exhibit data.

According to an exhibit explaining method of an explaining robot provided by the present invention, the synchronously sending the exhibit data to a client device communicating with the explaining robot includes:

In the case of receiving the browsing request information sent by the client device communicating with the explaining robot, obtaining the browsing permission of the exhibit data;

In the case that the browsing permission is to allow browsing, the exhibit data is sent to the client device synchronously.

According to an exhibit explaining method of an explaining robot provided by the present invention, the controlling the voice player of the explaining robot to play the explaining voice includes:

Obtaining the face image of the viewer, and extracting the facial features of the face image;

determining age information of the viewer based on the facial features;

Searching for a target voice role matching the age information from a voice role library;

Based on the target voice role, the voice player of the explaining robot is controlled to play the explaining voice.

According to an exhibit explaining method of an explaining robot provided by the present invention, it also includes:

After the explanation of the exhibit to be explained is completed, the exhibit type of the exhibit to be explained is obtained to obtain the target exhibit type;

In the case that the exhibit library contains matching exhibits whose exhibit type matches the target exhibit type, output an exhibit guide voice, and the exhibit guide voice is used to ask the viewer whether to view the match exhibit;

In the case of receiving a voice instruction for confirming viewing of the matching exhibits, determining a target exhibit from the matching exhibits, and determining route information to the target exhibit;

Controlling the explaining robot to move to the booth of the target exhibit based on the path information.

According to an exhibit explaining method of an explaining robot provided by the present invention, in the process of playing the explaining voice by the voice player, the method further includes:

Obtain viewer interaction information;

determining the degree of interest of the viewer in the exhibit to be explained according to the viewing interaction information;

When the degree of interest is greater than the threshold of interest degree, after the explanation of the exhibit to be explained is finished, the voice player is controlled to output an exhibit recommendation voice, and the exhibit recommendation voice is used to recommend exhibit types related to the exhibit to be explained Matching exhibits.

The present invention also provides an explaining robot, including a label recognizer, a voice player, a memory, a processor, a wireless communication module connected to the processor, and a computer program stored in the memory and operable on the processor. A computer program, the wireless communication module is used to communicate with the client device;

The label identifier is used to collect exhibit label information of exhibits to be explained;

The voice player is used to play the explanation voice;

When the processor executes the computer program, the exhibit explaining method of the explaining robot described in any one of the above is realized.

The present invention also provides an exhibit explaining system, including the above-mentioned explaining robot and a client device communicating with the explaining robot;

The client device is used to receive the exhibit data of the exhibit to be explained synchronously sent by the explaining robot during the process of playing the explaining voice of the exhibit to be explained, and save the exhibit when the first save instruction is detected data; wherein, the exhibit data is used to describe the exhibit to be explained;

Wherein, the explaining voice and the exhibit data are determined by the explaining robot based on exhibit label information of the exhibit to be explained.

According to an exhibit explaining system provided by the present invention, the client device is also used for:

displaying the exhibit browsing interface, and displaying the exhibit data in the exhibit browsing area of the exhibit browsing interface;

marking the exhibit data in response to a marking operation on the exhibit data;

If the second saving instruction is detected, the marked exhibit data in the exhibit data is saved.

According to an exhibit explaining system provided by the present invention, the client device is also used for:

When an annotation instruction is detected, select target exhibit data from the exhibit data according to the editing instruction, and display a text editing window in the exhibit browsing interface;

In response to an input operation facing the text editing window, determine the input text content, and associate the target exhibit data with the text content;

When the third saving instruction is detected, the annotated exhibit data obtained after association is saved.

The present invention also provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the exhibit explaining method of the explaining robot as described in any one of the above-mentioned exhibits is realized.

The explaining robot and its exhibit explaining method and exhibit explaining system provided by the present invention can determine the explaining voice of the exhibit to be explained and the exhibit data used to describe the exhibit to be explained based on the exhibit label information of the exhibit to be explained, and the explaining robot is playing the explaining voice During the process, by synchronously sending the exhibit data to the client device communicating with the explaining robot, the client device can save the exhibit data. In this way, visitors do not need to take pictures, take shorthand, etc., and can obtain and save the relevant data of the exhibits through their own client devices on the spot when the explaining robot is explaining the exhibits, so that they can review the exhibits anytime and anywhere after the exhibition .

Description of drawings

In order to more clearly illustrate the present invention or the technical solutions in the prior art, the accompanying drawings that need to be used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the accompanying drawings in the following description are the present invention. For some embodiments of the invention, those skilled in the art can also obtain other drawings based on these drawings without creative effort.

Fig. 1 is a schematic structural diagram of an explanation robot provided by an embodiment of the present invention;

Fig. 2 is a schematic flowchart of an exhibit explaining method of an explaining robot provided by an embodiment of the present invention;

Fig. 3 is a schematic structural diagram of an exhibit explaining system provided by an embodiment of the present invention;

Fig. 4 is a schematic diagram of an exhibit browsing interface in an embodiment of the present invention.

Detailed ways

In order to make the purpose, technical solutions and advantages of the present invention clearer, the technical solutions in the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the present invention. Obviously, the described embodiments are part of the embodiments of the present invention , but not all examples. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

It should be noted that the serial numbers for the described objects in the present invention, such as "first", "second", etc., are only used to distinguish the described objects and do not have any sequence or technical meaning.

In museums, science and technology museums, exhibitions and other scenarios, the explaining robot can replace the explainer to complete the explanation of the exhibits.

Fig. 1 exemplarily shows a structural schematic diagram of an explaining robot provided by an embodiment of the present invention. Referring to Fig. 1, the explaining robot may include a label recognizer 11, a voice player 12, a memory 13, a processor 14, and a processor 14 connected wireless communication module 15 and a computer program stored on the memory 13 and executable on the processor 14. Among them, the wireless communication module 15 can be used to communicate with the client device to realize the data transmission between the explaining robot and the client device; the label identifier 11 can be used to collect the exhibit label information of the exhibit to be explained; the voice player 12 can It is used to play explanation voices, and can also be used to output voices such as questions and answers, guidance and information recommendations to viewers in human-computer voice interaction; the processor 14 can call the logic instructions in the memory 13, that is, execute A computer program to execute the exhibit explaining method of the explaining robot provided by the embodiment of the present invention, for example, the method may include: obtaining exhibit label information of the exhibit to be explained, and determining the explaining voice and exhibit data of the exhibit to be explained based on the exhibit label information; The voice player 12 plays the explaining voice; during the process of playing the explaining voice, the voice player 12 synchronously sends the exhibit data to the client device communicating with the explaining robot, so that the client device saves the exhibit data.

Exemplarily, the tag identifier 11 can include an electronic tag (Radio Frequency Identification, RFID) identifier, correspondingly, an RFID tag can be set on the booth of each exhibit, and the explaining robot can identify the RFID tag of the exhibit through the RFID identifier, Get exhibit label information.

Exemplarily, the tag identifier 11 may also include a two-dimensional code identifier or a barcode identifier, etc. Correspondingly, a corresponding two-dimensional code or barcode may be set on the booth of each exhibit.

Exemplarily, the wireless communication module 15 may include a bluetooth communication module, a wifi communication module, a 4G communication module, a 5G communication module or a 6G communication module and the like.

Exemplarily, the voice player 12 may include at least one speaker.

Exemplarily, as shown in FIG. 1 , the explaining robot may include a head 10 , a main body 20 and a bottom 30 . The tag recognizer 11 can be set in the head 10 , and the voice player 12 , memory 13 , processor 14 and wireless communication module 15 can be set in the host part 20 . The head 10 may also include a voice collection device 16 and a camera 17 , and the bottom 30 may include a laser radar 18 and a chassis movement device 19 .

Wherein, voice collecting device 16 can comprise microphone or pick-up, and voice collecting device 16 can collect voice signal, and this voice signal is sent to processor 14, and processor 14 carries out voice recognition to this voice signal, can recognize the voice in the voice signal command, and then execute the corresponding processing flow based on the voice command. The camera 17 and the lidar 18 can respectively collect image information and radar point cloud data of the monitoring area, and send the collected image information and radar point cloud data to the processor 14, and the processor 14 performs a pair based on the image information and the radar point cloud data. Explain the robot's path planning and obstacle avoidance. Under the control of the processor 14, the chassis motion device 19 can drive the explaining robot to move.

Exemplarily, the explaining robot may also include a network transmission module connected to the processor 14, through which the network transmission module is connected to the server. When the processor 14 recognizes the question-and-answer instruction from the voice signal collected by the voice collection device 16, the voice data of the question in the voice signal is transmitted to the server through the network transmission module, and the server can use big data and deep learning algorithms for analysis and calculation, to obtain the answer knowledge data, or search the answer knowledge data matched with the voice data of the question from the question-and-answer knowledge base stored in the server, and then return the answer knowledge data to the processor 14 through the network transmission module, and the processor 14 The voice player 12 is controlled to play the answer knowledge data, so as to realize the voice question and answer before the viewer and the explaining robot.

Exemplarily, the explaining robot can also include a communication interface (Communication Interface), which can be used to communicate with external devices. The processor 14, the communication interface, and the memory 13 can communicate with each other through a communication bus.

In addition, the above-mentioned logic instructions in the memory 13 can be implemented in the form of software function units and can be stored in a computer-readable storage medium when sold or used as an independent product. Based on this understanding, the essence of the technical solution of the present invention or the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including Several instructions are used to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the methods described in various embodiments of the present invention. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disc, etc., which can store program codes. .

Based on the explaining robot of the embodiment corresponding to FIG. 1 , the exhibit explaining method of the explaining robot of the present invention will be described below in conjunction with FIG. 2 . The exhibit explaining method of the explaining robot can be applied to the processor 14 of the explaining robot.

FIG. 2 exemplarily shows a schematic flowchart of an exhibit explaining method of an explaining robot provided by an embodiment of the present invention. Referring to FIG. 2 , the exhibit explaining method of an explaining robot may include steps 210 to 240 as follows.

Step 210: Obtain the exhibit label information of the exhibit to be explained.

The explaining robot can scan and identify the label of the exhibit to be explained through the RFID identifier at the booth of the exhibit to be explained, and obtain the exhibit label information of the exhibit to be explained.

For example, when a visitor needs the explaining robot to navigate to the exhibit to be explained and give a voice explanation of the exhibit to be explained, the visitor can send the voice of the exhibit name or exhibit number to the explaining robot, for example, send "Explain Exhibit No. 2" to the explaining robot ", the voice signal is collected by the voice collection device 16 and sent to the processor 14, the processor 14 performs voice recognition on the voice signal, and determines the route information to the exhibit to be explained according to the voice recognition result, based on the route information The chassis movement device 19 is controlled to drive the explaining robot to move to the booth of the exhibit to be explained, and the camera 17 and the laser radar 18 can be used to avoid obstacles during the movement. After the explaining robot moves to the booth of the exhibit to be explained, the processor 14 controls the label recognizer 11 to scan the label of the exhibit to be explained to obtain the exhibit label information of the exhibit to be explained. For example, the tag recognizer 11 may be an RFID recognizer, and the processor 14 may control the RFID recognizer to scan and recognize the RFID tag at the exhibit to be explained.

Step 220: Based on the exhibit label information, determine the explaining voice and exhibit data of the exhibit to be explained.

After the processor 14 acquires the exhibit label information of the exhibit to be explained, it can search the exhibit information database for the explanation voice and exhibit data that match the exhibit label information. Among them, the corresponding relationship between exhibit label information, explanatory voice and exhibit data can be stored in the exhibit information database.

Wherein, the explanation voice of the exhibit to be explained is voice data describing and introducing relevant information of the exhibit to be explained, and may be saved in a voice file format, for example. The exhibit data of the exhibit to be explained may include at least one of the video, image, and text data of the exhibit, where the text data may include the text content corresponding to the voice of the explanation, and/or include the background information of the exhibit, which may include At least one of author information, design philosophy, design process, and application scenarios.

Step 230: Control the voice player of the explaining robot to play the explaining voice.

After the processor 14 determines the explaining voice of the exhibit to be explained, it controls the voice player 12 of the explaining robot to play the explaining voice, and introduces relevant information of the exhibit to be explained to the viewer through the voice.

Exemplarily, in an optional implementation manner, the processor 14 may control the voice player 12 of the explaining robot to play the explaining voice in a default voice role.

Exemplarily, in another optional implementation, the staff of the exhibition or exhibition hall can also set the voice role of the explanation voice according to the application scenario of the explanation robot. Characters can be set as adult voice characters in the exhibition hall for the public. Afterwards, the processor 14 can control the voice player 12 of the explaining robot to play the explaining voice with a set voice character. Specifically, the explaining robot may be provided with a display screen, and the exhibit explaining method of the explaining robot may also include: when a voice role setting instruction is detected, displaying a voice role setting interface on the display screen, the voice role setting interface includes voice A role selection control; in response to a selection operation on the voice role selection control, determine the voice role for the narration voice.

Exemplarily, in yet another optional implementation manner, the explaining robot can automatically select a voice role according to the age of the viewer. Specifically, controlling the voice player of the explaining robot to play the explaining voice may include: obtaining the face image of the viewer, and extracting the face features of the face image; determining the age information of the viewer based on the face feature; Find the target voice character matching the age information in the library; based on the target voice character, control the voice player of the explaining robot to play the explaining voice. Wherein, the corresponding relationship between age information and voice roles may be stored in the voice role library. For example, the age information may be an age range, for example, the age may be divided into age ranges such as children, youth, adults, and old people.

Wherein, optionally, determining the age information of the viewer based on facial features may include: inputting the facial features into an age detection model, and obtaining age information output by the age detection model. Wherein, the age detection model may be obtained by training an initial age detection model based on face feature samples and label data corresponding to the face feature samples. The initial age detection model may include a convolutional neural network (Convolutional Neural Network, CNN), a cyclic neural network (Recurrent Neural Networks, RNN), a BP neural network or a deep neural network (Deep NeuralNetworks, DNN), etc., but is not limited thereto.

Optionally, determining the age information of the viewer based on the facial features may include: searching the age information database for age information matching the facial features based on the facial features to obtain the age information of the viewer. Wherein, the age information database may store the corresponding relationship between facial features and age information. For example, the extracted face feature can be compared with the stored face feature in the age information database, and the similarity between the two can be calculated. If the similarity is greater than the set threshold, the stored face feature The corresponding age information is determined as matching age information.

Step 240 : During the process of playing the explaining voice by the voice player, synchronously send the exhibit data to the client device communicating with the explaining robot, so that the client device saves the exhibit data.

During the process of controlling the voice player 12 to play the explanation voice, the processor 14 can synchronously send the exhibit data to the client device communicating with the explaining robot through the wireless communication module 15, and the client device directly saves the exhibit data after receiving it. Alternatively, the client device displays the exhibit data after receiving the exhibit data, and the viewer may perform a save operation on the exhibit data on the client device, and the client device saves the exhibit data in response to the save operation. Or, the viewer can selectively save the exhibit data on the client device, for example, mark the data that needs to be saved in the exhibit data, and the client device determines the exhibit data to be saved in response to the marking operation, In the case of receiving the save instruction, save the exhibit data to be saved.

The explaining robot and its exhibit explaining method and exhibit explaining system provided by the present invention can determine the explaining voice of the exhibit to be explained and the exhibit data used to describe the exhibit to be explained based on the exhibit label information of the exhibit to be explained, and the explaining robot is playing the explaining voice During the process, by synchronously sending the exhibit data to the client device communicating with the explaining robot, the client device can save the exhibit data. In this way, visitors do not need to take pictures, shorthand, etc., when the explaining robot is explaining the exhibits, they can obtain and save the relevant data of the exhibits through the client device on the spot, so that they can review the exhibits at any time after the exhibition, which improves the user experience. viewing experience. At the same time, it also avoids the problem that it is easy to miss or miss part of the explanation content when recording the relevant information of the exhibits by shorthand, notes, etc. when listening to the explanation. Moreover, compared with on-site recording or video recording, it will not be affected by the on-site environment, and the quality of the preserved exhibit data is high.

Based on the exhibit explaining method of the explaining robot in the embodiment corresponding to FIG. 2 , in an example embodiment, the viewer may request the explaining robot to send the exhibit data of the currently explained exhibit through its client device. Specifically, synchronously sending the exhibit data to the client device communicating with the explaining robot may include: obtaining the browsing permission of the exhibit data when receiving the browsing request information sent by the client device communicating with the explaining robot; When the browsing permission is allowed to browse, the exhibit data will be sent to the client device synchronously.

Exemplarily, the browsing permission can be set by the manager of the exhibition hall or the organizer of the exhibition according to requirements. For example, if browsing and saving is not allowed for a period of time when the exhibit is newly exhibited, you can set the browsing permission to not allow browsing during this period; if you allow browsing and saving later, you can change the browsing permission to allow browsing. Specifically, the exhibit explaining method of the explaining robot may also include: when a browsing permission setting instruction is detected, displaying a browsing permission setting interface, the browsing permission setting interface includes an exhibit identification and a browsing permission setting control corresponding to the exhibit identification ; In response to the setting operation for the browsing permission setting control, determine the browsing permission of the corresponding exhibit.

Based on the exhibit explaining method of the explaining robot in the embodiment corresponding to Fig. 2, in an example embodiment, after explaining the exhibits to be explained, the explaining robot can recommend other exhibits of the same type to the viewer, and inquire about viewing by voice If the viewer agrees to view, the explaining robot can guide the viewer to move to the next exhibit of the same type for explanation. Specifically, the exhibit explaining method of the explaining robot may also include: after the explaining of the exhibit to be explained is finished, obtaining the exhibit type of the exhibit to be explained to obtain the target exhibit type; In the case of exhibits, the exhibit guide voice is output, and the exhibit guide voice is used to ask the viewer whether to view the matching exhibit; in the case of receiving a voice command to confirm viewing of the matching exhibit, determine the target exhibit from the matching exhibits, And determine the path information to the target exhibit; based on the path information, control the explaining robot to move to the booth of the target exhibit.

For example, the exhibit currently explained by the explaining robot is a landscape painting. After the explaining robot finishes explaining the landscape painting, it can inquire whether there are other landscape paintings in the current exhibition hall in the exhibit library. Output the exhibit guide voice such as "there are other landscape paintings in this exhibition hall, do you need to visit?", and the viewer can make a voice command to visit or not to visit according to the guide voice of the exhibit. The explaining robot recognizes the voice signal collected by the voice collection device 16, and when it recognizes the voice command to go to view, it can determine the landscape painting closest to the current landscape painting from other landscape paintings according to the location information of the current landscape painting as the target exhibit , or determine the landscape painting with the highest similarity with the current landscape painting as the target exhibit from other landscape paintings, such as the same author, the most similar style, etc., and determine the path information to the target exhibit at the same time. The path information planned and saved can be directly read from the path information database after the target exhibit is determined, and the path information between exhibits can be stored in the path information database. After obtaining the path information, the processor 14 can control the chassis motion device 19 based on the path information to drive the explaining robot to move to the booth of the target exhibit, and use the camera 17 and the laser radar 18 to avoid obstacles during the movement.

Exemplarily, the explaining robot can send a query request for querying the exhibit library to the server through the network transmission module, and query landscape paintings in the exhibit library saved by the server.

Based on the exhibit explaining method of the explaining robot in the embodiment corresponding to Fig. 2, in an example embodiment, in the process of playing the explaining voice on the voice player 12, the explaining robot can give the viewer an explanation method according to the degree of interest of the viewer in viewing the exhibit. Visitors recommend other similar exhibits. Specifically, the exhibit explaining method of the explaining robot may also include: obtaining the viewer's viewing interaction information; determining the viewer's degree of interest in explaining the exhibit according to the viewing interaction information; , after the explanation of the exhibit to be explained is finished, the voice player is controlled to output the exhibit recommendation voice, wherein the exhibit recommendation voice is used to recommend exhibits that match the exhibit type of the exhibit to be explained. In this way, other exhibits that are similar to the currently viewed exhibits in the exhibition hall can be recommended to the viewer through the exhibit recommendation voice, so that the viewer can understand the situation of the same type of exhibits in the exhibition hall, and it is convenient for the viewer to view the exhibits that they are interested in. Viewing efficiency and viewing experience are highly intelligent.

Wherein, the viewing interaction information may include the number of voice interactions between the viewer and the explaining robot and/or the length of stay of the viewer at the exhibit booth, etc., but is not limited thereto. During the process of playing the explaining voice through the voice player 12, the explaining robot can statistically record the viewing interaction information of the viewer.

Exemplarily, for each item of viewing interaction information, a weight value may be set, and then weighted summation is performed on each item of information based on the weight value to obtain the viewer's degree of interest in explaining the exhibit.

Exemplarily, the exhibit recommendation voice can also be used to ask the viewer whether to view the exhibit that matches the exhibit type of the exhibit to be explained, so as to further guide the viewer to other exhibits of interest.

Based on the explaining robot in the embodiment corresponding to FIG. 1 and the exhibit explaining method of the explaining robot in the above-mentioned embodiments, an embodiment of the present invention further provides an exhibit explaining system. FIG. 3 exemplarily shows a schematic structural diagram of an exhibit explaining system provided by an embodiment of the present invention. Referring to FIG. 310 may be the explaining robot in the embodiment corresponding to FIG. 1 , and the client device 320 may include at least one of a mobile phone, a laptop computer, a smart watch, and a tablet computer (Pad), but is not limited thereto.

Wherein, the client device 320 is used to receive the exhibit data of the exhibit to be explained synchronously sent by the explaining robot 310 during the process of playing the explaining voice of the exhibit to be explained, and save the exhibit data when the first saving instruction is detected; wherein, The explanation voice and exhibit data are determined by the explanation robot 310 based on the exhibit label information of the exhibit to be explained. For the specific determination process, refer to the relevant description in the corresponding embodiment method in FIG. 2 , which will not be repeated here.

Based on the exhibit explaining system of the embodiment corresponding to Fig. 3, in an exemplary embodiment, the client device 320 can also be used to: display the exhibit browsing interface, and display exhibit data in the exhibit browsing area of the exhibit browsing interface; The data marking operation is to mark the exhibit data; when the second saving instruction is detected, save the marked exhibit data in the exhibit data. In this way, the data to be saved can be selected from the exhibit data for storage. For example, the exhibit data can include the image and text introduction of the exhibit, and the viewer can select the image and/or text content of interest for targeted storage, improving It improves the intelligence of exhibit explanations and improves the viewing experience of users.

Exemplarily, the client device 320 can also be used to: when an annotation instruction is detected, select target exhibit data from the exhibit data according to the annotation instruction, and display a text editing window in the exhibit browsing interface; The input operation in the editing window determines the input text content and associates the target exhibit data with the text content; when the third save instruction is detected, the annotated exhibit data obtained after the association is saved, and the annotated exhibit data can be The target exhibit data carrying the annotation content may also be the exhibit data with annotation content added to the original exhibit data. In this way, a note-taking function can be provided for the viewers, who can input their impressions during the viewing process of the exhibits and/or record important information or interesting content obtained during the listening process through the text editing window, and combine these contents with the exhibits. The data is saved together, which further improves the intelligence of exhibit explanations and improves the viewing experience of users.

For example, FIG. 4 exemplarily shows a schematic diagram of the exhibit browsing interface. Referring to FIG. 4 , after the client device 320 receives the exhibit data, it can display the exhibit data in the exhibit browsing area 41 according to the display rules, such as the exhibit data Including videos, images, and text materials, the client device 320 can display the videos, images, and text materials in partitions in the exhibit browsing area 41, and the viewer can choose to turn on or off the display of a certain content according to needs, or click on the target Content area, the target content area can be enlarged and displayed. For another example, the exhibit data includes an image, and the client device 320 may display the image in a full area of the exhibit browsing area 41 . After the user clicks the save button, the client device 320 can save the received exhibit data.

Exemplarily, the exhibit browsing area 41 may include an explanatory text area 43 , and after receiving the exhibit data, the client device 320 may display in the explanatory text area 43 the text content corresponding to the synchronous explanatory voice.

Exemplarily, the marking function can be provided in the exhibit browsing interface. After the viewer clicks the "Mark" function control, the exhibit data displayed in the interface enters a state that can be marked, and the viewer can mark the content of interest on the exhibit data to save. For example, if the viewer pays more attention to a certain image of the exhibit and needs to save the image, he can click to select the image, and the image will be marked at this time. Based on this, he can mark all the content that needs to be saved, and click save after confirmation control, the interface may provide a first saving option, the first saving option may include the first option of saving marked content and the second option of saving exhibit data, when the viewer selects the first option, the client The device 320 will receive the second saving instruction, and save the marked exhibit data in the exhibit data at this time. When the viewer selects the second option, the client device 320 will receive the first saving instruction, and at this time, the original exhibit data will be saved.

Exemplarily, the annotation function can be provided in the exhibit browsing interface. After the viewer clicks the "annotation" function control, the exhibit data displayed in the interface enters a state that can be annotated and marked, and the viewer can click on the exhibit data to require annotation. Save the part after commenting. For example, if a viewer has a feeling about a certain image, a certain video or a certain part of the text data of the exhibit or needs to record some relevant information, he can click on the part that needs to be annotated. At this time, the client device 320 selects the target exhibit data, And a text editing window 42 is displayed in the exhibit browsing interface, and the viewer can input annotation content in the text editing window 42, and finish annotating the selected target exhibit data after confirming. In this way, all the required annotations can be realized, and then click the save control, and the second save option can be provided in the interface. The second save option can include the third option to save the annotated exhibit data and the second option to save the exhibit data. If the viewer selects the third option, the client device 320 will receive the third saving instruction, and save the annotated exhibit data at this time. When the viewer selects the second option, the client device 320 will receive the first saving instruction, and at this time, the original exhibit data will be saved.

The exhibit explaining system provided by the embodiment of the present invention includes an explaining robot and a client device communicating with the explaining robot. The explaining robot can determine the explaining voice of the exhibit to be explained based on the exhibit label information of the exhibit to be explained and be used to describe the exhibit to be explained exhibit data, and can synchronously send the exhibit data to the client device during the process of playing the explanation voice, and the client device saves the exhibit data when the first save instruction is detected. In this way, visitors do not need to take pictures, shorthand, etc., when the explaining robot is explaining the exhibits, they can obtain and save the relevant data of the exhibits through the client device on the spot, so that they can review the exhibits at any time after the exhibition, which improves the user experience. viewing experience. At the same time, it also avoids the problem that it is easy to miss or miss part of the explanation content when recording the relevant information of the exhibits by shorthand, notes, etc. when listening to the explanation. Moreover, compared with on-site recording or video recording, it will not be affected by the on-site environment, and the quality of the preserved exhibit data is high.

In addition, the exhibit explaining system provided by the embodiment of the present invention can provide exhibit mark function and comment function on the client device of the viewer, the viewer can mark the content to be saved through the mark function and save it, and the mark function can Annotate and record impressions, etc., with strong flexibility, which improves the degree of intelligence and user experience.

On the other hand, the present invention also provides a computer program product, the computer program product includes a computer program, the computer program can be stored on a computer-readable storage medium, and when the computer program is executed by a processor, the computer can perform the above-mentioned The exhibit explaining method of the explaining robot provided by the method embodiment, for example, the method may include: obtaining exhibit label information of the exhibit to be explained, and determining the explaining voice and exhibit data of the exhibit to be explained based on the exhibit label information, wherein the exhibit data is used for Describe the exhibits to be explained; control the voice player of the explaining robot to play the explaining voice; during the process of playing the explaining voice on the voice player, synchronously send the data of the exhibits to the client device connected to the explaining robot, so that the client device can save the exhibits data.

In yet another aspect, the present invention also provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, it is implemented to perform the exhibit explaining method of the explaining robot provided by the above method embodiments. For example, the method may include: obtaining the exhibit label information of the exhibit to be explained, and determining the explaining voice and exhibit data of the exhibit to be explained based on the exhibit label information, wherein the exhibit data is used to describe the exhibit to be explained; controlling the voice player of the explaining robot to play the explaining Voice: In the process of playing the explanation voice by the voice player, the exhibit data is synchronously sent to the client device connected with the explanation robot, so that the client device can save the exhibit data.

Exemplary, computer readable storage media may include non-transitory computer readable storage media.

The device embodiments described above are only illustrative, and the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in One place, or it can be distributed to multiple network elements. Part or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. It can be understood and implemented by those skilled in the art without any creative effort.

Through the above description of the implementations, those skilled in the art can clearly understand that each implementation can be implemented by means of software plus a necessary general hardware platform, and of course also by hardware. Based on this understanding, the essence of the above technical solution or the part that contributes to the prior art can be embodied in the form of software products, and the computer software products can be stored in computer-readable storage media, such as ROM/RAM, magnetic discs, optical discs, etc., including several instructions to make a computer device (which may be a personal computer, server, or network device, etc.) execute the methods described in various embodiments or some parts of the embodiments.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it can still be Modifications are made to the technical solutions described in the foregoing embodiments, or equivalent replacements are made to some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the various embodiments of the present invention.

Claims (10)

1. An exhibit explaining method for explaining a robot, characterized in that it comprises: Obtaining the exhibit label information of the exhibit to be explained, and determining the explanation voice and exhibit data of the exhibit to be explained based on the exhibit label information; wherein, the exhibit data is used to describe the exhibit to be explained; Control the voice player of the explanation robot to play the explanation voice; During the process of playing the explanation voice by the voice player, synchronously sending the exhibit data to a client device communicatively connected with the explanation robot, so that the client device saves the exhibit data. 2. The method for explaining exhibits by an explaining robot according to claim 1, wherein the synchronously sending the exhibit data to a client device communicating with the explaining robot comprises: In the case of receiving the browsing request information sent by the client device communicating with the explaining robot, obtaining the browsing permission of the exhibit data; In the case that the browsing permission is to allow browsing, the exhibit data is sent to the client device synchronously. 3. The exhibit explaining method of the explaining robot according to claim 1, wherein the voice player controlling the explaining robot to play the explaining voice comprises: Obtaining the face image of the viewer, and extracting the facial features of the face image; determining age information of the viewer based on the facial features; Searching for a target voice role matching the age information from a voice role library; Based on the target voice role, the voice player of the explaining robot is controlled to play the explaining voice. 4. The exhibit explaining method of the explaining robot according to any one of claims 1 to 3, further comprising: After the explanation of the exhibit to be explained is completed, the exhibit type of the exhibit to be explained is obtained to obtain the target exhibit type; In the case that the exhibit library contains matching exhibits whose exhibit type matches the target exhibit type, output an exhibit guide voice, and the exhibit guide voice is used to ask the viewer whether to view the match exhibit; In the case of receiving a voice instruction for confirming viewing of the matching exhibits, determining a target exhibit from the matching exhibits, and determining route information to the target exhibit; Controlling the explaining robot to move to the booth of the target exhibit based on the path information. 5. The exhibit explaining method of the explaining robot according to any one of claims 1 to 3, characterized in that, in the process of playing the explaining voice by the voice player, the method further comprises: Obtain viewer's viewing interaction information; determining the degree of interest of the viewer in the exhibit to be explained according to the viewing interaction information; In the case that the degree of interest is greater than the threshold of interest degree, after the explanation of the exhibit to be explained is finished, the voice player is controlled to output an exhibit recommendation voice, and the exhibit recommendation voice is used to recommend exhibit types related to the exhibit to be explained Matching exhibits. 6. A robot for explaining, it is characterized in that it includes a label recognizer, a voice player, a memory, a processor, a wireless communication module connected with the processor, and is stored in the memory and can be displayed on the processor a running computer program, the wireless communication module is used to communicate with the client device; The label identifier is used to collect exhibit label information of exhibits to be explained; The voice player is used to play the explanation voice; When the processor executes the computer program, the exhibit explaining method of the explaining robot according to any one of claims 1 to 5 is realized. 7. An exhibit explaining system, characterized in that it comprises the explaining robot as claimed in claim 6 and a client device communicatively connected to the explaining robot; The client device is used to receive the exhibit data of the exhibit to be explained synchronously sent by the explaining robot during the process of playing the explaining voice of the exhibit to be explained, and save the exhibit when the first save instruction is detected data; wherein, the exhibit data is used to describe the exhibit to be explained; Wherein, the explaining voice and the exhibit data are determined by the explaining robot based on exhibit label information of the exhibit to be explained. 8. The exhibit explaining system according to claim 7, wherein the client device is also used for: displaying the exhibit browsing interface, and displaying the exhibit data in the exhibit browsing area of the exhibit browsing interface; marking the exhibit data in response to a marking operation on the exhibit data; If the second saving instruction is detected, the marked exhibit data in the exhibit data is saved. 9. The exhibit explaining system according to claim 8, wherein the client device is further used for: When an annotation instruction is detected, select target exhibit data from the exhibit data according to the editing instruction, and display a text editing window in the exhibit browsing interface; In response to an input operation facing the text editing window, determine the input text content, and associate the target exhibit data with the text content; When the third saving instruction is detected, the annotated exhibit data obtained after association is saved. 10. A computer-readable storage medium, on which a computer program is stored, wherein, when the computer program is executed by a processor, the exhibit explaining method of the explaining robot according to any one of claims 1 to 5 is realized.

Images