CN115988228B

CN115988228B - Hot zone display method, device, equipment and storage medium for live broadcast screen

Info

Publication number: CN115988228B
Application number: CN202111201332.2A
Authority: CN
Inventors: 吴启亮
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2021-10-15
Filing date: 2021-10-15
Publication date: 2025-09-05
Anticipated expiration: 2041-10-15
Also published as: CN115988228A

Abstract

The present application discloses a method, device, equipment and storage medium for displaying hot zones of a live broadcast screen, and belongs to the field of live broadcast technology. The method includes: displaying a live broadcast screen in a live broadcast room, wherein the live broadcast screen displays at least one recommended object; in response to a hot zone display instruction triggered for the live broadcast screen, presenting at least one visual hot zone in the live broadcast screen, wherein the visual hot zone is used to represent the number of viewers who are looking at the area where the corresponding recommended object is located in the live broadcast screen. In this way, when watching the live broadcast screen, the audience does not need to actively interact, but can also more intuitively understand the audience's interest in each recommended object through the displayed visual hot zones, obtain audience feedback more promptly, and thereby improve the accuracy of the live broadcast content.

Description

Hot zone display method, device and equipment of live broadcast picture and storage medium

Technical Field

The application relates to the technical field of computers, in particular to the technical field of live broadcasting, and provides a hot zone display method, device and equipment of live broadcasting pictures and a storage medium.

Background

With the development of network technology, network live broadcast is widely popularized, and gradually becomes popular entertainment application. In general, a live webcast scene includes a host client and a viewer client, wherein a host may create a live room in the host client, and a viewer may interact with the host client after entering the live room through the viewer client. For example, when a host plays a live broadcast through a host client, a viewer may comment or like in a live broadcast room through the viewer client, and accordingly, comments or like initiated by the viewer client may be displayed in the respective areas of the host client and the viewer client.

However, at present, due to the limitation of physical space, when in live broadcast, the anchor is unable to directly watch the audience watching the live broadcast at the other end, but only can judge the preference of the audience to the live broadcast content through the interactive content actively initiated by the audience, but in this way, the anchor can only passively receive the feedback of the audience, once most of the audiences lack interaction, the anchor cannot obtain the feedback in time, and the live broadcast content may not be adjusted in time. For example, when a host broadcast recommends an item to a viewer in a live broadcast room, if feedback of the viewer cannot be obtained in time, and if the viewer is interested in which item, the currently recommended item cannot be adjusted in time, and then the item cannot be accurately recommended to the viewer, so that the accuracy of item recommendation is low, and the viewing experience of the viewer is poor.

Disclosure of Invention

The embodiment of the application provides a hot zone display method, device and equipment of a live broadcast picture and a storage medium, which are used for displaying a visual hot zone of the live broadcast picture, improving timeliness of obtaining feedback of a spectator and further improving accuracy of live broadcast content.

In one aspect, a method for displaying a hot zone of a live broadcast picture is provided, the method comprising:

displaying a live broadcast picture of a live broadcast room, wherein the live broadcast picture displays at least one recommended object;

And responding to a hotzone display instruction triggered for the live broadcast picture, and presenting at least one visual hotzone in the live broadcast picture, wherein the visual hotzone is used for representing the number of audiences gazing at a position area where a corresponding recommended object is located in the live broadcast picture.

In one aspect, a hot zone display device for a live view is provided, the device comprising:

The picture display unit is used for displaying a live broadcast picture of the live broadcast room, and the live broadcast picture is displayed with at least one recommended object;

and the hotzone presentation unit is used for responding to a hotzone display instruction triggered for the live broadcast picture, presenting at least one visual hotzone in the live broadcast picture, wherein the visual hotzone is used for representing the number of audiences gazing at a position area where a corresponding recommended object is located in the live broadcast picture.

Optionally, the live broadcast picture further displays a hot zone display control, and the hot zone presenting unit is further configured to:

And responding to the triggering operation of the hot zone display control, and obtaining the hot zone display instruction.

Optionally, the apparatus further comprises a hot zone generating unit for:

object recognition is carried out on the live broadcast picture to obtain the position area of each recommended object in the live broadcast picture, and

The method comprises the steps of obtaining a viewer account associated with each recommended object in at least one recommended object, wherein the association relation between the recommended objects and the viewer account is established according to the position area of each recommended object in the live broadcast picture and the position relation between the eyeball fixation point detected by terminal equipment when the live broadcast picture is played by the terminal equipment by using the viewer account;

and marking the associated audience accounts in the position area of each recommended object, and generating a visual hotzone corresponding to each recommended object.

Optionally, the hot zone generating unit is specifically configured to:

Receiving a plurality of groups of association relations issued by a background server, wherein each group of association relations comprises a recommended object associated with an audience account;

comparing the recommended objects in the multiple groups of association relations with the at least one recommended object to determine the audience account associated with each recommended object in the at least one recommended object.

Optionally, at least one visual hot zone is presented in the live view in at least one of the following ways:

Displaying at least one piece of marking information in the position area of each recommended object, wherein one piece of marking information represents at least one audience account associated with the corresponding recommended object;

Displaying the number of audience accounts associated with each recommendation object, wherein the number of audience accounts and the density of the marking information are positively related;

Displaying the recommended objects with the largest number of associated audience accounts in a hot zone display style different from the other recommended objects;

recommended objects with different numbers of associated audience accounts are displayed in different hot zone display modes;

and displaying recommended objects with different numerical intervals of the number of the associated audience accounts in different hot zone display modes.

Optionally, the apparatus further comprises a gaze point identification unit for:

object identification is carried out on the live broadcast picture, and the position area of each recommended object in the live broadcast picture is obtained;

Acquiring the position information of the detected eye gaze point on the live broadcast picture;

determining a target recommended object corresponding to the position information based on the position relation between the position information and the position areas of the recommended objects;

And establishing an association relation between the currently used target audience account and the target recommended object, and uploading the association relation to a background server.

Optionally, the apparatus further comprises an object focusing unit for:

Receiving a triggering operation for a target visual hot zone in the at least one visual hot zone;

displaying a focusing operation control of a target recommended object corresponding to the target visual hot zone;

and responding to the triggering operation of the focusing operation control, and displaying the target recommended object in an enlarged mode.

Optionally, the object focusing unit is specifically configured to:

responding to triggering operation of the focusing operation control, and sending a focusing instruction to connected image pickup equipment, wherein the focusing instruction is used for indicating the image pickup equipment to focus on the target recommended object;

And performing image display based on the focused image data sent by the image pickup equipment so as to display the enlarged target recommended object.

Optionally, the hot zone presenting unit is further configured to:

after receiving triggering operation for a target visual hot zone in the at least one visual hot zone, displaying an information display control corresponding to the target recommended object;

and responding to the triggering operation of the information display control, displaying an information display page of the target recommended object, wherein the information display page displays at least one of object introduction information of the target recommended object and account identification of an associated audience account.

Optionally, the information display page further displays a first object recommendation control corresponding to the target recommendation object;

The apparatus further comprises a recommending unit for:

and responding to the triggering operation of the first object recommendation control, and sending the object link address associated with the target recommendation object to the audience account associated with the target recommendation object.

Optionally, the recommending unit is further configured to:

responding to triggering operation of an account identifier of a target audience account in audience accounts displayed on the information display page, displaying an instant messaging page taking the target audience account as a communication object, wherein the instant messaging page displays a second object recommendation control corresponding to the target recommendation object;

And responding to the triggering operation of the second object recommendation control, and sending the object link address associated with the target recommendation object to the target audience account.

Optionally, the hot zone presenting unit is further configured to:

Responding to triggering operation of account identification of the target audience account, and displaying a gazing point track page of the target audience account, wherein the gazing point track page comprises various recommended objects corresponding to eyeball gazing points of the target audience account on corresponding terminal equipment;

the account identifier of the target audience account is an account identifier displayed on the information display page or an account identifier displayed on the instant messaging page.

Optionally, the hot zone presenting unit is specifically configured to:

sequencing the recommended objects according to the eye gaze point corresponding to the target audience account and the stay time in the position area of the recommended objects, and displaying the gaze point track page based on the sequencing order of the recommended objects, or

And sequencing the recommended objects according to the track sequence of the eyeball fixation point corresponding to the target audience account in the position area of the recommended objects, and displaying the fixation point track page based on the sequencing sequence of the recommended objects.

Optionally, the hot zone presenting unit is further configured to:

Displaying a hot zone closing control;

and hiding the at least one visual hot zone in response to triggering operation of the hot zone closing control, and returning to display the live broadcast picture.

Optionally, the live broadcast picture also displays a display control of the display page of the at least one recommended object;

the hot zone presentation unit is further configured to:

Responsive to a triggering operation for the show page display control, displaying a show page including the at least one recommended object; in the display page, display control for viewing the audience account associated with each recommended object is displayed;

And responding to the triggering operation of the display control corresponding to the target recommended object, and displaying the account identification of the audience account associated with the target recommended object.

Optionally, the hot zone presenting unit is specifically configured to:

Ranking the at least one recommendation object according to the number of viewer accounts with which the at least one recommendation object is associated, respectively;

And displaying the display page based on the ordering order of the at least one recommended object.

In one aspect, a computer device is provided comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps of any of the methods described above when the computer program is executed.

In one aspect, there is provided a computer storage medium having stored thereon computer program instructions which, when executed by a processor, perform the steps of any of the methods described above.

In one aspect, a computer program product or computer program is provided, the computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The computer instructions are read from a computer-readable storage medium by a processor of a computer device, and executed by the processor, cause the computer device to perform the steps of any of the methods described above.

In the embodiment of the application, the terminal equipment can present at least one visual hot zone, and the visual hot zone is used for representing the number of audiences looking at the position area where the corresponding recommended object is located in the live broadcast picture, so that when the live broadcast picture is watched, the interest degree of the audiences on the recommended objects can be more intuitively known without actively carrying out interaction actions by the audiences, the feedback of the audiences is obtained more timely, the live broadcast content can be correspondingly adjusted in time by a host, and the accuracy of the live broadcast content is improved. For example, when the main broadcasting and live broadcasting are used for recommending the articles, the introduction and recommendation of the articles can be performed in a targeted manner, so that the accuracy of article recommendation is improved, and the experience of the audience is better.

Drawings

Fig. 1 is a schematic view of an application scenario provided in an embodiment of the present application;

fig. 2 is a flowchart illustrating a method for displaying a hot zone of a live broadcast picture according to an embodiment of the present application;

Fig. 3a to fig. 3b are schematic diagrams of live broadcast pictures according to an embodiment of the present application;

fig. 4a to fig. 4c are schematic diagrams of live broadcast pictures showing a visual hot zone according to an embodiment of the present application;

fig. 5 is another flow chart of a hot zone display method of a live broadcast picture according to an embodiment of the present application;

Fig. 6 is a schematic diagram of eye tracking according to an embodiment of the present application;

fig. 7 is a schematic flow chart of a hot zone display method of a live broadcast picture according to an embodiment of the present application;

fig. 8 is a schematic flow chart of a hot zone display method of a live broadcast picture according to an embodiment of the present application;

fig. 9a to 9g are schematic operation diagrams of live broadcast frames according to an embodiment of the present application;

FIG. 10 is a schematic diagram of an operation of displaying a display page according to an embodiment of the present application;

fig. 11 is a schematic structural diagram of a hot zone display device of a live broadcast picture according to an embodiment of the present application;

Fig. 12 is a schematic structural diagram of a computer device according to an embodiment of the present application.

Detailed Description

For the purpose of making the objects, technical solutions and advantages of the present application more apparent, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application, and it is apparent that the described embodiments are only some embodiments of the present application, not all embodiments of the present application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application. Embodiments of the application and features of the embodiments may be combined with one another arbitrarily without conflict. Also, while a logical order is depicted in the flowchart, in some cases, the steps depicted or described may be performed in a different order than presented herein.

In order to facilitate understanding of the technical solution provided by the embodiments of the present application, some key terms used in the embodiments of the present application are explained here:

live broadcast refers to a technology that audio or video data of a main broadcasting end is collected through collection equipment such as audio or video collection equipment, is compressed into a video stream capable of being watched and transmitted through a series of processes such as video coding, and is output to audience equipment for playing. Live broadcast is a broadcasting mode of carrying out later synthesis and broadcasting simultaneously, and other contents, such as picture special effects (such as beauty special effects or face shielding special effects), interactive operation controls (such as praise, comment or attention controls) and recommended object (such as commodity) inlets, are synthesized and displayed in a picture besides audio or video data acquired by acquisition equipment in a live broadcast picture.

The recommended object can be content displayed in the live broadcast picture, such as physical objects placed in the main physical space, or electronic content displayed in the live broadcast picture, such as virtual objects, characters or link addresses. For example, when the presenter recommends physical commodities displayed in the physical space, the presenter may introduce each commodity, and the viewer may determine whether to purchase the commodity based on the presenter's introduction, then the recommended object may be the commodity, while for some live broadcasts, the presenter's recommended object is not the physical commodity but electronic content such as text displayed in the screen, then the recommended object may be the text. The embodiments of the present application are not limited in this regard as to the specific form of the recommended object.

The visual hot zone is capable of measuring the attention of the audience watching the live broadcast picture of each recommended object, and is a result obtained by dividing the live broadcast picture by taking the recommended objects as units according to the attention of the audience watching the live broadcast picture, for example, the higher the attention of the audience to a certain recommended object is, the higher the attention of the visual hot zone characterization is, for example, when the color blocks are marked, the darker and denser the color blocks of the recommended object area with the higher attention are. The attention is mainly measured by a recommended object watched by an eye gaze point of a viewer.

Eyeball fixation point-the eyeball fixation point is the eye drop point of the audience on the terminal equipment, which is determined by utilizing the eyeball tracking technology. The eyeball tracking technology is a scientific technology capable of predicting the eye drop point of a user in real time, when eyes of people look in different directions, eyes have tiny changes, the changes can generate extractable characteristics, and the characteristics can be detected by terminal equipment through an image capturing or scanning extraction mode, so that the changes of the eyes are tracked in real time, and the eye drop point of the user is predicted.

Audience accounts, which are typically used by the audience, in live scenes, including the anchor and the audience, by logging into the audience account at the live client to view the live content. In an actual scenario, the viewer may use the guest account to watch live without registering the account, and thus the viewer account may include the guest account.

The following briefly describes the design concept of the embodiment of the present application.

Along with the continuous development of science and technology, each flow platform provides a live broadcast function, and a host can recommend objects to audiences in a live broadcast mode, but due to the limitation of physical space, the host cannot directly check the audiences, cannot directly obtain feedback of the audiences from reflection of the audiences, and can only passively accept the feedback of the audiences, so that the host has certain uncertainty in selection of live broadcast contents, and thus cannot timely adjust currently recommended objects, the objects cannot be accurately recommended to the audiences, the recommendation accuracy of the objects is low, for example, when the host does not know the objects of which kind of in the audience, if some objects which are not interested by the audiences are introduced, the viewing experience of the audiences is poor.

For these problems, the main reason is that the presenter cannot actively acquire the feedback of the audience, but only can judge the preference degree of the audience through the barrage, the praise or the gift presented, the judgment dimension threshold is higher, and the audience needs to have the active actions before judgment, so that a brand new dimension for acquiring the feedback of the audience is needed to solve the problems, and the presenter can actively present the feedback of the audience to the presenter.

In view of this, an embodiment of the present application provides a method for displaying a hot zone of a live broadcast picture, where in the method, a terminal device may present at least one visual hot zone, where the visual hot zone is used to represent the number of viewers watching a location area where a corresponding recommended object is located in the live broadcast picture, so that when viewing the live broadcast picture, the viewers do not need to actively perform an interaction action, and the interest degree of the viewers on each recommended object can be more intuitively known, and the feedback of the viewers is more timely obtained.

In some embodiments, when the terminal device uses the viewer account to play the live broadcast picture, the viewer account is associated with the recommended object through the detected position area of the eye gaze point on the live broadcast picture, and when the visual hotspots need to be presented on the live broadcast picture, the corresponding visual hotspots can be presented on the live broadcast picture.

In some embodiments, by collecting the line-of-sight drop point and track of the viewer at the viewer end and displaying the line-of-sight drop point and track in a hot zone form at the anchor end, the anchor can judge which pictures are interesting to the viewer and are not interesting to the viewer according to the hot zone, so that the anchor can timely adjust live broadcast content, such as adjusting live broadcast shots or speaking content, and performing key explanation on pictures more interesting to the viewer, so that live broadcast becomes more flexible, and as a live lecture, the conversation can be timely adjusted according to feedback of the viewer, the atmosphere is active, and meanwhile, the viewing experience of the viewer is improved.

Therefore, in the method provided by the embodiment of the application, the anchor terminal device can actively present the feedback of the audience to the anchor, the dimension of the anchor for acquiring the feedback of the audience is expanded, and correspondingly, the anchor can timely adjust the live content, so that the accuracy of the live content is improved. For example, when the main broadcasting and live broadcasting are used for recommending the articles, the introduction and recommendation of the articles can be performed in a targeted manner, so that the accuracy of article recommendation is improved, and the experience of the audience is better.

After the design idea of the embodiment of the present application is introduced, some simple descriptions are made below for application scenarios applicable to the technical solution of the embodiment of the present application, and it should be noted that the application scenarios described below are only used for illustrating the embodiment of the present application and are not limiting. In the specific implementation process, the technical scheme provided by the embodiment of the application can be flexibly applied according to actual needs.

The scheme provided by the embodiment of the application can be suitable for most video application scenes, and is particularly suitable for real-time video application scenes such as live scenes. As shown in fig. 1, a network architecture schematic diagram is provided in an embodiment of the present application, where the architecture may include a first device 101, a server 102, and a second device 103.

The first device 101 may install and run a real-time video application, such as a browser or a real-time video client, where video playing is possible, and the user may perform a corresponding real-time video service, such as a live service, on the application. The application related to the embodiment of the application can be a software client, a webpage, an applet and other clients, and the server is a background server corresponding to the software, the webpage, the applet and the like, and the specific type of the client is not limited. The first device 101 may be a terminal used by a first type of user, and the first type of user may implement playing of real-time video using the first device 101.

The server 102 may be a background server corresponding to a real-time video application installed on the first device 101, for example, may be an independent physical server, may be a server cluster or a distributed system formed by a plurality of physical servers, or may be a cloud server that provides cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, that is, a content distribution network (Content Delivery Network, CDN), and basic cloud computing services such as big data and an artificial intelligent platform, but is not limited thereto.

The second device 103 may also install and run a real-time video application, such as a browser or a real-time video client, where video playing is possible, and the user may perform a corresponding real-time video service, such as a live service, on the application. The second device 103 may be a terminal used by a second type of user, and the second type of user may implement initiation and playback of real-time video using the first device 101.

The communication connection between the first device 101 and the server 102, and between the second device 103 and the server may be direct or indirect via one or more networks. The network may be a wired network, or may be a Wireless network, for example, a mobile cellular network, or may be a Wireless-Fidelity (WIFI) network, or may be other possible networks, which embodiments of the present invention are not limited in this respect.

The first device 101 or the second device 103 may be, for example, a smart phone, a smart palm phone, a tablet personal computer (PAD), a notebook computer, a desktop computer, a smart television, a vehicle-mounted terminal, or the like, but is not limited thereto.

Taking a live broadcast scene as an example, the first device 101 may be a host device, and accordingly, an application program installed on the first device 101 may collect audio data or video data through a data collecting device such as a camera and a microphone and the like included in the first device 101 for a host client host used by the host, or may collect audio data or video data through a camera device or a recording device externally connected to the first device 101, and upload the audio data or video data to the server 102, so as to generate a live broadcast picture through the collected audio data or video data.

The second device 103 may be a viewer-side device, and the application on the terminal device 103 may be a viewer client used by a viewer, who may obtain live-view screen data from the server 102 using the viewer client, and display the live-view screen data through the viewer client.

In a practical scenario, one terminal device may generally be used as both the first device 101 and the second device 103.

In actual application, after the anchor creates a live room through the first device 101, the audience can enter the live room through the second device 103 to watch the live pictures. The second device 103 may detect the eye gaze point of the viewer in real time by eye tracking techniques while the viewer is watching the live view. The second device 103 may detect the eye gaze point by Infrared detection or image recognition, or may detect the eye gaze point by other possible methods, for example, the second device 103 may include an Infrared (IR) light camera, and further may determine the eye gaze point according to the reflected light of the pupil by illuminating the pupil with the IR light. Meanwhile, the second device 103 may perform real-time image recognition on the live broadcast picture, identify the location area of each recommended object in the live broadcast picture, further determine the recommended object watched by the viewer in combination with the location information of the eye gaze point in the live broadcast picture, and upload the viewer information (i.e. the current account information of the viewer registered by the second device 103) and the recommended objects watched by each viewer to the server 102 in real time.

In a possible implementation manner, the first device 101 may perform real-time image recognition on the live broadcast picture in real time, identify the location area of each recommended object in the live broadcast picture, and upload each recommended object to the server 102 in the location area of the terminal of the first device 101, so that the server 102 may generate the visual hot zone corresponding to each recommended object based on the received recommended object watched by each viewer and sent by the second device 103, and the location area of each recommended object uploaded by the first device 101. When the first device 101 requests the display of the visual hot zone, the generated visual hot zone data is sent to the first device 101 for presentation of the visual hot zone in the first device 101.

In another possible implementation manner, the server 102 issues the recommended objects watched by the viewers to the first device 101, and the first device 101 can also perform real-time image recognition on the live broadcast picture in real time, identify the location area of each recommended object in the live broadcast picture, and generate the visual hotspots of each recommended object in combination with the recommended object watched by each viewer. When the anchor operates to display the visual hot zone, the first device 101 may present the visual hot zone in a live view. In this way, by generating the visual hot zone by the first device 101, delay in the presentation of the visual hot zone can be effectively reduced, and instantaneity of the visual hot zone information acquired by the anchor can be improved.

Of course, in the above embodiments, the first device 101 presents the visual hot zone as an example, but in practical application, the second device 103 may also present the visual hot zone.

In addition, in the above embodiment, a live video scenario is taken as an example, but the method of the embodiment of the present application may be applied to other video scenarios as well, for example, the method of the embodiment of the present application may be applied to a multi-person video conference scenario, and then each terminal device in the multi-person video conference scenario may correspond to the first device 101 or the second device 103 described above, or the method of the embodiment of the present application may also be applied to an online classroom scenario, and then a teacher end device in the online classroom scenario may correspond to the first device 101 described above, and a student end device may correspond to the second device 103 described above, for example, although the embodiment of the present application is not limited thereto.

It should be noted that, in the embodiment of the present application, the number of the first devices 101 may be one or more, and similarly, the number of the servers 102 may be one or more, that is, the number of the first devices 101 or the servers 102 is not limited.

In one possible application scenario, related data (such as recommended objects watched by each viewer account, etc.) in the embodiments of the present application may be stored using a cloud storage (closed storage) technology. Cloud storage is a new concept which extends and develops in the concept of cloud computing, and a distributed cloud storage system refers to a storage system which integrates a large number of storage devices (or called storage nodes) of different types in a network through application software or application interfaces to cooperatively work and jointly provides data storage and service access functions for the outside through functions of cluster application, grid technology, a distributed storage file system and the like.

At present, a storage method of a storage system is that logical volumes are created, and when the logical volumes are created, a physical storage space is allocated to each logical volume, where the physical storage space may be a disk of a certain storage device or a plurality of storage devices. The client stores data on a certain logical volume, that is, the data is stored on a file system, the file system divides the data into a plurality of parts, each part is an object, the object not only contains the data but also contains additional information such as a data Identification (ID) and the like, the file system writes each object into a physical storage space of the logical volume, and the file system records storage position information of each object, so that when the client requests to access the data, the file system can enable the client to access the data according to the storage position information of each object.

The storage system allocates physical storage space for a logical volume, specifically, the physical storage space is divided into stripes in advance according to the set of capacity estimation of objects stored in the logical volume (the estimation often has a large margin with respect to the capacity of the objects actually to be stored) and redundant array of independent disks (RAID, redundant Array of INDEPENDENT DISK), and one logical volume can be understood as one stripe, so that the physical storage space is allocated for the logical volume.

In one possible application scenario, to facilitate reducing the communication latency, the server 102 may be deployed in each region, or different servers 102 may serve regions corresponding to each of the first device 101 or the second device 103, respectively, for load balancing. The plurality of servers 102 are configured to share data by a blockchain, and the plurality of servers 102 correspond to a data sharing system formed by the plurality of servers 102. For example, the first device 101 or the second device 103 is located at the location a, and is in communication connection with the server 102, and the first device 101 or the second device 103 is located at the location b, and is in communication connection with other servers 102.

For each server 102 in the data sharing system having a node identifier corresponding to the server 102, each server 102 in the data sharing system may store the node identifiers of other servers 102 in the data sharing system, so that the generated block may be subsequently broadcast to other servers 102 in the data sharing system according to the node identifiers of the other servers 102. A list of node identifiers may be maintained in each server 102, and the server 102 name and node identifier may be stored in the list of node identifiers. The node identity may be a protocol (Internet Protocol, IP) address of the interconnection between networks, as well as any other information that can be used to identify the node.

Of course, the method provided by the embodiment of the present application is not limited to the application scenario shown in fig. 1, but may be used in other possible application scenarios, and the embodiment of the present application is not limited. The functions that can be implemented by each device in the application scenario shown in fig. 1 will be described together in the following method embodiments, which are not described in detail herein.

The method flow provided in the embodiments of the present application may be performed by any one of the first device 101, the second device 103, or the server 102 in fig. 1, or may be performed by the first device 101 and the second device 103 together, or may also be performed by the first device 101, the second device 103, and the server 102 together, and the description will be mainly given below taking the first device 101, the second device 103, and the server 102 as examples.

Referring to fig. 2, a flowchart of a method for displaying a hot zone of a live broadcast picture according to an embodiment of the present application is shown.

Step 201, the terminal equipment displays a live broadcast picture of the live broadcast room, wherein the live broadcast picture displays at least one recommended object.

It should be noted that, the terminal device may be the first device 101 mentioned above, or may be the second device 103 mentioned above, that is, in practical application, the device performing the visual hot zone display may be a hosting device or a viewer device, which is not limited to this embodiment of the present application.

In the implementation process, the terminal equipment can respond to the creation operation of the live broadcasting room of the host, create the corresponding live broadcasting room, and can respond to the start operation of the host, and when the host carries out live broadcasting, in order to enable the host to know the condition of live broadcasting and the feedback of audiences, the live broadcasting picture of the live broadcasting room is displayed on the terminal equipment.

In some embodiments, the terminal device may respond to a start operation of the live broadcast application by the anchor, start the live broadcast application, and perform an opening operation in the live broadcast application based on the anchor, request an opening to a server corresponding to the live broadcast application, and correspondingly, display a live broadcast picture on the terminal device based on a response of the server.

In some embodiments, the terminal device may also initiate live reference in response to a trigger from another device. For example, when a host is live, other external devices, such as a camera device, a microphone device, a light device, an external display screen, and the like, are usually connected, and when the host confirms that the live is required after the debugging of all the devices is completed, the terminal device can start the live application to perform subsequent related operations through triggering of the devices.

Correspondingly, the terminal equipment can also enter the live broadcasting room of the main broadcasting in response to the operation of entering the live broadcasting room of the audience, namely, the live broadcasting picture of the live broadcasting room is displayed on the terminal equipment.

In some embodiments, the terminal device may respond to the starting operation of the audience to the live broadcast application, start the live broadcast application, and request the live broadcast data of the live broadcast room from the server based on the live broadcast room selected by the audience in the live broadcast application, and further display the live broadcast picture on the terminal device based on the response of the server.

In some embodiments, the content displayed by the anchor device and the content displayed by the viewer device may be the same, or there may be a certain difference, for example, the live broadcast picture displayed by the anchor device may include a function button not included in the live broadcast picture displayed by the viewer device, and similarly, the live broadcast picture displayed by the viewer device may also include a function button not included in the live broadcast picture displayed by the anchor device.

In the process, the terminal equipment starts the live broadcast application, and displays a live broadcast picture in the live broadcast application, wherein one or more recommended objects are displayed in the live broadcast picture.

In some implementations, the recommended objects may be physical items placed in a physical space of the living room.

Fig. 3a is a schematic diagram of a live view. When the main cast a creates a live room, or after the created live room is opened, a view into the live room view of the main cast a can see a live screen as shown in fig. 3 a. When the main broadcasting a carries out live broadcasting, a video picture can be shot through an image acquisition device such as a camera, and the video picture is displayed for audiences, as shown in fig. 3a, the main broadcasting a shoots an object display table in a physical space through the camera, so that the object display table can also be displayed in the live broadcasting picture, a plurality of entity objects are displayed on the object display table, as shown in fig. 3a, the object display table in the uppermost row displays a plurality of enterprise dolls, the object display table in the second row displays toy cars, cups, rabbit dolls and the like, the audiences can watch all entity objects on the object display table through the live broadcasting picture displayed by the audience terminal device, the entity objects can be recommended objects, the main broadcasting can introduce all entity objects, and the audiences can judge whether the entity objects are needed or not based on the introduction of the main broadcasting.

In some embodiments, the recommended object may also be electronic content displayed in a live screen, such as a virtual item, text, or a link address.

Referring to fig. 3b, another live view is shown. In the live view shown in fig. 3a, instead of providing the live view by using an image capturing device such as a camera, the anchor a may directly present an electronic content interface, for example, a screen of another electronic device may be accessed to form the live view, and then the electronic content presented in the live view may also be used as a recommendation object.

For example, the anchor a may be a game anchor, and then the anchor a may access a game screen currently being played to form a live broadcast screen, as shown in fig. 3b, the anchor a may be currently located in a game hero selection interface, on which game heros 1-4 are displayed, through which the anchor a may select a hero to be played next, or select a hero to be explained by a spectator, and then these heros may be recommended objects.

And 202, the terminal equipment responds to a hotzone display instruction triggered for the live broadcast picture, at least one visual hotzone is presented in the live broadcast picture, and each visual hotzone is used for representing the number of audiences gazing at a position area where a corresponding recommended object is located in the live broadcast picture.

In the embodiment of the application, in order to enable a host or a viewer to acquire the interest degree of the viewer currently watching the live broadcast picture on each recommended object in the live broadcast picture, a visual hot zone of the current live broadcast picture can be displayed for the host or the viewer.

In some embodiments, referring to fig. 3a and fig. 3b, a hot zone display control is further displayed in the live broadcast picture, when a visual hot zone of the live broadcast picture needs to be presented, a trigger operation may be performed on the hot zone display control, and accordingly, based on the trigger operation, the terminal device may receive a hot zone display instruction, for example, may be a hot zone display instruction received by a live broadcast application client on the terminal device, so as to present a corresponding visual hot zone.

In fig. 3a and 3b, the hot zone display control is respectively displayed at the bottom end and the top end of the live broadcast picture, but it should be understood that, for the display position, the icon style, and the like of the hot zone display control, the embodiment of the present application is not limited thereto, and in practical application, the hot zone display control may be correspondingly set according to practical situations.

Optionally, the triggering operation of the user on the hot zone display control includes, but is not limited to, clicking operation, long press operation, double click operation, sliding operation, etc., and the embodiment of the application does not limit the type of triggering operation. Also, when the trigger operation is mentioned later, the operation types of the operations may be the operations described above, and the trigger operations may be the same or different for different spaces.

In some embodiments, for the sake of the cleanliness of the live broadcast screen, the display of the hot zone display control may not be performed in the live broadcast screen, and the user (may be a host or a viewer) may trigger the terminal device to acquire the hot zone display instruction in other manners. For example, a shortcut key is set, that is, a certain key of the terminal device is set as a shortcut key displayed in the hot zone, so that the terminal device can obtain a display instruction of the hot zone by operating the shortcut key. Or the gesture for displaying the hot zone can be preset in a gesture operation mode, and when an operator uses the gesture to operate the terminal device, the terminal device can acquire a hot zone display instruction. Of course, the hot zone display instruction may be triggered by other modes, such as a voice control mode, an eye movement triggering mode, an expression triggering mode, and a limb action triggering mode, which are not limited in the embodiment of the present application.

In some embodiments, the terminal device may also automatically detect whether the condition of the hot zone display trigger is met, and if so, automatically trigger the hot zone display instruction, and correspondingly, the terminal device displays the visual hot zone based on the hot zone display instruction triggered by itself. For example, the frequency of the hot zone display may be preset, for example, once for 2 minutes or once for 5 minutes, when the time arrives, the terminal device determines that the triggering condition of the hot zone display is met, and automatically triggers the hot zone display instruction, or the terminal device may further detect a live broadcast picture, when specific content appears in the live broadcast picture, the terminal device determines that the triggering condition of the hot zone display is met, and automatically triggers the hot zone display instruction, or the terminal device may determine based on the attention degree of each current audience to the recommended object, for example, when the attention degree of a certain commodity is particularly high, and the attention degree of the currently introduced commodity of the anchor is low, the terminal device determines that the triggering condition of the hot zone display is met, and automatically triggers the hot zone display instruction. Of course, the hot zone display instruction may also be triggered by a triggering condition, and the embodiment of the present application does not limit the manner in which the hot zone display instruction is triggered.

In the embodiment of the application, when the live broadcast application is used, the user can selectively select the triggering mode of the hot zone display instruction, namely, the expected triggering mode can be preset, and further, in the display process of the anchor picture, the hot zone display instruction can be triggered by adopting the corresponding triggering mode.

Optionally, the user may also choose to turn off the hotbox display function, which represents that the user does not wish to display the visual hotbox, and therefore, does not trigger the display of the visual hotbox during the live display.

In the embodiment of the application, the visual hotspots are used for representing the number of audiences gazing at the position area where the corresponding recommended object is located in the live broadcast picture. In practical applications, a viewer uses one viewer account to watch live broadcast content, so that each visual hotzone, that is, the number of viewer accounts associated with the corresponding recommended objects, is represented, and the association relationship between the recommended objects and the viewer accounts is established according to the position area of at least one recommended object in the live broadcast picture and the position relationship between the eyeball gaze point detected by the terminal device when the terminal device uses the viewer account to play the live broadcast picture, in other words, the regional distribution condition of the eyeball gaze point of the viewer on the live broadcast picture can be reflected, and when the eyeball gaze point of the viewer is distributed more densely in the position area of a certain recommended object, the current more viewers are indicated to have higher interest degree in the recommended object.

In some embodiments, the association of the viewer account and the recommended object indicates the recommended object watched by the viewer account, that is, when a viewer views a live broadcast picture through its corresponding viewer account, the viewer account of the viewer is associated with the recommended object when the eye gaze point of the viewer is located on a certain recommended object. Note that, when the viewer views the live broadcast picture, the eye gaze point is continuously changed, for example, the viewer focuses on commodity a in the last second, and then the viewer may shift his or her line of sight to commodity B in the next second.

In the embodiment of the present application, at least one of the following manners may be adopted, where at least one visual hot zone is presented in a live broadcast picture, and fig. 4a and fig. 4b are schematic diagrams of live broadcast pictures presenting the visual hot zone in combination with fig. 4a to fig. 4 c.

(1) And displaying at least one piece of marking information in the position area corresponding to each recommended object, wherein one piece of marking information represents at least one audience account associated with the corresponding recommended object.

In the embodiment of the application, the number of the audience accounts can be presented by marking each audience account associated with each recommended object.

In some embodiments, it may be that one of the indicia information corresponds to one of the viewer accounts. That is, when the recommended object associated with the viewer account 1 is the recommended object a, a flag is added in the location area of the recommended object a, so that the number of the recommended objects a associated with the viewer account is reflected in the number of the flags.

In some implementations, the color patches may be used as the indicia information and the color patches for each viewer account are the same. When the audience account 1 is associated with the recommended object A, one color block is added in the position area of the recommended object A, so that the color blocks of the audience account associated with the recommended object A are overlapped in the position area, the attention degree of the recommended object A can be intuitively reflected through the density degree and the color depth degree of the color blocks, and the darker the color blocks are, the higher the attention degree of the recommended object A is indicated. Referring to fig. 4a, a corresponding number of color patches are displayed in a superimposed manner in the corresponding location area of each displayed commodity, such as in the first row of article display stands, the number of viewers whose eye gaze point falls in the first penguin doll area from the left is less than the number of viewers whose eye gaze point falls in the second penguin doll area from the left, so that the number of color patches in the first penguin doll area is significantly less than the number of color patches in the second penguin doll area in the visual hot zone presented. It should be noted, however, that the number of color patches shown in fig. 4a may not directly correspond to the number of viewers at the view, since there may be an overlap of color patches.

In some embodiments, one piece of tagging information may correspond to multiple viewer accounts. That is, one piece of flag information may characterize a plurality of viewer accounts viewing a certain recommended object, for example, when there are 1W viewers viewing a certain recommended object, one piece of flag information is added in a location area of the recommended object.

In the embodiment of the application, the density of the marking information is positively correlated with the number of associated audience accounts, that is, the more the number of audiences watching a certain recommended object is, the more the number of marking information in the position area of the recommended object is.

Optionally, in the implementation process, the specific style of the color block is not limited by the embodiment of the present application. For example, different recommended objects may use the same color block, such as red or green, or different recommended objects may use different color blocks, such as one color number for each recommended object. In addition, different recommended objects may adopt the same color block shape, such as the circular shape shown in fig. 4a, or different recommended objects may also adopt different color block shapes, such as the color block shape corresponding to the recommended object a is a circular shape and the color block shape corresponding to the recommended object is a star shape. Also, the marking pattern of the visual hot zone is not limited to the patch pattern, and may be any visual pattern that can serve the purpose of marking.

In some embodiments, the visual hot zone may also be presented in the form of a heat map, and when one viewer account is associated with the recommended object a, the color of the location area of the recommended object a is deepened by one unit, so that the number of the viewer accounts associated with the recommended object a determines the degree of color shade in the location area, and the degree of attention of the recommended object a can be intuitively reflected through the degree of color shade in the heat map. As shown in fig. 4b, the focus of the audience on each game hero is reflected by overlapping the colors in the corresponding position area of each game hero, for example, the color of the game hero 1 is obviously lighter than that of the game hero 2, which indicates that the focus of the audience on the game hero 2 is higher than that of the game hero 1.

(2) The number of viewer accounts associated with each recommendation object is displayed.

In order to more intuitively reflect the attention degree of each recommended object, the number of audience accounts associated with each recommended object can also be directly displayed.

Referring to fig. 4a and 4b, each recommended object also shows the number of corresponding viewers at the same time. An on-sight audience for a recommended object refers to an audience whose line of sight falls within the recommended object region (i.e., the eye gaze point detected).

In some implementations, the number of viewers at the watch may be displayed within a corresponding region of the recommended object. As shown in fig. 4a, in the first row of object display stands, "about 2 tens of thousands of people are looking" is displayed in the vicinity of the first penguin doll from the left, which means that the number of viewers whose eye gaze point falls within the penguin doll area is about 2 tens of thousands of people. As another example, as shown in fig. 4b, "about 2 tens of thousands of people are looking" is displayed in the position area of the game hero 1, which means that the number of viewers whose eye gaze point falls within the game hero 1 is about 2 tens of thousands of people.

In some implementations, the number of viewers at the watch of each recommended object may also be displayed in a ranked manner. Referring to fig. 4c, in order to facilitate the hosting to obtain the attention degree ranking of each game hero more conveniently, the number of watched audience of each game hero can be presented directly in a ranking manner, for example, in the current live broadcast picture, the number of watched audience of game hero 2 is about 9 ten thousand, the number of watched audience of game hero 3 is about 6 ten thousand, the number of watched audience of game hero 3 is about second, and so on.

The display mode and the display style of the number of viewers to be watched are not limited. Other possible bubble patterns may be used as well, or a display of the number of viewers at the watch may be made at other locations. Furthermore, the data of the appearance of the visual hot zone is not limited to the number of people, and may be all data related to the user portrait, such as geographical location, age, etc.

(3) The recommended object with the largest number of associated viewer accounts is displayed in a different hotspot display style than the remaining recommended objects.

In the embodiment of the application, the first recommended object is used for indicating the recommended object with the largest number of associated audience accounts, namely the recommended object with the largest audience, and the second recommended object is the rest recommended objects except the first recommended object. In order to facilitate the anchor to more intuitively know which recommended object has the highest attention, the visual hot zone of the recommended object may be displayed in a different manner from other recommended objects.

In one embodiment, the visual hot zone of the first recommended object may be highlighted. The highlighted content may be a location area of the recommended object or the number of viewers at the same time. As shown in FIG. 4a, the number of the audience watching the penguin dolls in the middle of the first row is about 7 ten thousand, the penguin dolls are the first recommended objects when the first recommended objects are arranged in all the objects, and the other objects are the second recommended objects, so that the bubbles of the number of the audience watching the penguin dolls can be highlighted when the visual hot zone is presented, and the number of the audience watching the penguin dolls is displayed by using the bubbles with darker colors in FIG. 4a, so that the number of the audience watching the penguin dolls is more striking. As shown in fig. 4b, the number of the watched audience of the game hero 2 is about 9 ten thousand, the first game hero 2 is the first recommended object, and the other game heros are the second recommended objects, and when the visual hotspots are presented, the number of the watched audience of the game hero 2 can be highlighted, and in fig. 4b, the number of the watched audience of the game hero 2 is specifically displayed by adopting bold characters, so that the number of the watched audience of the game hero 2 is more striking.

(4) Display styles for different visual hotspots are formulated based on the number of associated viewer accounts.

In the embodiment of the application, the recommended objects with different numbers of the associated audience accounts are displayed in different hot zone display modes, or the recommended objects with different numerical intervals in which the numbers of the associated audience accounts are positioned are displayed in different hot zone display modes.

In some implementations, the first class of recommended objects represents recommended objects having a number of associated viewer accounts greater than the object number threshold, and the second class of recommended objects represents recommended objects having a number of associated viewer accounts not greater than the object number threshold. That is, a number threshold may be preset to highlight the recommended objects with higher viewer interest, for example, the number threshold may be set to 30% of the total audience in the living room, and then the visual hot zone of the recommended objects with the number of viewers being more than 30% may be highlighted. Of course, the threshold number of objects is merely an example, and in practical application, corresponding values may be set according to actual requirements, which is not limited by the embodiment of the present application.

It should be noted that, the live broadcast images showing the visual hot zone shown in fig. 4a to 4c are only examples, and in practical application, the visual hot zone can be shown in any other possible manner, which is not limited in the embodiment of the present application.

It should be noted that, because the association relationship between the recommended object and the account of the viewer changes in real time, correspondingly, the visual hot zone also changes along with the real-time change of the association relationship. For example, the number of viewers at the previous time is 8 ten thousand, and the number of viewers at the current time is only 2 ten thousand, the visual hotspots of the recommended object a need to be correspondingly adjusted, such as adjusting the number and color of the display color patches and the value of the number of viewers at the current time. In addition, when the host broadcast is in live broadcast, the shooting area of the shooting equipment may be adjusted, or the live broadcast content may be adjusted, and the live broadcast picture may be correspondingly changed, so that the visual hot zone may be changed accordingly. For example, the area photographed at the previous moment includes the object a, and after the lens of the image capturing device is adjusted, the object a is moved out of the live broadcast picture, then the visual hot zone of the object a is no longer presented, and if a certain object B appears newly, the visual hot zone of the object B is also displayed according to the new data.

In the embodiment of the present application, referring to fig. 4a to fig. 4c, after the terminal device responds to the hot zone display instruction, the state of a part of the controls on the live interface is changed, for example, the hot zone display control is changed to a hot zone closing control, and as shown in the drawing, the hot zone closing control is changed to a "closing hot zone" button, so that a user can perform a triggering operation on the hot zone closing control, and correspondingly, the terminal device responds to the triggering operation, at least one visual hot zone displayed is hidden, and the live image before being displayed is returned.

The following describes an embodiment of the present application by taking a case where a second device (a viewer device) collects eye gaze points of a viewer and a first device (a anchor device) displays a visual hot zone. Referring to fig. 5, another flow chart of the method for displaying a hot zone of a live broadcast picture according to the embodiment of the present application is shown.

In step 501a, a first device performs object recognition on a live broadcast picture to obtain a position area of each recommended object in the live broadcast picture.

And step 501b, the second device performs object identification on the live broadcast picture to obtain the position area of each recommended object in the live broadcast picture.

In the embodiment of the application, in general, the live broadcast side and the audience side can display live broadcast pictures, but because of different devices used by the live broadcast side and the audience side, the positions of each recommended object on the device screen may be different, so that each terminal device (including the first device and the second device) can identify the live broadcast pictures (including people and objects in the pictures) in real time, and record the position areas of each recommended object (including the people and the objects in the pictures) on the live broadcast pictures in real time.

In some embodiments, the location area may refer to a location area of a recommended object on a screen of the terminal device when the terminal device displays the live broadcast picture, so that the location area of each recommended object is identified in real time, so that the location area is convenient for subsequent comparison with an implementation drop point of a viewer, or is convenient for subsequent display of a visual hot zone.

In the embodiment of the application, the object identification refers to identifying the live broadcast picture in an image identification mode, namely identifying the recommended object and the corresponding position area contained in the live broadcast picture. Since the live broadcast picture generally includes a video stream picture (refer to a video picture shot by the image capturing device) and further includes other function buttons or icons, the object recognition may refer only to recognition of the video stream picture, that is, each frame of image of the video stream picture may be used as an image to be recognized, so that each frame of image of the video stream picture may be recognized, and a recommended object included in each frame and a corresponding location area may be stored, or the object recognition may also be recognition of the current whole live broadcast picture, for example, a screen of a display screen of the terminal device may be used to capture the image to be recognized, and then the captured image to be recognized may be recognized, and the recommended object included in each frame and the corresponding location area may be stored.

It should be noted that, the processes of the step 501a and the step 501b are not substantially sequential, and the first device executing the step 501a and the second device executing the step 501b may be performed continuously in real time, so that the first device executing the step 501a and the second device executing the step 501b may be performed simultaneously, or a certain sequential order may exist.

Step 502, the second device obtains the position information of the detected eye gaze point on the live broadcast picture.

The second device may be a terminal device corresponding to any viewer account entering the living room. In an implementation, the second device may not include it, because of the hardware limitations of some terminal devices, which may not support eye tracking.

The second device may detect the eye gaze point of the current audience in real time based on eye tracking techniques.

In some embodiments, eye tracking may be performed using an eye controller included with the second device. Referring to fig. 6, a schematic diagram of eye tracking is shown. The eye control instrument can comprise a built-in infrared light source, an optical sensor, an image processor, a viewpoint calculating core and the like.

When the second device is playing a live view, the viewer views the live view, and at this time, the eye controller included in the second device performs step S1 in fig. 6, i.e. the eye controller projects the created set image onto the human eye, which image may be projected by an infrared light source, for example, and is not normally perceived by the human eye. After the image is projected, the eye controller performs S2, that is, captures a face image through an optical sensor included therein, thereby obtaining image information of the eyes from the face image. Next, the eye control device performs S3 step, that is, extraction of the eye image features by an image processor included therein, based on the captured eye image information. Further, the eye controller performs S4 step of calculating eyeball fixation point position information, such as coordinates on the second device screen (screen coordinates may be mapped to positions on the live view), through a point calculation core included therein based on the eye image features.

In some embodiments, the camera of the second device may be further used to capture a face image of the viewer, and further analyze the face image with a deep learning model to obtain an eye gaze point of the viewer corresponding to the second device.

In the embodiment of the present application, the adopted eye tracking technology is only required to be able to detect the eye gaze point of the viewer, and the specific implementation manner and the required physical conditions are not limited. Also, it should be appreciated that detecting eye gaze points using eye tracking techniques may be under the permission of a viewer, such as when the detection is first made, the live application may require the viewer to be required to authorize the eye detection function.

Step 503, the second device determines a target recommended object corresponding to the location area where the location information is located.

In the embodiment of the application, the position information of the eye gaze point is compared with the position areas of the recommended objects, so that the position area of the recommended object in which the eye gaze point is located can be obtained, and the recommended object is the target recommended object.

In some embodiments, the location information may be represented by coordinates, and then the coordinates of the eye gaze point may be used to traverse the location area included in each recommended object to obtain the target recommended object corresponding to the matched coordinates.

And 504, the second equipment establishes an association relation between the target audience account and the target recommended object, and uploads the association relation to the background server.

In the embodiment of the application, the target audience account refers to an account logged in a live broadcast application on the second device. In some scenarios, the second device may conduct use of the live application with a guest identity, which may then also be considered the target audience account.

In some embodiments, when the audience uses the target audience account to watch the live broadcast picture, the eye gaze point of the audience falls in the position area of the target recommendation object, and then the target audience account and the target recommendation object have an association relationship, and the association relationship is uploaded to a background server of the live broadcast application.

It should be noted that, the detection of the eye gaze point is continuously performed in real time, and the association relationship may also be uploaded in real time, that is, each time the second device determines in which recommended object location area the eye gaze point of the viewer falls, that is, after the second device determines the recommended object that the current viewer is looking at, the target viewer account used by the viewer and the recommended object that is watched are uploaded to the background server.

Alternatively, the information of the uploaded target viewer account may be information capable of uniquely identifying a viewer account, such as an account identifier (identity), and the information of the uploaded recommended object may be information capable of uniquely identifying a recommended object, such as an object ID or an object connection address.

In embodiments of the present application, generating the visual hot zone may include two ways as follows.

(1) First mode

This approach generates a visual hot zone by the first device, i.e., the approach shown in fig. 5.

In step 505, the first device receives multiple groups of association relations issued by the background server, where each group of association relations includes a recommended object associated with the account of the audience.

In the embodiment of the application, in order to generate the visual hot zone, the first device needs to obtain corresponding support data, namely, obtain the audience account associated with each recommended object in the live broadcast picture, and the background server receives the association relation uploaded by each second device in real time, so that the background server can issue the received association relation to the first device, and the first device can acquire the audience account associated with each recommended object based on the association relation.

In some embodiments, the background server may continuously receive the association relationship, and sequentially send the received association relationship to the first device. That is, each time the background server receives an association relationship sent by the second device, the background server synchronizes with the first device.

In some embodiments, the background server may still continuously receive the association relationship until it is determined that a certain trigger condition is met, and send the association relationship to the first device once. The triggering condition may be, for example, that the time difference from the last transmission reaches a time difference threshold, or that the association relationships of all the second devices are received, or that the number of received association relationships reaches a certain number threshold, or any other possible triggering condition, which is not limited in the embodiment of the present application.

In the embodiment of the application, after the first device receives the association relationship, the recommended objects in the plurality of groups of association relationship can be compared with at least one recommended object so as to determine the audience account associated with each recommended object in the at least one recommended object.

For example, items A, B, C and D are displayed in the live view, and the association received by the first device is shown in table 1 below, where the item associated with the viewer account 1001 is item a, the item associated with the viewer account 1002 is item C, the item associated with the viewer account 1003 is item B, the item associated with the viewer account 1004 is item a, the item associated with the viewer account 1005 is item C, the item associated with the viewer account 1006 is item D, and the item associated with the viewer account 1007 is item a.

TABLE 1

After comparison, the viewer accounts associated with item A are 1001, 1004 and 1007, the viewer account associated with item B is 1003, the viewer accounts associated with item C are 1002 and 1005, and the viewer account associated with item D is 1006.

In step 506, the first device marks the associated viewer account in the location area of each recommended object, and generates a visual hotzone corresponding to each recommended object.

In the embodiment of the application, marking is performed in the corresponding position area according to the position area of each recommended object identified in real time so as to form a visual hot zone of each recommended object. For example, when color blocks are used as marking information, one color block can be marked for each viewer account ID associated with the recommended object in the corresponding position area, and after marking of all viewer account IDs associated with the recommended object is completed, the visual hotspots corresponding to the recommended object are obtained.

It should be noted that, the visual hot zone generated by the first device is not directly displayed, and the first device may receive, in real time, the association relationship data, that is, the account ID of the viewer and the recommendation object data that the background server has sent, and form the visual hot zone in the background of the first device, but not display the visual hot zone, and when the display is triggered, display the visual hot zone on the live broadcast screen based on the formed visual hot zone.

Step 507, the first device responds to the hotbox display instruction triggered for the live screen to present the visual hotbox in the live screen.

This step is referred to the description of step 202 above, and will not be described in detail here.

(2) Second mode

In this manner, the background server integrates the association relationship of each recommended object, and the first device generates the visual hot zone, see the manner shown in fig. 7, where steps 501a, 501b and steps 502-504 in fig. 7 are identical to the embodiment shown in fig. 5, and thus will not be described in detail herein.

Step 508, the first device uploads the identified recommended object to the backend server.

Step 509, receiving the audience account associated with each recommended object in the live broadcast picture sent by the background server.

In the embodiment of the application, after the first device identifies the live broadcast picture, that is, the identified recommended objects are uploaded to the background server in real time, and meanwhile, the background server also receives the association relationship from the second device, so that the background server can integrate based on the recommended objects uploaded by the first device and the association relationship uploaded by the second device to obtain statistics of the audience account associated with each recommended object uploaded by the first device and feed the statistics back to the first device.

It should be noted that, when the background server performs data integration, the method adopted by the background server may be the same as that adopted by the first device for integration, so reference may be made to the description of step 505 above.

And 510, marking the associated audience accounts in the position area of each recommended object by the first device, and generating a visual hotzone corresponding to each recommended object.

Step 511 the first device presents a visual hotbox in the live view in response to the hotbox display instruction triggered for the live view.

Step 510 and step 511 are described in step 506 and step 507, and are not described herein.

(3) Third mode

In this manner, the background server generates the visual hot zone, and the first device displays the hot zone, as shown in fig. 8, wherein steps 501a, 501b and steps 502-504 in fig. 8 are identical to those in the embodiment shown in fig. 5, and thus will not be described in detail herein.

Step 512, the first device uploads the identified recommended object and the corresponding location area information to the backend server.

Step 513, the first device sends a hot zone request to the background server in response to the hot zone display instruction triggered for the live screen.

In the embodiment of the application, after the first device identifies the live broadcast picture, that is, the identified recommended objects are uploaded to the background server in real time, and meanwhile, the background server also receives the association relationship from the second device, so that the background server can integrate based on the recommended objects uploaded by the first device and the association relationship uploaded by the second device to obtain statistics of the audience account associated with each recommended object uploaded by the first device, and mark the corresponding position area by combining the position area information of each recommended object, so as to form the visual hot area of each recommended object.

When the first device needs to present the visual hot zone, if the anchor clicks a 'display hot zone' button, the first device responds to a hot zone display instruction triggered by the clicking operation, and sends a hot zone request to a background server to request visual hot zone data to be displayed.

And step 514, the first device presents the visual hotspots in the live broadcast picture based on the visual hotspot data returned by the background server.

In the embodiment of the application, after the visual hotspots are presented in the live broadcast picture, the host can more conveniently know the recommended objects interested by the audience, so that the recommended objects can be introduced in a targeted manner. Referring to fig. 9a to 9c, an operation flow diagram of the focus target recommended object is shown.

Referring to fig. 9a, after the visual hot zone is presented in the live broadcast picture, the penguin doll in the middle of the first row can be easily seen as the recommended object with the highest attention at present, and then the host can adjust the live broadcast content to introduce the penguin doll. Then, a target visual hot zone may be selected from the visual hot zones presented in the live broadcast picture, where the selected target visual hot zone is taken as an example, and the selected target visual hot zone is a visual hot zone corresponding to the penguin doll with the highest attention, and the target visual hot zone is triggered to jump to the interface shown in fig. 9 b.

Optionally, the triggering operation performed on the target visual hot zone may be, but is not limited to, a clicking operation, a long-press operation, a double-click operation, a sliding operation, etc., and the embodiment of the present application does not limit the type of the triggering operation.

Referring to fig. 9b, after the triggering operation is performed on the target visual hot zone, the operable controls of the target recommended object corresponding to the target visual hot zone are displayed on the live broadcast picture, where the operable controls include the focusing operation control and the information display control shown in fig. 9b, but it should be understood that, within a reasonable scope, when other operations need to be performed on the target recommended object, the corresponding operation controls may also be displayed, and the embodiment of the present application is not limited thereto.

Optionally, in order to display the interface neatly, after the operation on the target visual hot zone, part of the content of the interface shown in fig. 9a may be displayed in a hidden manner, such as in fig. 9b, to avoid the bad viewing experience of the user caused by the mess of the interface. Of course, other contents may be hidden and displayed, such as color block marks, may also be hidden and displayed.

The focusing operation control is used for focusing and displaying the target recommended object so as to display details of the target recommended object, if the target recommended object needs to be focused and displayed, the focusing operation control can be triggered, the terminal equipment responds to the triggering operation on the focusing operation control and jumps to an interface shown in fig. 9c, and the target recommended object is displayed in an enlarged mode.

In some embodiments, the terminal device may zoom in on an area where the target recommended object is located in the current live broadcast picture, so as to obtain an effect of zoom-in display of the target recommended object. If the terminal device is a viewer terminal device, the viewer terminal device cannot adjust the image capturing device of the live broadcast picture, and then the viewer terminal device can enlarge the area where the target object is located in an image enlarging manner so as to focus and display the target recommended object.

In some embodiments, if the terminal device is a hosting device, the hosting device may adjust a lens of the image capturing device to focus on the target recommended object. The image capturing device may be a camera included in the host device or an external image capturing device.

Specifically, the anchor device may respond to a triggering operation performed on the focusing operation control, and send a focusing instruction to a connected image capturing device (including a camera of the anchor device), where the focusing instruction is used to instruct the image capturing device to focus on the target recommended object, so that the image capturing start to write may adjust a focal length, and return the adjusted picture data, so that the anchor device may perform picture display based on the focused picture data sent by the image capturing device, so as to display the amplified target recommended object. Meanwhile, after the camera equipment is adjusted, the live broadcast picture displayed by the audience terminal equipment is adjusted in the same step, namely, the enlarged target recommended object is displayed. Due to the adjustment mode of the image pickup device, the loss of image quality can be reduced as much as possible, so that better viewing experience can be brought to users.

Specifically, after the user clicks the zoom-in lens button, the system sends an instruction for amplifying the visual hot zone, and the front end displays the amplified effect, as shown in fig. 9c, so that the selected penguin doll is amplified and displayed, and the audience can more clearly watch the details of the penguin doll to judge whether the commodity needs to be purchased or not.

It should be understood that after the focusing operation, the live interface may be switched to a normal interface, that is, an interface that does not display the visual hot zone, and accordingly, the state of some space displayed in the live screen of the visual hot zone needs to be switched accordingly. For example, referring to fig. 9c, if a "close hot zone" button is displayed on the live interface presenting the visual hot zone, it is switched to a "display hot zone" button for display.

With continued reference to FIG. 9b, an information display control, i.e., "detailed information" as shown in FIG. 9b, is also displayed therein, the information display control being used to display detailed information of the target recommended object. Referring to fig. 9d, a schematic diagram of an information display page of the target recommended object is shown.

Specifically, the terminal device may display the information display page of the target recommended object in response to a triggering operation performed on the information display control.

In some implementations, as shown in fig. 9d, the information display page can be presented on the live view in a pop-up window. The popup window shown in fig. 9d is only one possible example, and the style and position of the popup window are reasonably adjusted in practical application, which is not limited in the embodiment of the present application.

In some embodiments, the information display page may also be displayed in a full page manner, i.e., a jump from a live view to the information display page may be made.

Wherein the information display page is displayed with at least one of the following information.

(1) Object introduction information of the target recommended object.

As shown in fig. 9d, the information display page displays the information of the penguin doll with the highest attention, such as the name, price, introduction of the article, etc., and it is conceivable that after the information display page is presented on the anchor device, the anchor can better introduce the article according to the information on the page.

In the embodiment of the application, in order to display the object introduction information of each recommended object, an object information base is needed to be created in advance, and the object introduction information of each recommended object possibly related to the object introduction information is recorded, so that in the live broadcast process, after clicking the detailed information, data can be used as a support to display a corresponding information display page. For example, the operation establishes an information base of all the articles in advance, and when the anchor clicks on the articles, the anchor can check the detailed information of the articles and assist the anchor to introduce the articles in more detail.

In the embodiment of the present application, the created object information base may be stored in the background server, for example, after the anchor clicks the "detailed information" button shown in fig. 9b, the terminal device sends an information acquisition request for the target recommended object to the background server, and displays the information display page shown in fig. 9d based on the object introduction information of the target recommended object returned by the background server.

(2) Account identification of viewer accounts associated with target recommended objects

As shown in fig. 9d, the account identifier of the viewer account associated with the target recommended object may also be displayed in the information display page, and in fig. 9d, the account header is specifically shown, however, it should be noted that, in the actual implementation process, other contents may also be displayed as the account identifier, which is not limited in the embodiment of the present application.

(3) Related recommended objects (FIG. 9d is not shown)

In the embodiment of the application, the information display interface can also display other recommended objects related to the target recommended object, and the other recommended objects are not limited to the recommended objects existing in the live broadcast room.

(4) First object recommendation control

As shown in fig. 9d, the "mass-sending commodity link" button displayed in the information display page is the first object recommendation control, which is used for mass-sending the object link address of the target recommendation object.

Specifically, when the anchor is live, the viewers looking at the target recommended object are usually interested in it, so that the object link address of the target recommended object can be sent to the viewer accounts of these viewers. Then, the anchor may perform a triggering operation on the first object recommendation control, and further, the terminal device responds to the triggering operation to send the object link address associated with the target recommendation object to the account of the audience associated with the target recommendation object.

In some embodiments, after the terminal device receives the trigger operation, it is known that the group is issued to a default set of viewer accounts, such as viewer accounts of viewers who have seen the target recommendation object.

In some embodiments, after the terminal device receives the trigger operation, a display page as shown in fig. 9e may be displayed to provide the anchor with the selectable mass-sending object.

In the embodiment of the application, the anchor can select to send the object link address of the target recommended object to all audience accounts in the living broadcast room, or can select to send the object link address of the target recommended object to the appointed audience accounts, for example, after selecting 'group to appointed audience', the anchor can jump to an account selection page, and after completing the selection, the object link address of the target recommended object is sent to the selected audience accounts.

The above description is given by taking the anchor device as an example, but the operations performed by the anchor device may also be applied to the viewer device.

In the embodiment of the application, the function of independently sending the target recommended object link can also be provided. Referring to fig. 9f, after the information display page of the target recommended object is displayed, the account identifier on the page may also be operated. In fig. 9f, after the first audience account is taken as the target audience account and the head portrait is triggered, the terminal device responds to the triggering operation performed on the target audience account to display the instant messaging page taking the target audience account as the communication object.

As shown in the right diagram of fig. 9f, in the instant messaging page, an account identifier corresponding to the target recommended object, and an interactive control, such as a voice control, an expression control, etc., for performing even communication interaction with the target recommended object are displayed, and in addition, a second object recommendation control is also displayed in the instant messaging page, where the second object recommendation control is used for sending an object link address associated with the target recommended object to the target audience account. When the triggering operation is performed on the second object recommendation control, the terminal device responds to the triggering operation, and then the object link address associated with the target recommendation object can be sent to the target audience account, so that the anchor can independently send commodity links to the audience in a private letter mode.

It should be noted that, in the embodiment of the present application, the sending of the object connection address by the terminal device may be the sending of the link by the background server, that is, the terminal device sends a request to the background server, requesting the background server to send the object connection address to the corresponding account of the audience.

Referring to fig. 9g, a schematic view of the gaze point track page is shown. The user may also perform a triggering operation on the account identifier of the target audience account, and correspondingly, the terminal device responds to the triggering operation to display a gaze point track page of the target audience account, where the gaze point track page includes recommended objects corresponding to an eyeball gaze point of the target audience account on the corresponding terminal device, that is, a line of sight stay track of an audience corresponding to the target audience account, as shown in a right diagram in fig. 9g, an article seen by the account a includes a penguin doll, a drinking cup, a rabbit doll, and the like.

Alternatively, the account identifier is an account identifier displayed on the information display page, or is an account identifier displayed on the instant messaging page, that is, the gaze point track page may be displayed by performing a triggering operation on the account identifier displayed on the instant messaging page, that is, the manner (1) shown in fig. 9g, or the gaze point track page may be displayed by performing a triggering operation on the account identifier displayed on the information display page, that is, the manner (2) shown in fig. 9 g.

In some embodiments, the recommended objects may be ranked according to the eye gaze point of the target audience account, the stay time in the location area of the recommended objects, and the gaze point track page is displayed based on the ranking order of the recommended objects, that is, the display mode shown in the right diagram in fig. 9g, where the display order is in turn penguin, drinking cup, rabbit doll, toy car, and the like according to the implementation stay time of the account a.

In some embodiments, the recommended objects may be sorted according to the eye gaze point of the target audience account, the track sequence in the location area of the recommended objects, and the gaze point track page may be displayed based on the sorting sequence of the recommended objects, that is, sequentially displayed according to the detection timeline of the eye gaze point.

With continued reference to fig. 3a, a showcase display control may also be displayed on the live view, where the showcase display control is used to display recommended objects in the live room. The recommended objects in the live broadcasting room can include at least one recommended object which is not displayed in the current live broadcasting picture besides the recommended object which is displayed in the current live broadcasting picture. The terminal equipment responds to the triggering operation by triggering the display control of the display page, so that the display page is displayed.

Referring to fig. 10, an interface diagram of a display page is shown. Wherein a plurality of goods such as penguin toys, drinking cups, rabbit dolls, toy cars, etc. shown in fig. 10 are displayed in the display page.

In some embodiments, the terminal device may count the data of each recommended object regularly, for example, may count the number of viewer accounts associated with each recommended object in a history, and may further rank at least one recommended object according to the number of viewer accounts associated with each at least one recommended object, and display the recommended objects in the ranking order of the recommended objects in the display page. Referring to fig. 10, the display pages may be used as a commodity ranking list, and ranked according to the number of people who see each commodity, for example, the penguin doll is seen by 2345, the first is ranked, the drinking cup is seen by 2341, and the second is ranked.

Referring to fig. 10, a display control for viewing the account of the audience associated with each recommended object is further displayed in the display page, and then by operating the display control corresponding to the target recommended object, the user can jump to the interface shown in the right diagram of fig. 10, and the account identifier of the account of the audience associated with the target recommended object is displayed on the interface. As shown in the right diagram of fig. 10, when the penguin doll is taken as the target recommended object, after the penalty operation is performed on the display operation control corresponding to the penguin doll, that is, the "seen person" button shown in fig. 10, the terminal device may display the account identifier, such as the head portrait, the account ID, etc., corresponding to the audience who has seen the penguin doll.

Optionally, the account identifier of the audience account associated with the target recommended object may be displayed in a sorted manner according to the number of times of watching, which is specifically shown in fig. 10 as an example, or may be displayed in a sorted manner according to the time sequence of actual watching, so as to assist the host in better live broadcasting.

It should be noted that the display page may be presented on the live broadcast screen in a popup window manner. The popup window shown in fig. 10 is only one possible example, and the style and position of the popup window are reasonably adjusted in practical application, which is not limited in the embodiment of the present application. Or the display can be performed in a complete page mode, namely, the display page can be jumped from a live broadcast picture. Similarly, the same is true for the display page of account identification for the associated viewer account.

In summary, the embodiment of the application uses the front-end system image of the audience terminal equipment to identify the objects and people in the live broadcast picture, marks the coordinates in real time, records the eye drop coordinates of the audience by using the eye tracking technology, obtains the objects and people seen by the audience through comparison, uploads the objects and people to the background server in real time, and then issues the objects and people to the front-end system of the host terminal equipment in real time, and the front-end system analyzes the data for visual display, so that the host can watch the objects and people seen by the audience at the other end in real time, know which viewers are more interested, and can timely adjust the lens or the words, so that the live broadcast becomes more flexible, can timely adjust the speaking according to the feedback of the audience like a field lecture, is active, and improves the viewing experience of the audience. For example, when selling goods and broadcasting directly, the host can know that the audience is more interested in the goods, so that the host can introduce the goods in a heavy way when broadcasting, the accuracy of commodity recommendation is improved, and the success rate of commodity transaction is improved.

Referring to fig. 11, based on the same inventive concept, an embodiment of the present application further provides a hot zone display device 110 of a live broadcast picture, where the device includes:

A picture display unit 1101, configured to display a live picture of a live room, where the live picture displays at least one recommendation object;

And the hotbox presentation unit 1102 is configured to present at least one visual hotbox in the live-broadcast picture in response to a hotbox display instruction triggered for the live-broadcast picture, where the visual hotbox is used for characterizing the number of viewers gazing at a location area where a corresponding recommended object is located in the live-broadcast picture.

Optionally, the live broadcast screen further displays a hot zone display control, and the hot zone presenting unit 1102 is further configured to:

and responding to the triggering operation of the hot zone display control, and obtaining a hot zone display instruction.

Optionally, the apparatus further comprises a hot zone generating unit 1103 for:

The method comprises the steps of obtaining a viewer account associated with each recommended object in at least one recommended object, wherein the association relation between the recommended objects and the viewer account is established according to the position area of each recommended object in a live broadcast picture and the position relation between eyeball fixation points detected by terminal equipment when the terminal equipment uses the viewer account to play the live broadcast picture;

Optionally, the hot zone generating unit 1103 is specifically configured to:

and comparing the recommended objects in the multiple groups of association relations with at least one recommended object to determine the audience account associated with each recommended object in the at least one recommended object.

Displaying the number of viewer accounts associated with each recommendation object;

the intensity of the marking information is positively correlated with the number of associated audience accounts;

Optionally, the apparatus further comprises a gaze point identification unit 1104 for:

determining a target recommended object corresponding to a target position area where the position information is located;

Optionally, the apparatus further comprises an object focusing unit 1105 for:

receiving a triggering operation for a target visual hot zone in at least one visual hot zone;

And responding to the triggering operation of the focusing operation control, and magnifying and displaying the target recommended object.

Optionally, the object focusing unit 1105 is specifically configured to:

Responding to triggering operation on a focusing operation control, and sending a focusing instruction to connected image pickup equipment, wherein the focusing instruction is used for indicating the image pickup equipment to focus on a target recommended object;

and performing picture display based on the focused picture data sent by the image pickup device to display the enlarged target recommended object.

Optionally, the hot zone presenting unit 1102 is further configured to:

After receiving triggering operation for a target visual hotbox in at least one visual hotbox, displaying an information display control corresponding to the target recommended object;

The apparatus further comprises a recommending unit 1106 for:

Optionally, the recommending unit 1106 is further configured to:

Responding to the triggering operation of the account identification of the target audience account in the audience accounts displayed on the information display page, displaying an instant messaging page taking the target audience account as a communication object, wherein the instant messaging page is displayed with a second object recommendation control corresponding to the target recommendation object;

Optionally, the hot zone presenting unit 1102 is further configured to:

Responding to triggering operation of account identification of a target audience account, and displaying a gaze point track page of the target audience account, wherein the gaze point track page comprises various recommended objects corresponding to eyeball gaze points of the target audience account on corresponding terminal equipment;

Optionally, the hot zone presenting unit 1102 is specifically configured to:

sequencing each recommended object according to the eye gaze point corresponding to the target audience account and the stay time in the position area of each recommended object, and displaying the gaze point track page based on the sequencing order of each recommended object, or

And sequencing the recommended objects according to the eye gaze point corresponding to the target audience account and the track sequence in the position area of the recommended objects, and displaying the gaze point track page based on the sequencing sequence of the recommended objects.

Optionally, the hot zone presenting unit 1102 is further configured to:

Displaying a hot zone closing control;

and hiding at least one visual hot zone in response to the triggering operation of the hot zone closing control, and returning to display the live broadcast picture.

Optionally, the live broadcast picture also displays a display control of a display page of at least one recommended object;

the hot zone presentation unit 1102 is further configured to:

in response to a triggering operation performed on the showcase display control, displaying a showcase including at least one recommended object;

Optionally, the hot zone presenting unit 1102 is specifically configured to:

the display page is displayed based on the ordered sequence of the at least one recommended object.

The apparatus may be used to perform the methods shown in the embodiments of the present application, and therefore, the description of the foregoing embodiments may be referred to for the functions that can be implemented by each functional module of the apparatus, and the like, which are not repeated.

According to the device provided by the embodiment of the application, when the live broadcast picture is played by using the audience account, the audience account and the recommended objects are associated through the detected position area of the eye gaze point on the live broadcast picture, and further when the visual hot area is required to be presented on the live broadcast picture, the corresponding visual hot area can be presented on the live broadcast picture, and the visual hot area is used for representing the number of the audience accounts associated with each recommended object, so that when the live broadcast picture is watched, the audience does not need to actively perform interaction, the interest degree of the audience on each recommended object can be more intuitively known, and the feedback of the audience is more timely obtained.

Referring to fig. 12, based on the same technical concept, an embodiment of the present application further provides a computer device 120, where the computer device 120 may be a terminal device or a server shown in fig. 1, and the computer device 120 may include a memory 1201 and a processor 1202.

The memory 1201 is used for storing a computer program executed by the processor 1202. The memory 1201 may mainly include a storage program area that may store an operating system, application programs required for at least one function, and the like, and a storage data area that may store data created according to the use of the computer device, and the like. The processor 1202 may be a central processing unit (central processing unit, CPU), or a digital processing unit, or the like. The specific connection medium between the memory 1201 and the processor 1202 is not limited in this embodiment of the application. In the embodiment of the present application, the memory 1201 and the processor 1202 are connected by the bus 1203 in fig. 12, the bus 1203 is shown by a thick line in fig. 12, and the connection manner between other components is only schematically illustrated, which is not limited thereto. The bus 1203 may be classified as an address bus, a data bus, a control bus, or the like. For ease of illustration, only one thick line is shown in fig. 12, but not only one bus or one type of bus.

The memory 1201 may be a volatile memory (RAM) such as a random-access memory (RAM), the memory 1201 may be a nonvolatile memory (non-volatile memory) such as a read-only memory (rom), a flash memory (flash memory), a hard disk (HARD DISK DRIVE, HDD) or a solid state disk (solid-state drive) (STATE DRIVE, SSD), or the memory 1201 may be any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer, but is not limited thereto. The memory 1201 may be a combination of the above memories.

A processor 1202 for executing the methods executed in the above embodiments when calling the computer program stored in the memory 1201.

In some possible implementations, aspects of the method provided by the present application may also be implemented in the form of a program product, which includes a program code for causing a computer device to perform the steps of the method according to the various exemplary embodiments of the application described above, when the program product is run on the computer device, for example, the computer device may perform the method performed in the embodiments described above.

The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of a readable storage medium include an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

While preferred embodiments of the present application have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. It is therefore intended that the following claims be interpreted as including the preferred embodiments and all such alterations and modifications as fall within the scope of the application.

It will be apparent to those skilled in the art that various modifications and variations can be made to the present application without departing from the spirit or scope of the application. Thus, it is intended that the present application also include such modifications and alterations insofar as they come within the scope of the appended claims or the equivalents thereof.

Claims

1. A method for displaying hot spots of a live broadcast image, characterized in that the method comprises:

Displaying a live broadcast screen of a live broadcast room, wherein the live broadcast screen displays at least one recommended object, wherein the at least one recommended object is an item recommended by the live broadcast room to viewers, and the live broadcast screen includes a location area corresponding to each of the at least one recommended object;

In response to a hot zone display instruction triggered for the live broadcast screen, at least one visual hot zone is presented in the live broadcast screen, one visual hot zone corresponds to one recommended object, one visual hot zone is used to represent the number of viewers who are gazing at the location area where the corresponding recommended object is located in the live broadcast screen, and one visual hot zone is generated by marking an associated viewer account in the location area of the corresponding recommended object, wherein the association relationship between the recommended object and the viewer account is established based on the positional relationship between the location area of each of the at least one recommended objects in the live broadcast screen and the eye gaze point detected by the terminal device when the terminal device uses the viewer account to play the live broadcast screen.

2. The method according to claim 1, wherein the live broadcast screen further displays a hot zone display control, and before presenting at least one visual hot zone in the live broadcast screen in response to the hot zone display instruction triggered for the live broadcast screen, the method further comprises:

In response to a triggering operation on the hot zone display control, the hot zone display instruction is obtained.

3. The method according to claim 1, further comprising:

Performing object recognition on the live broadcast screen to obtain a location area of each of the at least one recommended object in the live broadcast screen;

Obtaining a viewer account associated with each of the at least one recommended object;

The associated viewer account is marked in the location area of each recommended object to generate a visual hotspot corresponding to each recommended object.

4. The method according to claim 3, wherein obtaining the viewer account associated with each of the at least one recommended object comprises:

Receive multiple sets of association relationships sent by the backend server, each set of association relationships including a recommended object associated with a viewer account;

The recommended objects in the multiple groups of association relationships are compared with the at least one recommended object to determine the viewer account associated with each recommended object in the at least one recommended object.

5. The method according to claim 3, wherein at least one visual hotspot is presented in the live broadcast image by adopting at least one of the following methods:

In the location area of each recommended object, at least one tag information is displayed, where each tag information represents at least one viewer account associated with the corresponding recommended object;

Display the number of viewer accounts associated with each recommended object, where the number of viewer accounts is positively correlated with the density of the tagged information;

The recommended objects with the largest number of associated viewer accounts are displayed in a hot zone display style different from that of the other recommended objects;

Recommended objects with different numbers of associated viewer accounts are displayed in different hot zone display styles;

Recommended objects whose numbers of associated viewer accounts are in different numerical ranges are displayed in different hot zone display styles.

6. The method according to claim 1, further comprising:

Obtaining position information of the detected eye gaze point on the live broadcast image;

Determining a target recommended object corresponding to the location information based on a positional relationship between the location information and the location areas of each recommended object;

An association relationship between the currently used target audience account and the target recommendation object is established, and the association relationship is uploaded to the backend server.

7. The method according to any one of claims 1 to 6, wherein after presenting at least one visual hot zone in the live broadcast image in response to a hot zone display instruction triggered for the live broadcast image, the method further comprises:

receiving a trigger operation performed on a target visual hotspot among the at least one visual hotspot;

Displaying a focus operation control for the target recommended object corresponding to the target visual hotspot;

In response to a triggering operation on the focus operation control, the target recommended object is displayed in an enlarged manner.

8. The method according to claim 7, wherein, in response to a triggering operation on the focus operation control, the enlarged display of the target recommended object comprises:

In response to a trigger operation on the focus operation control, sending a focus instruction to a connected camera device, wherein the focus instruction is used to instruct the camera device to focus on the target recommended object;

A screen display is performed based on the focused screen data sent by the camera device to display the magnified target recommended object.

9. The method according to claim 7, wherein after receiving a trigger operation for a target visual hotspot in the at least one visual hotspot, the method further comprises:

Display the information display control corresponding to the target recommendation object;

In response to a triggering operation on the information display control, an information display page of the target recommended object is displayed, and the information display page displays at least one of object introduction information of the target recommended object and an account identifier of an associated viewer account.

10. The method according to claim 9, wherein the information display page further displays a first object recommendation control corresponding to the target recommended object;

The method further comprises:

In response to a triggering operation performed on the first object recommendation control, the object link address associated with the target recommended object is sent to a viewer account associated with the target recommended object.

11. The method according to claim 9, wherein after displaying the information display page of the target recommended object in response to a triggering operation on the information display control, the method further comprises:

In response to a triggering operation performed on an account identifier of a target audience account among the audience accounts displayed on the information display page, displaying an instant messaging page with the target audience account as a communication object, the instant messaging page displaying a second object recommendation control corresponding to the target recommended object;

In response to a triggering operation performed on the second object recommendation control, the object link address associated with the target recommended object is sent to the target audience account.

12. The method according to claim 11, further comprising:

In response to a triggering operation performed on the account identifier of the target audience account, displaying a gaze track page of the target audience account, the gaze track page including each recommended object corresponding to the eye gaze point of the target audience account on the corresponding terminal device;

The account identifier of the target audience account is the account identifier displayed on the information display page, or the account identifier displayed on the instant messaging page.

13. The method according to claim 12, wherein displaying the gaze track page of the target audience account comprises:

Sorting the recommended objects according to the dwell time of the eye gaze point corresponding to the target audience account within the location area of each recommended object, and displaying the gaze point track page based on the sorting order of the recommended objects; or

The recommended objects are sorted according to the track order of the eye gaze points corresponding to the target audience accounts within the position areas of the recommended objects, and the gaze point track page is displayed based on the sorting order of the recommended objects.

14. The method according to any one of claims 1 to 6, characterized in that, in response to a hot zone display instruction triggered for the live broadcast image, the method further comprises:

Display hot zone off controls;

In response to a triggering operation on the hot zone closing control, the at least one visual hot zone is hidden and the live broadcast screen is displayed again.

15. The method according to any one of claims 1 to 6, wherein the live broadcast screen further displays a display control for a display page of the at least one recommended object;

The method further comprises:

In response to a trigger operation on the display page display control, a display page including the at least one recommended object is displayed; in the display page, a display control for viewing a viewer account associated with each recommended object is displayed;

In response to a triggering operation performed on a display manipulation control corresponding to a target recommendation object, an account identifier of a viewer account associated with the target recommendation object is displayed.

16. The method according to claim 15, wherein displaying a display page including the at least one recommended object comprises:

sorting the at least one recommended object according to the number of viewer accounts associated with each of the at least one recommended object;

The display page is displayed based on the sort order of the at least one recommended object.

17. A hot zone display device for a live broadcast screen, characterized in that the device comprises:

a screen display unit, configured to display a live screen of the live broadcast room, wherein the live screen displays at least one recommended object, the at least one recommended object being an item recommended by the live broadcast room to viewers, and the live screen including location areas corresponding to the at least one recommended object;

A hot zone presentation unit is used to present at least one visual hot zone in the live screen in response to a hot zone display instruction triggered for the live screen, wherein one visual hot zone corresponds to one recommended object, and one visual hot zone is used to represent the number of viewers who are gazing at the location area where the corresponding recommended object is located in the live screen. One visual hot zone is generated by marking an associated viewer account in the location area of the corresponding recommended object, wherein the association relationship between the recommended object and the viewer account is established based on the positional relationship between the location area of each of the at least one recommended objects in the live screen and the eye gaze point detected by the terminal device when the terminal device uses the viewer account to play the live screen.

18. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein:

When the processor executes the computer program, the steps of the method according to any one of claims 1 to 16 are implemented.

19. A computer storage medium having computer program instructions stored thereon, characterized in that:

When the computer program instructions are executed by a processor, the steps of the method according to any one of claims 1 to 16 are implemented.

20. A computer program product comprising computer program instructions, characterized in that