HK40084576A - Method, apparatus, device, and storage medium for displaying hot zone in live broadcast screen - Google Patents

Description

Hot area display method, device and equipment of live broadcast picture and storage medium

Technical Field

The application relates to the technical field of computers, in particular to the technical field of live broadcast, and provides a hot area display method, a hot area display device, equipment and a storage medium for live broadcast pictures.

Background

With the development of network technology, live webcast is widely popularized and gradually becomes a favorite entertainment application of the public. Generally, a webcast scene includes a main broadcast client and a viewer client, the main broadcast can create a live broadcast room in the main broadcast client, and the viewer can interact with the main broadcast client after entering the live broadcast room through the viewer client. For example, when the anchor is broadcasted directly through the anchor client, the viewer can make comments or likes in the live room through the viewer client, and accordingly, the comments or likes initiated by the viewer client can be displayed in the corresponding areas of the anchor client and the viewer client.

However, at present, when live broadcasting is performed, due to the limitation of a physical space, the anchor broadcast cannot directly view the audience watching the live broadcasting at the other end, and can only judge the preference of the audience for the live broadcasting content through the interactive content actively initiated by the audience. For example, when the anchor recommends an object to the audience in the live broadcast room, if the feedback of the audience cannot be obtained in time to judge which object the audience is interested in, the currently recommended object cannot be adjusted in time, and therefore the object cannot be recommended to the audience accurately, the recommendation accuracy of the object is low, and the watching experience of the audience is poor.

Disclosure of Invention

The embodiment of the application provides a hot area display method, device and equipment of a live broadcast picture and a storage medium, which are used for displaying a visual hot area of the live broadcast picture, improving the timeliness of obtaining audience feedback and further improving the accuracy of live broadcast content.

In one aspect, a hot zone display method for a live broadcast picture is provided, the method comprising:

displaying a live broadcast picture of a live broadcast room, wherein at least one recommended object is displayed on the live broadcast picture;

and responding to a hotspot display instruction triggered by the live broadcast picture, presenting at least one visual hotspot in the live broadcast picture, wherein the visual hotspot is used for representing the number of audiences watching the position area of the corresponding recommended object in the live broadcast picture.

In one aspect, a hot zone display apparatus for a live view is provided, the apparatus including:

the picture display unit is used for displaying a live broadcast picture of a live broadcast room, and the live broadcast picture displays at least one recommended object;

and the hot zone presenting unit is used for responding to a hot zone display instruction triggered by the live broadcast picture, presenting at least one visual hot zone in the live broadcast picture, wherein the visual hot zone is used for representing the number of audiences watching the position area where the corresponding recommended object in the live broadcast picture is located.

Optionally, if a hot zone display control is further displayed in the live view, the hot zone presenting unit is further configured to:

and responding to the trigger operation aiming at the hot zone display control to obtain the hot zone display instruction.

Optionally, the apparatus further includes a hot zone generating unit, configured to:

carrying out object identification on the live broadcast picture to obtain a position area of each recommended object in the live broadcast picture; and the number of the first and second groups,

obtaining a viewer account associated with each of the at least one recommendation object; the association relationship between the recommendation objects and the audience account is established according to the position relationship between the position area of each recommendation object in the live broadcast picture and the eyeball fixation point detected by the terminal equipment when the terminal equipment plays the live broadcast picture by using the audience account;

and marking the related audience accounts in the position area of each recommended object to generate a visual hotspot corresponding to each recommended object.

Optionally, the hot zone generating unit is specifically configured to:

receiving a plurality of groups of incidence relations issued by a background server, wherein each group of incidence relations comprises a recommendation object associated with an audience account;

comparing the recommended object in the multiple groups of incidence relations with the at least one recommended object to determine a viewer account associated with each recommended object in the at least one recommended object.

Optionally, at least one visual hotspot is presented in the live picture in at least one of the following ways:

displaying at least one piece of tag information in the position area of each recommended object, wherein the tag information represents at least one audience account related to the corresponding recommended object;

displaying the number of the audience accounts associated with each recommendation object, wherein the number of the audience accounts is positively correlated with the density of the marking information;

displaying the recommended object with the largest number of the associated audience accounts in a hotspot display style different from that of the rest recommended objects;

the recommendation objects with different associated audience account numbers are displayed in different hotspot display modes;

and the number of the related audience accounts is positioned in the recommended objects with different numerical value intervals, and the recommended objects are displayed in different hotspot display modes.

Optionally, if a hot zone display control is further displayed in the live view, the hot zone presenting unit is further configured to:

and responding to the trigger operation aiming at the hot zone display control to obtain the hot zone display instruction.

Optionally, the apparatus further includes a gazing point identification unit, configured to:

performing object identification on the live broadcast picture to obtain a position area of each recommended object in the live broadcast picture;

acquiring position information of the detected eyeball fixation point on the live broadcast picture;

determining a target recommendation object corresponding to the position information based on the position relation between the position information and the position area of each recommendation object;

and establishing an association relation between the currently used target audience account and the target recommendation object, and uploading the association relation to a background server.

Optionally, the apparatus further comprises an object focusing unit, configured to:

receiving a trigger operation for a target visual hotspot of the at least one visual hotspot;

displaying a focusing operation control of a target recommended object corresponding to the target visual hot zone;

and responding to the trigger operation of the focusing operation control, and amplifying and displaying the target recommendation object.

Optionally, the object focusing unit is specifically configured to:

responding to the trigger operation of the focusing operation control, and sending a focusing instruction to connected camera equipment, wherein the focusing instruction is used for indicating the camera equipment to focus on the target recommendation object;

and performing screen display based on the focused screen data transmitted by the image pickup apparatus to display the enlarged target recommendation object.

Optionally, the hot zone presenting unit is further configured to:

after receiving triggering operation for a target visual hot zone in the at least one visual hot zone, displaying an information display control corresponding to the target recommendation object;

and responding to the triggering operation of the information display control, and displaying an information display page of the target recommendation object, wherein the information display page displays at least one of object introduction information of the target recommendation object and an account identifier of an associated audience account.

Optionally, the information display page further displays a first object recommendation control corresponding to the target recommendation object;

the apparatus further comprises a recommending unit for:

and responding to the triggering operation of the first object recommendation control, and sending the object link address associated with the target recommendation object to the audience account associated with the target recommendation object.

Optionally, the recommending unit is further configured to:

responding to a triggering operation performed on an account identifier of a target audience account in the audience accounts displayed on the information display page, and displaying an instant messaging page which takes the target audience account as a messaging object, wherein the instant messaging page displays a second object recommendation control corresponding to the target recommendation object;

and responding to the triggering operation carried out on the second object recommendation control, and sending the object link address associated with the target recommendation object to the target audience account.

Optionally, the hot zone presenting unit is further configured to:

responding to a trigger operation performed on an account identifier of the target audience account, and displaying a gaze point track page of the target audience account, wherein the gaze point track page comprises recommended objects corresponding to eyeball gaze points of the target audience account on corresponding terminal equipment;

and the account identifier of the target audience account is the account identifier displayed on the information display page, or the account identifier displayed on the instant messaging page.

Optionally, the hot zone presenting unit is specifically configured to:

sequencing each recommended object according to the eyeball fixation point corresponding to the target audience account and the stay time of each recommended object in the position area, and displaying the fixation point track page based on the sequencing sequence of each recommended object; alternatively, the first and second electrodes may be,

and sequencing the recommended objects according to the eyeball gaze points corresponding to the target audience accounts and the track sequence in the position areas of the recommended objects, and displaying the gaze point track page based on the sequencing sequence of the recommended objects.

Optionally, the hot zone presenting unit is further configured to:

displaying a hot zone closing control;

and hiding the at least one visual hotspot in response to the triggering operation of the hotspot closing control, and returning to display the live broadcast picture.

Optionally, the live view further displays a display page display control of the at least one recommended object;

the hotspot presenting unit is further configured to:

in response to a triggering operation performed on the display page display control, displaying a display page including the at least one recommended object; a display control for viewing the audience account associated with each recommendation object is displayed in the display page;

and responding to a trigger operation performed on a display control corresponding to the target recommendation object, and displaying an account identifier of a viewer account associated with the target recommendation object.

Optionally, the hot zone presenting unit is specifically configured to:

sequencing the at least one recommended object according to the number of the audience accounts respectively associated with the at least one recommended object;

displaying the display page based on the sorted order of the at least one recommended object.

In one aspect, a computer device is provided, comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps of any of the above methods when executing the computer program.

In one aspect, a computer storage medium is provided having computer program instructions stored thereon that, when executed by a processor, implement the steps of any of the methods described above.

In one aspect, a computer program product or computer program is provided, the computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The computer instructions are read by a processor of a computer device from a computer-readable storage medium, and the computer instructions are executed by the processor to cause the computer device to perform the steps of any of the methods described above.

In the embodiment of the application, the terminal equipment can present at least one visual hot area, the visual hot area is used for representing and watching the audience number in the position area of the corresponding recommended object in the live broadcast picture, so that when the live broadcast picture is watched, the audience does not need to actively perform interaction behavior, the interest degree of the audience to each recommended object can be more intuitively known, the audience feedback is more timely acquired, correspondingly, the live broadcast content can be timely adjusted by the anchor broadcast, and the accuracy of the live broadcast content is improved. For example, when the anchor broadcasts live for recommending articles, the articles can be introduced and recommended in a targeted manner, so that the article recommendation accuracy is improved, and the experience of audiences is better.

Drawings

Fig. 1 is a schematic view of an application scenario provided in an embodiment of the present application;

fig. 2 is a schematic flowchart of a hot zone display method of a live view according to an embodiment of the present application;

fig. 3a to fig. 3b are schematic diagrams of live broadcast frames provided in an embodiment of the present application;

fig. 4a to 4c are schematic views of a live view showing a visual hot zone according to an embodiment of the present disclosure;

fig. 5 is another schematic flow chart of a hot zone display method of a live view according to an embodiment of the present application;

fig. 6 is a schematic view illustrating an eyeball tracking principle provided by an embodiment of the present application;

fig. 7 is a further flowchart of a hot zone display method for a live view according to an embodiment of the present disclosure;

fig. 8 is a schematic flowchart of a hot zone display method of a live view according to an embodiment of the present application;

FIGS. 9a to 9g illustrate embodiments of the present application an operation schematic diagram of the provided live broadcast picture;

FIG. 10 is a schematic diagram illustrating an operation of displaying a display page provided by an embodiment of the present application;

fig. 11 is a schematic structural diagram of a hot zone display device of a live view according to an embodiment of the present application;

fig. 12 is a schematic structural diagram of a computer device according to an embodiment of the present application.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more apparent, the technical solutions in the embodiments of the present application will be described clearly and completely with reference to the accompanying drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application. In the present application, the embodiments and features of the embodiments may be arbitrarily combined with each other without conflict. Also, while a logical order is shown in the flow diagrams, in some cases, the steps shown or described may be performed in an order different than here.

For the convenience of understanding the technical solutions provided by the embodiments of the present application, some key terms used in the embodiments of the present application are explained first:

and (4) live broadcast: live broadcasting refers to a technology of acquiring audio or video data of a main broadcasting end through acquisition equipment such as audio or video, performing a series of processing such as video coding, compressing into a viewable and transmittable video stream, and outputting to audience end equipment for playing. Live broadcasting is a broadcasting mode in which synthesis and broadcasting are performed at the same time in a later period, and besides audio or video data acquired by acquisition equipment, other contents such as picture special effects (such as a beauty special effect or a face shielding special effect) and interactive operation controls (such as praise, comment or attention controls) and recommended object (such as commodity) entries can be synthesized and displayed in a live broadcasting picture.

The recommended object is: the recommended object may be content displayed in a live view, for example, an entity article placed in the main physical space, or electronic content displayed in a live view, for example, a virtual article, text, or a link address. For example, when the anchor recommends physical goods displayed in the physical space, the anchor may present descriptions for the respective goods, and the viewer may determine whether to purchase the goods based on the descriptions of the anchor, and the recommendation object may be the goods, and for some live broadcasts, the object recommended by the anchor is not the physical goods, but is electronic content such as text displayed in a screen, and the recommendation object may also be the text. The embodiment of the present application does not limit the specific form of the recommended object.

Visual hot zone: the visual hotspot can measure the attention of the viewer watching the live broadcast picture of each recommendation object, and is a result obtained by dividing the live broadcast picture by taking the recommendation object as a unit according to the attention of the viewer watching the live broadcast picture, for example, the higher the attention of the viewer to a certain recommendation object, the higher the attention of the visual hotspot representation is, for example, when a color block is marked, the color block of the recommendation object region with the higher attention is darker and denser. The attention here is mainly measured by the recommended object focused on by the eyeball gaze point of the viewer.

Eyeball fixation point: the eyeball fixation point refers to a sight line falling point of the audience on the terminal equipment determined by an eyeball tracking technology. The eyeball tracking technology is a scientific technology capable of predicting the sight line landing point of a user in real time, when eyes of people look at different directions, the eyes have slight changes, the changes can generate extractable features, and the features can be detected by terminal equipment in an image capturing or scanning extraction mode, so that the changes of the eyes are tracked in real time, and the sight line landing point of the user is predicted.

The audience account: in a live scene, typically including a main broadcast and a viewer, a viewer account is an account used by the viewer, and the viewer logs in the viewer account at a live client to view live content. In an actual scene, the viewer can use the guest account for live viewing without registering the account, and therefore, the account of the viewer may include the guest account.

The following briefly introduces the design concept of the embodiments of the present application.

With the continuous development of science and technology, each flow platform provides a live broadcast function, and a anchor can recommend objects to audiences in a live broadcast manner, but due to the limitation of physical space, the anchor cannot directly view the audiences, cannot directly obtain the feedback of the audiences from the reflection of the audiences, and only passively accept the feedback of the audiences, so that the anchor has certain uncertainty in the selection of live broadcast content, and thus cannot adjust the currently recommended objects in time, the object recommendation to the audiences is probably not accurately performed, the recommendation accuracy of the objects is low, for example, when the anchor does not know which object the audiences watch, the watching experience of the audiences is poor if some objects which the audiences do not interest in are introduced.

The main reason for these problems is that the anchor can not actively obtain the feedback of the audience, but can only determine the preference degree of the audience by the barrage, the approval or the gift given, and these determination dimensions have a high threshold, and the audience can only determine the preference degree after these active actions, so to solve these problems, a brand new dimension for obtaining the feedback of the audience is needed, and the anchor terminal device can actively present the feedback of the audience to the anchor.

In view of this, an embodiment of the present application provides a method for displaying hotspots of a live broadcast frame, where in the method, a terminal device may present at least one visual hotspot, where the visual hotspot is used to represent the number of viewers watching a position area where a corresponding recommended object in the live broadcast frame is located, so that when watching the live broadcast frame, active interaction by the viewers is not required, and the interested degree of the viewers in each recommended object may be known more intuitively, so that the feedback of the viewers is obtained more timely.

In some embodiments, when the terminal device plays the live broadcast screen by using the audience account, the audience account is associated with the recommendation object through the detected position area of the eyeball gaze point on the live broadcast screen, and then when a visual hot zone needs to be presented on the live broadcast screen, the corresponding visual hot zone can be presented in the live broadcast screen.

In some embodiments, the line of sight falling points and trajectories of viewers are collected at the audience end, and the device at the anchor end is displayed in a hot zone mode, so that the anchor can judge which pictures are interesting to the viewers and which are not interesting to the viewers according to the hot zone, and the anchor can adjust live broadcast content in time, such as adjusting live broadcast lenses or speaking content, and give key explanation to the pictures more interesting to the viewers, so that live broadcast becomes more flexible, and like doing live lectures, the technique and the active atmosphere can be adjusted in time according to the feedback of the viewers, and the viewing experience of the viewers is improved.

Therefore, in the method provided by the embodiment of the application, the anchor terminal equipment can actively present the feedback of the audience to the anchor, the dimension of the anchor for acquiring the feedback of the audience is expanded, correspondingly, the anchor can adjust the live broadcast content in time, and the accuracy of the live broadcast content is improved. For example, when the anchor broadcasts live to recommend the item, the introduction and recommendation of the item can be performed in a targeted manner, so that the accuracy of the item recommendation is improved, and the experience of the audience is better.

After introducing the design concept of the embodiment of the present application, some simple descriptions are provided below for application scenarios to which the technical solution of the embodiment of the present application can be applied, and it should be noted that the application scenarios described below are only used for describing the embodiment of the present application and are not limited. In a specific implementation process, the technical scheme provided by the embodiment of the application can be flexibly applied according to actual needs.

The scheme provided by the embodiment of the application can be suitable for most video application scenes, and is particularly suitable for real-time video application scenes such as live scenes. As shown in fig. 1, a schematic diagram of a network architecture provided in the embodiment of the present application may include a first device 101, a server 102, and a second device 103.

The first device 101 may be installed and run with a real-time video application, such as a browser or a real-time video client, which may perform video playing, and a user may perform a corresponding real-time video service, such as a live broadcast service, on the application. The application related to the embodiment of the application can be a software client, and can also be a client such as a webpage and an applet, and the server is a background server corresponding to the software or the webpage and the applet, and the specific type of the client is not limited. The first device 101 may be a terminal used by a first type of user, and the first type of user may play real-time video by using the first device 101.

The server 102 may be a background server corresponding to a real-time video application installed on the first device 101, for example, an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, or a cloud server providing basic cloud computing services such as cloud service, a cloud database, cloud computing, cloud functions, cloud storage, web service, cloud communication, middleware service, domain name service, security service, content Delivery Network (CDN), and a big data and artificial intelligence platform, but is not limited thereto.

The second device 103 may also be installed and run a real-time video application capable of playing video, such as a browser or a real-time video client, and a user may perform a corresponding real-time video service, such as a live broadcast service, on the application. The second device 103 may be a terminal used by the second type of user, and the second type of user may initiate and play the real-time video by using the first device 101.

The first device 101 and the server 102, and the second device 103 and the server may be in direct or indirect communication connectivity via one or more networks. The network may be a wired network or a Wireless network, for example, the Wireless network may be a mobile cellular network, or may be a Wireless-Fidelity (WIFI) network, or may also be other possible networks, which is not limited in this embodiment of the present invention.

The first device 101 or the second device 103 may be, for example, a smart phone, a PAD, a notebook computer, a desktop computer, a smart television, a vehicle-mounted terminal, and the like, but is not limited thereto.

Taking a live broadcast scene as an example, the first device 101 may be a anchor terminal device, and correspondingly, an application installed on the first device 101 may be an anchor client anchor used by the anchor through a data acquisition device included in the first device 101 itself, such as a camera and a microphone, for example, to acquire audio data or video data, or through a camera device or a recording device externally connected to the first device 101, to acquire the audio data or video data, and upload the audio data or video data to the server 102, so as to generate a live broadcast picture through the acquired audio or video data.

The second device 103 may be a viewer-side device, and the application program on the terminal device 103 may be a viewer client used by the viewer, and the viewer may obtain the live image data from the server 102 by using the viewer client and display the live image data through the viewer client.

In practical scenarios, a terminal device may generally serve as both the first device 101 and the second device 103.

In practical applications, after the anchor creates a live broadcast room through the first device 101, the viewer can enter the live broadcast room through the second device 103 to watch live broadcast pictures. When the viewer watches the live video, the second device 103 may detect the eye gaze point of the viewer through an eye tracking technique in real time. The second device 103 may detect the eye gaze point through Infrared detection or image recognition, or certainly, may also detect the eye gaze point through other possible manners, taking Infrared detection as an example, the second device 103 may include an Infrared (IR) camera, and further may illuminate a pupil through IR light, and determine the eye gaze point according to pupil reflected light. Meanwhile, the second device 103 may perform real-time image recognition on the live broadcast picture, identify the position area of each recommended object in the live broadcast picture, further determine the recommended object watched by the viewer in combination with the position information of the eyeball gaze point in the live broadcast picture, and upload, in real time, the viewer information (i.e., the viewer account information registered by the second device 103 at present) and the recommended objects watched by the viewers to the server 102.

In a possible embodiment, the first device 101 may also perform real-time image recognition on the live broadcast screen in real time, identify a location area of each recommended object in the live broadcast screen, and upload each recommended object to the server 102 in the location area of the terminal of the first device 101, and the server 102 may generate a visual hot zone corresponding to each recommended object based on the received recommended object watched by each viewer and sent by the second device 103 and the location area of each recommended object uploaded by the first device 101. When the first device 101 requests display of a visual hot zone, the generated visual hot zone data is sent to the first device 101 for presentation of the visual hot zone in the first device 101.

In another possible implementation manner, the server 102 issues the recommended objects watched by the viewers to the first device 101, and the first device 101 may also perform real-time image recognition on a live broadcast screen in real time, recognize position areas of the recommended objects in the live broadcast screen, and generate a visual hotspot of each recommended object in combination with the recommended objects watched by the viewers. When the anchor operates to display the visual hot zone, the first device 101 may present the visual hot zone in the live view. In this way, by generating the visual hot area implemented by the first device 101, the delay in the presentation of the visual hot area can be effectively reduced, and the real-time performance of the visual hot area information acquired by the anchor is improved.

Of course, in the above embodiments, the first device 101 is taken as an example to present the visual hot area, but in practical applications, the second device 103 may also present the visual hot area.

In addition, in the foregoing embodiment, a live scene is taken as an example, but the method in the embodiment of the present application may also be applied to other video scenes, for example, the method in the embodiment of the present application may be applied to a multi-person video conference scene, each terminal device in the multi-person video conference scene may correspond to the first device 101 or the second device 103, or the method in the embodiment of the present application may also be applied to an online classroom scene, a teacher-side device in the online classroom scene may correspond to the first device 101, and a student-side device may correspond to the second device 103, for example, and of course, the method in the embodiment of the present application may also be applied to other video scenes, which is not limited in this respect.

In the embodiment of the present application, the number of the first devices 101 may be one or multiple, and similarly, the number of the servers 102 may also be one or multiple, that is, the number of the first devices 101 or the servers 102 is not limited.

In a possible application scenario, the related data (such as the recommended objects watched by the respective viewer accounts) involved in the embodiments of the present application may be stored by using a cloud storage (cloud storage) technology. Cloud storage is a new concept extended and developed on the cloud computing concept, and a distributed cloud storage system refers to a storage system which integrates a large number of storage devices (or called storage nodes) of various types in a network through application software or application interfaces to cooperatively work and provides data storage and service access functions to the outside through functions such as cluster application, grid technology, and a distributed storage file system.

At present, a storage method of a storage system is as follows: logical volumes are created, and when created, each logical volume is allocated physical storage space, which may be the disk composition of a certain storage device or of several storage devices. The client stores data on a certain logical volume, that is, the data is stored on a file system, the file system divides the data into a plurality of parts, each part is an object, the object not only contains the data but also contains additional information such as data identification (ID, ID entry), the file system writes each object into a physical storage space of the logical volume, and the file system records storage location information of each object, so that when the client requests to access the data, the file system can allow the client to access the data according to the storage location information of each object.

The process of allocating physical storage space for the logical volume by the storage system specifically includes: physical storage space is divided in advance into stripes according to a group of capacity measures of objects stored in a logical volume (the measures often have a large margin with respect to the capacity of the actual objects to be stored) and Redundant Array of Independent Disks (RAID), and one logical volume can be understood as one stripe, thereby allocating physical storage space to the logical volume.

In a possible application scenario, in order to reduce communication delay, the servers 102 may be deployed in different regions, or in order to balance load, different servers 102 may respectively serve the regions corresponding to the first devices 101 or the second devices 103. The plurality of servers 102 share data through a blockchain, and the plurality of servers 102 correspond to a data sharing system formed by the plurality of servers 102. For example, the first device 101 or the second device 103 is located at the site a and is in communication connection with the server 102, and the first device 101 or the second device 103 is located at the site b and is in communication connection with other servers 102.

Each server 102 in the data sharing system has a node identifier corresponding to the server 102, and each server 102 in the data sharing system may store node identifiers of other servers 102 in the data sharing system, so that the generated block is broadcast to other servers 102 in the data sharing system according to the node identifiers of other servers 102. Each server 102 may maintain a node identifier list, and store the name of the server 102 and the node identifier in the node identifier list. The node identifier may be an Internet Protocol (IP) address of an interconnection between networks and any other information that can be used to identify the node.

Certainly, the method provided in the embodiment of the present application is not limited to be used in the application scenario shown in fig. 1, and may also be used in other possible application scenarios, and the embodiment of the present application is not limited. Functions that can be implemented by each device of the application scenario shown in fig. 1 will be described together in the subsequent method embodiment, and will not be described in detail herein.

The method flows provided in the embodiments of the present application may be executed by any one of the first device 101, the second device 103, or the server 102 in fig. 1, or may be executed by the first device 101 and the second device 103 together, or may also be executed by the first device 101, the second device 103, and the server 102 together, and the following mainly takes the first device 101, the second device 103, and the server 102 as an example.

Fig. 2 is a schematic flow chart of a hot area display method of a live view provided in an embodiment of the present application.

Step 201: the terminal equipment displays a live broadcast picture of a live broadcast room, and the live broadcast picture displays at least one recommended object.

It should be noted that the terminal device here may be the above-mentioned first device 101, or may also be the above-mentioned second device 103, that is, in practical applications, the device for performing visual hot zone display may be an anchor terminal device, or may also be a viewer terminal device, and this embodiment of the present application is not limited thereto.

In a specific implementation process, the terminal device may create a corresponding live broadcast room in response to a live broadcast room creation operation of the anchor, and may display a live broadcast picture of the live broadcast room on the terminal device in order to enable the anchor to know a live broadcast situation and feedback of viewers when the anchor performs live broadcast in response to a broadcast operation of the anchor.

In some embodiments, the terminal device may start the live application in response to a start operation of the anchor on the live application, perform a play operation in the live application based on the anchor, request play from a server corresponding to the live application, and accordingly, display a live frame on the terminal device based on a response of the server.

In some embodiments, the terminal device may also initiate the live reference in response to a trigger by another device. For example, when the anchor performs live broadcasting, the anchor is usually connected to other external devices, such as a camera device, a microphone device, a lighting device, and an external display screen, and when it is determined that the live broadcasting is required after debugging all the devices is completed, the terminal device can start a live broadcasting application to perform subsequent related operations by triggering these external devices.

Correspondingly, the terminal device can also respond to the operation of entering the live broadcasting room of the audience, so as to enter the live broadcasting room of the anchor, namely, the live broadcasting picture of the live broadcasting room is displayed on the terminal device.

In some embodiments, the terminal device may start the live application in response to a start operation of the viewer on the live application, request the server for live data of the live room based on the live room selected by the viewer in the live application, and then display a live picture on the terminal device based on a response of the server.

In some embodiments, the content displayed by the anchor device and the content displayed by the audience device may be the same, or there may be a certain difference, for example, a live view displayed by the anchor device may include a function button not included in a live view displayed by the audience device, and similarly, a live view displayed by the audience device may also include a function button not included in a live view displayed by the anchor device.

In the process, the terminal equipment starts the live application, displays a live picture in the live application, and displays one or more recommended objects in the live picture.

In some implementations, the recommendation object can be a physical item placed in a physical space of a live room.

Fig. 3a is a schematic diagram of a live view. When anchor a creates a live room, or after the created live room is played, the live view shown in fig. 3a is visible when entering the live room of anchor a for viewing. When the anchor a broadcasts directly, can shoot the video picture like the camera through image acquisition equipment, and show this video picture to spectator, as shown in fig. 3a, anchor a's article show stand in having shot a physical space through the camera, thereby also can show this article show stand in the live picture, a plurality of entity article have been shown on this article show stand, as shown in fig. 3a, the show of article show stand of top row is by a plurality of enterprise dolls, the show of article show stand of second row has toy car, cup and rabbit doll etc., this live picture through spectator end equipment demonstration, spectator then can watch each entity article on this article show stand, then these entity article then can be for recommending the object, the anchor can introduce each entity article, spectator can judge whether oneself needs this entity article based on the introduction of anchor.

In some embodiments, the recommendation object may also be electronic content displayed in a live screen, such as a virtual article, text, or a link address.

Fig. 3b is a schematic diagram of another live view. In the live view shown in fig. 3a, the anchor a may not provide the live view by using an image capturing device such as a camera, but directly present an electronic content interface, for example, a screen of another electronic device may be accessed to form the live view, and then the electronic content presented in the live view may also be a recommendation object.

For example, the anchor a may be a game anchor, and the anchor a may access a game screen currently being played by the anchor a to form a live screen, as shown in fig. 3b, the anchor a may be currently located in a selection interface of a game hero, and game heros 1 to 4 are displayed on the interface, and through the interface, the anchor a may select heros to be played next or heros explained by the audience, and then the heros may be recommended objects.

Step 202: and the terminal equipment responds to a hotspot display instruction triggered by the live broadcast picture, and at least one visual hotspot is presented in the live broadcast picture, wherein each visual hotspot is used for representing the number of audiences watching the position area where the corresponding recommended object in the live broadcast picture is located.

In the embodiment of the application, in order to enable a main broadcast or a viewer to obtain the interest degree of the viewer watching the live broadcast picture in each recommended object in the live broadcast picture, a visual hotspot of the current live broadcast picture can be displayed for the main broadcast or the viewer.

In some embodiments, referring to fig. 3a and 3b, a hot zone display control is further displayed in the live broadcast picture, and when a visual hot zone of the live broadcast picture needs to be presented, a trigger operation may be performed on the hot zone display control, and correspondingly, based on the trigger operation, the terminal device may receive a hot zone display instruction, for example, a live broadcast application client on the terminal device may receive the hot zone display instruction, and then present a corresponding visual hot zone.

In fig. 3a and 3b, the hot zone display control is respectively displayed at the bottom end and the top end of the live broadcast frame, but it should be understood that, for the display position, the icon style, and the like of the hot zone display control, this embodiment of the application is not limited thereto, and in practical application, corresponding settings may be performed according to practical situations.

Optionally, the user may trigger operations on the hotspot display control, including but not limited to: click operation, long-press operation, double-click operation, sliding operation, and the like, and the embodiment of the present application does not limit the type of the trigger operation. Similarly, when the trigger operation is mentioned later, the operation types of the operation may be the above-mentioned operation, and the trigger operations of different spaces may be the same or different.

In some embodiments, for the purpose of neatness of the live broadcast screen, the display of the hotspot display control may not be performed in the live broadcast screen, and the user (which may be a main broadcast or a viewer) may trigger the terminal device to obtain the hotspot display instruction in other manners. For example, a shortcut key can be set, that is, a certain key of the terminal device is set as a shortcut key for hot zone display, and then the terminal device can obtain a hot zone display instruction by operating the shortcut key. Or, a gesture operation mode may be used, that is, a gesture for displaying the hot zone is preset, and when the operator uses the gesture to operate the terminal device, the terminal device may obtain the hot zone display instruction. Of course, the hot area display instruction may also be triggered in other manners, such as a manner of voice control, a manner of eye movement triggering, a manner of expression triggering, a manner of limb movement triggering, and the like.

In some embodiments, the terminal device may further automatically detect whether a hot zone display triggering condition is currently met, if so, automatically trigger a hot zone display instruction, and correspondingly, the terminal device displays the visual hot zone based on the hot zone display instruction triggered by the terminal device. For example, the frequency of hot area display may be preset, for example, once every 2 minutes or once every 5 minutes, and when the time arrives, the terminal device determines that the triggering condition of hot area display is met, and automatically triggers a hot area display instruction; or the terminal equipment can also detect the live broadcast picture, and when the specific content appears in the live broadcast picture, the terminal equipment determines that the triggering condition of the hot area display is met, and automatically triggers a hot area display instruction; or, the terminal device may determine based on the current attention of each viewer to the recommended object, and if the attention of a certain product is particularly high and the attention of the currently introduced product in the anchor is low, the terminal device determines that the triggering condition for displaying the hot zone is met, and automatically triggers the hot zone display instruction. Of course, the hot area display instruction may also be triggered by a trigger condition, and the embodiment of the present application does not limit the manner in which the hot area display instruction is triggered.

In the embodiment of the application, when the user uses the live application, the user can selectively select the triggering mode of the hot area display instruction, that is, the expected triggering mode can be preset, and then the hot area display instruction can be triggered by adopting the corresponding triggering mode in the process of displaying the main broadcast picture.

Optionally, the user may also choose to turn off the hot zone display function, which means that the user does not wish to have a visual hot zone displayed, and therefore the visual hot zone display is not triggered during the live frame display.

In the embodiment of the application, the visual hotspot is used for representing the number of audiences watching a position area where the corresponding recommended object in the live broadcast picture is located. In practical applications, usually one viewer uses one viewer account to view live broadcast content, so that each visual hotspot represents the number of viewer accounts associated with a corresponding recommendation object, and the association relationship between the recommendation object and the viewer account is established according to the position relationship between the position region of each recommendation object in the live broadcast picture and the eyeball gaze point detected by the terminal device when the terminal device uses the viewer account to play the live broadcast picture, in other words, the region distribution condition of the eyeball gaze point of the viewer on the live broadcast picture can be reflected, and when the distribution condition of the eyeball gaze point of the viewer in the position region of a certain recommendation object is denser, the higher interest degree of more viewers in the recommendation object is indicated.

In some embodiments, the association between the viewer account and the recommendation object indicates the recommendation object watched by the viewer account, that is, when a viewer watches a live broadcast through the corresponding viewer account, the eyeball watching point of the viewer is located on a certain recommendation object, and the viewer account of the viewer is associated with the recommendation object. It should be noted that, because the eye gaze point is continuously changed when the viewer watches the live view, for example, when the viewer focuses on the article a in the last second, the viewer may shift the sight to the article B in the next second, and thus, the association is changed in real time and is not a fixed association.

In this embodiment of the application, at least one of the following manners may be adopted, and as shown in fig. 4a to 4c, each of fig. 4a and 4b is a schematic diagram of a live broadcast picture presenting a visual hotspot.

(1) And displaying at least one piece of mark information in the position area corresponding to each recommended object, wherein one piece of mark information represents at least one audience account related to the corresponding recommended object.

In the embodiment of the application, the number of the audience accounts can be presented by marking each audience account associated with each recommendation object.

In some embodiments, it may be that one tag information corresponds to one viewer account. That is, when the recommendation object associated with the viewer account 1 is the recommendation object a, a mark is added in the location area of the recommendation object a, so as to reflect the number of the recommendation object a associated with the viewer account by the number of the marks.

In some embodiments, color blocks may be used as the mark information, and the color blocks of each viewer account are the same. And when the audience account 1 is associated with the recommendation object A, adding a color block in the position area of the recommendation object A, so that the color blocks of the audience account associated with the recommendation object A are overlapped in the position area of the audience account, and the attention of the recommendation object A can be visually reflected according to the density degree and the depth degree of the color blocks, wherein the denser the color blocks and the darker the color, the higher the attention of the recommendation object A is. Referring to fig. 4a, a corresponding number of color blocks are displayed in a position area corresponding to each displayed commodity in an overlapping manner, for example, in the first row of article display stands, the number of audiences with eyeball gaze points falling in the first penguin doll area from the left is smaller than the number of audiences with eyeball gaze points falling in the second penguin doll area from the left, so that in the visual hot area presented, the number of color blocks in the first penguin doll area is obviously smaller than that in the second penguin doll area. It should be noted that the number of color patches shown in fig. 4a may not directly correspond to the number of viewers watching the image, since there may be an overlap of color patches.

In some embodiments, multiple viewer accounts may correspond to one tag information. That is, one tag information may represent a plurality of viewer accounts viewing a certain recommended object, for example, when there are 1W viewers viewing a certain recommended object, one tag information is added in the location area of the recommended object.

In the embodiment of the present application, the density of the tag information is positively correlated with the number of the associated viewer accounts, that is, the greater the number of viewers watching a certain recommendation object, the greater the number of tag information in the location area of the recommendation object.

Optionally, in a specific implementation process, the specific style of the color block is not limited in the embodiments of the present application. For example, different recommended objects may adopt the same color block color, such as red or green, or different recommended objects may also adopt different color block colors, such as each recommended object corresponds to one color number. In addition, different recommendation objects may adopt the same color block shape, such as a circle as shown in fig. 4a, or different recommendation objects may also adopt different color block shapes, such as a circle corresponding to the recommendation object a and a star corresponding to the recommendation object a. The marking pattern of the visual hot zone is not limited to the color block pattern, and may be any visual pattern that can serve the purpose of marking.

In some embodiments, the visual hotspot may be presented in the form of a heat map, and when one viewer account is associated with the recommendation object a, the color of the location area of the recommendation object a is deepened by one unit, so that the number of viewer accounts associated with the recommendation object a determines the degree of color depth in the location area, and the degree of color depth in the heat map may visually reflect the attention of the recommendation object a. Referring to fig. 4b, the attention of the spectator to each game hero is reflected by the superposition of colors in the corresponding location area of each game hero, for example, the color of the game hero 1 is obviously lighter than that of the game hero 2, which indicates that the attention of the spectator to the game hero 2 is higher than that of the game hero 1.

(2) And displaying the number of the audience accounts associated with each recommendation object.

In order to reflect the attention degree of each recommendation object more intuitively, the number of the audience accounts associated with each recommendation object can be directly displayed.

Referring to fig. 4a and 4b, each recommended object also displays the number of viewers that are watching. The viewer of a recommendation object refers to a viewer whose gaze point (i.e., the detected eye gaze point) falls within the recommendation object area.

In some embodiments, the number of viewers may be displayed in the corresponding area of the recommended object. As shown in fig. 4a, in the first row article display stand, the area around the first penguin doll from the left shows "about 2 million people looking" meaning that the eye gaze point falls within the area of the penguin doll for about 2 million people. For example, as shown in fig. 4b, the "about 2 ten thousand people are looking" is displayed in the position area of the game hero 1, which means that the number of the audience members whose eye gaze points fall within the game hero 1 is about 2 ten thousand people.

In some embodiments, the number of viewers watching each recommended object may also be displayed in an ordered manner. Referring to fig. 4c, in order to obtain the attention ranking of each game hero more conveniently for the anchor, the number of the watching audience of each game hero may be directly presented in a ranking manner, for example, in the current live broadcast picture, the number of the watching audience of the game hero 2 is about 9 ten thousand, the first is arranged, the number of the watching audience of the game hero 3 is about 6 ten thousand, the second is arranged, and so on.

The display mode and the display style for the number of viewers are not limited. Other possible bubble patterns may be used, or the number of viewers in the display may be displayed at other locations. Further, the data of the appearance of the visual hot zone is not limited to the number of persons, and may be all data related to the user representation, such as geographical position, age, and the like.

(3) And displaying the recommended object with the largest number of the associated audience accounts in a hotspot display style different from that of the rest recommended objects.

In the embodiment of the application, the first recommendation object is used for representing the recommendation object with the largest number of associated viewer accounts, that is, the recommendation object with the largest number of associated viewer accounts is watched, and the second recommendation objects are the other recommendation objects except the first recommendation object. In order to facilitate the anchor to more intuitively know which recommended object has the highest attention, the visual hot zone of the recommended object can be displayed in a manner different from other recommended objects.

In one embodiment, the visual hotspot of the first recommendation object may be highlighted. The highlighted content may be a position area of the recommendation object or the number of viewers watching the content. As shown in fig. 4a, the number of the viewers of the penguin dolls in the middle of the first row is about 7 million, the first article is arranged in all the articles, the penguin doll is the first recommended object, the other articles are the second recommended objects, when the visual hot zone is presented, the number of the bubbles of the penguin doll in the number of the viewers can be highlighted, and the number of the viewers of the penguin doll is specifically displayed by the bubbles with darker colors in fig. 4a, so that the number of the viewers of the penguin doll in the number of the viewers is more striking. As shown in fig. 4b, the number of the viewing audience of the game hero 2 is about 9 thousands, the game hero 2 is the first recommended object when all the game heros are arranged first, and the other game heros are the second recommended objects, when the visual hotspot is presented, the number of the viewing audience of the game hero 2 can be highlighted, and the number of the viewing audience of the game hero 2 is specifically displayed in bold type in fig. 4b, so that the number of the viewing audience of the game hero 2 is more striking.

(4) Based on the number of associated viewer accounts, the display styles for different visual hotspots are formulated.

In the embodiment of the application, the recommendation objects with different associated audience account numbers are displayed in different hotspot display styles; or the recommendation objects with different numerical intervals in which the number of the associated audience accounts is located are displayed in different hotspot display modes.

In some embodiments, the first type of recommendation object represents recommendation objects having a number of associated viewer accounts greater than an object number threshold, and the second type of recommendation object represents recommendation objects having a number of associated viewer accounts not greater than the object number threshold. That is, a threshold number may be set in advance, and the recommended objects with high viewer attention may be highlighted, for example, the threshold number may be set to 30% of the total audience in the live broadcast room, and then the visual hotspots of the recommended objects with the audience number greater than 30% may be highlighted. Of course, the object quantity threshold is only an example, and a corresponding numerical value may be set according to an actual requirement in an actual application, which is not limited in the embodiment of the present application.

The live broadcast screens showing the visual hot zones shown in fig. 4a to 4c are only examples, and in practical applications, the visual hot zones can be shown in any other possible manner, which is not limited in the embodiment of the present application.

It should be noted that, because the association relationship between the recommendation object and the viewer account changes in real time, the visual hotspot may also change along with the real-time change of the association relationship. For example, if the number of the audience watching the recommendation object a at the last time is 8 million people, and the number of the audience watching the recommendation object a at the current time is only 2 million people, the visual hot area of the recommendation object a needs to be adjusted accordingly, such as adjusting the number and color of the displayed color blocks and the value of the number of the audience watching. In addition, when the anchor broadcast is performing live broadcast, the shooting area of the image pickup device may also be adjusted, or the live broadcast content may also be adjusted, and the live broadcast picture may also change correspondingly, so that the visual hotspot may also change accordingly. For example, the area shot at the previous time includes an article a, and after the lens of the image capture device is adjusted, the article a is moved out of the live view, the visual hot area of the article a is no longer presented, and if a certain article B newly appears, the visual hot area of the article B is also displayed according to new data.

In this embodiment, referring to fig. 4a to 4c, after responding to the hot zone display instruction, the terminal device may further change the state of a part of controls on the live broadcast interface, for example, change the hot zone display control to a hot zone closing control, and if the hot zone closing control is changed as shown in the figure, a "hot zone closing" button is changed, then the user may perform a trigger operation on the hot zone closing control, and correspondingly, the terminal device may respond to the trigger operation, hide at least one displayed visual hot zone, and return to the live broadcast picture before displaying.

The following describes a scheme of an embodiment of the present application, taking an example in which the second device (the audience device) collects an eyeball gaze point of an audience and displays a visual hotspot on the first device (the anchor device). Fig. 5 is another schematic flow chart of a hot zone display method of a live view provided in the embodiment of the present application.

Step 501a: the first equipment carries out object identification on the live broadcast picture and obtains the position area of each recommended object in the live broadcast picture.

Step 501b: and the second equipment identifies the objects of the live broadcast picture and obtains the position area of each recommended object in the live broadcast picture.

In the embodiment of the present application, normally, both the anchor terminal and the viewer terminal perform display of a live broadcast picture, but due to different devices used by the live broadcast terminal and the viewer terminal, positions of each recommended object on a device screen may be different, so that each terminal device (including the first device and the second device) can identify (including people and articles in the picture) the live broadcast picture in real time, and record a position area of each recommended object (including people and articles in the picture) on the live broadcast picture in real time.

In some embodiments, the location area may refer to a location area of the recommendation object on a screen of the terminal device when the terminal device displays a live broadcast screen, and the location area of each recommendation object is identified in real time, so as to facilitate subsequent comparison with an implementation drop point of a viewer, or facilitate display of a subsequent visual hotspot.

In the embodiment of the application, the object recognition means that a live broadcast picture is recognized in an image recognition mode, that is, a recommended object and a corresponding position area contained in the live broadcast picture are recognized. Because the live broadcast picture usually includes a video stream picture (which is a video picture shot by the image pickup device), and also displays other function buttons or icons in an overlapping manner, object identification can only refer to identification of the video stream picture, that is, each frame image of the video stream picture can be used as an image to be identified, so that the video frame image can be identified frame by frame, and a recommended object and a corresponding position area included in each frame are stored; or, the object recognition may be to recognize the current whole live broadcast picture, for example, a screen capture may be performed on a display screen of the terminal device to obtain an image to be recognized, and then the captured image to be recognized is recognized, and the recommended object and the corresponding location area included in each frame are stored.

It should be noted that the processes of step 501a and step 501b have no substantial order relationship, and the first device may continuously perform step 501a and the second device may continuously perform step 501b in real time, so that the first device may perform step 501a and the second device may perform step 501b simultaneously, or a certain order may exist.

Step 502: and the second equipment acquires the position information of the detected eyeball fixation point on the live broadcast picture.

The second device may be a terminal device corresponding to any viewer account entering the live broadcast room. In an implementation, eye tracking may not be supported due to hardware limitations of some terminal devices, and the second device may not include it.

The second device may detect the eye gaze point of the current viewer in real time based on eye tracking techniques.

In some embodiments, eye tracking may be performed using an eye control unit included with the second device. Fig. 6 is a schematic diagram of eyeball tracking. The eye control instrument can comprise a built-in infrared light source, an optical sensor, an image processor, a viewpoint calculation core and other components.

When the second device is playing the live video, the viewer watches the live video, and at this time, the second device includes an eye controller that performs step S1 in fig. 6, that is, the eye controller projects the created setting image onto human eyes, which may be projected by an infrared light source, for example, and the human eyes usually do not perceive the image. After the image is projected, the eye control instrument performs step S2, namely, captures a face image through an optical sensor included therein, thereby obtaining image information of the eyes from the face image. Next, the eye control instrument performs step S3, based on the captured eye image information, that is, performs extraction of eye image features by an image processor included therein. Further, the eye control instrument performs step S4 of calculating eyeball fixation point position information such as coordinates on the screen of the second device (screen coordinates may be mapped to a position on the live view) by a point of view calculation core included therein based on the eye image feature.

In some embodiments, the face image of the viewer may be captured by a camera of the second device, and the deep learning model is further used to analyze the face image, so as to obtain an eyeball gaze point of the viewer corresponding to the second device.

In the embodiment of the present application, the eyeball tracking technology used is only required to be capable of detecting the eyeball fixation point of the viewer, and the specific implementation manner and the required physical conditions are not limited. Also, it should be understood that the detection of eye gaze points using eye tracking techniques may be performed under the permission of the viewer, for example, when the detection is performed for the first time, the live application needs to request the viewer to authorize the eye detection function.

Step 503: and the second equipment determines a target recommendation object corresponding to the position area where the position information is located.

In the embodiment of the application, the position information of the eyeball fixation point is compared with the position areas of the recommended objects, so that the position area of the recommended object in which the eyeball fixation point is located can be obtained, and the recommended object is the target recommended object.

In some embodiments, the position information may be represented by coordinates, and then the coordinates of the eyeball fixation point may be used to traverse the position area included in each recommended object to obtain the target recommended object corresponding to the matched coordinates.

Step 504: and the second equipment establishes the incidence relation between the target audience account and the target recommendation object and uploads the incidence relation to the background server.

In this embodiment of the present application, the target audience account refers to an account logged in a live application on the second device. In some scenarios, the second device may be used for live applications in the guest identity, which may then also be considered a target audience account.

In some embodiments, when the viewer views the live broadcast image by using the target viewer account, the eyeball gaze point of the viewer falls within the position area of the target recommendation object, and the target viewer account and the target recommendation object have an association relationship, and the association relationship is uploaded to a background server of the live broadcast application.

It should be noted that the detection of the eye gaze point is performed continuously in real time, and further, the association relationship may also be uploaded in real time, that is, whenever the second device determines that the eye gaze point of the viewer falls within the location area of which recommendation object, that is, after the second device determines the recommendation object that the viewer is currently watching, the target viewer account used by the viewer and the recommendation object that the viewer has watched are uploaded to the background server.

Optionally, the uploaded information of the target audience account may be information capable of uniquely identifying one audience account, such as an account Identifier (ID), and the uploaded information of the recommended object may also be information capable of uniquely identifying one recommended object, such as an object ID or an object connection address.

In the embodiment of the present application, generating the visual hot zone may include the following two ways.

(1) First mode

This approach generates a visual hot zone by the first device, the approach shown in fig. 5.

Step 505: the first device receives a plurality of groups of association relations issued by the background server, wherein each group of association relations comprises a recommendation object associated with the audience account.

In the embodiment of the application, in order to generate the visual hotspot, the first device needs to obtain corresponding support data, that is, to obtain the audience account associated with each recommended object in the live broadcast picture, and the background server receives the association relationship uploaded by each second device in real time, so that the background server can issue the received association relationship to the first device, so that the first device can obtain the audience account associated with each recommended object based on the association relationship.

In some embodiments, the background server may continuously receive the association relationship and sequentially send the received association relationship to the first device. That is, each time the backend server receives an association sent by the second device, the backend server synchronizes to the first device.

In some embodiments, the background server may still continuously receive the association relationship until determining that a certain trigger condition is satisfied, and send the association relationship to the first device once. The trigger condition may be, for example, that a time difference from last transmission reaches a time difference threshold, or that all the association relations of the second device are received completely, or that the number of received association relations reaches a certain number threshold, or of course, other possible trigger conditions may also be used, which is not limited in this embodiment of the present application.

In this embodiment of the application, after receiving the association relationship, the first device may compare the recommendation object in the multiple groups of association relationships with at least one recommendation object to determine the audience account associated with each recommendation object in the at least one recommendation object.

For example, the items A, B, C and D are displayed in the live view, and the association relationship received by the first device is shown in table 1 below, where the item associated with the viewer account 1001 is item a, the item associated with the viewer account 1002 is item C, the item associated with the viewer account 1003 is item B, the item associated with the viewer account 1004 is item a, the item associated with the viewer account 1005 is item C, the item associated with the viewer account 1006 is item D, and the item associated with the viewer account 1007 is item a.

TABLE 1

After the comparison, the viewer accounts associated with item a are 1001, 1004, and 1007, the viewer account associated with item B is 1003, the viewer accounts associated with item C are 1002 and 1005, and the viewer account associated with item D is 1006.

Step 506: and the first equipment marks the related audience accounts in the position area of each recommended object and generates a visual hotspot corresponding to each recommended object.

In the embodiment of the application, according to the position area of each recommended object identified in real time, marking is carried out in the corresponding position area so as to form the visual hot area of each recommended object. For example, when color blocks are used as the marking information, one color block may be marked in the corresponding position region for each viewer account ID associated with the recommendation object, and after the marking of all viewer account IDs associated with the recommendation object is completed, the visual hotspot corresponding to the recommendation object is obtained.

It should be noted that the visual hotspot generated by the first device is not directly displayed, and the first device may receive, in real time, association relationship data issued by the background server, that is, the viewer account ID and recommendation object data viewed by the viewer account ID, and form the visual hotspot in the background of the first device, but not display the visual hotspot, and when the display is triggered, the visual hotspot is presented on the live broadcast screen based on the formed visual hotspot.

Step 507: the first device presents a visual hotspot in the live view in response to a hotspot display instruction triggered for the live view.

This step can be referred to the description of step 202, and is not repeated herein.

(2) Second mode

In this way, the association relationship of each recommended object is integrated by the background server, and the first device generates a visual hot zone, see the way shown in fig. 7, where steps 501a and 501b and steps 502 to 504 in fig. 7 are completely the same as the embodiment shown in fig. 5, and thus are not described again here.

Step 508: the first device uploads the identified recommended object to the background server.

Step 509: and receiving an audience account related to each recommended object in the live broadcast picture sent by the background server.

In this embodiment of the application, after the first device identifies the live broadcast picture, the identified recommended object may be uploaded to the background server in real time, and at the same time, the background server may also receive the association relationship from the second device, so that the background server may integrate the recommended object uploaded by the first device and the association relationship uploaded by the second device to obtain statistics of the audience account associated with each recommended object uploaded by the first device, and feed the statistics back to the first device.

It should be noted that, when the backend server performs data integration, the method adopted by the backend server may be the same as that adopted by the first device for integration, so reference may be made to the description in the above step 505.

Step 510: and the first equipment marks the related audience accounts in the position area of each recommended object and generates a visual hotspot corresponding to each recommended object.

Step 511: the first device presents a visual hotspot in the live view in response to a hotspot display instruction triggered for the live view.

Step 510 and step 511 can refer to the descriptions of step 506 and step 507 above, and are not described herein again.

(3) Third mode

In this manner, the background server generates a visual hot zone, and the first device displays the hot zone, which is the manner shown in fig. 8, wherein steps 501a and 501b and steps 502 to 504 in fig. 8 are completely the same as those in the embodiment shown in fig. 5, and therefore, the description thereof is omitted here.

Step 512: the first device uploads the identified recommended object and corresponding location area information to the background server.

Step 513: the first device sends a hotspot request to a background server in response to a hotspot display instruction triggered by the live video.

In this embodiment of the application, after the first device identifies the live broadcast picture, the identified recommended objects may be uploaded to the background server in real time, and at the same time, the background server may also receive the association relationship from the second device, so that the background server may integrate the recommended objects uploaded by the first device and the association relationship uploaded by the second device to obtain statistics about the audience accounts associated with each recommended object uploaded by the first device, and mark in the corresponding location area in combination with the location area information of each recommended object to form a visual hot area of each recommended object.

When the first device needs to present the visual hot zone, if the anchor clicks a 'display hot zone' button, the first device responds to a hot zone display instruction triggered by the clicking operation and sends a hot zone request to a background server to request the visual hot zone data to be displayed.

Step 514: and the first device presents the visual hotspot in the live broadcast picture based on the visual hotspot data returned by the background server.

In the embodiment of the application, after the visual hot zone is presented in the live broadcast picture, the anchor can more conveniently know the recommendation object interested by the audience so as to pertinently introduce the recommendation object. Referring to fig. 9a to 9c, operation flow diagrams of focusing on a target recommendation object are shown.

Referring to fig. 9a, after a visual hot zone is presented in a live broadcast picture, the penguin dolls in the middle of the first row are easily seen as the recommended objects with the highest attention, and the anchor can adjust the live broadcast content to introduce the penguin dolls. Then, a target visual hot zone may be selected from the visual hot zones presented in the live broadcast frame, where the selected target visual hot zone is the visual hot zone corresponding to the highest attention penguin doll, and the target visual hot zone is triggered to jump to the interface shown in fig. 9 b.

Optionally, the triggering operation performed on the target visual hot zone may be, but is not limited to: click operation, long-press operation, double-click operation, sliding operation, and the like, and the embodiment of the present application does not limit the type of the trigger operation.

Referring to fig. 9b, after the target visual hotspot is triggered, an operable control for a target recommended object corresponding to the target visual hotspot is displayed on a live broadcast screen, where the operable control includes a focusing operation control and an information display control as shown in fig. 9b, but it should be understood that, within a reasonable range, when other operations need to be performed on the target recommended object, a corresponding operation control may also be displayed, which is not limited in this embodiment of the present application.

Optionally, in order to display tidiness of the interface, after the operation is performed on the target visual hotspot, part of the content of the interface shown in fig. 9a can be hidden, such as the number of watching audiences is hidden and displayed in fig. 9b, so as to avoid the clutter of the interface from bringing a poor viewing experience to the user. Of course, other contents can be hidden and displayed, for example, the color block marks can also be hidden and displayed.

The focusing operation control is used for performing focusing display on the target recommended object to display details of the target recommended object, if the target recommended object needs to be subjected to focusing display, the focusing operation control can be triggered, the terminal device responds to the triggering operation performed on the focusing operation control, jumps to an interface shown in fig. 9c, and performs amplification display on the target recommended object.

In some embodiments, the terminal device may enlarge an area where the target recommendation object is located in the current live broadcast picture to obtain an effect of enlarged display of the target recommendation object. If the terminal device is a spectator device, the spectator device cannot adjust the camera device of the live broadcast picture, and then the spectator device can amplify the area where the target object is located by adopting an image amplification mode so as to focus and display the target recommendation object.

In some embodiments, if the terminal device is a anchor device, the anchor device may adjust a lens of the image capturing device to focus on the target recommendation object. The camera device may be a camera included in the anchor terminal device itself or an external camera device.

Specifically, the anchor terminal device may send a focusing instruction to a connected image pickup device (including a camera of the device itself) in response to a trigger operation performed on the focusing operation control, where the focusing instruction is used to instruct the image pickup device to focus on the target recommended object, and then the image pickup pen may adjust the focal length and return the adjusted image data, so that the anchor terminal device may perform image display based on the focused image data sent by the image pickup device to display the enlarged target recommended object. Meanwhile, after the camera shooting device is adjusted, the live broadcast picture displayed by the audience terminal device can be adjusted at the same time, namely, the amplified target recommendation object can be displayed. Due to the adjustment mode of the camera equipment, the loss of image quality can be reduced as much as possible, so that better watching experience can be brought to a user.

Specifically, after the user clicks the "zoom-in lens" button, the system sends an instruction of amplifying the visual hot zone, and the front end displays the amplified effect, as shown in fig. 9c, the selected penguin doll is amplified and displayed, so that the audience can watch the details of the penguin doll more clearly to determine whether to purchase the commodity.

It should be understood that after the focusing operation is performed, the live interface may be switched to a normal interface, i.e., an interface that does not display the visual hotspot, and accordingly, the state of some space displayed in the live frame that presents the visual hotspot needs to be switched accordingly. For example, as shown in fig. 9c, if a "hot zone off" button is displayed on the live interface presenting the visual hot zone, the button is switched to a "hot zone display" button for display.

With continued reference to fig. 9b, an information display control, i.e., "detailed information" shown in fig. 9b, is also displayed, and the information display control is used for displaying the detailed information of the target recommendation object. Referring to fig. 9d, a schematic diagram of an information display page for the target recommendation object is shown.

Specifically, the terminal device may display an information display page of the target recommendation object in response to a trigger operation performed on the information display control.

In some embodiments, as shown in fig. 9d, the information display page may be presented on the live screen in a pop-up window. The pop-up window shown in fig. 9d is only one possible example, and the style and the position of the pop-up window are both reasonably adjusted in practical application, which is not limited in the embodiment of the present application.

In some embodiments, the information display page may also be displayed in a full page manner, i.e., a jump may be made from the live view to the information display page.

The information display page displays at least one of the following information.

(1) Object introduction information of the target recommendation object.

As shown in fig. 9d, the information of the penguin doll with the highest attention, such as the name, price, article introduction and the like, is displayed in the information display page, and it is conceivable that after the information display page is presented on the anchor terminal device, the anchor can better introduce the goods according to the information on the page.

In the embodiment of the application, in order to display the object introduction information of each recommended object, an object information base needs to be created in advance, and the object introduction information of each recommended object which may be related to is recorded, so that in the live broadcast process, data can be used as support after clicking detailed information, and a corresponding information display page is presented. For example, the operation establishes an information base of all items in advance, and when the anchor clicks on an item, the anchor can view detailed information of the item, so as to assist the anchor to introduce the item in more detail.

In this embodiment of the application, the created object information library may be stored in the background server, for example, after the anchor clicks the "detailed information" button shown in fig. 9b, the terminal device sends an information acquisition request for the target recommended object to the background server, and displays an information display page shown in fig. 9d based on object introduction information of the target recommended object returned by the background server.

(2) Account identification of audience account associated with target recommendation object

As shown in fig. 9d, an account identifier of the viewer account associated with the target recommendation object may also be displayed in the information display page, and is specifically shown by an account icon in fig. 9d, but it should be noted that in an actual implementation process, other content may also be displayed as the account identifier, which is not limited in this embodiment of the present application.

(3) Related recommendation object (not shown in FIG. 9 d)

In the embodiment of the application, the information display interface may further display other recommended objects related to the target recommended object, and the other recommended objects are not limited to existing recommended objects in the live broadcast room.

(4) First object recommendation control

As shown in fig. 9d, the "mass texting goods link" button displayed in the information display page is the first object recommendation control, and functions as an object link address of the mass texting target recommendation object.

Specifically, when the anchor is playing on the fly, the viewers who have viewed the target recommendation object usually have a certain interest in it, so that the object link address of the target recommendation object can be sent to the viewer accounts of these viewers. Then, the anchor may perform a trigger operation on the first object recommendation control, and the terminal device sends the object link address associated with the target recommendation object to the audience account associated with the target recommendation object in response to the trigger operation.

In some embodiments, after the terminal device receives the trigger operation, the terminal device may be informed of the viewer account of the default setting, such as the viewer account of the viewer who has seen the target recommendation object.

In some embodiments, after the terminal device receives the trigger operation, a display page as shown in fig. 9e may be displayed to provide the anchor selectable mass-sending object.

In the embodiment of the application, the anchor can select to send the object link address of the target recommendation object to all audience accounts in the live broadcast room; or, the object link address of the target recommendation object can be selected and sent to all audience accounts which have seen the target recommendation object in the live broadcast room; alternatively, the object link address of the target recommendation object may be selected to be sent to the designated viewer account, for example, after "group sending to the designated viewer", the user may jump to an account selection page, and after the selection is completed, the object link address of the target recommendation object may be sent to the selected viewer account.

It should be noted that, the above description has been given by taking the main broadcasting end device as an example, but the operation performed by the main broadcasting end device may also be applied to the viewer end device.

In the embodiment of the application, a function of separately sending the target recommendation object link can be provided. Referring to fig. 9f, after the information display page of the target recommendation object is displayed, the account identifier on the page may also be operated. If the first audience account is the target audience account as shown in fig. 9f, after the avatar is triggered, the terminal device responds to the trigger operation performed on the target audience account to display the instant messaging page with the target audience account as the messaging object.

As shown in the right diagram of fig. 9f, an account identifier corresponding to the target recommended object and interactive controls, such as a voice control, an expression control, and the like, for performing communication interaction with the target recommended object are displayed in the instant messaging page, and in addition, a second object recommendation control is also displayed in the instant messaging page, and the second object recommendation control is used for sending an object link address associated with the target recommended object to the target audience account. When the second object recommendation control is triggered, the terminal device responds to the triggering operation, and the object link address associated with the target recommendation object can be sent to the target audience account, so that the anchor can independently send the commodity link to the audience in a private letter mode.

It should be noted that, in the embodiment of the present application, the sending of the object connection address by the terminal device may be performed by linking through a background server, that is, the terminal device sends a request to the background server to request the background server to send the object connection address to the corresponding viewer account.

Fig. 9g is a schematic diagram showing a display of a gaze point track page. The user may also perform a trigger operation on an account identifier of the target audience account, and correspondingly, the terminal device displays, in response to the trigger operation, a gaze point trajectory page of the target audience account, where the gaze point trajectory page includes recommended objects corresponding to eye gaze points of the target audience account on the corresponding terminal device, that is, gaze staying trajectories of audiences corresponding to the target audience account, and as shown in the right diagram in fig. 9g, the objects viewed by the account a include penguin puppets, drinking cups, rabbit dolls, and the like.

Optionally, the account identifier is an account identifier displayed on an information display page, or an account identifier displayed on an instant messaging page, that is, a gaze point track page may be displayed by performing a trigger operation on the account identifier displayed on the instant messaging page, that is, in a manner (1) shown in fig. 9 g; alternatively, the gaze point trajectory page may also be displayed by performing a trigger operation on the account identifier displayed on the information display page, that is, in the manner (2) shown in fig. 9 g.

In some embodiments, the recommended objects may be sorted according to the eyeball gaze point of the target audience account and the dwell time in the position area of each recommended object, and a gaze point track page, that is, the display mode shown in the right diagram in fig. 9g, may be displayed based on the sorting order of each recommended object, and the display order is, in order, the penguin doll, the water cup, the rabbit doll, the toy car, and the like according to the realized dwell time of the account a.

In some embodiments, the recommended objects may be sorted according to the eyeball gaze point of the target audience account, the track order in the position area of each recommended object, and the gaze point track page may be displayed based on the sorted order of each recommended object, that is, sequentially displayed according to the detection timeline of the eyeball gaze point.

With continued reference to fig. 3a, a display page display control may also be displayed on the live broadcast screen, where the display page display control is used to display the recommended objects in the live broadcast room. The recommendation objects in the live broadcast room can include recommendation objects which are not displayed in the current live broadcast picture besides at least one recommendation object which is displayed in the current live broadcast picture. The display page display control can be triggered, and the terminal equipment responds to the triggering operation to display the display page.

Referring to fig. 10, a schematic view of an interface for displaying pages is shown. Among them, a plurality of commodities such as penguin puppets, drinking cups, rabbit dolls, toy cars, etc., shown in fig. 10, are displayed in the display page.

In some embodiments, the terminal device may periodically count the data of each recommendation object, for example, count the number of viewer accounts historically associated with each recommendation object, and may sort at least one recommendation object according to the number of viewer accounts respectively associated with the at least one recommendation object, and display the at least one recommendation object in the display page in the sorted order of the recommendation objects. Referring to fig. 10, the display page may be a list of items, sorted by number of people seen in each item, e.g., penguin doll 2345, first, drinking cup 2341, second.

Referring to fig. 10, a display control for viewing the audience account associated with each recommended object is also displayed in the display page, and then by operating the display control corresponding to the target recommended object, the interface shown in the right diagram of fig. 10 may be skipped to, and the account identifier of the audience account associated with the target recommended object is displayed on the interface. As shown in the right diagram of fig. 10, when the penguin doll is taken as the target recommendation object, after performing a penalty operation on the display operation control corresponding to the penguin doll, i.e., the "person seen" button shown in fig. 10, the terminal device may display the account identifier, such as the avatar, the account ID, etc., corresponding to the viewer who has seen the penguin doll.

Optionally, the account identifier of the viewer account associated with the target recommendation object may also be displayed in a sequence according to the number of viewing times, which is specifically shown in fig. 10 as an example, or may also be displayed in a sequence according to the actual watching time, so as to assist the anchor to perform better live broadcasting.

It should be noted that the display page may be presented on the live screen in a popup manner. The pop-up window shown in fig. 10 is only one possible example, and the style and the position of the pop-up window are reasonably adjusted in practical application, which is not limited in the embodiment of the present application. Alternatively, the display may be in full page, i.e. the jump from the live view to the showcase page may be made. Likewise, so is the display page of account identifications for the associated viewer accounts.

To sum up, this application embodiment uses spectator's end equipment front-end system image recognition live article and people in the picture, and mark the coordinate in real time, the sight falling point coordinate of spectator is recorded with eyeball tracking technology, reachs the article and the people that spectator saw through the contrast, upload the backend server in real time, backend server issues anchor end equipment front-end system in real time again, front-end system analysis data carries out visual show, make anchor can watch the article and the people that other end spectator saw in real time, know that the spectator is more interesting to what, anchor can in time adjust camera lens or speech like this, make the live broadcast become more nimble, just as doing a scene speech, can in time adjust the speech according to spectator's feedback, active atmosphere, promote spectator's viewing experience simultaneously. For example, when the direct broadcasting is selling, the anchor can know that the audience is more interested in the commodities, so that the anchor gives emphasis to the commodities when the direct broadcasting is carried out, the accuracy of commodity recommendation is improved, and the success rate of commodity transaction is improved.

Referring to fig. 11, based on the same inventive concept, an embodiment of the present invention further provides a hot zone display apparatus 110 for live broadcasting, including:

a screen display unit 1101 configured to display a live screen of a live broadcast room, the live screen displaying at least one recommended object;

and a hotspot presenting unit 1102, configured to present, in response to a hotspot display instruction triggered by the live broadcast picture, at least one visual hotspot in the live broadcast picture, where the visual hotspot is used to represent the number of viewers watching the position area where the corresponding recommendation object is located in the live broadcast picture.

Optionally, if a hot zone display control is further displayed in the live view, the hot zone presenting unit 1102 is further configured to:

and responding to the trigger operation of the hot zone display control, and obtaining a hot zone display instruction.

Optionally, the apparatus further includes a hot zone generating unit 1103 configured to:

carrying out object identification on the live broadcast picture to obtain a position area of each recommended object in the live broadcast picture; and the number of the first and second groups,

obtaining a viewer account associated with each recommended object in at least one recommended object; the association relationship between the recommendation objects and the audience account is established according to the position relationship between the position area of each recommendation object in the live broadcast picture and the eyeball fixation point detected by the terminal equipment when the terminal equipment uses the audience account to play the live broadcast picture;

and marking the related audience accounts in the position area of each recommended object to generate a visual hotspot corresponding to each recommended object.

Optionally, the hot zone generating unit 1103 is specifically configured to:

receiving a plurality of groups of incidence relations issued by a background server, wherein each group of incidence relations comprises a recommendation object associated with an audience account;

and comparing the recommended objects in the multiple groups of association relations with at least one recommended object to determine the audience account associated with each recommended object in the at least one recommended object.

Optionally, at least one visual hotspot is presented in the live view in at least one of the following ways:

displaying at least one tag information in a location area of each recommended object, one tag information characterizing at least one viewer account associated with the corresponding recommended object;

displaying the number of the audience accounts associated with each recommendation object;

displaying the recommended object with the largest number of the associated audience accounts in a hotspot display style different from that of the rest recommended objects;

the density of the marking information is positively correlated with the number of the associated audience accounts;

the recommendation objects with different associated audience account numbers are displayed in different hotspot display styles;

and the number of the related audience accounts is positioned in the recommended objects with different numerical value intervals, and the recommended objects are displayed in different hotspot display modes.

Optionally, if a hot zone display control is further displayed in the live view, the hot zone presenting unit 1102 is further configured to:

and responding to the trigger operation of the hot zone display control to obtain a hot zone display instruction.

Optionally, the apparatus further comprises a gazing point identifying unit 1104, configured to:

carrying out object identification on the live broadcast picture to obtain a position area of each recommended object in the live broadcast picture; and the number of the first and second groups,

acquiring position information of a detected eyeball fixation point on a live broadcast picture;

determining a target recommendation object corresponding to a target position area where the position information is located;

and establishing an incidence relation between the currently used target audience account and the target recommendation object, and uploading the incidence relation to a background server.

Optionally, the apparatus further comprises an object focusing unit 1105, configured to:

receiving a trigger operation for a target visual hotspot in at least one visual hotspot;

displaying a focusing operation control of a target recommendation object corresponding to the target visual hot zone;

and responding to the trigger operation of the focusing operation control, and magnifying and displaying the target recommendation object.

Optionally, the object focusing unit 1105 is specifically configured to:

responding to the trigger operation of the focusing operation control, and sending a focusing instruction to the connected camera equipment, wherein the focusing instruction is used for indicating the camera equipment to focus on the target recommended object;

and performing screen display based on the focused screen data transmitted by the image pickup apparatus to display the enlarged target recommendation object.

Optionally, the hot zone presenting unit 1102 is further configured to:

after receiving triggering operation for a target visual hot zone in at least one visual hot zone, displaying an information display control corresponding to a target recommendation object;

and responding to the triggering operation of the information display control, and displaying an information display page of the target recommendation object, wherein at least one of object introduction information of the target recommendation object and an account identifier of the associated audience account is displayed on the information display page.

Optionally, the information display page further displays a first object recommendation control corresponding to the target recommendation object;

the apparatus further comprises a recommending unit 1106 for:

and responding to the triggering operation performed on the first object recommendation control, and sending the object link address associated with the target recommendation object to the audience account associated with the target recommendation object.

Optionally, the recommending unit 1106 is further configured to:

responding to a triggering operation performed on an account identifier of a target audience account in the audience accounts displayed on the information display page, and displaying an instant messaging page which takes the target audience account as a messaging object, wherein the instant messaging page displays a second object recommendation control corresponding to the target recommendation object;

and responding to the triggering operation performed on the second object recommendation control, and sending the object link address associated with the target recommendation object to the target audience account.

Optionally, the hot zone presenting unit 1102 is further configured to:

responding to a trigger operation carried out aiming at an account identifier of a target audience account, and displaying a fixation point track page of the target audience account, wherein the fixation point track page comprises recommended objects corresponding to eyeball fixation points of the target audience account on corresponding terminal equipment;

the account identifier of the target audience account is an account identifier displayed on an information display page, or an account identifier displayed on an instant messaging page.

Optionally, the hot zone presenting unit 1102 is specifically configured to:

sequencing all recommended objects according to eyeball fixation points corresponding to target audience accounts and the stay time of the eyeball fixation points in the position areas of all recommended objects, and displaying a fixation point track page based on the sequencing sequence of all recommended objects; alternatively, the first and second liquid crystal display panels may be,

and sequencing the recommended objects according to the eyeball gaze points corresponding to the target audience accounts and the track sequence in the position areas of the recommended objects, and displaying a gaze point track page based on the sequencing sequence of the recommended objects.

Optionally, the hot zone presenting unit 1102 is further configured to:

displaying a hot zone closing control;

and hiding at least one visual hotspot in response to the triggering operation of the hotspot closing control, and returning to display the live broadcast picture.

Optionally, the live view further displays a display page display control of at least one recommended object;

a hot zone presenting unit 1102, further configured to:

displaying a display page comprising at least one recommended object in response to a trigger operation performed on a display page display control; in the display page, a display control for viewing the audience account associated with each recommendation object is displayed;

and responding to the triggering operation performed on the display control corresponding to the target recommendation object, and displaying the account identification of the audience account associated with the target recommendation object.

Optionally, the hot zone presenting unit 1102 is specifically configured to:

sequencing the at least one recommended object according to the number of the audience accounts respectively associated with the at least one recommended object;

and displaying the display page based on the sorting order of the at least one recommended object.

The apparatus may be configured to execute the method shown in each embodiment of the present application, and therefore, for functions and the like that can be realized by each functional module of the apparatus, reference may be made to the description of the foregoing embodiment, which is not repeated herein.

The device provided by the embodiment of the application can associate the audience accounts with the recommended objects through the detected eyeball gazing points in the position area of the live broadcast picture when the live broadcast picture is played by using the audience accounts, and further can present corresponding visual hot zones in the live broadcast picture when the visual hot zones are required to be presented on the live broadcast picture, wherein the visual hot zones are used for representing the number of the audience accounts associated with each recommended object, so that when the live broadcast picture is watched, the audience does not need to actively perform interactive behaviors, the interest degree of the audience to each recommended object can be more intuitively known, and the audience feedback is more timely obtained.

Referring to fig. 12, based on the same technical concept, an embodiment of the present application further provides a computer device 120, where the computer device 120 may be the terminal device or the server shown in fig. 1, and the computer device 120 may include a memory 1201 and a processor 1202.

The memory 1201 is used for storing computer programs executed by the processor 1202. The memory 1201 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function, and the like; the storage data area may store data created according to use of the computer device, and the like. The processor 1202 may be a Central Processing Unit (CPU), a digital processing unit, or the like. The embodiment of the present application does not limit the specific connection medium between the memory 1201 and the processor 1202. In the embodiment of the present application, the memory 1201 and the processor 1202 are connected through the bus 1203 in fig. 12, the bus 1203 is shown by a thick line in fig. 12, and the connection manner between other components is only schematically illustrated and is not limited thereto. The bus 1203 may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown in FIG. 12, but this is not intended to represent only one bus or type of bus.

Memory 1201 may be a volatile memory (volatile memory), such as a random-access memory (RAM); the memory 1201 may also be a non-volatile memory (non-volatile memory) such as, but not limited to, a read-only memory (rom), a flash memory (flash memory), a Hard Disk Drive (HDD) or a solid-state drive (SSD), or any other medium which can be used to carry or store desired program code in the form of instructions or data structures and which can be accessed by a computer. The memory 1201 may be a combination of the above memories.

A processor 1202, configured to execute the methods executed in the foregoing embodiments when calling the computer program stored in the memory 1201.

In some possible embodiments, various aspects of the methods provided by the present application may also be implemented in the form of a program product including program code for causing a computer device to perform the steps of the methods according to various exemplary embodiments of the present application described above in this specification when the program product is run on the computer device, for example, the computer device may perform the methods performed in the embodiments described above.

The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

While the preferred embodiments of the present application have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all alterations and modifications as fall within the scope of the application.

It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include such modifications and variations as well.

Claims (20)

1. A hot zone display method of a live broadcast picture, the method comprising:

displaying a live broadcast picture of a live broadcast room, wherein at least one recommended object is displayed on the live broadcast picture;

and responding to a hotspot display instruction triggered by the live broadcast picture, presenting at least one visual hotspot in the live broadcast picture, wherein the visual hotspot is used for representing the number of audiences watching the position area of the corresponding recommended object in the live broadcast picture.

2. The method of claim 1, wherein the live view further displays a hotspot display control, the method further comprising, prior to presenting at least one visual hotspot in the live view in response to the hotspot display instruction triggered for the live view:

and responding to the trigger operation aiming at the hot zone display control, and obtaining the hot zone display instruction.

3. The method of claim 1, wherein the method further comprises:

carrying out object identification on the live broadcast picture to obtain a position area of each recommended object in the live broadcast picture;

obtaining a viewer account associated with each of the at least one recommendation object; the association relationship between the recommendation objects and the audience account is established according to the position relationship between the position area of each recommendation object in the live broadcast picture and the eyeball fixation point detected by the terminal equipment when the terminal equipment plays the live broadcast picture by using the audience account;

and marking the related audience accounts in the position area of each recommended object to generate a visual hotspot corresponding to each recommended object.

4. The method of claim 3, wherein obtaining the viewer account associated with each of the at least one recommendation object comprises:

receiving a plurality of groups of incidence relations issued by a background server, wherein each group of incidence relations comprises a recommendation object associated with an audience account;

comparing the recommended object in the multiple groups of incidence relations with the at least one recommended object to determine a viewer account associated with each recommended object in the at least one recommended object.

5. A method as defined in claim 3, wherein at least one visual hotspot is presented in the live view in at least one of:

displaying at least one piece of mark information in the position area of each recommended object, wherein one piece of mark information represents at least one audience account related to the corresponding recommended object;

displaying the number of the audience accounts associated with each recommendation object, wherein the number of the audience accounts is positively correlated with the density of the marking information;

displaying the recommended object with the largest number of the associated audience accounts in a hotspot display style different from that of the rest recommended objects;

the recommendation objects with different associated audience account numbers are displayed in different hotspot display styles;

and the recommended objects with the number of the related audience accounts in different numerical value intervals are displayed in different hotspot display styles.

6. The method of claim 1, wherein the method further comprises:

carrying out object identification on the live broadcast picture to obtain a position area of each recommended object in the live broadcast picture;

acquiring position information of the detected eyeball fixation point on the live broadcast picture;

determining a target recommendation object corresponding to the position information based on the position relation between the position information and the position area of each recommendation object;

and establishing an association relation between the currently used target audience account and the target recommendation object, and uploading the association relation to a background server.

7. The method of any of claims 1-6, wherein after presenting at least one visual hotspot in the live view in response to a hotspot display instruction triggered for the live view, the method further comprises:

receiving a trigger operation for a target visual hotspot of the at least one visual hotspot;

displaying a focusing operation control of a target recommendation object corresponding to the target visual hotspot;

and responding to the trigger operation of the focusing operation control, and amplifying and displaying the target recommendation object.

8. The method of claim 7, wherein in response to a triggering operation on the focus operation control, zooming in on the target recommendation object comprises:

responding to the trigger operation of the focusing operation control, and sending a focusing instruction to connected camera equipment, wherein the focusing instruction is used for indicating the camera equipment to focus on the target recommendation object;

and performing screen display based on the focused screen data transmitted by the image pickup apparatus to display the enlarged target recommendation object.

9. The method of claim 7, wherein after receiving a triggering operation for a target visual hotspot of the at least one visual hotspot, the method further comprises:

displaying an information display control corresponding to the target recommendation object;

and responding to the triggering operation of the information display control, and displaying an information display page of the target recommended object, wherein the information display page displays at least one of object introduction information of the target recommended object and an account identifier of an associated audience account.

10. The method of claim 9, wherein the information display page further displays a first object recommendation control corresponding to the target recommendation object;

the method further comprises:

and responding to the triggering operation performed on the first object recommendation control, and sending the object link address associated with the target recommendation object to the audience account associated with the target recommendation object.

11. The method of claim 9, wherein after displaying an information display page of the target recommendation object in response to a triggering operation performed on the information display control, the method further comprises:

responding to a triggering operation performed on an account identifier of a target audience account in the audience accounts displayed on the information display page, and displaying an instant messaging page which takes the target audience account as a messaging object, wherein the instant messaging page displays a second object recommendation control corresponding to the target recommendation object;

and responding to the triggering operation performed on the second object recommendation control, and sending an object link address associated with the target recommendation object to the target audience account.

12. The method of claim 11, wherein the method further comprises:

responding to a trigger operation performed aiming at the account identifier of the target audience account, and displaying a gaze point track page of the target audience account, wherein the gaze point track page comprises each recommended object corresponding to an eyeball gaze point of the target audience account on corresponding terminal equipment;

and the account identifier of the target audience account is the account identifier displayed on the information display page, or the account identifier displayed on the instant messaging page.

13. The method of claim 12, wherein displaying a point of regard track page for the target viewer account comprises:

sequencing each recommended object according to the eyeball fixation point corresponding to the target audience account and the stay time of each recommended object in the position area, and displaying the fixation point track page based on the sequencing sequence of each recommended object; alternatively, the first and second electrodes may be,

and sequencing the recommended objects according to the eyeball gaze points corresponding to the target audience accounts and the track sequence in the position areas of the recommended objects, and displaying the gaze point track page based on the sequencing sequence of the recommended objects.

14. The method of any of claims 1 to 6, wherein in response to a hotspot display instruction triggered for the live view, further comprising:

displaying a hot zone closing control;

and hiding the at least one visual hot zone in response to the triggering operation of the hot zone closing control, and returning to display the live broadcast picture.

15. The method according to any one of claims 1 to 6, wherein the live view further displays a showcase page display control of the at least one recommended object;

the method further comprises:

displaying a display page comprising the at least one recommended object in response to a triggering operation performed on the display page display control; a display control for viewing the audience account associated with each recommendation object is displayed in the display page;

and responding to a trigger operation performed on a display control corresponding to the target recommendation object, and displaying an account identifier of a viewer account associated with the target recommendation object.

16. The method of claim 15, wherein displaying an showcase page including the at least one recommended object comprises:

sequencing the at least one recommended object according to the number of the audience accounts respectively associated with the at least one recommended object;

displaying the display page based on the sorted order of the at least one recommended object.

17. A hot zone display device for live video, the device comprising:

the system comprises a picture display unit, a selection unit and a selection unit, wherein the picture display unit is used for displaying a live broadcast picture of a live broadcast room, and the live broadcast picture displays at least one recommended object;

and the hot zone presenting unit is used for responding to a hot zone display instruction triggered by the live broadcast picture, presenting at least one visual hot zone in the live broadcast picture, wherein the visual hot zone is used for representing the number of audiences watching the position area where the corresponding recommended object in the live broadcast picture is located.

18. A computer device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor,

the processor when executing the computer program realizes the steps of the method of any of claims 1 to 16.

19. A computer storage medium having computer program instructions stored thereon, wherein,

the computer program instructions, when executed by a processor, implement the steps of the method of any one of claims 1 to 16.

20. A computer program product comprising computer program instructions that, when executed,

the computer program instructions, when executed by a processor, implement the steps of the method of any one of claims 1 to 16.