WO2022032916A1

WO2022032916A1 - Display system

Info

Publication number: WO2022032916A1
Application number: PCT/CN2020/130193
Authority: WO
Inventors: 雷将; 胡帆
Original assignee: 海信电子科技(武汉)有限公司
Priority date: 2020-08-12
Filing date: 2020-11-19
Publication date: 2022-02-17
Also published as: CN112004131A

Abstract

The present embodiment shows a display system, comprising a server and a display device, wherein the display device is provided with a first controller and a second controller. When a media resource needs to be searched, a user outputs a user voice to the first controller. The first controller sends the received user voice to the server. The server processes the user voice to obtain a head word; retrieves a query tag, the query tag being used for prompting the user to output the related user voice; and outputs the head word and the query tag to the second controller. The second controller controls a second display to display the head word and the query tag. Hence, in the display system shown in the embodiment of the present application, a head word and a query tag related to the head word can be obtained by processing a user voice, and further, the head word and the query tag are displayed on a second display. A user can perform targeted media resource search for content displayed on the second display, so that the user experience is good.

Description

a display system

This application claims the priority of the application filed with the China Patent Office on August 12, 2020, the application number is CN 202010805835.X, and the application name is "a display system"; the entire contents of which are incorporated into this application by reference.

technical field

The present invention relates to televisions, in particular to a display system.

Background technique

Smart TV is a TV product that can realize two-way human-computer interaction function and integrate various functions such as audio and video, entertainment, and data. The user interface of smart TV is used as a medium for interaction and information exchange between it and users. In order to meet the diverse needs of users, TV designers have also made adjustments to the form of TV to facilitate modern life. A dual-screen display (including a first display and a second display) TV.

The dual-screen display TV, the first display screen is used to display some media resources, such as videos, animations, pictures, etc. The second display screen is used to display some prompt information, such as user voice, time, weather, etc. For example, when the user wants to watch Andy Lau's movie, the user voice output by the user is "I want to watch Andy Lau's movie". The dual-screen display TV, after receiving the user's voice, the second display screen displays "I want to watch Andy Lau's movie" in the form of text, and the first display screen displays Andy Lau's movies.

In the existing dual-screen display TV, when the user searches for media resources, the content displayed on the second display only includes the user's voice, and the above-mentioned user's voice cannot play a prompting role. Usually, it takes a lot of time for users to find the target media resources, and the user experience Feel bad.

SUMMARY OF THE INVENTION

Based on the above technical problems, the purpose of the present application is to provide a display system.

The embodiment of the present application shows a display system, including:

The server is configured to receive the user's voice; process the user's voice to obtain a central word; retrieve a query label, where the query label is a label corresponding to the central word, and the query label is used to prompt the user to output the relevant user's voice; output the central word and query label;

A display device, provided with a first display; a second display; a first controller, configured to transmit the received user voice to the server; a second controller, configured to receive the central word and the query tag, The second display is controlled to display the head word and the query tag.

Description of drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the accompanying drawings required in the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some of the present invention. In the embodiments, for those of ordinary skill in the art, other drawings can also be obtained according to these drawings without any creative effort.

FIG. 1 exemplarily shows a schematic diagram of an operation scene between a display device and a control device according to an embodiment;

FIG. 2 exemplarily shows a block diagram of the configuration of the control device 100 according to the exemplary embodiment;

FIG. 3 exemplarily shows a schematic diagram of the hardware structure of the hardware system in the display device 200 according to the exemplary embodiment;

Figure 4 shows a schematic diagram of the connection relationship between the power supply board and the load;

FIG. 5 exemplarily shows the hardware architecture block diagram of the display device 200 shown in FIG. 3;

FIG. 6 exemplarily shows a schematic diagram of the functional configuration of the display device according to the exemplary embodiment;

FIG. 7 exemplarily shows a configuration block diagram of a software system in the display device 200 according to an exemplary embodiment;

Figure 8 exemplarily shows a configuration block diagram of the application layer according to an exemplary embodiment;

FIG. 9 exemplarily shows a schematic diagram of a user interface in the display device 200 according to an exemplary embodiment;

10 is a structural block diagram of a display system according to a feasible embodiment;

FIG. 11 is a flowchart showing the interaction between a display device and a server according to a feasible embodiment;

12 is a schematic diagram of an interface displayed by a display device according to a feasible embodiment;

13 is a schematic diagram of an interface displayed by a second display according to a feasible embodiment;

14 is a schematic diagram of an interface displayed by a second display according to a feasible embodiment;

FIG. 15 is a flowchart showing the interaction between a display device and a server according to a feasible embodiment;

FIG. 16 is a flowchart showing the interaction between a display device and a server according to a feasible embodiment;

17 is a schematic diagram of an interface displayed by a display device according to a feasible embodiment;

18 is a schematic diagram of an interface displayed by a display device according to a feasible embodiment;

19 is a schematic diagram of an interface displayed by a display device according to a feasible embodiment;

FIG. 20 is a flowchart showing the interaction between a display device and a server according to a feasible embodiment;

FIG. 21 is a schematic diagram of an interface displayed by a display device according to a feasible embodiment.

detailed description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

This application is mainly aimed at a display device with a dual-system, dual-display structure, that is, a display device with a first controller (first hardware system), a second controller (second hardware system), a first display, and a second display For audio and video synchronization processing, the following first describes in detail the structure, function, and implementation of a display device with a dual-system hardware structure.

For the convenience of users, various external device interfaces are usually provided on the display device, so as to connect different peripheral devices or cables to realize corresponding functions. When a high-definition camera is connected to the interface of the display device, if the hardware system of the display device does not have the hardware interface of the high-pixel camera that receives the source code, the data received by the camera cannot be presented to the display of the display device. superior.

Moreover, due to the hardware structure, the hardware system of traditional display devices only supports one channel of hard decoding resources, and usually only supports up to 4K resolution video decoding. The resolution of the network video picture requires the use of hard decoding resources (usually the GPU in the hardware system) to decode the network video. The video chat screen is processed by soft decoding.

Using soft decoding to process the video chat screen will greatly increase the data processing burden of the CPU. When the data processing burden of the CPU is too heavy, the picture may be stuck or not smooth. Further, subject to the data processing capability of the CPU, when using the CPU soft decoding to process the video chat screen, it is usually impossible to implement multi-channel video calls. When the user wants to conduct video chat with multiple other users in the same chat scene Access is blocked.

Based on the above considerations, in order to overcome the above shortcomings, the present application discloses a dual hardware system architecture to realize multiple channels of video chatting data (at least one channel of local video).

The concepts involved in the present application are first described below with reference to the accompanying drawings. It should be pointed out here that the following descriptions of various concepts are only for the purpose of making the content of the present application easier to understand, and do not limit the protection scope of the present application.

The term "module" used in the various embodiments of the present application may refer to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic or combination of hardware or/and software codes capable of executing the execution associated with the element function.

The term "remote control" used in various embodiments of the present application refers to a component of an electronic device (such as the display device disclosed in the present application), which can usually wirelessly control the electronic device within a short distance range. The component can generally use infrared and/or radio frequency (RF) signals and/or Bluetooth to connect with electronic devices, and may also include functional modules such as WiFi, wireless USB, Bluetooth, and motion sensors. For example, a hand-held touch remote control replaces most of the physical built-in hard keys in a general remote control device with a user interface in a touch screen.

The term "gesture" used in various embodiments of the present application refers to a user behavior that is used by a user to express an expected idea, action, purpose/or result through an action such as a change of hand shape or hand movement.

The term "hardware system" used in the various embodiments of this application may refer to a computer system composed of mechanical, optical, electrical, and magnetic devices such as an integrated circuit (IC) and a printed circuit board (PCB). , physical components that control, store, input, and output functions. In various embodiments of the present application, the hardware system is also generally referred to as a motherboard or a chip.

FIG. 1 exemplarily shows a schematic diagram of an operation scenario between a display device and a control apparatus according to an embodiment. As shown in FIG. 1 , a user can operate the display apparatus 200 through the control apparatus 100 .

Wherein, the control device 100 may be a remote controller 100A, which can communicate with the display device 200 through infrared protocol communication, Bluetooth protocol communication, ZigBee protocol communication or other short-distance communication methods, for wireless or other communication The display device 200 is controlled in a wired manner. The user can control the display device 200 by inputting user instructions through keys on the remote controller 100A, voice input, control panel input, or the like. For example, the user can control the display device by inputting corresponding control commands through the volume plus and minus keys, channel control keys, up/down/left/right movement keys, voice input keys, menu keys, and power-on/off keys on the remote control 100A. 200 functions.

The control device 100 can also be a smart device, such as a mobile terminal 100B, a tablet computer, a computer, a notebook computer, etc., which can use a local network (LAN, Local Area Network), a wide area network (WAN, Wide Area Network), a wireless local area network (WLAN, Wireless Local Area Network) or other networks communicate with the display device 200, and control the display device 200 through an application program corresponding to the display device 200. For example, the display device 200 is controlled using an application running on the smart device. The application can provide users with various controls through an intuitive user interface (UI, User Interface) on the screen associated with the smart device.

For example, software applications can be installed on both the mobile terminal 100B and the display device 200, so that the connection and communication between the two can be realized through a network communication protocol, thereby realizing the purpose of one-to-one control operation and data communication. For example, the mobile terminal 100B and the display device 200 can be made to establish a control instruction protocol, the remote control keyboard can be synchronized to the mobile terminal 100B, and the function of controlling the display device 200 can be realized by controlling the user interface on the mobile terminal 100B; The audio and video content displayed on the display device 200 is transmitted to the display device 200 to realize the synchronous display function.

As shown in FIG. 1 , the display device 200 can also perform data communication with the server 300 through various communication methods. In various embodiments of the present application, the display device 200 may be allowed to perform wired communication connection or wireless communication connection with the server 300 through a local area network, a wireless local area network, or other networks. The server 300 may provide various contents and interactions to the display device 200 .

For example, the display device 200 interacts with an Electronic Program Guide (EPG) by sending and receiving information, receiving software program updates, or accessing a remotely stored digital media library. The server 300 may be one group or multiple groups, and may be one or more types of servers. Other network service contents such as video-on-demand and advertising services are provided through the server 300 .

The display device 200 includes a first display 201 and a second display 202, wherein the first display 201 and the second display 202 are independent of each other, and a dual hardware control system is used between the first display 201 and the second display 202.

The first display 201 and the second display 202 may be used to display different display images. For example, the first display 201 may be used for screen display of traditional TV programs, and the second display 202 may be used for screen display of auxiliary information such as notification messages and voice assistants.

In some embodiments of the present application, the content displayed on the first display 201 and the content displayed on the second display 202 may be independent of each other and not affect each other. For example, when the first display 201 is playing a TV program, the second display 202 may display information such as time, weather, temperature, and reminder messages that are not related to the TV program.

In some embodiments of the present application, there may also be an association relationship between the content displayed on the first display 201 and the content displayed on the second display 202 . For example, when the first display 201 plays the main screen of the video chat, the second display 202 may display information such as the avatar and the chat duration of the user currently accessing the video chat.

In some embodiments of the present application, part or all of the content displayed on the second display 202 may be adjusted to be displayed on the first display 201 . For example, information such as time, weather, temperature, and reminder message displayed on the first display 201 may be adjusted to be displayed on the first display 201 , and other information may be displayed on the second display 202 .

In addition, the first display 201 also displays a multi-party interactive screen while displaying the traditional TV program screen, and the multi-party interactive screen will not block the traditional TV program screen. Wherein, the present application does not limit the display modes of traditional TV program pictures and multi-party interactive pictures. For example, the present application can set the positions and sizes of the traditional TV program pictures and the multi-party interactive pictures according to the priorities of the traditional TV program pictures and the multi-party interactive pictures.

Taking the priority of the traditional TV program screen higher than the priority of the multi-party interactive screen as an example, the area of the traditional TV program screen is larger than that of the multi-party interactive screen, and the multi-party interactive screen can be located on one side of the traditional TV program screen, or can be set by floating. In the corner of the multi-party interactive screen.

The display device 200, on the one hand, can be a liquid crystal display, an OLED (Organic Light Emitting Diode) display, a projection display device; on the other hand, the display device can be a smart TV or a display system composed of a display and a set-top box. The specific display device type, size and resolution are not limited. Those skilled in the art can understand that the display device 200 can make some changes in performance and configuration as required.

The display device 200 may additionally provide an intelligent network television function that provides a computer-supported function in addition to the function of broadcasting and receiving television. Examples include Internet TV, Smart TV, Internet Protocol TV (IPTV), and the like. In some embodiments, the display device may not have broadcast reception television capabilities.

As shown in FIG. 1 , a camera may be connected or set on the display device 200 for presenting a picture captured by the camera on the display interface of the display device or other display devices, so as to realize interactive chat between users. Specifically, the picture captured by the camera may be displayed on the display device in full screen, half screen, or in any optional area.

As a connection method in some embodiments of the present application, the camera is connected to the rear case of the display device through a connecting plate, and is fixedly installed in the upper middle of the rear case of the display device. As an installable method, it can be fixedly installed in the display device Any position of the rear shell of the device can ensure that the image acquisition area is not blocked by the rear shell. For example, the image acquisition area and the display device have the same display orientation.

As another connection method in some embodiments of the present application, the camera is connected to the rear shell of the display device in a liftable manner through a connecting plate or other conceivable connectors, and a lifting motor is installed on the connector. When the user wants to use the camera or have a When the application needs to use the camera, it is raised above the display device. When the camera is not needed, it can be embedded behind the back shell to protect the camera from damage and protect the user's privacy.

As an embodiment, the camera used in this application may be 16 million pixels, so as to achieve the purpose of ultra-high-definition display. In actual use, cameras with higher or lower pixels than 16 megapixels can also be used.

When a camera is installed on the display device, the content displayed in different application scenarios of the display device can be integrated in many different ways, so as to achieve functions that cannot be achieved by traditional display devices.

Exemplarily, a user may video chat with at least one other user while watching a video program. The presentation of the video program can be used as a background image, and the video chat window is displayed on the background image. Visually, this function can be called "watch while chatting".

In some embodiments of the present application, in the scenario of "watching while chatting", at least one video chat is performed across terminals while watching a live video or an online video.

In another example, the user may video chat with at least one other user while entering the educational application for learning. For example, students can interact with teachers remotely while learning content in educational applications. Visually, this function can be called "learning while chatting".

In another example, a user video chats with a player entering the game while playing a card game. For example, when a player enters a game application to participate in the game, he can realize remote interaction with other players. Visually, this function can be called "play while watching".

In some embodiments of the present application, the game scene is merged with the video screen, and the portraits in the video screen are cut out and displayed on the game screen to improve user experience.

In some embodiments of the present application, in somatosensory games (such as playing ball, boxing, running, dancing, etc.), the camera is used to obtain human posture and movement, limb detection and tracking, and detection of human skeleton key point data, Then integrate with the animation in the game to realize the game of scenes such as sports and dance.

In another example, the user can perform video and voice interaction with at least one other user in the K song application. Visually, this function can be called "sing while watching". In some embodiments of the present application, when at least one user enters the application in a chatting scenario, multiple users can jointly complete the recording of a song.

In another example, the user can turn on the camera locally to obtain pictures and videos, which can be called "looking in the mirror".

In other examples, more functions may be added or the above functions may be reduced. The present application does not specifically limit the function of the display device.

FIG. 2 exemplarily shows a block diagram of the configuration of the control apparatus 100 according to the exemplary embodiment. As shown in FIG. 2 , the control device 100 includes a controller 110 , a communicator 130 , a user input/output interface 140 , a memory 190 , and a power supply 180 .

The control apparatus 100 is configured to control the display device 200 , and to receive user input operation instructions, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, so as to mediate interaction between the user and the display device 200 . For example, the user operates the channel addition and subtraction keys on the control device 100, and the display device 200 responds to the channel addition and subtraction operation.

In some embodiments, the control apparatus 100 may be a smart device. For example, the control apparatus 100 may install various applications for controlling the display device 200 according to user requirements.

In some embodiments, as shown in FIG. 1 , the mobile terminal 100B or other intelligent electronic device may perform a similar function of the control apparatus 100 after installing the application for operating the display device 200 . For example, the user can install the application, various function keys or virtual buttons of the graphical user interface that can be provided on the mobile terminal 100B or other intelligent electronic devices, so as to realize the function of the physical key of the control apparatus 100 .

Controller 110 includes processor 112, RAM 113 and ROM 114, a communication interface, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as the communication and cooperation among the internal components and the external and internal data processing functions.

The communicator 130 implements communication of control signals and data signals with the display device 200 under the control of the controller 110 . For example, the received user input signal is sent to the display device 200 . The communicator 130 may include at least one of communication modules such as a WIFI module 131 , a Bluetooth module 132 , and an NFC module 133 .

The user input/output interface 140, wherein the input interface includes at least one of input interfaces such as a microphone 141, a touch panel 142, a sensor 143, a key 144, a camera 145, and the like. For example, the user can implement the user command input function through actions such as voice, touch, gesture, pressing, etc. The input interface converts the received analog signal into a digital signal, and converts the digital signal into a corresponding command signal, and sends it to the display device 200.

The output interface includes an interface for transmitting received user instructions to the display device 200 . In some embodiments, it may be an infrared interface or a radio frequency interface. For example, when the infrared signal interface is used, the user input instruction needs to be converted into an infrared control signal according to the infrared control protocol, and sent to the display device 200 through the infrared sending module. For another example, when a radio frequency signal interface is used, the user input command needs to be converted into a digital signal, and then modulated according to the radio frequency control signal modulation protocol, and then sent to the display device 200 by the radio frequency transmission terminal.

In some embodiments, the control device 100 includes at least one of a communicator 130 and an output interface. The control device 100 is configured with a communicator 130, such as WIFI, Bluetooth, NFC and other modules, which can send user input instructions to the display device 200 through WIFI protocol, Bluetooth protocol, or NFC protocol encoding.

The memory 190 is used to store various operating programs, data and applications for driving and controlling the control device 100 under the control of the controller 110 . The memory 190 can store various control signal instructions input by the user.

The power supply 180 is used to provide operating power support for each electrical component of the control device 100 under the control of the controller 110 . The power supply 180 can be powered by a battery and related control circuits.

FIG. 3 exemplarily shows a schematic diagram of a hardware structure of a hardware system in the display device 200 according to an exemplary embodiment. For the convenience of description, the display device 200 in FIG. 3 is illustrated by taking a liquid crystal display as an example.

As shown in FIG. 3 , the display device 200 includes: a first panel 11 , a first backlight assembly 21 , a main board 31 , an interactive board 32 , a first display driver board 33 , a second panel 12 , a second backlight assembly 22 , and a second display driver The board 34 , the power board 4 , the first rear case 51 , the second rear case 52 and the base 6 .

Wherein, the first panel 11 is used to present a picture of the first display 201 to the user. The first backlight assembly 21 is located below the first panel 11 and is usually some optical assemblies for supplying sufficient brightness and evenly distributed light sources, so that the first panel 11 can normally display images. The first backlight assembly 21 further includes a first backplane (not shown in the figure). The main board 31 , the interactive board 32 , the first display driver board 33 and the power board 4 are disposed on the first backplane, and usually some convex hull structures are formed by stamping on the first backplane. The main board 31 , the interactive board 32 , the first display driver board 33 and the power board 4 are fixed on the convex hull by screws or hooks. The main board 31 , the interactive board 32 , the first display driver board 3 and the power board 4 may be arranged on one board, or may be arranged on different boards respectively. The first rear case 51 is covered on the first panel 11 to hide the components of the display device 200 such as the first backlight assembly 21 , the main board 31 , the interactive board 32 , the first display driver board 33 and the power board 4 , so as to be beautiful. Effect.

Among them, the main function of the first display driver board 33 is: through the PWM signal and the Lcaldimming signal transmitted by the first controller on the main board 31 to perform thousand-level backlight partition control, this part of the control is changed according to the image content, and the main board After the handshake is established between the first controllers on the main board 31 , the VbyOne display signal sent by the first controller on the main board 31 is received, and the VbyOne display signal is converted into an LVDS signal to realize the image display of the first display 201 . The base 6 is used to support the display device 200. It is worth noting that only one form of base design is shown in the figure, and those skilled in the art can design different forms of bases according to product requirements.

Wherein, the second panel 12 is used to present a picture of the second display 202 to the user. The second backlight assembly 22 is located below the second panel 12 and is usually some optical assemblies for supplying sufficient brightness and uniformly distributed light sources so that the second panel 12 can normally display images. The second backlight assembly 22 also includes a second backplane (not shown in the figure). The second display driving board 34 is disposed on the second backplane, and usually some protruding structures are formed by stamping on the second backplane. The second display driving board 34 is fixed on the boss by screws or hooks. The second display driving board 34 may be arranged on one board, or may be arranged on different boards respectively. The second rear case 52 is covered on the second panel 12 to hide the components of the display device 200 such as the second backlight assembly 22 , the switching driver board 35 , the second TCON board 34 b and the key board 36 , and has an aesthetic effect. .

In some embodiments of the present application, FIG. 3 further includes a key board 35 , and the key board 35 may be disposed on the first backplane or on the second backplane, which is not limited in this application.

In addition, the display device 200 also includes a sound reproduction device (not shown in the figure) such as an audio component, such as an I2S interface including a power amplifier (Amplifier, AMP) and a speaker (Speaker), etc., for realizing sound reproduction. Usually, the audio component can achieve at least two channels of sound output; when you want to achieve the effect of panoramic sound surround, you need to set up multiple audio components to output the sound of multiple channels, which will not be described in detail here.

It should be noted that the display device 200 may also adopt an OLED display, in this way, the template included in the display device 200 will be changed accordingly, which will not be described here.

Figure 4 shows a schematic diagram of the connection relationship between the power board and the load. As shown in Figure 4, the power board 4 includes an input terminal IN and an output terminal OUT (the figure shows the first output terminal OUT1, the second output terminal OUT2, the third output terminal OUT2, the third The output terminal OUT3, the fourth output terminal OUT4 and the fifth output terminal OUT5), wherein the input terminal IN is connected to the mains, and the output terminal OUT is connected to the load, for example, the first output terminal OUT1 and the light-emitting element (such as a light bar or self- The second output terminal OUT2 is connected to the audio component, the third output terminal OUT3 is connected to the main board 31, the fourth output terminal OUT4 is connected to the first display driver board 33, and the fifth output terminal OUT5 is connected to the first backlight assembly. 21 connected. The power board 4 needs to convert the AC mains power into the DC power required by the load, and the DC power usually has different specifications, for example, the audio component needs 18V, the panel needs 12V/18V, and so on.

For ease of expression, one hardware system in the dual hardware system architecture is referred to as the first hardware system or the first controller, and the other hardware system is referred to as the second hardware system or the second controller. The first controller includes various types of processors and various types of interfaces of the first controller, and the second controller includes various types of processors and various types of interfaces of the second controller. A relatively independent operating system may be installed in each of the first controller and the second controller, and the operating system of the first controller and the operating system of the second controller may communicate with each other through a communication protocol. Exemplary: the first controller The framework layer of the operating system of the second controller and the framework layer of the operating system of the second controller can communicate to transmit commands and data, so that there are two independent but interrelated subsystems in the display device 200 .

The dual hardware system architecture of the present application will be further described below with reference to FIG. 5 . It should be noted that FIG. 5 is only an exemplary illustration of the dual hardware system architecture of the present application, and does not represent a limitation on the present application. In practical applications, both hardware systems may contain more or less hardware or interfaces as required.

FIG. 5 exemplarily shows a hardware architecture block diagram of the display device 200 shown in FIG. 3 . As shown in FIG. 5 , the hardware system of the display device 200 includes a first controller 210 and a second controller 310, and modules connected to the first controller 210 or the second controller 310 through various interfaces.

Wherein, the first controller 210 may be disposed on the main board 31 shown in FIG. 3 . In some embodiments of the present application, the first controller 210: mainly implements traditional TV functions (for example, an external set-top box, etc.). The second controller 310 may be disposed on the second display driving board 34 shown in FIG. 3 . In some embodiments of the present application, the second controller 310 may be configured to receive an instruction sent by the first controller 210 and control the second display 380 to display a corresponding image.

The modules connected with the first controller 210 may include a tuner-demodulator 220, a communicator 230, an external device interface 250, a memory 290, a user input interface 260-3, a video processor 260-1, an audio processor 260-2, Audio output interface 270 , power supply module 240 .

In some embodiments of the present application, the module connected with the first controller 210 may further include a first display 280 .

In other embodiments, the first controller 210 may also be connected with more or less modules.

In other embodiments, the first controller includes any one or more of the above modules.

Among them, the tuner and demodulator 220 is used to perform modulation and demodulation processing such as amplification, frequency mixing and resonance on the broadcast and television signals received by wire or wireless, so as to demodulate the user's data from a plurality of wireless or wire broadcast and TV signals. Audio and video signals carried in the frequencies of the selected TV channels, as well as additional information (eg EPG data signals). According to different TV signal broadcasting standards, the signal paths of the tuner and demodulator 220 can be various, such as: terrestrial broadcasting, cable broadcasting, satellite broadcasting or Internet broadcasting, etc.; Analog modulation is also possible; and depending on the type of received television signal, the tuner demodulator 220 can demodulate analog and/or digital signals.

The tuner and demodulator 220 is also configured to respond to the frequency of the television channel selected by the user and the television signal carried by the frequency according to the user's selection and controlled by the first controller 210 .

In some other exemplary embodiments, the tuner 220 may also be in an external device, such as an external set-top box or the like. In this way, the set-top box outputs the television audio and video signals after modulation and demodulation, and inputs them into the display device 200 through the external device interface 250 .

The communicator 230 is a component for communicating with external devices or external servers according to various communication protocol types. For example, the communicator 230 may include a WIFI module 231, a Bluetooth module 232, a wired Ethernet module 233, and other network communication protocol modules such as an infrared communication protocol module or a near field communication protocol module (not shown in the figure).

The display device 200 may establish a connection of control signals and data signals with an external control device or a content providing device through the communicator 230 . For example, the communicator may receive a control signal of the remote controller 100 according to the control of the first controller 210 .

The external device interface 250 is a component that provides data transmission between the first controller 210 and other external devices. The external device interface 250 can be connected with external devices such as set-top boxes, game devices, notebook computers, etc. in a wired/wireless manner, and can receive external devices such as video signals (for example, moving images), audio signals (for example, music), additional information (for example, EPG) and other data.

The external device interface 250 may include: a high-definition multimedia interface (HDMI) terminal is also called HDMI 251, a composite video blanking sync (CVBS) terminal is also called AV 252, an analog or digital component terminal is also called component 253 , any one or more of a universal serial bus (USB) terminal 254, a red, green and blue (RGB) terminal (not shown in the figure). This application does not limit the number and type of external device interfaces.

The first controller 210 controls the operation of the display device 200 and responds to user operations by running various software control programs (eg, an operating system and/or various application programs) stored in the memory 290 .

As shown in Figure 5, the first controller 210 includes a read-only memory RAM 213, a random access memory ROM 214, a graphics processor 216, a CPU processor 212, a communication interface 218, and a communication bus. Among them, the ROM 213 and the RAM 214, the graphics processor 216, the CPU processor 212, and the communication interface 218 are connected through a bus.

The ROM 213 is used to store various system startup instructions. For example, when receiving the power-on signal, the power supply of the display device 200 starts to start, and the CPU processor 212 runs the system start-up instruction in the ROM, and copies the operating system stored in the memory 290 to the RAM 214 to start running the boot operating system. After the startup of the operating system is completed, the CPU processor 212 copies various application programs in the memory 290 to the RAM 214, and then starts to run and start various application programs.

The graphics processor 216 is used to generate various graphic objects, such as: icons, operation menus, and user input instructions to display graphics and so on. It includes an operator, which performs operations by receiving various interactive instructions input by the user, and displays various objects according to the display properties. and includes a renderer, generating various objects obtained based on the arithmetic unit, and displaying the result of rendering on the first display 280 .

CPU processor 212 for executing operating system and application program instructions stored in memory 290 . And various application programs, data and content are executed according to various interactive instructions received from the external input, so as to finally display and play various audio and video content.

In some exemplary embodiments, CPU processor 212 may include multiple processors. The plurality of processors may include a main processor and multiple or one sub-processors. The main processor is used to perform some operations of the display device 200 in the pre-power-on mode, and/or an operation of displaying a picture in the normal mode. Multiple or one sub-processors for performing an operation in a state such as standby mode.

The communication interface 218 may include a first interface 218-1 to an nth interface 218-n. These interfaces may be network interfaces connected to external devices via a network.

The first controller 210 may control operations of the display apparatus 200 in relation to the first display 280 . For example, in response to receiving a user command for selecting a UI object to be displayed on the first display 280, the first controller 210 may perform an operation related to the object selected by the user command.

In some embodiments of the present application, the first controller 210 may control operations related to the second display 380 . For example, in response to receiving a user command for selecting a UI object to be displayed on the second display 380, the first controller 210 may perform an operation related to the object selected by the user command.

where the object can be any of the optional objects, such as a hyperlink or an icon. Actions related to the selected object, such as displaying actions linked to hyperlinked pages, documents, images, etc., or executing actions that correspond to an icon. The user command for selecting the UI object may be an input command through various input devices (eg, a mouse, a keyboard, a touchpad, etc.) connected to the display device 200 or a voice command corresponding to a voice spoken by the user.

The memory 290 includes storing various software modules for driving and controlling the display device 200 . For example, various software modules stored in the memory 290 include: a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules (not shown in the figure).

The basic module is a low-level software module used for signal communication between various hardwares in the display device 200 and sending processing and control signals to the upper-layer modules. The detection module is a management module used to collect various information from various sensors or user input interfaces, perform digital-to-analog conversion, and analyze and manage. The speech recognition module includes a speech parsing module and a speech instruction database module. The display control module is a module used to control the first display 280 to display image content, and can be used to play information such as multimedia image content and UI interface. The communication module is a module used for control and data communication with external devices. The browser module is a module for performing data communication between browser servers. Service modules are modules used to provide various services and various applications.

At the same time, the memory 290 is also used for storing received external data and user data, images of various items in various user interfaces, and visual effect diagrams of focal objects.

The user input interface 260-3 is used to send the user's input signal to the first controller 210, or to transmit the signal output from the first controller 210 to the user. Exemplarily, the control device (such as a mobile terminal or a remote control) can send input signals input by the user, such as power switch signal, channel selection signal, volume adjustment signal, etc., to the user input interface, and then forwarded by the user input interface 260-3 to the user input interface. The first controller 210; alternatively, the control device may receive output signals such as audio, video or data output from the user input interface 260-3 processed by the first controller 210, and display the received output signals or output the received output signals in the form of audio or vibration.

In some embodiments, the user may input a user command on a graphical user interface (GUI) displayed on the first display 280, and the user input interface 260-3 receives the user input command through the graphical user interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface 260-3 recognizes the sound or gesture through a sensor to receive the user input command.

The video processor 260-1 is used to receive video signals, and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to the standard codec protocol of the input signal, and can obtain A video signal displayed or played directly on the first display 280 .

Exemplarily, the video processor 260-1 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, etc. (not shown in the figure).

Among them, the demultiplexing module is used for demultiplexing the input audio and video data stream. For example, if MPEG-2 is input, the demultiplexing module demultiplexes it into video signals and audio signals.

The video decoding module is used to process the demultiplexed video signal, including decoding and scaling.

The image synthesizing module, such as an image synthesizer, is used for superimposing and mixing the GUI signal generated by the graphics generator according to the user's input or itself, and the zoomed video image, so as to generate an image signal that can be displayed.

The frame rate conversion module is used to convert the frame rate of the input video, such as converting the frame rate of the input 24Hz, 25Hz, 30Hz, 60Hz video to the frame rate of 60Hz, 120Hz or 240Hz. The video stream is related, and the output frame rate can be related to the refresh rate of the display device. The display formatting module is used to change the signal output by the frame rate conversion module into a signal conforming to a display format such as a display device, such as converting the format of the signal output by the frame rate conversion module to output an RGB data signal.

The first display 280 is used to receive the image signal input from the video processor 260-1, to display video content and images, and to operate the menu interface. The first display 280 includes a display component for presenting pictures and a driving component for driving image display . The displayed video content can come from the video in the broadcast signal received by the tuner and demodulator 220, or from the video content input from the communicator or the interface of the external device. The first display 280 simultaneously displays a user manipulation interface UI generated in the display device 200 and used for controlling the display device 200 .

And, depending on the type of the first display 280, a driving component for driving the display is also included. Alternatively, if the first display 280 is a projection display, it may also include a projection device and a projection screen.

The audio processor 260-2 is used for receiving the audio signal, decompressing and decoding according to the standard codec protocol of the input signal, and processing the audio content such as noise reduction, digital-to-analog conversion, and amplification, so as to obtain a result that can be played in the speaker 272 audio signal.

The audio output interface 270 is used to receive the audio signal output by the audio processor 260-2 under the control of the first controller 210. The audio output interface may include a speaker 274, or an external audio output terminal 272 of a generator output to an external device. , such as: external audio terminal or headphone output terminal, etc.

In some other exemplary embodiments, the video processor 260-1 may comprise one or more chips. The audio processor 260-2 may also include one or more chips.

And, in some other exemplary embodiments, the video processor 260-1 and the audio processor 260-2 may be separate chips, or may be integrated with the first controller 210 in one or more chips.

The power supply module 240 is configured to, under the control of the first controller 210 , use the power input from the external power source to provide power supply support for the display device 200 . The power supply module 240 may include a built-in power supply circuit installed inside the display device 200 , or may be a power supply installed outside the display device 200 , such as a power interface that provides an external power supply in the display device 200 .

Similar to the first controller 210 , as shown in FIG. 5 , a module connected with the second controller 310 may include a communicator 330 , a detector 340 , and a memory 390 . In some embodiments, a user input interface, a video processor, an audio processor, a second display, and an audio output interface may also be included. In some embodiments, there may also be a power supply module (not shown in the figure) that independently supplies power to the second controller 310 .

In some embodiments, the second controller 310 may include any one or more of the modules described above.

The communicator 330 is a component for communicating with external devices or external servers according to various communication protocol types. For example, the communicator 330 may include a WIFI module 331, a Bluetooth communication protocol module 332, a wired Ethernet communication protocol module 333, and other network communication protocol modules such as an infrared communication protocol module or a near field communication protocol module (not shown in the figure).

The communicator 330 and the communicator 230 of the first controller 210 also interact with each other. For example, the WiFi module 231 in the hardware system of the first controller 210 is used to connect to an external network and generate network communication with an external server and the like. The WiFi module 331 in the hardware system of the second controller 310 is used to connect to the WiFi module 231 of the first controller 210 without direct connection with the external network, etc. The second controller 310 is connected to the external network through the first controller 210 . Therefore, for the user, a display device as in the above embodiment displays a WiFi account to the outside.

The detector 340 is a component of the second controller 310 for collecting external environment or external interaction signals. The detector 340 may include a light receiver 342, a sensor used to collect ambient light intensity, and can adapt to changes in display parameters by collecting ambient light; it may also include an image collector 341, such as a camera, a camera, etc., which can be used to collect external The environment scene, as well as the gestures used to collect user attributes or interact with the user, can adaptively change display parameters, and can also recognize user gestures to realize the function of interacting with the user.

The external device interface 350 provides components for data transmission between the second controller 310 and the first controller 210 or other external devices. The external device interface can be connected with external devices such as set-top boxes, game devices, notebook computers, etc. in a wired/wireless manner.

The video processor 360 is used for processing related video signals.

The second controller 310 controls the operation of the display device 200 and responds to the user by running various software control programs stored in the memory 390 (eg, using installed third-party applications, etc.) and interacting with the first controller 210 operation.

As shown in Figure 5, the second controller 310 includes a read-only memory ROM 313, a random access memory RAM 314, a graphics processor 316, a CPU processor 312, a communication interface 318, and a communication bus. Wherein, the ROM 313 and the RAM 314, the graphics processor 316, the CPU processor 312, and the communication interface 318 are connected through a bus.

The ROM 313 is used to store various system startup instructions. The CPU processor 312 runs the system startup instruction in the ROM, and copies the operating system stored in the memory 390 to the RAM 314 to start running the startup operating system. When the startup of the operating system is completed, the CPU processor 312 copies various application programs in the memory 390 to the RAM 314, and then starts to run and start various application programs.

The CPU processor 312 is used to execute the operating system and application program instructions stored in the memory 390, and communicate with the first controller 210, transmit and interact with the first controller 210, such as signals, data, and instructions, and receive various interactive instructions from external inputs. , to execute various applications, data and content, so as to finally display and play various audio and video content.

There are multiple communication interfaces 318, which may include a first interface 318-1 to an nth interface 318-n. These interfaces may be network interfaces connected to external devices via a network, or may be network interfaces connected to the first controller 210 via a network.

The second controller 310 may control operations of the display apparatus 200 in relation to the second display 380 . For example, in response to receiving a user command for selecting a UI object to be displayed on the second display 380, the second controller 310 may perform an operation related to the object selected by the user command.

The second controller 310 may control operations of the display apparatus 200 in relation to the first display 280 . For example, in response to receiving a user command for selecting a UI object to be displayed on the first display 280, the first controller 210 may perform an operation related to the object selected by the user command.

The graphics processor 316 is used to generate various graphic objects, such as: icons, operation menus, and user input instructions to display graphics and so on. It includes an operator, which performs operations by receiving various interactive instructions input by the user, and displays various objects according to the display properties. and includes a renderer, generating various objects obtained based on the arithmetic unit, and displaying the result of rendering on the second display 380 .

Both the graphics processor 316 of the second controller 310 and the graphics processor 216 of the first controller 210 can generate various graphic objects. Differently, if application 1 is installed on the second controller 310, and application 2 is installed on the first controller 210, when the user is on the interface of application 1 and performs an instruction input by the user in application 1, the second controller Graphics processor 316 of 310 generates graphic objects. When the user is on the interface of the application 2 and performs an instruction input by the user in the application 2 , the graphic object is generated by the graphics processor 216 of the first controller 210 .

FIG. 6 exemplarily shows a functional configuration diagram of a display device according to an exemplary embodiment.

As shown in FIG. 6 , the memory 390 of the second controller 310 and the memory 290 of the first controller 210 are respectively used to store the operating system, application programs, content and user data, etc. The system operation of driving the first display 280 and the second display 380 and responding to various operations of the user are performed under the control of the 210 . Memory 390 and memory 290 may include volatile and/or non-volatile memory.

The memory 290 is specifically used to store the running program that drives the first controller 210 in the display device 200, as well as various application programs built in the display device 200, various application programs downloaded by the user from external devices, and application programs related to the storage device 200. Various graphical user interfaces, as well as various objects related to the graphical user interface, user data information, and various internal data supporting the application. The memory 290 is used to store system software such as an operating system (OS) kernel, middleware, and applications, as well as input video data and audio content, and other user data.

The memory 290 is specifically used to store drivers and related data such as the video processor 260-1, the audio processor 260-2, the first display 280, the communicator 230, the tuner and demodulator 220, and input/output interfaces.

In some embodiments, memory 290 may store software and/or programs representing an operating system (OS) including, for example, a kernel, middleware, application programming interfaces (APIs) and/or applications. Illustratively, the kernel may control or manage system resources, or other program-implemented functions (such as middleware, APIs, or applications), and the kernel may provide interfaces to allow middleware and APIs, or applications, to access controllers to Implements control or management of system resources.

Exemplarily, the memory 290 includes a broadcast receiving module 2901, a channel control module 2902, a volume control module 2903, an image control module 2904, a display control module 2905, a first audio control module 2906, an external command identification module 2907, a communication control module 2908, A power control module 2910, an operating system 2911, and other application systems 2912, a browser module 2913, and the like. The first controller 210 executes various software programs in the memory 290, such as: broadcast TV signal reception and demodulation function, TV channel selection control function, volume selection control function, image control function, display control function, audio control function, Various functions such as external command recognition function, communication control function, optical signal receiving function, power control function, software control platform supporting various functions, and browser function.

The memory 390 includes storing various software modules for driving and controlling the display device 200 . For example, various software modules stored in the memory 390 include: a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules (not shown in the figure). Since the functions of the memory 390 and the memory 290 are relatively similar, reference may be made to the memory 290 for related parts, which will not be repeated here.

Exemplarily, the memory 390 includes an image control module 3904, a second audio control module 3906, an external command recognition module 3907, a communication control module 3908, a light receiving module 3909, an operating system 3911, other application programs 3912, a browser module 3913, etc. . The first controller 210 executes various software programs in the memory 290, such as: image control function, display control function, audio control function, external command recognition function, communication control function, light signal receiving function, power control function, support Various functions such as software control platform and browser function.

Differently, the external command recognition module 2907 of the first controller 210 and the external command recognition module 3907 of the second controller 310 can recognize different commands.

Exemplarily, when an image receiving device such as a camera is connected to the second controller 310, the external instruction recognition module 3907 of the second controller 310 may include a pattern recognition module 2907-1, and a pattern database is stored in the pattern recognition module 3907-1. , when the camera receives external graphics instructions, it will correspond with the instructions in the graphics database, so as to make instructions to control the display device. Since the voice receiving device and the remote controller are connected to the first controller 210, the external command recognition module 2907 of the first controller 210 may include a voice recognition module 2907-2, and the voice recognition module 2907-2 stores a parsing result library , when a voice receiving device or the like receives an external voice command or command, a corresponding relationship is made with the command in the analysis result library, so as to perform command control on the display device. Similarly, the control device 100 such as a remote control is connected to the first controller 210, and the key command recognition module 2907-3 performs command interaction with the control device 100.

FIG. 7 exemplarily shows a configuration block diagram of a software system in the display device 200 according to an exemplary embodiment.

For the first controller 210, as shown in FIG. 7, the operating system 2911, including the execution software for processing various basic system services and for implementing hardware-related tasks, acts as an application program and completes data processing between hardware components medium.

In some embodiments, a portion of the operating system kernel may contain a set of software to manage hardware resources of the display device and provide services for other programs or software codes.

In some other embodiments, a portion of the operating system kernel may contain one or more device drivers, and the device drivers may be a set of software codes in the operating system to help operate or control devices or hardware associated with the display device. Drivers may contain code to operate video, audio and/or other multimedia components. Examples include displays, cameras, Flash, WiFi, and audio drivers.

Among them, the accessibility module 2911-1 is used to modify or access the application program, so as to realize the accessibility of the application program and the operability of the displayed content thereof.

The communication module 2911-2 is used to connect with other peripherals via related communication interfaces and communication networks.

The user interface module 2911-3 is used to provide objects for displaying a user interface for each application program to access, which can realize user operability.

The control application 2911-4 is used to control process management, including runtime applications and the like.

The event transmission system 2914 can be implemented in the operating system 2911 or in the application program 2912 . In some embodiments, on the one hand, it is implemented in the operating system 2911, and at the same time, it is implemented in the application program 2912 to monitor various user input events, and will refer to the recognition results in response to various events or sub-events according to various events, Instead, a handler that implements one or more sets of predefined actions.

Among them, the event monitoring module 2914-1 is used to monitor user input interface input events or sub-events.

The event identification module 2914-2 is used to input the definitions of various events to various user input interfaces, identify various events or sub-events, and transmit them to the processing program for executing its corresponding one or more groups .

The event or sub-event refers to the input detected by one or more sensors in the display device 200 and the input of the external control device (eg, the control device 100 , etc.). Such as: various sub-events of voice input, gesture input sub-events of gesture recognition, and sub-events of remote key command input of the control device, etc. Exemplarily, one or more sub-events in the remote control include various forms, including but not limited to one or a combination of key press up/down/left/right/, confirm key, key press and so on. And non-physical button operations, such as move, hold, release and other operations.

The interface layout management module 2913 directly or indirectly receives and monitors each user input event or sub-event from the event transmission system 2914, and is used to update the layout of the user interface, including but not limited to the position of each control or sub-control in the interface, and the container The size or position, level, etc. of the interface perform various operations related to the interface layout.

Since the functions of the operating system 3911 of the second controller 310 are similar to those of the operating system 2911 of the first controller 210 , reference may be made to the operating system 2911 for related parts, which will not be repeated here.

As shown in FIG. 8 , the application layer of the display device contains various applications executable on the display device 200 .

The application layer 2912 of the first controller 210 may include, but is not limited to, one or more applications, such as a video-on-demand application, an application center, a game application, and the like. The application layer 3912 of the second controller 310 may include, but is not limited to, one or more applications, such as a live TV application, a media center application, and the like. It should be noted that the application programs included in the second controller 310 and the first controller 210 are determined according to the operating system and other designs, and the present invention does not need to specify the application programs included in the second controller 310 and the first controller 210. The application to do specific qualification and division.

Live TV app that can provide live TV from different sources. For example, a live TV application may provide a TV signal using input from cable, over-the-air, satellite services, or other types of live TV services. And, the live TV application may display the video of the live TV signal on the display device 200 .

Video-on-demand application that can provide video from different storage sources. Unlike live TV applications, video-on-demand provides a display of video from certain storage sources. For example, video-on-demand can come from the server side of cloud storage, from local hard disk storage containing existing video programs.

A media center application that can provide a variety of multimedia content playback applications. For example, a media center may provide services other than live TV or video-on-demand, where users can access various images or audio through a media center application.

The application center can provide storage of various applications. An application can be a game, an application, or some other application that is associated with a computer system or other device but can run on a display device. The application center can obtain these applications from various sources, store them in local storage, and then run them on the display device 200 .

Since the second controller 310 and the first controller 210 may be respectively installed with independent operating systems, there are two independent but interrelated subsystems in the display device 200 . For example, both the second controller 310 and the first controller 210 may be independently installed with Android (Android) and various APPs, both of which may implement certain functions, and the second controller 310 and the first controller 210 may cooperate to implement certain functions. item function.

FIG. 9 exemplarily shows a schematic diagram of a user interface in the display device 200 according to an exemplary embodiment. As shown in FIG. 9 , the user interface includes a first view display area 2011 and a second view display area 2021 . The functions of the first image display area 2011 and the second image display area 2021 are basically the same, and only the first image display area 2011 will be described below. For example, the first view display area 2011 includes layout of one or more different items. Also, the user interface also includes a selector indicating that an item is selected, and the position of the selector can be moved by user input to change the selection of a different item.

"User interface" is a medium interface for interaction and information exchange between application programs or operating systems and users, which realizes the conversion between the internal form of information and the form acceptable to users. A commonly used form of user interface is a graphical user interface (graphic user interface, GUI), which refers to a user interface related to computer operations displayed in a graphical manner. It can be an icon, window, control and other interface elements displayed on the display of the electronic device, wherein the control can include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, Widgets and other visual elements interface elements.

In some embodiments, the first view display area 2011 is a zoomable view display. "Zoomable" may mean that the size or proportion of the first view display area 2011 is scalable on the screen, or the size or proportion of the items in the view display 201 is scalable on the screen.

An "item" refers to a visual object displayed in the view display area of the user interface in the display device 200 to represent, such as an icon, a thumbnail, a video clip, or the like, a visual object corresponding to the content. For example, an item may represent image content or video clips of movies, TV series, audio content of music, applications, or other user access content history information.

In addition, the item may represent an interface or a set of interfaces displayed by which the display device 200 is connected to an external device, or may represent the name of an external device connected to the display device, or the like. Such as: signal source input interface collection, or high definition multimedia interface (High Definition Multimedia Interface, HDMI), USB interface, PC terminal interface, etc.

It should be noted that: the view display area can present the content of the video chat item, or the content of the application layer item (eg, web video, video on demand (VOD) display, application screen, etc.).

A "selector" is used to indicate that any of the items has been selected, such as the cursor or the focused object. Positioning the selection information input according to the icon or menu position touched by the user in the display 200 enables the movement of the display focus object in the display device 200 to select control items, one or more of which may be selected or controlled.

A focus object refers to an object that moves between items based on user input. Illustratively, the focus object position is achieved or identified by drawing a thick line at the edge of the item. In other embodiments, the focus form is not limited to an example, and can be a visible or invisible form that can be recognized by the user, such as a cursor, such as a 3D deformation of an item, or the border line and size of the text or image of the focused item can be changed. , color, transparency and outline and/or font.

The event transmission system 2914 can monitor the user input of each predefined event or sub-event, and directly or indirectly provides the interface layout management module 2913 with the control of identifying the event or sub-event.

The interface layout management module 2913 is used for monitoring the state of the user interface (including the position and/or size of the view partition, item, focus or cursor object, etc., and the change process, etc.), and according to the event or sub-event, the view display area can be modified. The size and position, hierarchy and other layouts, and/or, adjust or modify the size or/and position, quantity, type, content and other layouts of various item layouts in the view display area. In some embodiments, modifying and adjusting the layout includes displaying or not displaying each view partition or the content of items in a view partition on the screen.

The user input interface is used to send the user's input signal to the controller, or transmit the signal output from the controller to the user. Exemplarily, the control device (such as a mobile terminal or a remote control) can send input signals input by the user, such as power switch signal, channel selection signal, volume adjustment signal, etc., to the user input interface, and then forward the user input interface to the controller; Alternatively, the control device may receive an output signal such as audio, video or data output from the user input interface through the controller processing, and display the received output signal or output the received output signal in the form of audio or vibration.

In some embodiments, the user may input user commands on a graphical user interface (GUI) displayed on the display 200, and the user input interface receives the user input commands through the graphical user interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through a sensor to receive the user input command.

In an existing dual-screen display TV, when a user searches for media resources, the content displayed on the second display only includes the user's voice, and the above-mentioned user's voice cannot play a role of prompting. Usually, it takes a lot of time for users to find the target media resources. Bad experience.

In order to solve the above technical problems, an embodiment of the present application shows a display system. For details, please refer to FIG. 10 . FIG. 10 is a structural block diagram of a display system according to a feasible embodiment. It can be seen from FIG. 10 that the display system may include : Displays devices and servers. For the interaction process between the display device and the server, reference may be made to FIG. 11 , which is a flowchart of the interaction between the display device and the server according to a feasible embodiment. As can be seen from Figure 11, the display device is provided with a first controller and a second controller;

Wherein, the first controller is configured to perform step S101 to receive user voice;

In the present application, the first controller is provided with a user interface, and the user interface is used for receiving user voice input by the user or a key command issued by the user through the remote control.

In this application, the user's voice is used to transmit relevant information of media assets. For example, the user information may be "Andy Lau's movie", "Andy Lau's song" and so on.

The first controller is configured to perform step S102 to transmit the received user voice to the server.

In some feasible embodiments, the first controller can be connected with the server through a wireless module, and the corresponding user voice can be transmitted to the server through a network channel. In some feasible embodiments, the first controller can be connected with the server through a line, and the corresponding user voice can be transmitted to the server through a physical channel.

The server is configured to perform step S103 to process the user's voice to obtain the central word;

The natural language processing technology commonly used in the art can be used for processing the user's voice. For example, the server divides the user speech "I want to watch Andy Lau's movies" into word sets, and the word sets include: "I", "Want", "Watch", "Andy Lau", "De", "Movie". The server deletes some meaningless words "I", "thinking", "see", and "the" in the word set. The server finally got the central words including: "movie" and "Andy Lau".

This embodiment only exemplarily shows a processing manner of the user voice. In the process of practical application, the processing manner of the user voice may be but not limited to the above processing manner.

The server is configured to perform step S104 to retrieve the query label, and output the central word and the query label; the query label is the label corresponding to the central word, and the query label is used to prompt the user to output the relevant user voice;

In the technical solutions shown in the embodiments of the present application, a list of central words is pre-built, and the list of central words is used to access the central words and tags corresponding to the central words.

For example, Table 1 is a list of head words according to a feasible embodiment.

Table 1

The tags involved in this application are information that plays a suggestive role in the user's search. For example, for Andy Lau, the director can be used to prompt the user that one of Andy Lau's identities is the director, and prompt the user to search for movies directed by Andy Lau. For another example, "Meng Meiqi" can be used as a label of "women's group" to prompt users to search for Meng Meiqi, etc.

The second controller is configured to execute step S105 to control the second display to display the head word and the query tag.

When the second display displays the central word and the query label, the user can make further searches according to the prompts of the central word and the query label.

It can be seen from the above technical solutions that this embodiment shows a display system including: a server and a display device, wherein the display device is provided with a first controller and a second controller. When it is necessary to search for media assets, the user outputs a user voice to the first controller. The first controller sends the received user voice to the server. The server processes the user's voice to obtain the central word; and retrieves the query tag, wherein the query tag is used to prompt the user to output the relevant user voice; and outputs the central word and the query tag to the second controller. The second controller controls the second display to display the head word and the query tag. It can be seen that the display system shown in the embodiment of the present application obtains the central word and the query label related to the central word by processing the user's voice, and further displays the central word and the query label on the second display. The user can search for media resources in a targeted manner with respect to the content displayed on the second display, and the user experience is better.

The solution shown in the present application will be further described below with reference to specific examples.

In a feasible embodiment, the user voice output by the user is "Andy Lau's movie", at this time, the display device can refer to the interface 11 in FIG. Display the user's voice in the form. The first controller sends "Andy Lau's movie" to the server. The server processes "Andy Lau's movie" to get the central words "Andy Lau" and "movie". The server retrieves the query tags "actor", "singer" and "director" corresponding to "Andy Lau"; the query tags corresponding to "movie" are: "comedy", "shootout", "love" and "ethics". The server sends the central word and the query tag to the second controller. The second controller controls the second display to display the above-mentioned head word and query label. In this case, the interface displayed by the display device can refer to the interface 21 in FIG. 12 . The user can search for media resources in a targeted manner for the content displayed on the second display. For example, the user voice input by the user can be "comedy movie directed by Andy Lau", "shooting movie directed by Andy Lau" and so on.

FIG. 12 is only a schematic diagram illustrating an interface displayed by a display device during a search process. In the process of practical application, the display position of the central word or query label can be configured according to the requirements. For example, FIG. 13 is a schematic diagram of an interface displayed by the second display according to a feasible embodiment; it can be seen from FIG. 13 that the upper half of the second display is used to display the head word, and the lower part of the second display is used to display head words. The half is used to display the query label.

In some feasible embodiments, the second controller may also generate some prompt words based on the received head words and query tags, and control the second display to display the head words, query tags and prompt words. Specifically, please refer to FIG. 14. It can be seen from FIG. 14 that the second display simultaneously displays the central word, the query label and the prompt.

It is worth noting that the embodiments of the present application merely illustrate several display methods of the head word and the query label. In the process of practical application, the display methods of the head word and the query label may be but not limited to the above-mentioned ones. The display method is not limited by the applicant here.

In order to obtain a central word with a high degree of fit with the user's voice, the embodiment of the present application makes further improvements on the basis of the display system shown in the above-mentioned embodiment. After the improvement, the interaction flow diagram between the display device and the server can be referred to FIG. 15 , FIG. 15 is a flowchart showing the interaction between a display device and a server according to a feasible embodiment; it can be seen from FIG. 15 that:

The first controller is configured to perform step S101 to receive user voice;

Wherein, the implementation manner of receiving the user's voice can refer to the above-mentioned embodiments, and the applicant will not repeat them here;

The first controller is configured to perform step S102 to transmit the received user voice to the server;

The server is configured to perform step S1031 to train the user's voice to obtain keywords;

The training method for the user's voice may adopt the natural language processing technology commonly used in the art, for example, some meaningless symbols or texts in the user's voice may be removed to obtain keywords.

In some feasible embodiments, a domain tag may be configured for the keyword for subsequent use. Specifically, the server configures domain tags for keywords by executing steps (11)-(13).

Step (11) in the pre-stored hot spot statistics table, look up the query field, and the query field is the field to which the keyword belongs;

Among them, the generating process of the hotspot statistics table is to use the deep learning textCNN model to determine the hotspots that the user has paid attention to in the recent period of time. The specific process includes steps (111)-steps (116)

Step (111) collects the search data of the user in the most recent period;

The search data may be the user's voice, or may be the user's play record, or the like.

For example, the search data of users in the last month can be found in Table 2.

Table 2

事项matter	内容content	事项matter	内容content
用户语音user voice	刘德华的电影Andy Lau's movies	播放影片play video	《十面埋伏》"House of Flying Daggers"
用户语音user voice	刘德华演唱过的歌曲Songs sung by Andy Lau	播放影片play video	《桃姐》"Sister Peach"
用户语音user voice	刘德华演导演的电影Films directed by Andy Lau	播放影片play video	《瘦身男女》"Slimming Men and Women"
用户语音user voice	刘德华导演过的喜剧A comedy directed by Andy Lau	播放影片play video	《无间道》"Infernal Affairs"
……...	……...	……...	……...

In step (112), word segmentation is performed on the search data, and some meaningless symbols or texts are removed to obtain word segmentation.

For example, "Andy Lau's movie" segmented words obtained are "Andy Lau" and "movie";

For example, the word segmentation obtained by the word segmentation of "Songs sung by Andy Lau" are "Andy Lau" and "Song";

For example, "Andy Lau's comedy" can be processed by the word segmentation as "Andy Lau", "director" and "comedy"...;

In the process of practical application, other word segmentation processing methods can also be adopted, and the applicant does not limit it too much here.

Step (113) then maps each word segment into a multi-dimensional word vector through embedding methods such as word2vec or GLOV, which is used to digitize natural language;

Continue to adopt the embodiment shown in Table 2, wherein the word vector corresponding to the participle Andy Lau is: "movie", "song", "director", "comedy"; wherein the word vector corresponding to the participle movie is: "Andy Lau", "Director" ", "Comedy", "House of Flying Daggers", "Sister Peach"...

In step (114), after constructing the word vector, all word vectors are spliced into a two-dimensional vector;

Among them, the two-dimensional vector is the word segmentation and the corresponding field of the word segmentation, and Table 3 is used to record the table of the two-dimensional vector;

table 3

Step (115) is input into the textCNN model for training. After the convolution and max-pool of the three convolutional layers, a vector is obtained, which represents some features of the training data learned by each convolutional layer (in This application may also be referred to as a label);

In step (116), the vector is finally input into a single-layer neural network and classified by softmax to obtain the final domain classification result, that is, the film and television category.

Among them, the two-dimensional vector is the field corresponding to word segmentation and word segmentation, and Table 4 is used to record the table of the two-dimensional vector;

Table 4

For example, the word vector corresponding to "movie" can be: "thriller", "shootout", "love"...; the word vector corresponding to cartoon can be: "education", "guoxue", "thankful"...; The word vectors corresponding to cartoons can be: "age", "history", "love"...; then the corresponding tags in the film and television field can be: "education", "Chinese studies", "thank you", "thriller", "shooting" ", "love", "age", "history".

Based on the above method, each field is bound to the corresponding label, and then the binding result is stored in the hotspot statistics table.

When receiving the user's voice, the server searches the query field in the pre-stored hotspot statistics table;

Step (12) calls the field label, and the field label is the label corresponding to the query field;

Step (13) binds the domain tag and the keyword.

For example, for the keyword "movie", the field it belongs to is the field of "film and television", and the corresponding field labels are "education", "Chinese studies", "gratitude", "thriller", "shooting", "love", " Age", "History"...;

Since the display space of the second display is limited, in a feasible embodiment, the number of occurrences of each label can be counted by a statistical method, and the results obtained by arranging the labels in descending order of the occurrences of the last month are shown in Table 5. Show.

table 5

N=3 is set, and in this embodiment, the keyword "movie" is bound to the domain tags "comedy", "shootout", and "love".

In the process of practical application, if multiple fields are used for a keyword pair, in this embodiment, the query relevance can be arranged in descending order, and the query relevance is the relevance between the keyword and the query field. ; Keep the first N keywords.

For example, the fields corresponding to "Andy Lau" can be: "Film and Television", "Singer", "Actor", "Director"; the server can calculate the relationship between "Andy Lau" and "Film and Television", "Singer", "Actor", "Director" The correlation degree of , the calculated results can be found in Table 6;

Table 6

序号serial number	关键词Key words	领域field	相关度relativity
11	刘德华Andy Lau	影视film and television	80％80%
22	刘德华Andy Lau	演员actor	65％65%
33	刘德华 Andy Lau		歌手singer	32％32%
44	刘德华 Andy Lau		导演director	31％31%

If N=1 is set, then the field corresponding to "Andy Lau" is "film and television"; if N=2 is set, then the fields corresponding to "Andy Lau" are "film and television" and "actor".

In the process of practical application, if the keyword pairs are used in multiple fields, due to the limited display space of the second display, in this embodiment, the business proportions can be arranged in descending order, and the business proportions The ratio is the ratio of the number of occurrences of the query field to the number of occurrences of all fields;

For example, the fields corresponding to "Andy Lau" can be: "Film and Television", "Singer", "Actor", "Director"; the server can calculate the relationship between "Andy Lau" and "Film and Television", "Singer", "Actor", "Director" The correlation degree of , the calculated results can be found in Table 7.

Table 7

序号serial number	关键词Key words	领域field	业务占比Business ratio
11	刘德华Andy Lau	影视film and television	37％37%
22	刘德华Andy Lau	演员actor	26％26%
33	刘德华 Andy Lau		歌手singer	12％12%
44	刘德华Andy Lau	导演director	3％3%

If N=1 is set, then the field corresponding to "Andy Lau" is film and television; if N=2 is set, then the fields corresponding to "Andy Lau" are "film and television" and "actor".

S1032 according to the matching result of the keyword and the user's voice;

In this embodiment, different central words can be generated according to the matching result between the keyword and the user's voice. Specifically, please refer to FIG. 16 , which shows the interaction between the display device and the server according to a feasible embodiment. Flow chart; it can be seen from FIG. 16 that the processor is further configured to: execute steps S10321-step S10323;

Step S10321, judging whether the keyword matches the user's voice;

In some feasible embodiments, the server may calculate the similarity between the keyword and the user's voice. If the similarity is greater than the preset similarity, the keyword matches the user's voice; if the similarity is less than the preset similarity, the keyword matches the user's voice. Mismatch. This embodiment is only an example to show an implementation manner of judging whether a keyword matches the user's voice. In the process of practical application, the implementation manner of judging whether a keyword matches the user's voice may be, but is not limited to implementation of the above.

In step S10322, if the keyword does not match the user's voice, filter out the word with the greatest degree of matching with the keyword in the preset central word list as the central word;

Step S10323 If the keyword matches the user's voice, the keyword is used as the central word.

In this embodiment, the server pre-stores a list of central words, and the list of central words is used to record tags corresponding to each keyword. Table 8 is a list of central words shown according to a feasible embodiment;

Table 8

For example, in a feasible embodiment, the user voice input by the user is "a song that Mao is not easy to sing", and the interface displayed by the display device at this time may refer to interface 21 in FIG. 17 . The keywords after the server has trained the above-mentioned user voice are "mao not easy" and "music". The server calculates the similarity between the keyword "Mao not easy" and the user's voice "Mao not easy to sing", and the result is that the similarity is 80% (greater than the preset similarity); The similarity of the song", the result is that the similarity is 75% (greater than the preset similarity). In this embodiment, the keyword matches the user's voice. The server uses "mao not easy" and "song" as the central words. The server retrieves the tags corresponding to "Mao Buyi" and "Song" in the central word list, which is the query tag, wherein the query tag corresponding to "Mao Buyi" is "Singer"; the query tag corresponding to "Song" is "Classical" ", "Modern", "Jazz". The server sends the query label and the central word to the second controller, and the second controller controls the second display to display the query label and the central word. The interface displayed by the display device at this time may refer to interface 22 in FIG. 17 .

In a feasible embodiment, the user voice input by the user is "Liu Hua's song", and the interface displayed by the display device at this time may refer to interface 31 in FIG. 18 . The keywords after the server has trained the above-mentioned user voice are "Andy Lau" and "music". The server calculates the similarity between the keyword "Andy Lau" and the user's voice "Liu Hua's song", and the result is that the similarity is 18% (less than the preset similarity); the similarity between "music" and the user's voice "Liu Hua's song" Similarity, the result obtained is that the similarity is 75% (greater than the preset similarity). In this embodiment, the keyword "Andy Lau" does not match the user's voice. The server will filter out the central word of "Andy Lau" with the highest similarity to "Andy Lau" in the preset central word list. The server retrieves the tags corresponding to "Andy Lau" and "song" in the preset central word list, which is the query tag, and the query tags corresponding to "Andy Lau" are "actor", "singer", "director"; "Song" ” corresponds to the query labels “classical”, “modern”, “jazz”. The server sends the query label and the central word to the second controller, and the second controller controls the second display to display the query label and the central word. For the interface displayed by the display device at this time, please refer to the interface 32 in FIG. 18 .

In a feasible embodiment, the user voice input by the user is "a song sung by Zhang Hua", and the interface displayed by the display device at this time may refer to interface 41 in FIG. 19 . The keywords after the server has trained the above-mentioned user voice are "Zhang Hua" and "music". Among them, the field to which "Zhang Aihua" belongs is "film and television", and the corresponding field labels of film and television are "movie", "television series", "animation"; Similarity, the result is that the similarity is 15% (less than the preset similarity); the similarity between "music" and the user's voice "Songs sung by Zhang Hua", the result is that the similarity is 75% (more than the preset similarity) similarity). In this embodiment, the keyword "Zhang Aihua" does not match the user's voice. The server will filter out the head words similar to "Zhang Aihua" in the preset head word list, but no head words similar to "Zhang Aihua" are found in the preset head word list. The server sends the query tags "classical", "modern" and "jazz" corresponding to the field tags "movie", "tv series", "animation" and "song" corresponding to "Zhang Aihua" to the second controller, and the second The controller controls the second display to display the query label and the central word. At this time, the interface displayed by the display device may refer to interface 42 in FIG. 19 .

During the process of the server retrieving the list corresponding to the central word, the server is further configured to execute step (21)-step (25);

Step (21) judges whether the preset central word list stores the central word;

Step (22) if the preset central word list stores the central word, then the query label corresponding to the central word is retrieved;

Step (23) If the preset central word list does not store the central word, the domain label is used as the query label.

Step (24) if the preset central word list does not store the central word,

Step (25) Write the center word and the domain label corresponding to the center word into the preset center word list.

For example, for the preset central word list shown in Table 8, the central word "Zhang Aihua" and its corresponding field labels "movie", "TV series", and "animation" are not recorded, and the preset central word list needs to be updated. , the updated preset head word list can be found in Table 9:

Table 9

It can be seen that with the display system shown in the embodiment of the present application, the server needs to judge whether the keywords obtained by training match the user's voice, and obtain different central words according to the matching results. Using the display system shown in the above embodiment, the center word with a high degree of fit with the user's voice can be used, thereby ensuring that the center word and the query label displayed on the second display can be more suitable for the user's idea, and the user experience is better.

Fig. 20 is a flowchart showing the interaction between a display device and a server according to a feasible embodiment; it can be seen from Fig. 20 that:

The first controller is configured to perform step S101 to receive user voice;

Wherein, the implementation of receiving the user's voice can refer to the above-mentioned embodiments, and the applicant will not repeat them here; the first controller is configured to perform step S102 to transmit the received user's voice to the server;

The server is configured to perform step S103 to process the user's speech to obtain the central word.

The method of generating the head word may refer to the above-mentioned embodiment, which will not be repeated here.

The retrieval process of the query label; the transmission process of the central word and the query label can refer to the above-mentioned embodiments, and the applicant will not repeat them here.

For the display process of the head word and the query tag, reference may be made to the above-mentioned embodiment, and details are not described here.

The server is further configured to perform step S106 to retrieve the media asset-related content corresponding to the user's voice; and output the media asset-related content to the first controller.

The first controller is configured to execute step S107 to control the first display to display the content related to the media asset.

In some feasible embodiments, the first controller is further configured to: perform step S108 in response to the user's touch on the control, output the media asset ID of the target media asset-related content to the server

The server is configured to perform step S109, fetching and sending the media asset resource corresponding to the media asset ID to the first controller, and the target media asset is the media asset-related content loaded by the touched control;

The first controller is configured to execute step S110 to control the first display to display media assets.

In a feasible embodiment, when the server receives the user's voice, the server will retrieve the media asset-related content corresponding to the user's voice, wherein the media asset-related content may be, but not limited to, the publicity homepage of the media asset, or the media asset. A profile of the media asset, where the profile may be, but not limited to, the starring, director, dubbing and other information of the media asset.

For example, the user voice input by the user is "Andy Lau's movie", and the interface displayed by the display device can refer to interface 51 in Figure 21; when the server receives the user voice "Andy Lau's movie", it retrieves "Andy Lau's movie" ” media asset-related content, and send the media asset-related content to the first controller. The server sends the central word "Andy Lau", "movie" and the query tags "actor", "singer", "director", "comedy", "shootout", "love", "ethics" to the second controller. The second control controls the second display to display the query label and the central word when the query label and the central word are received. For the interface displayed by the display device at this time, please refer to the interface 52 in FIG. 21 . The user searches for tags according to the central word displayed on the second display. Enter the user voice "Comedy starring Andy Lau" again. The first controller transmits the received user voice "Comedy starring Andy Lau" to the server. When the server receives the user voice "Comedy starring Andy Lau", the server retrieves the content related to the media asset of "Comedy starring Andy Lau", and sends the content related to the media asset to the first controller. The first controller controls the first display to display the content related to the media asset of "Comedy starring Andy Lau", and the interface displayed by the display device at this time may refer to the interface 53 in FIG. 21 . The user clicks the control corresponding to the comedy 7, and the first control sends the media asset ID value of the comedy 7 to the server; the server retrieves and sends the media asset resource corresponding to the media asset ID to the first controller. The first control is to play the media resource of the comedy 7, and the interface displayed by the display device at this time may refer to the interface 54 in FIG. 21 .

In a specific implementation, the present invention also provides a computer storage medium, wherein the computer storage medium can store a program, and when the program is executed, it can include part or all of the various embodiments of the method for adjusting the shooting angle of a camera provided by the present invention step. The storage medium can be a magnetic disk, an optical disc, a read-only memory (English: read-only memory, abbreviated: ROM) or a random access memory (English: random access memory, abbreviated: RAM), etc.

Those skilled in the art can clearly understand that the technology in the embodiments of the present invention can be implemented by means of software plus a necessary general hardware platform. Based on such understanding, the technical solutions in the embodiments of the present invention may be embodied in the form of software products in essence or the parts that make contributions to the prior art, and the computer software products may be stored in a storage medium, such as ROM/RAM , magnetic disk, optical disk, etc., including several instructions for causing a computer device (which may be a personal computer, server, or network device, etc.) to perform the methods of various embodiments or parts of embodiments of the present invention.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: The technical solutions described in the foregoing embodiments can still be modified, or some or all of the technical features thereof can be equivalently replaced; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the technical solutions of the embodiments of the present application. Scope.

For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above exemplary discussions are not intended to be exhaustive or to limit implementations to the specific forms disclosed above. Numerous modifications and variations are possible in light of the above teachings. The above embodiments have been chosen and described to better explain the principles and practical applications, so as to enable those skilled in the art to better utilize the embodiments and various modified embodiments suitable for specific use considerations.

Claims

A display system comprising:

The server is configured to receive the user's voice; process the user's voice to obtain a central word; retrieve a query label, where the query label is a label corresponding to the central word, and the query label is used to prompt the user to output the relevant user's voice; output the central word and query label;

A display device, provided with a first display; a second display; a first controller, configured to transmit the received user voice to the server; a second controller, configured to receive the central word and the query tag, The second display is controlled to display the head word and the query tag.
The display system of claim 1, the server is further configured to:

training the user voice to obtain keywords;

A central word is generated according to the matching result between the keyword and the user's voice.
The display system of claim 2, the server is further configured to:

Search for a query field in a pre-stored hotspot statistics table, where the query field is the field to which the keyword belongs;

Retrieve the domain label, where the domain label is the label corresponding to the query domain;

Bind the domain tag to the keyword.
The display system of claim 3, the server is further configured to:

If the keyword matches the user's voice, the keyword is used as a central word.

If the keyword does not match the user's voice, a word with the greatest degree of matching with the keyword is selected from the preset central word list as a central word.
The display system of claim 4, the server is further configured to:

Judging whether the preset central word list stores the central word;

If the preset central word list stores the central word, then retrieve the query tag corresponding to the central word;

If the preset central word list does not store the central word, the domain label is used as the query label.
The display system according to claim 5, if the preset central word list does not store the central word, the server is further configured to:

Write the center word and the domain label corresponding to the center word into the preset center word list.
According to the display system according to any one of claims 1-6, if the keywords correspond to multiple fields, the server is further configured to:

calculating the relevance of the keyword to each of the fields;

The domain that produces the greatest relevance is selected as the query domain.
The display system according to claim 7, if the user voice is trained to obtain a plurality of keywords, the server is further configured to:

Arrange the query relevance in descending order, where the query relevance is the relevance between the keyword and the query field;

The first N said keywords are retained.
The display system according to claim 8, if the keywords correspond to multiple fields, the server is further configured to:

Arrange the business proportions in descending order, and the business proportion is the ratio of the number of occurrences of the query field to the number of occurrences of all fields;

The first N said keywords are retained.
The display system of claim 1, the server is further configured to:

retrieving the media asset-related content corresponding to the user voice;

Outputting the media asset-related content to the first controller, so that the first controller controls the first display to display the media asset-related content.
The display system of claim 10, the first controller is further configured to:

In response to the user's touch on the control, output the media asset ID of the target media asset-related content to the server, so that the server sends the media asset resource corresponding to the media asset ID to the first controller, the The target media asset is the media asset related content loaded by the touched control.