CN110737840B - Voice control method and display device - Google Patents

Abstract

The invention provides a voice control method and display equipment. The method comprises the following steps: receiving the voice input from the audio receiving element and generating a voice search instruction according to the voice; a voice search instruction input by a user is sent to a server, wherein the voice search instruction carries target search words, and the target search words are used for adjusting the display sequence of the labels when the service types are not less than two; receiving a first display instruction returned by the server based on the voice search instruction, wherein the first display instruction is generated according to the display sequence of the labels; and responding to the first display instruction, and sequentially displaying the labels in the label display area in the resource display interface according to the adjusted display sequence. By the method, the resource information of the service type with higher association degree with the target search word can be displayed preferentially, so that the possibility that the display sequence of the resource information does not accord with the search intention of the user is reduced, and the user can find the target resource information conveniently.

Description

Voice control method and display device

technical field

Embodiments of the present invention relate to the technical field of voice recognition, and in particular, to a voice control method and a display device.

Background technique

At present, smart TVs support more and more business scenarios, such as film and television, education, music, applications, shopping and other services. Because there are many intersections and correlations between businesses, the same target search term may correspond to resource information of multiple business types.

In the prior art, the voice search instruction input by the user is mainly analyzed and searched by means of semantic analysis, so as to obtain the resource information corresponding to the target search word in the voice search instruction. Since the same target search term may correspond to resource information of multiple business types, when resource information is displayed to users, the resource information may be classified into corresponding tab pages in the preset tab page list according to business types. The order of the tab pages in the tab page list is pre-set. No matter what target search term is included in the voice search instruction input by the user, the tab pages will display the resource information of the corresponding service type in a fixed order.

However, although the target search term can correspond to resource information of various business types, different target search terms focus on different businesses, and the tab pages display the resource information of the corresponding business type in a fixed order, resulting in the display order of resource information It often does not meet the user's search intention, and the user's target resource is ranked at a lower position, which greatly increases the time for the user to find the target search resource from the tab page list, and reduces the user experience.

Contents of the invention

Embodiments of the present invention provide a voice control method and a display device to solve the problem in the prior art that the display order of resource information often does not meet the user's search intention.

The first aspect of the embodiments of the present invention provides a voice control method, including:

receiving voice input from the audio receiving element, and generating a voice search instruction according to the voice;

Sending a voice search instruction input by the user to the server, wherein the voice search instruction carries a target search word, and the target search word is used to adjust the display order of the tags when there are no less than two business types, and the different tags The display order corresponds to different said target search terms;

receiving a first display instruction returned by the server based on the voice search instruction, the first display instruction is generated according to the display order of the labels;

In response to the first display instruction, the tags are displayed sequentially in the tag display area in the resource display interface according to the adjusted display order.

A second aspect of the embodiments of the present invention provides a voice control method, including:

receiving a voice search command sent by the display device, the voice search command is generated according to the voice input by the audio receiving element in the display device, and the voice search command carries a target search word;

Obtain resource information of the business type corresponding to the target search term;

Responding to no less than two types of business, adjusting the display order of tags according to the target search term, each of the tags is used to load resource information of one type of business;

generating a first display instruction according to the display order of the tags;

Pushing the first display instruction to the display device, where the first display instruction is used to instruct the display device to sequentially display the tags in the tag display area of the resource display interface according to the adjusted display order.

A third aspect of the embodiments of the present invention provides a display device, including:

a display configured to display a user interface, the user interface also includes a selector indicating that an item is selected, the position of the selector in the user interface can be moved by user input, so that different all said project;

a controller in communication with the display screen, the controller configured to:

receiving voice input from the audio receiving element, and generating a voice search instruction according to the voice;

Sending a voice search instruction input by the user to the server, wherein the voice search instruction carries a target search word, and the target search word is used to adjust the display order of the tags when there are no less than two business types, and the different tags The display order corresponds to different said target search terms;

receiving a first display instruction returned by the server based on the voice search instruction, the first display instruction is generated according to the display order of the labels;

In response to the first display instruction, the tags are displayed sequentially in the tag display area in the resource display interface according to the adjusted display order.

A fourth aspect of the embodiments of the present invention provides a server, including:

memory and processor;

The memory is used to store executable instructions of the processor;

The processor is configured to: receive a voice search command sent by the display device, the voice search command is generated according to the voice input by the audio receiving element in the display device, and the voice search command carries a target search word;

Obtain resource information of the business type corresponding to the target search term;

Responding to no less than two types of business, adjusting the display order of tags according to the target search term, each of the tags is used to load resource information of one type of business;

generating a first display instruction according to the display order of the labels;

Pushing the first display instruction to the display device, where the first display instruction is used to instruct the display device to sequentially display the tags in the tag display area of the resource display interface according to the adjusted display order.

A fifth aspect of the present invention provides a storage medium, where a computer program is stored in the readable storage medium, and the computer program is used to execute the method described in the first aspect.

A sixth aspect of the present invention provides a storage medium, where a computer program is stored in the readable storage medium, and the computer program is used to execute the method described in the second aspect.

In the voice control method and display device provided by the embodiments of the present invention, the display device receives the voice input from the audio receiving element, and generates a voice search command according to the voice; then, the display device sends the voice search command input by the user to the server, wherein the voice search The instruction carries the target search word, and the target search word is used to adjust the display order of the labels when there are no less than two business types, and different display orders of the labels correspond to different target search words; then, the display device receives the server based on voice search In response to the first display instruction returned by the instruction, the display device displays the labels sequentially in the label display area of the resource display interface according to the adjusted display order. Through the above method, the display order of tab pages can be adjusted according to the target search term, so that the resource information of the business type with a higher degree of correlation with the target search term can be preferentially displayed, so as to reduce the possibility that the display order of resource information does not meet the user's search intention It reduces the time for users to find the target search resource from the tab page list, and improves the user experience.

Description of drawings

In order to more clearly illustrate the present invention or the technical solutions in the prior art, the accompanying drawings that need to be used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the accompanying drawings in the following description are the present invention. For some embodiments of the invention, those skilled in the art can also obtain other drawings according to these drawings without paying creative efforts.

FIG. 1 is a schematic diagram of an operation scene between a display device and a control device provided in an embodiment of the present application;

FIG. 2 is a block diagram of a hardware configuration of a display device 200 provided in an embodiment of the present application;

FIG. 3 is a hardware configuration block diagram of a control device 100 provided in an embodiment of the present application;

FIG. 4 is a schematic diagram of a functional configuration of a display device 200 provided in an embodiment of the present application;

FIG. 5a is a schematic diagram of software configuration in a display device 200 provided in an embodiment of the present application;

FIG. 5b is a schematic configuration diagram of an application program in a display device 200 provided in an embodiment of the present application;

FIG. 6 is a signaling interaction diagram of a voice control method provided by an embodiment of the present application;

Fig. 7a is a schematic diagram of a voice wake-up interface provided by the embodiment of the present application;

Fig. 7b is a schematic diagram of a search result interface provided by the embodiment of the present application;

FIG. 8 is a schematic diagram of a display principle of a label display area provided by an embodiment of the present application;

Fig. 9a is a schematic interface diagram of a display device provided by an embodiment of the present application;

Fig. 9b is a schematic interface diagram of another display device provided by the embodiment of the present application

FIG. 10 is a schematic flowchart of a voice control method provided in an embodiment of the present application;

FIG. 11 is a signaling interaction diagram of another voice control method provided in the embodiment of the present application;

FIG. 12 is a signaling interaction diagram of another voice control method provided by the embodiment of the present application;

FIG. 13 is a schematic diagram of a text display principle provided by the embodiment of the present application;

FIG. 14 is a schematic interface diagram of another display device provided in the embodiment of the present application;

FIG. 15 is a schematic structural diagram of a display device provided by an embodiment of the present application;

FIG. 16 is a schematic structural diagram of a server provided by an embodiment of the present application.

Detailed ways

In order to make the purposes, technical solutions and advantages of the exemplary embodiments of the present application clearer, the technical solutions in the exemplary embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings in the exemplary embodiments of the present application. , the described exemplary embodiments are only some of the embodiments of the present application, but not all of the embodiments.

Based on the exemplary embodiments shown in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application. In addition, although the disclosures in this application are described according to one or several examples, it should be understood that each aspect of these disclosures can also independently constitute a complete technical solution.

It should be understood that the terms "first", "second", and "third" in the description and claims of this application and the above drawings are used to distinguish similar objects, and not necessarily used to describe a specific order or priority. It should be understood that the data used in this way can be interchanged under appropriate circumstances, for example, it can be implemented in an order other than those given in the illustrations or descriptions of the embodiments of the present application.

Furthermore, the terms "comprising" and "having" and any variations thereof, are intended to cover but not exclusively include, for example, a product or device comprising a series of components need not be limited to those components explicitly listed, but may include other components not expressly listed or inherent in these products or equipment.

The term "module" as used in this application refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic or combination of hardware and/or software codes capable of performing the functions associated with that element.

The term "remote control" used in this application refers to a component of an electronic device (such as the display device disclosed in this application), which can usually control the electronic device wirelessly within a relatively short distance. Infrared rays and/or radio frequency (RF) signals and/or Bluetooth are generally used to connect with electronic devices, and functional modules such as WiFi, wireless USB, Bluetooth, and motion sensors may also be included. For example: a hand-held touch remote controller replaces most of the physical built-in hard keys in a general remote control device with a user interface in a touch screen.

The term "gesture" used in this application refers to the user's behavior of expressing expected ideas, actions, goals and/or results through changes in hand shapes or hand movements.

FIG. 1 is a schematic diagram of an operation scene between a display device and a control device provided by an embodiment of the present application. As shown in FIG. 1 , a user can operate the display device 200 through the mobile terminal 300 and the control device 100 .

Wherein, the control device 100 can control the display device 200 by a remote control, including infrared protocol communication or bluetooth protocol communication, and other short-distance communication methods, etc., through wireless or other wired methods. The user can control the display device 200 by inputting user commands through buttons on the remote controller, voice input, control panel input, and the like. For example, the user can control the display device 200 by inputting corresponding control commands through the volume plus and minus keys, channel control keys, up/down/left/right movement keys, voice input keys, menu keys, and power on/off keys on the remote control. function.

In some embodiments, mobile terminals, tablet computers, computers, notebook computers, and other smart devices can also be used to control the display device 200 . For example, the display device 200 is controlled using an application program running on the smart device. The app can be configured to provide users with various controls in an intuitive user interface (UI) on the screen associated with the smart device.

For example, the mobile terminal 300 can install software applications with the display device 200, realize connection and communication through a network communication protocol, and realize the purpose of one-to-one control operation and data communication. For example, it is possible to use the mobile terminal 300 to establish a control instruction protocol with the display device 200 , to synchronize the remote control keyboard to the mobile terminal 300 , and to control the display device 200 by controlling the user interface on the mobile terminal 300 . The audio and video content displayed on the mobile terminal 300 may also be transmitted to the display device 200 to realize a synchronous display function.

As also shown in FIG. 1 , the display device 200 also performs data communication with the server 400 through various communication methods. The display device 200 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200 . For example, display device 200 interacts with an Electronic Program Guide (EPG) by sending and receiving messages, receiving software program updates, or accessing a remotely stored digital media library. The servers 400 may be in one group or in multiple groups, and may be one or more types of servers. Other network service contents such as video on demand and advertisement service are provided through the server 400 .

The display device 200 may be a liquid crystal display, an OLED display, or a projection display device. The specific display device type, size and resolution are not limited, and those skilled in the art can understand that the display device 200 can be changed in performance and configuration as required.

In addition to providing the TV function of broadcasting reception, the display device 200 may also provide an intelligent network TV function providing computer support functions. Examples include, IPTV, Smart TV, Internet Protocol Television (IPTV), and the like.

FIG. 2 is a block diagram of a hardware configuration of a display device 200 provided in an embodiment of the present application. As shown in Figure 2, the display device 200 includes a controller 210, a tuner and demodulator 220, a communication interface 230, a detector 240, an input/output interface 250, a video processor 260-1, an audio processor 60-2, Display 280, audio output 270, memory 290, power supply, infrared receiver.

The display 280 is used to receive an image signal input from the video processor 260-1, and display video content and images and a component of a menu manipulation interface. The display 280 includes a display screen component for presenting pictures, and a driving component for driving image display. Display video content, which can be from broadcast TV content, or various broadcast signals that can be received through wired or wireless communication protocols. Alternatively, various image contents received from the network server can be displayed through the network communication protocol.

At the same time, the display 280 simultaneously displays the user manipulation UI interface generated in the display device 200 and used for controlling the display device 200 .

And, according to different types of the display 280, it also includes a driving component for driving display. Alternatively, if the display 280 is a projection display, it may also include a projection device and a projection screen.

The communication interface 230 is a component for communicating with external devices or external servers according to various communication protocol types. For example: the communication interface 230 may be a Wifi chip 231, a Bluetooth communication protocol chip 232, a wired Ethernet communication protocol chip 233 and other network communication protocol chips or near field communication protocol chips, and an infrared receiver (not shown in the figure).

The display device 200 can send and receive control signals and data signals with an external control device or content providing device through the communication interface 230 . And, the infrared receiver is an interface that can be used to receive infrared control signals of the control device 100 (such as: an infrared remote controller, etc.).

The detector 240 is used by the display device 200 to collect signals from the external environment or interact with the outside. The detector 240 includes a light receiver 242, which is a sensor for collecting ambient light intensity, and can adaptively display parameter changes and the like by collecting ambient light.

And include an image collector 241, such as a camera, a video camera, etc., which can be used to collect external environmental scenes, as well as to collect user attributes or interactive gestures with users, and can adaptively change display parameters, and can also recognize user gestures, so as to achieve communication with users. The function of interaction between users.

In some other exemplary embodiments, the detector 240 may also be a temperature sensor, for example, by sensing the ambient temperature, the display device 200 may adaptively adjust the display color temperature of the image. For example, in an environment with a relatively high temperature, the display device 200 can be adjusted to display an image with a cooler tone, or in an environment with a relatively low temperature, the display device 200 can be adjusted to display an image with a warmer tone.

In some other exemplary embodiments, the detector 240 may also be a sound collector, such as a microphone, which may be used to receive the user's voice, including the voice signal of the user's control instruction for controlling the display device 200, or collect environmental sound, and use In order to identify the type of environmental scene, the display device 200 can adaptively adapt to the environmental noise.

The input/output interface 250 controls data transmission between the display device 200 and other external devices under the control of the controller 210 . Such as receiving video signals and audio signals from external devices, or data such as command instructions.

Wherein, the input/output interface 250 may include, but not limited to, the following: high-definition multimedia interface HDMI interface 251, analog or data high-definition component input interface 253, composite video input interface 252, USB input interface 254, RGB port (not shown in the figure) out) and so on for one or more interfaces.

In some other exemplary embodiments, the input/output interface 250 may also form a composite input/output interface with the above-mentioned multiple interfaces.

The tuner demodulator 220 receives broadcast TV signals through wired or wireless reception, can perform modulation and demodulation processing such as amplification, frequency mixing and resonance, and demodulates the frequency of the TV channel selected by the user from multiple wireless or cable broadcast TV signals The TV audio and video signals carried in it, as well as the EPG data signal.

The tuner demodulator 220 can be selected by the user and controlled by the controller 210 to respond to the frequency of the TV signal selected by the user and the TV signal carried by the frequency.

The tuner and demodulator 220 can receive signals in many ways according to different TV signal broadcasting formats, such as: terrestrial broadcasting, cable broadcasting, satellite broadcasting or Internet broadcasting signals, etc.; and according to different modulation types, it can be digitally modulated, or Modulation methods can be simulated. Depending on the type of TV signal received, analog and digital signals can be used.

In some other exemplary embodiments, the tuner-demodulator 220 may also be in an external device, such as an external set-top box. In this way, the set-top box outputs TV audio and video signals after modulation and demodulation, and inputs them into the display device 200 through the input/output interface 250 .

The video processor 260-1 is used to receive an external video signal and perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, etc. according to the standard codec protocol of the input signal, A signal directly available for display or playback on the display device 200 is available.

Exemplarily, the video processor 260-1 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like.

Wherein, the demultiplexing module is used for demultiplexing the input audio and video data stream, such as inputting MPEG-2, then the demultiplexing module demultiplexes into video signal and audio signal and so on.

The video decoding module is used to process the demultiplexed video signal, including decoding and scaling.

An image synthesis module, such as an image synthesizer, is used to superimpose and mix the graphic generator with the zoomed video image according to the GUI signal input by the user or generated by itself, so as to generate an image signal available for display.

The frame rate conversion module is used for converting the input video frame rate, such as converting a 60Hz frame rate to a 120Hz frame rate or a 240Hz frame rate, and the usual format is realized by frame interpolation.

The display formatting module is used to convert the received frame rate to the video output signal, and change the signal to conform to the display format signal, such as outputting RGB data signal.

The audio processor 260-2 is used to receive an external audio signal, perform decompression and decoding according to the standard codec protocol of the input signal, and perform processing such as noise reduction, digital-to-analog conversion, and amplification processing to obtain audio signals that can be played in the speaker. sound signal.

In some other exemplary embodiments, the video processor 260-1 may include one or more chips. The audio processor 260-2 may also include one or more chips.

And, in some other exemplary embodiments, the video processor 260 - 1 and the audio processor 260 - 2 may be separate chips, or may be integrated with the controller 210 into one or more chips.

Audio output 270, under the control of controller 210, receives the sound signal output by audio processor 260-2, such as: speaker 272, and in addition to the speaker 272 carried by the display device 200 itself, can be output to the generator of the external device An external audio output terminal 274, such as an external audio interface or an earphone interface.

The power supply, under the control of the controller 210 , provides power supply support for the display device 200 with the power input from the external power supply. The power supply may include a built-in power circuit installed inside the display device 200 , or may be an external power supply installed on the display device 200 , and a power interface provided in the display device 200 for external power supply.

The user input interface is configured to receive user input signals, and then send the received user input signals to the controller 210 . The user input signal can be a remote control signal received through an infrared receiver, and various user control signals can be received through a network communication module.

For example, the user inputs a user command through the remote control or the mobile terminal 300 , the user input interface is based on the user's input, and the display device 200 responds to the user's input through the controller 210 .

In some embodiments, the user may input user commands through a graphical user interface (GUI) displayed on the display 280, and the user input interface receives user input commands through the graphical user interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through a sensor to receive the user input command.

The controller 210 controls the work of the display device 200 and responds to user operations through various software control programs stored in the memory 290 .

As shown in FIG. 2 , the controller 210 includes a RAM 213 and a ROM 214 , a graphics processor 216 , a CPU processor 212 , a communication interface 218 , such as a first interface 218 - 1 to an nth interface 218 - n, and a communication bus. Wherein, RAM213, ROM214, graphics processor 216, CPU processor 212, and communication interface 218 are connected through a bus.

ROM213 is used to store various system startup instructions. For example, when receiving the power-on signal, the power supply of the display device 200 starts to start, and the CPU processor 212 executes the system startup command in the ROM, and copies the operating system stored in the memory 290 to the RAM 213, so that the operating system starts running. After the operating system is started, the CPU processor 212 copies the various application programs in the memory 290 to the RAM 213, and then starts running and starting various application programs.

The graphics processor 216 is used to generate various graphic objects, such as icons, operation menus, and user input instructions to display graphics. It includes an arithmetic unit, which performs calculations by receiving various interactive instructions input by users, and displays various objects according to display attributes. And a renderer is included to generate various objects obtained based on the computing unit, and the rendering result is displayed on the display 280 .

The CPU processor 212 is configured to execute operating system and application program instructions stored in the memory 290 . And execute various applications, data and content according to various interactive instructions received from the outside, so as to finally display and play various audio and video contents.

In some exemplary embodiments, the CPU processor 212 may include multiple processors. Multiple processors may include a main processor and multiple or one sub-processors. The main processor is used to perform some operations of the display device 200 in the pre-power mode, and/or display images in the normal mode. Multiple or one sub-processor for an operation in a state such as standby mode.

The controller 210 may control overall operations of the display device 200 . For example: In response to receiving a user command for selecting a UI object to be displayed on the display 280, the controller 210 may perform an operation related to the object selected by the user command.

Wherein, the object may be any one of selectable objects, such as a hyperlink or an icon. Operations related to the selected object, for example: display operations connected to hyperlink pages, documents, images, etc., or execute operations corresponding to the icon. The user command for selecting a UI object may be a command input through various input means (eg, mouse, keyboard, touch pad, etc.) connected to the display apparatus 200 or a voice command corresponding to a voice spoken by the user.

The memory 290 includes storing various software modules for driving the display device 200 . For example, various software modules stored in the memory 290 include: a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules.

Among them, the basic module is used for signal communication between various hardware in the postpartum care display device 200 and a bottom software module for sending processing and control signals to the upper module. The detection module is a management module used to collect various information from various sensors or user input interfaces, perform digital-to-analog conversion, and analyze and manage.

For example: the voice recognition module includes a voice analysis module and a voice command database module. The display control module is a module for controlling the display 280 to display image content, and can be used for playing information such as multimedia image content and UI interface. Communication module, a module used for control and data communication with external devices. Browser module, a module for performing data communication between browsing servers. The service module is used to provide various services and modules including various application programs.

At the same time, the memory 290 is also used to store received external data and user data, images of various items in various user interfaces, visual effect diagrams of focus objects, and the like.

FIG. 3 is a configuration block diagram of a control device 100 provided in an embodiment of the present application. As shown in FIG. 3 , the control device 100 includes a controller 110 , a communication interface 130 , a user input/output interface 140 , a memory 190 , and a power supply 180 .

The control device 100 is configured to control the display device 200 , and can receive user input operation instructions, and convert the operation instructions into instructions recognizable and respondable by the display device 200 , and play an intermediary role between the user and the display device 200 . For example, the user operates the channel addition and subtraction keys on the control device 100, and the display device 200 responds to the operation of channel addition and subtraction.

In some embodiments, the control device 100 may be a smart device. For example, the control device 100 can install various applications for controlling the display device 200 according to user requirements.

In some embodiments, as shown in FIG. 1 , a mobile terminal 300 or other smart electronic device can perform a similar function of controlling the device 100 after installing an application for manipulating the display device 200 . For example, the user can control the function of the physical keys of the device 100 by installing the application and various function keys or virtual buttons of the graphical user interface provided on the mobile terminal 300 or other intelligent electronic devices.

The controller 110 includes a processor 112 and a RAM 113 and a ROM 114, a communication interface 130, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100 , as well as the communication and cooperation between internal components and external and internal data processing functions.

The communication interface 130 realizes communication of control signals and data signals with the display device 200 under the control of the controller 110 . For example: sending the received user input signal to the display device 200 . The communication interface 130 may include at least one of other near field communication modules such as a WiFi chip 131 , a Bluetooth module 132 , and an NFC module 133 .

A user input/output interface 140 , wherein the input interface includes at least one of other input interfaces such as a microphone 141 , a touch panel 142 , a sensor 143 , and a key 144 . For example, the user can realize the user command input function through actions such as voice, touch, gesture, and press, and the input interface converts the received analog signal into a digital signal, and converts the digital signal into a corresponding command signal, and sends it to the display device 200 .

The output interface includes an interface for transmitting received user instructions to the display device 200 . In some embodiments, it may be an infrared interface or a radio frequency interface. For example, when using an infrared signal interface, user input commands need to be converted into infrared control signals according to the infrared control protocol, and sent to the display device 200 through the infrared sending module. Another example: in the radio frequency signal interface, the user input command needs to be converted into a digital signal, and then modulated according to the radio frequency control signal modulation protocol, and then sent to the display device 200 by the radio frequency sending terminal.

In some embodiments, the control device 100 includes at least one of a communication interface 130 and an output interface. The control device 100 is equipped with a communication interface 130, such as WiFi, Bluetooth, NFC and other modules, which can encode user input commands to the display device 200 through WiFi protocol, Bluetooth protocol, or NFC protocol.

The memory 190 is used for storing various operating programs, data and applications for driving and controlling the display device 200 under the control of the controller 110 . The memory 190 can store various control signal instructions input by the user.

The power supply 180 is used to provide operating power support for each component of the control device 100 under the control of the controller 110 . Can be battery and related control circuit.

FIG. 4 is a schematic diagram of a functional configuration of a display device 200 provided in an embodiment of the present application. As shown in FIG. 4 , the memory 290 is used to store the operating system, application programs, content and user data, etc., and is executed to drive the system operation of the display device 200 and respond to various operations of the user under the control of the controller 210 . Memory 290 may include volatile and/or non-volatile memory.

The memory 290 is specifically used to store and drive the running program of the controller 210 in the display device 200, and to store various application programs built in the display device 200, various application programs downloaded by users from external devices, and various graphical user programs related to the applications. Interface, and various objects related to the graphical user interface, user data information, and various internal data supporting applications. The memory 290 is used to store system software such as OS kernel, middleware and applications, and store input video data and audio data, and other user data.

The memory 290 is specifically used to store drivers and related data such as the audio and video processors 260-1 and 260-2, the display 280, the communication interface 230, the tuner and demodulator 220, and the input/output interface of the detector 240.

In some embodiments, memory 290 may store software and/or programs, and software programs representing an operating system (OS) include, for example, kernels, middleware, application programming interfaces (APIs) and/or application programs. Exemplarily, the kernel may control or manage system resources, or functions implemented by other programs (such as middleware, APIs, or applications), and the kernel may provide interfaces to allow middleware and APIs, or applications to access the controller to Implements control or management of system resources.

Exemplarily, the memory 290 includes a broadcast receiving module 2901, a channel control module 2902, a volume control module 2903, an image control module 2904, a display control module 2905, an audio control module 2906, an external command recognition module 2907, a communication control module 2908, a light receiving module Module 2909, power control module 2910, operating system 2911, and other application programs 2912, browser module, etc., wherein the external command recognition module 2907 includes a graphic recognition module 2907-1, a voice recognition module 2907-2, and a key command recognition module 2907-3. By running various software programs in the memory 290, the controller 210 performs functions such as: broadcast TV signal reception demodulation function, TV channel selection control function, volume selection control function, image control function, display control function, audio control function, external command Other applications such as identification function, communication control function, optical signal receiving function, power control function, software control platform supporting various functions, and browser function.

Fig. 5a is a configuration block diagram of a software system in the display device 200 provided by the embodiment of the present application.

As shown in FIG. 5a, the operating system 2911, including executive operating software for processing various basic system services and for implementing hardware-related tasks, serves as an intermediary for data processing done between application programs and hardware components. In some embodiments, part of the operating system kernel may include a series of software for managing hardware resources of the display device and providing services for other programs or software codes.

In some other embodiments, part of the operating system kernel may include one or more device drivers, and a device driver may be a set of software codes in the operating system to help operate or control devices or hardware associated with the display device. Drivers may contain code to manipulate video, audio, and/or other multimedia components. Examples include displays, cameras, Flash, WiFi, and audio drivers.

Among them, the accessibility module 2911-1 is used for modifying or accessing the application program, so as to realize the accessibility of the application program and the operability of its displayed content.

The communication module 2911-2 is used for connecting with other peripherals via relevant communication interfaces and communication networks.

The user interface module 2911-3 is configured to provide objects displaying a user interface for each application program to be accessible, so as to realize user operability.

The control application program 2911-4 is used for controllable process management, including runtime application programs and the like.

The event transmission system 2914 can be implemented in the operating system 2911 or in the application program 2912. In some embodiments, it can be implemented in the operating system 2911 and in the application program 2912 on the one hand, and is used to monitor various user input events , which will implement one or more sets of predefined operations according to the recognition results of various events or sub-events.

Among them, the event monitoring module 2914-1 is used to monitor user input interface input events or sub-events.

The event identification module 2914-2 is used for inputting the definitions of various events to various user input interfaces, identifying various events or sub-events, and transmitting them to processing for executing their corresponding one or more groups of processing programs .

Wherein, an event or a sub-event refers to an input detected by one or more sensors in the display device 200 and an input of an external control device (eg, the control device 100 , etc.). Such as: various sub-events of voice input, gesture input of gesture recognition, and sub-events of remote control key command input of control equipment, etc. Exemplarily, one or more sub-events in the remote controller include multiple forms, including but not limited to one or a combination of key presses up/down/left and right/, confirm key, and key presses. And operations of non-physical buttons, such as moving, pressing, releasing, etc.

The interface layout manager 2913 directly or indirectly receives user input events or sub-events monitored by the event transmission system 2914, and is used to update the layout of the user interface, including but not limited to the position of each control or sub-control in the interface, and the container Various operations related to the interface layout such as the size or position, hierarchy, etc.

FIG. 5b is a schematic configuration diagram of an application program in the display device 200 provided by the embodiment of the present application. As shown in FIG. 5 b , applications 2912 include various applications that are also executable on display device 200 . An application may include, but is not limited to, one or more applications, such as: a live TV application, a video-on-demand application, a media center application, an application center, a game application, and the like.

Live TV app that provides live TV from different sources. For example, a live TV application may provide a TV signal using input from cable TV, over-the-air broadcast, satellite service, or other types of live TV services. And, the live TV application can display the video of the live TV signal on the display device 200 .

A video-on-demand application that can provide videos from different storage sources. Unlike live TV applications, video on demand provides video displays from some stored source. For example, video on demand can come from a server side of cloud storage, from local hard disk storage containing stored video programs.

The media center application program can provide an application program for playing various multimedia contents. For example, a media center may provide a service for users to access a variety of images or audio through a media center application, as opposed to live TV or video-on-demand.

The application program center can provide and store various application programs. The application program may be a game, an application program, or some other application programs related to the computer system or other devices but capable of running on the smart TV. The application center can obtain these applications from different sources, store them in local storage, and then run them on the display device 200 .

During the use of various programs, the user inevitably needs to search for resources. In some embodiments, the user's search command can be input through the audio receiving element (such as a microphone) in the user input interface 140. In some embodiments, it can be It is input through the keys 144 in the user input interface 140 , for example, through the keys of the remote controller. The following embodiments take voice input through a microphone as an example.

In addition, the item may represent an interface or interface collection display through which the display device 200 is connected to an external device, or may represent the name of an external device connected to the display device, or the like. Such as: signal source input interface collection, or HDMI interface, USB interface, PC terminal interface, etc.

Taking voice input as an example, smart TVs currently support more and more business scenarios, such as film and television, education, music, applications, shopping and other services. Because there are many intersections and correlations between businesses, the same target search term may correspond to resource information of multiple business types. In the prior art, the voice search instruction input by the user is mainly analyzed and searched by means of semantic analysis, so as to obtain the resource information corresponding to the target search word in the voice search instruction. Since the same target search term may correspond to resource information of multiple business types, when resource information is displayed to users, the resource information may be classified into corresponding tab pages in the preset tab page list according to business types. The order of the tab pages in the tab page list is pre-set. No matter what target search term is included in the voice search instruction input by the user, the tab pages will display the resource information of the corresponding service type in a fixed order. However, although the target search term can correspond to resource information of various business types, different target search terms focus on different businesses, and the tab pages display the resource information of the corresponding business type in a fixed order, resulting in the display order of resource information Often it does not meet the user's search intention, and the target resource is ranked at a lower position, which greatly increases the time for the user to find the target search resource from the tab page list, and reduces the user experience.

In order to solve the above problems, an embodiment of the present application provides a voice control method to reduce the possibility that the display sequence of resource information does not conform to the user's search intention.

The technical solutions of the embodiments of the present application will be described in detail below with specific embodiments. The following specific embodiments may be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments.

FIG. 6 is a signaling interaction diagram of a voice control method provided by an embodiment of the present application. This embodiment relates to the process of determining resource information according to voice search instructions. In the embodiment of the present application, the method in the embodiment of the present application is described by taking a display device and a server as examples. As shown in Figure 6, the method includes:

Step S101, the display device receives voice input from the audio receiving element, and generates a voice search instruction according to the voice.

Wherein, the audio receiving element may be, for example, a microphone.

In some embodiments, the user inputs voice through the microphone in the user input interface 140, and the display device generates a voice search command according to the input voice. 230 sends the text data to the voice server for analysis, then receives the analysis result fed back by the voice server, and generates a voice search instruction according to the analysis result.

Fig. 7a is a schematic diagram of a voice wake-up interface provided by the embodiment of the present application. As shown in Fig. 7a, in some embodiments, the user input interface is a remote controller. The display device sends the first key value/or the first Bluetooth command, and the TV switches out the first voice interaction interface according to the received first key value/or the first Bluetooth command. The mode is superimposed on the previous interface.

Fig. 7b is a schematic diagram of a search result interface provided by the embodiment of the present application. After the user inputs the speech, the search interface presented in response to the speech is as shown in Fig. 7b. Fig. 7b exemplarily shows the The interface layout manager 2913 in the display device 200 presents a schematic diagram of the user interface when presenting search results. As shown in Figure 7b, the user interface includes a plurality of view display areas, for example, including a search term display area, a label display area, a resource display area, etc. set from top to bottom, and each view display area includes one or more layouts. different projects. And the user interface further includes a selector indicating that any item is selected, and the position of the selector can be moved through user input to change the selection of different items.

It should be noted that the multiple view display areas may be visible boundaries or invisible boundaries. For example, different view display areas can be marked by different background colors of each view display area, visible marks such as boundary lines, or invisible invisible boundaries. There may also be no visible or non-visual borders, but only display related items in a certain range of areas on the screen, with the same size and/or arrangement changing attributes, and the certain range of areas is regarded as the same Existence of view partition boundaries.

In some embodiments, the search word display area is used to display the search instructions entered by the user, and the search instructions entered by the user or including the search instructions entered by the user can also be displayed on the left side of the search word display area, and the recommended search instructions can be displayed on the right side. words, and vice versa. The recommended search terms are obtained by the server according to the user's name search command.

In some embodiments, in the interactive interface, the tag display area is located below the search term display area (if any), or above the resource display area, and is used to display tags in the order of tags determined by the server, among which the tag with the largest weight is displayed On the left side of the area, all tags are arranged from left to right according to their weight. When there are more than one line of labels, another line is created to display the labels with a lower weight than the first line.

In some embodiments, the resource display area is located at the bottom, and the resource display area includes slots distributed in a matrix, and the slots can load the resources of the service corresponding to the selected tag according to the selected tag. When the label is switched, the vacancy releases the original resources and reloads the resources of the service corresponding to the selected label according to the selected label.

Step S102, the display device sends a voice search instruction to the server.

Wherein, the voice search instruction carries target search words.

In this embodiment, both the display device and the server have a communication function and can interact with each other. The display device can record the voice input by the user, generate a voice search instruction, and send the voice search instruction to the server through the communication interface. Exemplarily, the display device can accept the input of voice with the mobile phone connected to it; or, the display device can accept the input of voice through the remote controller connected to it; or, the display device can also accept the input of voice through the recording component configured by itself entry.

In some embodiments, for the entered voice, the display device may utilize a local database to generate a voice search command, or may first generate text from the voice locally, and send the text to a voice server to generate a voice command through the voice server.

The embodiment of the present application does not limit the language used for the voice search instruction input by the user, for example, it may be Chinese, English, French and so on.

The target search term can also be understood as a search keyword, which is a key word in a voice search command, which can be a noun, such as "yoga", "sunset", etc., or a place name, such as "Beijing", " Moscow", etc., can also be the title of audio-visual works. The voice search instruction may contain one target search word, or may contain multiple target search words, and this embodiment of the present application does not limit the number of target search words.

In step S103, the server acquires resource information of the business type corresponding to the target search term.

In this step, the server can access the resource library, which stores resource information of different business types, and each target search word corresponds to resource information of at least one business type. Exemplarily, "yoga" corresponds to the resource information of the shopping service and the resource information of the film and television service, and "apple" corresponds to the resource information of the shopping service, the resource information of the film and television service, and the resource information of the music service. The service type corresponding to the above target search term can be pre-stored in the memory of the server, or stored in a storage device, and the probability of a service corresponding to the target search term can also be output through the voice model, wherein the voice model is pre-prepared by multiple target search terms. Generated by corpus training of search words and the business types corresponding to each word. Wherein, the storage device is connected to the server, and the storage device can be set inside the server or outside the server.

In some embodiments, the server may pre-store the correspondence between the target search term and the business type of the resource, and the resource information of the business type corresponding to the target search term may be determined according to the correspondence between the target search term and the business type of the resource. In some embodiments, the uncertainty input by the user can be used to determine the business type corresponding to the target search term through the deep learning model of the target search term-resource business type.

Because there are many intersections and correlations between businesses, the same target search term may correspond to different business types. Exemplarily, "Apple" can correspond to resource information of film and television type, music type resource information, and shopping type resource information; "yoga" can correspond to film and television type resource information, It may also correspond to resource information of shopping type. It should be noted that there may be one or more resource information obtained for each service type, and this embodiment of the present application does not limit the number of resource information.

In some embodiments, determining the business type corresponding to the target search word according to the target search word and searching in the resource library according to the target search word can also be two parallel threads. All media resources in the resource library contain media of many business types Resources, the media resource corresponding to the target search term may only correspond to one type of business, or may correspond to two or more types of business.

Step S104, in response to no less than two types of business, the server adjusts the display order of tags according to the target search term, and each tag is used to load resource information of one type of business.

In this step, resources of different service types may be placed under different service label types, or service type labels are set in each resource. The server acquires resource information corresponding to the target search term from resources of the business type. If the target search term corresponds to at least two service types, the server also needs to adjust the display order of the tags according to the target search term.

Among them, tags can be divided according to business types, such as music tags, shopping tags, and novel tags, and the resource information of the business type corresponding to the target search word acquired by the server can be mapped to the corresponding tag according to the corresponding business type. For example, the resource information of the film and television genre can be mapped to the film and television tag, the resource information of the music type can be mapped to the music tag, the resource information of the shopping type can be mapped to the shopping tag, and the resource information of the novel type can be mapped to the novel tag.

In some embodiments, the server may adjust the display order of the tags according to the weight of the target search term corresponding to at least two service types.

Wherein, the embodiment of the present application does not limit how to determine the weight of the business type corresponding to the target keyword. In some embodiments, the weight of the business type corresponding to the target search word can preset a mapping relationship, and the server can Adjust the display order of tabs.

Exemplarily, the target keyword "yoga" corresponds to resource information of two business types, film and television and shopping. The weight of the film and television type is preset to 5, and the weight of the shopping type is preset to 3. The weight is greater than the weight of the shopping type, and the tags of the movie and TV type can be ranked in front of the tags of the shopping type.

In some other embodiments, the server may also determine the weight of the business type corresponding to the target search word through the dependency relationship between the non-target keyword and the target keyword in the voice search instruction.

Step S105, the server generates a first display instruction according to the display sequence of the labels.

In this step, after the server adjusts the display order of the tags, it can also generate a first display instruction, which is used to send to the display device to instruct the display device to display the tags, wherein the first display device includes a display of tags order.

In some embodiments, the server may also acquire the address corresponding to the resource information of the service type corresponding to the tag, and generate the first display instruction according to the adjusted display order of the tags and the address corresponding to the resource information of the service type corresponding to the tag.

Step S106, the server pushes a first display instruction to the display device, and the first display instruction is used to instruct the display device to sequentially display tags in the tag display area of the resource display interface according to the adjusted display order.

In step S106, after the server obtains the resource information of the business type corresponding to the target search word and adjusts the display order of the tab pages, it may push the first display instruction to the display device, so that the display device passes through the tab page area according to the adjusted display order. Display the labels sequentially.

Figure 8 is a schematic diagram of the display principle of a label display area provided by an embodiment of the present application. In some embodiments, as shown in Figure 8, the data obtained by the server in response to the target search word includes TAB data and search result data, where TAB The data includes the tags that need to be returned and the sorting of the tags. The search result data includes the business data corresponding to all the tags in the TAB data and the mapping relationship between the data and the tags. The server can encapsulate the search result data and the TAB data into an object numbered notation (javascript object notation, JSON) format to the display device. After the display device receives the JSON data, it parses out the TAB data and search result data, and displays the TAB data in the label display area in the order determined by the server. The business data corresponding to the tag at the focus position (for example, including poster information) is loaded in the space of the resource display area, so as to display different resources of this type of business in different spaces.

In some embodiments, the search result data includes address information corresponding to each resource, and the vacancy can display a poster of the resource by loading the address information, and the poster includes a display picture and a title of the resource.

Step S107 , the display device sequentially displays the tags in the tag display area of the resource display interface according to the adjusted display order.

Wherein, the resource display interface may include a list display area and a resource display area. The tab at the top of the list is set as the default selected tab.

In one possible implementation, the tag display area displayed on the display device may include the tags corresponding to the type of business in this voice search; in another possible implementation, the tag page list displayed on the display device may include all business types type of label, the specific quantity of resource information can be displayed for the label page that has obtained resource information, and the quantity can be displayed as zero for the label page that has not obtained resource information.

Exemplarily, taking the target search word as "yoga" as an example, "yoga" corresponds to resource information of film and television type, and also corresponds to resource information of shopping type. Correspondingly, the server respectively obtains resource information of a film and television category corresponding to "yoga" and resource information of a shopping category corresponding to "yoga". Map the resource information of the shopping type to the tags of the shopping type, map the resource information of the movie and TV resource type to the tags of the movie and TV type, and rank the tags of the movie and TV type before the tags of the shopping type according to the weight. Subsequently, the server can send a first display instruction to the display device, and the display device displays the resource information corresponding to "yoga" through the label display area, and the film and television type labels are ranked before the shopping type labels in the label page list.

Fig. 9a is a schematic diagram of an interface of a display device provided by an embodiment of the present application. Fig. 9b is a schematic diagram of an interface of another display device provided by an embodiment of the present application. As shown in Figures 9a and 9b, taking the target search words "yoga" and "yoga teaching" as an example, the interface of the display device displays resource information related to the target search words "yoga" and "yoga teaching" through the label display area , the tags in the tag display area can be, for example: film and television, education, shopping platform 1, application, shopping platform 2, etc. After the user clicks on different tags, the display device can display the resource information corresponding to the tag in the resource display area.

In some embodiments, the tag can use the same field as the business type, or can use a different field. When the target search term is "yoga", the media assets in the corresponding media asset (media resource) library include multiple, for example, belong to There are "Kung Fu Yoga" and "Just Love Yoga" in the film and television business, as well as "Yoga Tutorials" and "Learn Yoga with me" in the education business, as well as "Yoga Clothes" and "Yoga Mats" in Jukankan's shopping business. , There are also APP resources "Daily Yoga" and "Yoga Introduction" that belong to the application business, and "Yoga clothes" and "Yoga mats" that belong to the Taobao shopping business.

In some embodiments, the first display instruction includes the tag data, the search result data of the media assets, and the sequence of the tags. The tag data is determined by the server according to the business location of the target search term. For example, when the target search term is located in the film and television business, or when the probability of being in the film and television business is the highest, the label film and television corresponding to the film and television business will be ranked first, and other positions can be arranged randomly; it can also be arranged according to the business probability, for example , the smaller the probability, the later. It can also be arranged according to the user's historical search habits. The lower the user frequency, the later. The user with the highest frequency of use is ranked second, and the first label that does not affect business positioning. In some embodiments, the display order corresponding to "Yoga" is: film and television, education, Jukanan shopping, application, Taobao shopping, and the display order corresponding to "Yoga teaching" is: application, education, Jukanan shopping, film and television, Taobao shopping . Tags corresponding to different target search words may be the same or different, different target search words may correspond to different tag sequences, and different tag sequences correspond to different target search words.

In some optional embodiments, if the first display instruction includes the address corresponding to the resource information of the business type corresponding to the tag, the display device displays the address corresponding to the resource display area in the resource display interface according to the address and the selected tag. The resource information of a business type corresponding to the selected tag.

Correspondingly, the display device may also receive an instruction input by the user, and play or display the corresponding resource according to the identifier in the instruction. Exemplarily, taking a smart TV as an example, the resource information is displayed in the tag display area on the smart TV, and the user can switch the selection of different tags through the remote control, and the resource display area loads the resource information corresponding to the selected tag. For the resources to be played or displayed, the user can input commands to the smart TV through the remote control, such as pressing the key down, which can control the focus to move from the label display area to the vacant position in the resource display area. If the smart TV receives a certain instruction input by the user, it can obtain the resource corresponding to the vacancy at the focus point from the server according to the identifier in the instruction, and then play or display the resource.

In the voice control method provided by the embodiment of the present application, the display device receives the voice input from the audio receiving element, and generates a voice search command according to the voice; then, the display device sends the voice search command input by the user to the server, wherein the voice search command carries Target search words, the target search words are used to adjust the display order of labels when there are no less than two business types, and different display orders of labels correspond to different target search words; then, the display device receives the information returned by the server based on voice search instructions A first display instruction, in response to the first display instruction, the display device sequentially displays the tags in the tag display area of the resource display interface according to the adjusted display order. Through the above method, the display order of tab pages can be adjusted according to the target search term, so that the resource information of the business type with a higher degree of correlation with the target search term can be preferentially displayed, so as to reduce the possibility that the display order of resource information does not meet the user's search intention It reduces the time for users to find the target search resource from the tab page list, and improves the user experience.

On the basis of the foregoing embodiments, how the server adjusts the display order of tab pages will be described below. FIG. 10 is a schematic flowchart of a voice control method provided by an embodiment of the present application. This embodiment relates to the specific process of how the server adjusts the display order of tab pages. In this embodiment of the present application, the method of this embodiment is described by using a server as an execution subject. As shown in Figure 10, on the basis of the foregoing embodiments, the method includes:

Step S201, receiving a voice search command sent by a display device, where the voice search command carries a target search word.

Step S202, acquiring resource information of the business type corresponding to the target search word.

The technical terms, technical effects, technical features, and optional implementation manners of steps S201-S202 can be understood with reference to steps S102-S103 shown in FIG. 6 , and repeated content will not be repeated here.

Step S203, in response to the fact that there are no less than two business types, obtain the weights of the target search words corresponding to each business type.

In some embodiments, the server may obtain the weights of the target search words corresponding to the business types according to the target search words and the preset mapping relationship between the search words and the weights of the business types.

In this embodiment, the server may pre-store a preset mapping relationship between search words and the weights of business types. Weights.

Exemplarily, if the voice search instruction includes the target search word "computer", the server pre-stores the mapping relationship between the search word "computer" and the weights of film and television genres, education genres, and shopping genres. Based on this, the server can directly obtain the weight 1 of the film and television genre, the weight 2 of the education genre, and the weight 3 of the shopping genre corresponding to the target search term "computer" from the database.

In this embodiment, the above-mentioned mapping relationship between the target search term and the weight of the business type can be used as the attribute information of the target search term. In some embodiments, the uncertainty input by the user can be obtained through the target search term-business type depth The learning model is used to determine the weight of the business type corresponding to the target search term. When the target search term corresponds to multiple business types, the corresponding business types can be sorted according to the weight.

In some embodiments, the voice search instruction includes at least one non-target search term in addition to the target search term, and the server obtains the target search term corresponding to each service based on the dependency relationship between the target search term and the at least one non-target search term. type of weight.

In this embodiment, determining the weights of each business type only according to the target search words may cause deviations, so non-target search words can be used to assist in determining the weights of the business types.

The above-mentioned non-target search words may be words other than the target search words in the voice search instruction, and the non-target search words can usually assist the target search words in locating the service type. Non-target search words can be verbs, such as "see", "buy", "learn", etc., and can also be names such as "director", "concert", "handbag" and so on.

Wherein, the above dependency relationship may be preset. In an optional implementation manner, modifier rules may be configured to form an attributive relationship with the target search term, and the attributive relationship is used as a dependency relationship between the target search term and the non-target search term.

Exemplarily, the voice search command is "cheap mobile phone", wherein the target search term is "mobile phone", and the non-target search term is "cheap", according to the dependency between "mobile phone" and "cheap", it can be determined The weight of the shopping business is greater than or that of the film and television business. Correspondingly, the server may set the weight of the shopping service to 2, and set the weight of the film and television service to 1. In addition, the non-target search term "cheap" can also assist the target keyword to search for relevant resource information under the corresponding business type.

In some embodiments, the target search term refers to a term whose degree of matching with the title of the resource is higher than a preset threshold. Non-target search terms are names, verbs or adjectives that are not included in the target search term in the voice command.

In another optional implementation manner, the verb rule can be configured to form an attributive relationship with the target search term, and the attributive relationship can be used as a dependency relationship between the target search term and the non-target search term.

Exemplarily, the voice search command is "listen to Little Apple", wherein the target search term is "Little Apple" and the non-target search term is "listen". According to the dependency between "Little Apple" and "Listen", it can be determined The weight of the music business is greater than that of the film and television business. Correspondingly, the server may set the weight of the music service to 2, and set the weight of the film and television service to 1.

In this embodiment, the voice search instruction may contain multiple non-target search words. Correspondingly, the weight of the non-business type may be determined by considering the dependency relationship between multiple non-target search terms and the target search term.

Exemplarily, the voice search command is "I want to watch Zhong Hanliang's Why Shengxiaomo". First, determine that the target search term "Why Shengxiaomo" corresponds to a video service. Then, determine the dependency relationship between the three non-target search words "I think", "watch" and "Zhong Hanliang's" and the target search word "Why Shengxiaomo", and respectively Determine the weights a1, a2, and a3 of the video service, and aggregate the three weights a1, a2, and a3 to obtain the total weight a of the video service; correspondingly, determine that the target search term "Why Shengxiaomo" corresponds to a music service. Then, determine the dependency relationship between the three non-target search words "I think", "watch" and "Zhong Hanliang's" and the target search word "Why Shengxiaomo", and respectively Determine the weights b1, b2, and b3 of the music business, and summarize the three weights b1, b2, and b3 to obtain the total weight b of the music business.

In some embodiments, the correspondence between the above-mentioned non-target search terms and business types can be used as the attribute information of the non-target search terms. In some embodiments, the uncertainty input by the user can be determined by the The deep learning model is used to determine the weight of the business type corresponding to the non-target search term. When the non-target search term corresponds to multiple business types, the corresponding business types can be sorted according to the weight.

In some embodiments, the non-target search terms and corresponding click data may also be counted in the form of big data to determine the weight of the business type corresponding to the non-target search terms.

Step S204 , adjusting the display order of the tags according to the weights of the target search terms corresponding to each business type.

In this step, when the server determines the weight of each business type corresponding to the target search word, the tags may be sorted according to the weight of the corresponding business type from large to small, thereby adjusting the display order of the tag pages according to the sorting results.

In some embodiments, the server can locate the target business type according to the weight of each business type corresponding to the target search term; wherein, the weight of the target business type is the largest; according to the target business type, adjust the display order of the label pages so that the target business type corresponds to The label of is at the top of the list of label pages.

Exemplarily, if "Apple" corresponds to a music genre with a weight of 3, a film and television genre with a weight of 2, and a shopping genre with a weight of 1. Since the weight of the music type is the highest, the music type can be positioned as the target type, and it can be arranged at the top of the label.

In this embodiment, there is no restriction on the arrangement order of the positions other than the first in the label display area. In some embodiments, after the tag of the target type is ranked first, the subsequent tags may also be arranged in descending order of weight. In some embodiments, after the tag of the target type is ranked first, subsequent tags can be randomly arranged. In some embodiments, after the label of the target type is ranked first, the label corresponding to the service type to be recommended may also be placed second.

Exemplarily, as shown in Figures 9a and 9b, in the label display area in Figure 9a, the "Video" label is at the first place, followed by "Education", "Jukankan Communication", "Application", "Taobao Shopping" " and other tags, as shown in Figure 9a, after searching, the default focus is on the first tag, so the resource display area will download the resource information corresponding to the "Movie" tag in each space.

Step S205, generating a first display instruction according to the display sequence of the labels.

Step S206 , push a first display instruction to the display device, the first display instruction is used to instruct the display device to sequentially display tags in the tag display area of the resource display interface according to the adjusted display order.

The technical terms, technical effects, technical features, and optional implementation manners of steps S205-S206 can be understood with reference to steps S105-S106 shown in FIG. 6 , and repeated content will not be repeated here.

In the voice control method provided by the embodiment of the present application, the server acquires the weights of the target search words corresponding to each business type; and adjusts the label display order according to the weights of the target search words corresponding to each business type. By ranking the tag of the target business type with the greatest weight on the home page, the resource information of the business type with a higher degree of correlation with the target search term can be displayed preferentially, so as to reduce the possibility that the display order of the resource information does not meet the user's search intention. The time for the user to find the target search resource from the label display area is reduced, and the user experience is improved.

If the target search term in the voice search command received by the server only corresponds to resource information of one type of service, the display device may directly display the resource information of the service type corresponding to the target search term. FIG. 11 is a signaling interaction diagram of another voice control method provided by the embodiment of the present application. This embodiment relates to the specific process of how the server obtains the resource information corresponding to the target search term. In this embodiment of the present application, a server is taken as an example to describe the method in the embodiment of the present application. As shown in Figure 11, on the basis of the foregoing embodiments, the method includes:

Step S301, the display device receives voice input from the audio receiving component, and generates a voice search instruction according to the voice.

Step S302, the display device sends a voice search instruction to the server.

Step S303, the server acquires resource information of the service type corresponding to the target search word.

The technical terms, technical effects, technical features, and optional implementation manners of steps S301-S303 can be understood with reference to steps S101-S103 shown in FIG. 6 , and repeated content will not be repeated here.

Step S304, in response to one type of service, the server pushes a second display instruction to the display device, the second display instruction is used to instruct the display device to display the label in the label display area of the resource display interface, and according to the address and the label, display the label in the resource display interface. The resource display area in the display interface displays the resource information of a business type corresponding to the label.

In this step, if the target search term in the voice search command corresponds to a business type, there is no need to adjust the display order of the label pages, and the second display command can be directly pushed to the display device, so that the display device displays the corresponding service type of the target search term. The resource information of the business type.

Exemplarily, if the target search term in the voice search command is "yoga", and the attribute information of the target search term "yoga" only corresponds to film and television services, the server may directly push the second display command to the display device, so that the display device displays Resources about the film and television business of "Yoga."

In some embodiments, if the target search word only corresponds to one business type, after the display device parses the received JSON data, the TAB data only contains one label, so only this one label is displayed in the label display area, because the focus is on the label, so the vacancy in the resource display area loads the resource information corresponding to the label.

In some embodiments, if the target search word only corresponds to one type of service, and there is only one resource information under the service type, the display device can also directly display or play the resource corresponding to the resource information.

In the voice control method provided in the embodiment of the present application, the server pushes a second display instruction to the display device in response to the service type being one type, and the second display instruction is used to instruct the display device to display the target search term corresponding to the label corresponding to the service type. The resource information of the service type, so that when the target search term only corresponds to one service type, the display device can directly display the resource information of the service type corresponding to the target search term to the user.

After receiving the voice search instruction sent by the display device, the server may process the voice search instruction, so as to obtain the target search word. FIG. 12 is a signaling interaction diagram of another voice control method provided by the embodiment of the present application. This embodiment relates to the specific process of how to accurately obtain the target search word. In the embodiment of the present application, the method in the embodiment of the present application is described by taking the display device, the voice server, and the data server as examples. As shown in Figure 12, on the basis of the foregoing embodiments, the method includes:

Step S401, the display device receives the voice input from the audio receiving element, and sends the voice to the voice server.

Step S402, the voice server generates text corresponding to the voice according to the voice.

In steps S401 and S402, the display device may acquire the voice input by the user through the microphone on the remote controller or the microphone on the display device body. Subsequently, the natural language input by the user acquired by the display device is sent to the voice server, and the voice server converts the voice into corresponding text.

It should be noted that, the embodiment of the present application does not limit how to convert speech into corresponding text, and it may be any of the existing conversion methods.

Step S403, the voice server pushes a third display instruction to the display device, the third display instruction is used to instruct the display device to display the text corresponding to the voice.

FIG. 13 is a schematic diagram of a text display principle provided in an embodiment of the present application, and FIG. 14 is a schematic diagram of an interface of another display device provided in an embodiment of the present application. Exemplarily, as shown in FIG. 13 , after receiving the third display instruction sent by the voice server, the display device may create a layout file of the text corresponding to the voice search instruction, then load the layout file and initialize the text control in the layout file, Finally, the text corresponding to the voice search instruction is displayed. Exemplarily, as shown in Figure 14, if the voice search command is "yoga", the voice server may push a third display command to the display device after obtaining the text corresponding to the voice search command, and the display device may receive the third display command Finally, the text "yoga" corresponding to the voice search command can be displayed in the tag display area on the interface.

In some embodiments, the voice server and the data server may be the same server, and the third display instruction and the first display instruction are sent to the display device at the same time after the search is completed. The text can be searched by the data server, which can directly obtain the text from the voice server.

In the embodiment of the present application, there is no limitation on the page where the display device displays the text corresponding to the voice search command. The text corresponding to the voice search command can be displayed on the voice search page, or the text corresponding to the voice search command can be displayed on the label display area page after the search is completed. text.

By displaying the text corresponding to the voice search instruction on the display device, the user can judge whether the voice recognition is accurate. When the voice recognition is inaccurate, the display device may resend the voice search command to the server after receiving the re-recognition command input by the user.

Step S404, the display device generates a voice search instruction according to the text and sends it to the data server.

In some embodiments, the data server and the voice server may be different servers, and the user's voice needs to be analyzed on the voice server, and then the text is returned to the display device and then sent to the data server by the display device.

In some embodiments, the voice search instruction also includes information such as the ID of the display device, so that the data server can accurately feed back search results to the display device.

Step S405, the data server performs word segmentation processing on the text to obtain the target search word.

In this step, after obtaining the text corresponding to the voice search instruction, the data server may perform word segmentation processing on the text, so as to obtain the target search word.

It should be noted that the embodiment of the present application does not limit the word segmentation method, and in an optional implementation manner, the forward maximum matching method may be selected.

Exemplarily, the voice search instruction input by the user is "I want to watch yoga", after the data server receives the voice search instruction and converts it into text, it can use the maximum matching method to decompose "I want to watch yoga" into "I", "want to ", "Looking", "Yoga". Subsequently, from the target search word list pre-stored in the data server, it can be determined that the target search word corresponding to the voice search instruction is "yoga".

Step S406, the data server acquires resource information of the service type corresponding to the target search word.

Step S407, the data server adjusts the display order of tags according to the target search word in response to no less than two types of business, and each tag is used to display resource information of one type of business.

Step S408, the data server generates a first display instruction according to the display order of the labels.

Step S409 , the data server pushes a first display instruction to the display device, and the first display instruction is used to instruct the display device to sequentially display tags in the tag display area of the resource display interface according to the adjusted display order.

Step S410, the display device sequentially displays the tags in the tag display area of the resource display interface according to the adjusted display order.

The technical terms, technical effects, technical features, and optional implementations of steps S406 to S410 can be understood with reference to steps S103 to S107 shown in FIG. 6 , and repeated content will not be repeated here.

The voice control method provided by the embodiment of the present application acquires the text corresponding to the voice search command, performs word segmentation processing on the text, and acquires the target search word and the attribute information of the target search word, so as to determine the resource information set. By improving the accuracy of targeted search terms, it reduces the likelihood that search results will not match user intent.

Those of ordinary skill in the art can understand that all or part of the steps to realize the above method embodiments can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer-readable storage medium. When the program is executed, the It includes the steps of the above method embodiments; and the aforementioned storage medium includes: ROM, RAM, magnetic disk or optical disk and other various media that can store program codes.

FIG. 15 is a schematic structural diagram of a display device provided by an embodiment of the present application. The display device can be implemented by software, hardware or a combination of the two, so as to execute the above voice control method. As shown in Figure 10, the display device includes:

A display device 51, the display device is configured to display a user interface, the user interface also includes a selector indicating that the item is selected, and the position of the selector in the user interface can be moved by user input, so that a different item is selected;

a controller 52 in communication with the display device, the controller being configured to:

receiving voice input from the audio receiving element, and generating a voice search command according to the voice;

Send the voice search command input by the user to the server, wherein the voice search command carries the target search word, and the target search word is used to adjust the display order of the tags when there are no less than two business types, and different display orders of the tags correspond to different target search terms for

receiving the first display instruction returned by the server based on the voice search instruction, where the first display instruction is generated according to the display order of the tags;

In response to the first display instruction, the tags are sequentially displayed in the tag display area in the resource display interface according to the adjusted display order.

In an optional implementation manner, the first display instruction includes an address corresponding to the resource information of the business type corresponding to the tag;

The controller 52 is specifically configured to: display resource information of a service type corresponding to the selected tag in the resource display area of the resource display interface according to the address and the selected tag.

In an optional implementation manner, if the service type is one, the controller 52 is also configured to:

Receiving the second display instruction pushed by the server, in response to the second display instruction, the display device displays the label in the label display area of the resource display interface, and displays the information corresponding to the label in the resource display area of the resource display interface according to the address and the label. Resource information of a business type.

In an optional implementation manner, the controller 52 is specifically configured as:

Send voice to the voice server;

Receive the text returned by the voice server, where the text is generated by the voice server based on the voice;

Generate voice search commands from text.

In an optional implementation manner, the controller 52 is also configured to:

Receiving the third display instruction pushed by the voice server, the display device responds to the third display instruction to display the text corresponding to the voice in the search word display area in the resource display interface, wherein the search word display area, the label display area, and the resource display area are from top to bottom Arranged in order below.

In an optional implementation manner, the label at the top of the sort is set as the default selected label.

The display device provided in the embodiment of the present application can perform the actions of the display device in the above method embodiment, and its implementation principle and technical effect are similar, and will not be repeated here.

FIG. 16 is a schematic structural diagram of a server provided by an embodiment of the present application. As shown in FIG. 16 , the electronic device may include: at least one processor 61 and a memory 62 . FIG. 16 shows an electronic device with a processor as an example.

The memory 62 is used to store programs. Specifically, the program may include program code, and the program code includes computer operation instructions.

The memory 62 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one magnetic disk memory.

The processor 61 is configured to execute the computer-executed instructions stored in the memory 62, so as to implement the above-mentioned voice control method on the server side.

Wherein, the processor 61 may be a central processing unit (Central Processing Unit, referred to as CPU), or a specific integrated circuit (Application Specific Integrated Circuit, referred to as ASIC), or is configured to implement one or multiple integrated circuits.

Optionally, in terms of specific implementation, if the communication interface, memory 62 and processor 61 are implemented independently, the communication interface, memory 62 and processor 61 may be connected to each other through a bus to complete mutual communication. The bus may be an Industry Standard Architecture (Industry Standard Architecture, ISA for short) bus, a Peripheral Component Interconnect (PCI for short) bus, an Extended Industry Standard Architecture (EISA for short) bus, and the like. The bus can be divided into address bus, data bus, control bus, etc., but it does not mean that there is only one bus or one type of bus.

Optionally, in terms of specific implementation, if the communication interface, the memory 62 and the processor 61 are integrated and implemented on one chip, the communication interface, the memory 62 and the processor 61 may complete communication through an internal interface.

The present invention also provides a computer-readable storage medium, which may include: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random AccessMemory) Various media that can store program codes, such as magnetic disks or optical discs, specifically, program instructions are stored in the computer-readable storage medium, and the program instructions are used for the method on the first terminal side or the method on the second terminal side.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present invention, rather than limiting them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: It is still possible to modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the technical solutions of the various embodiments of the present invention. scope.

Claims (11)

1. A voice control method, characterized in that the method comprises: receiving voice input from the audio receiving element, and generating a voice search instruction according to the voice; Sending a voice search instruction input by the user to the server, wherein the voice search instruction carries a target search word, and the target search word is used to adjust the display order of the tags when there are no less than two business types, and the different tags The display sequence corresponds to different target search terms; the target search term corresponds to resource information of at least one business type, and the business type corresponding to the target search term is determined by the deep learning model of the target search term-resource business type; receiving the first display instruction returned by the server based on the voice search instruction, the first display instruction is generated according to the display order of the tags; the first display instruction includes the business type corresponding to the tag The address corresponding to the resource information of ; In response to the first display instruction, the label display area in the resource display interface sequentially displays the labels according to the adjusted display order; according to the address and the selected label, the resource display in the resource display interface The area displays the resource information of a business type corresponding to the selected label; The resource display area contains spaces distributed in a matrix, and the spaces are used to load the resources of the service corresponding to the selected label according to the selected label; when the label is switched, the spaces are also used to release the original resources The resource of the service corresponding to the selected tag is reloaded according to the selected tag. 2. The method according to claim 1, wherein if the service type is one, after sending the voice search command input by the user to the server, the method further comprises: Receiving the second display instruction pushed by the server, in response to the second display instruction, the display device displays the label in the label display area of the resource display interface, and according to the address and the label, display the label on the resource The resource display area in the display interface displays resource information of a service type corresponding to the label. 3. The method according to claim 2, wherein said generating a voice search instruction according to said voice comprises: Send the voice to the voice server; receiving the text returned by the voice server, wherein the text is generated by the voice server according to the voice; Voice search instructions are generated from the text. 4. The method according to claim 3, characterized in that, after sending the voice to the voice server, the method further comprises: receiving a third display instruction pushed by the voice server, the display device responding to the third display instruction to display the text corresponding to the voice in the search word display area of the resource display interface, wherein the search word display area, The label display area and the resource display area are arranged sequentially from top to bottom. 5. The method according to any one of claims 1-3, wherein the label at the top of the ranking is set as the default selected label. 6. A voice control method, characterized in that the method comprises: receiving a voice search command sent by the display device, the voice search command is generated according to the voice input by the audio receiving element in the display device, and the voice search command carries a target search word; Obtain the resource information of the business type corresponding to the target search word; the target search word corresponds to at least one business type resource information, and the business type corresponding to the target search word is determined by the deep learning model of the business type of the target search word-resource ; Responding to the fact that there are no less than two types of business, obtaining the weights of the target search words corresponding to each of the business types; adjusting the display order of labels according to the weight of the target search words corresponding to each of the business types, Each of the tags is used to load resource information of a business type; generating a first display instruction according to the display order of the labels; Pushing the first display instruction to the display device, the first display instruction is used to instruct the display device to display the tags sequentially in the tag display area of the resource display interface according to the adjusted display order; the resource display area contains matrix-style distribution of vacancies, which are used to load the resources of the service corresponding to the selected tag according to the selected tag; when the label is switched, the vacancies are also used to release the original The tag loads the business resources corresponding to the selected tag; The obtaining the weight of each of the business types corresponding to the target search term includes: According to the target search term and the preset mapping relationship between the search term and the weight of the business type, obtain the weight of the target search term corresponding to each of the business types; If the voice search instruction includes at least one non-target search term in addition to the target search term, the acquisition of the weight of the target search term corresponding to each of the business types further includes: Based on the dependency relationship between the target search term and the at least one non-target search term, the weights of the target search term corresponding to each of the service types are obtained. 7. The method according to claim 6, wherein the generating the first display instruction according to the display order of the labels comprises: The first display instruction is generated according to the tags in an adjusted display order and the address corresponding to the resource information of the service type corresponding to the tags. 8. The method according to claim 6, wherein the adjusting the display order of the tags according to the weight of the target search words corresponding to each of the business types comprises: According to the weight of each of the business types corresponding to the target search word, locate the target business type; wherein, the weight of the target business type is the largest; According to the target service type, the display order of the tags is adjusted so that the tag corresponding to the target service type is at the first place. 9. The method according to claim 7, characterized in that, after obtaining the resource information of the business type corresponding to the target search word, the method further comprises: In response to the fact that the service type is one, push a second display instruction to the display device, the second display instruction is used to instruct the display device to display the label in the label display area of the resource display interface, and according to For the address and the label, the resource information of a service type corresponding to the label is displayed in the resource display area of the resource display interface. 10. The method according to claim 6, characterized in that, after receiving the voice search instruction sent by the display device, the method further comprises: Acquiring text corresponding to the voice search command according to the voice search command; Word segmentation is performed on the text to obtain the target search word. 11. A display device, characterized in that it comprises: a display configured to display a user interface, the user interface also includes a selector indicating that an item is selected, the position of the selector in the user interface can be moved by user input, so that different all said project; a controller in communication with the display, the controller configured to: receiving voice input from the audio receiving element, and generating a voice search instruction according to the voice; Sending a voice search instruction input by the user to the server, wherein the voice search instruction carries a target search word, and the target search word is used to adjust the display order of the tags when there are no less than two business types, and the different tags The display sequence corresponds to different target search terms; the target search term corresponds to resource information of at least one business type, and the business type corresponding to the target search term is determined by the deep learning model of the target search term-resource business type; receiving the first display instruction returned by the server based on the voice search instruction, the first display instruction is generated according to the display order of the tags; the first display instruction includes the business type corresponding to the tag The address corresponding to the resource information of ; In response to the first display instruction, the label display area in the resource display interface sequentially displays the labels according to the adjusted display order; according to the address and the selected label, the resource display in the resource display interface The area displays the resource information of a business type corresponding to the selected label; The resource display area contains spaces distributed in a matrix, and the spaces are used to load the resources of the service corresponding to the selected label according to the selected label; when the label is switched, the spaces are also used to release the original resources The resource of the service corresponding to the selected tag is reloaded according to the selected tag.