CN111914134A - Association recommendation method, intelligent device and service device - Google Patents

Abstract

The present application discloses an association recommendation method, an intelligent device and a service device, which are used for association recommendation according to a query sentence. An intelligent device, comprising: an input interface and a controller; the controller is configured to: send a query sentence input through the input interface to a service device, so that the service device searches for a target in an established knowledge graph An associated entity corresponding to an entity, the knowledge graph is used to represent the semantic relationship between entities, and the target entity is an entity determined according to the query statement; the associated entity is acquired from the service device and output.

Description

A kind of association recommendation method, intelligent device and service device

technical field

The embodiments of the present application relate to the field of computer technology. More specifically, it relates to an association recommendation method, a smart device and a service device.

Background technique

At present, users can query and obtain information through smart devices such as smart TVs and smart speakers. In order to better meet users' needs for information acquisition, recommendation systems emerge as the times require. The recommendation system can perform associated recommendation on the information queried by the user, so as to provide the user with relevant information of the queried information.

Relevant recommendation has many advantages. For example, in this era of information overload, in the face of massive data, it is difficult for users to query all the information that may be of interest one by one. Help users to quickly find more information that may be of interest; for another example, when a user queries for some information, such as querying a specified person, if the specified person is not found, it is recommended to recommend related people of the specified person rather than simply returning "query failure". The result is a better user experience.

In order to further improve the user experience, how to provide a more comprehensive and rich association recommendation is a problem that still needs to be solved.

SUMMARY OF THE INVENTION

Embodiments of the present application provide an association recommendation method, an intelligent device, and a service device, which are used for association recommendation according to a query sentence.

In a first aspect, an intelligent device is provided, including: an input interface and a controller;

The above controller is configured to:

Send the query statement input through the above input interface to the service device, so that the service device searches for the associated entity corresponding to the target entity in the established knowledge graph, the above knowledge graph is used to represent the semantic relationship between entities, and the above target entity is The entity determined according to the above query statement;

Obtain the above-mentioned associated entity from the above-mentioned service device and output it.

In a second aspect, a service device is provided, including:

The receiving module is used to receive the current query statement from the smart device;

The association recommendation module is used to find the associated entity corresponding to the target entity in the established knowledge graph, the knowledge graph is used to represent the semantic relationship between the entities, and the target entity is the entity determined according to the current query sentence.

In a third aspect, a method for association recommendation is provided, applied to a smart device, including:

Send the query statement input through the input interface to the service device, so that the service device searches for the associated entity corresponding to the target entity in the established knowledge graph. The above knowledge graph is used to represent the semantic relationship between entities, and the above target entity is based on The entity identified by the above query statement;

Obtain the above-mentioned associated entity from the above-mentioned service device and output it.

In a fourth aspect, an association recommendation method is provided, applied to a service device, including:

Receive the current query statement from the smart device;

The associated entity corresponding to the target entity is searched in the established knowledge graph, the above knowledge graph is used to represent the semantic relationship between entities, and the above target entity is the entity determined according to the above current query sentence.

In the above embodiment, the smart device may send the received query statement to the service device, so as to obtain and output the associated entity corresponding to the target entity determined by the service device according to the query statement. Therefore, in the interaction process between the smart device and the user, a relatively comprehensive association recommendation can be implemented for the query statement input by the user.

Description of drawings

In order to more clearly illustrate the embodiments of the present application or the implementations in the related technologies, the following will briefly introduce the accompanying drawings that need to be used in the description of the embodiments or related technologies. Obviously, the drawings in the following description are the For some embodiments of the application, for those of ordinary skill in the art, other drawings can also be obtained according to these drawings.

FIG. 1 exemplarily shows a schematic diagram of an operation scene between a display device and a control apparatus according to some embodiments;

FIG. 2 exemplarily shows a hardware configuration block diagram of a display device 200 according to some embodiments;

FIG. 3 exemplarily shows a hardware configuration block diagram of the control device 100 according to some embodiments;

FIG. 4 exemplarily shows a schematic diagram of software configuration in the display device 200 according to some embodiments;

FIG. 5 exemplarily shows a schematic diagram of displaying an icon control interface of an application in the display device 200 according to some embodiments;

FIG. 6 exemplarily shows a schematic diagram of a network architecture provided by an embodiment of the present application;

FIG. 7 exemplarily shows a flowchart of the association recommendation method provided by the embodiment of the present application;

8A-8G exemplarily show a schematic diagram of a display screen when outputting an associated entity;

FIG. 9 exemplarily shows a flowchart of an association recommendation method applied to a service device.

Detailed ways

In order to make the purpose, embodiments and advantages of the present application clearer, the exemplary embodiments of the present application will be described clearly and completely below with reference to the accompanying drawings in the exemplary embodiments of the present application. Obviously, the exemplary embodiments described It is only a part of the embodiments of the present application, but not all of the embodiments.

Based on the exemplary embodiments described in this application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the appended claims of this application. Furthermore, although the disclosure in this application has been presented in terms of illustrative example or instances, it should be understood that various aspects of this disclosure may also constitute a complete embodiment in isolation.

It should be noted that the brief description of the terms in the present application is only for the convenience of understanding the embodiments described next, and is not intended to limit the embodiments of the present application. Unless otherwise specified, these terms are to be understood according to their ordinary and ordinary meanings.

The terms "first", "second", "third", etc. in the description and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and are not necessarily meant to limit specific Order or sequence, unless otherwise indicated. It should be understood that the terms so used are interchangeable under appropriate circumstances, eg, can be implemented in an order other than those given in the illustration or description of the embodiments of the present application.

Furthermore, the terms "comprising" and "having" and any variations thereof, are intended to cover but not exclusively include, for example, a product or device incorporating a series of components is not necessarily limited to those explicitly listed, but may include No other components are expressly listed or inherent to these products or devices.

The term "module" as used in this application refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic or combination of hardware or/and software code capable of performing the function associated with that element.

As used in this application, the term "remote control" refers to a component of an electronic device, such as the display device disclosed in this application, that can wirelessly control the electronic device, usually over a short distance. Generally, infrared and/or radio frequency (RF) signals and/or Bluetooth are used to connect with electronic devices, and functional modules such as WiFi, wireless USB, Bluetooth, and motion sensors may also be included. For example, a hand-held touch remote control replaces most of the physical built-in hard keys in a general remote control device with a user interface in a touch screen.

The term "gesture" used in this application refers to a user's behavior that is used by a user to express an expected thought, action, purpose/or result through an action such as a change of hand shape or hand movement.

In order to facilitate the understanding of the method and the smart device provided by the embodiments of the present application, the following takes the display device in the smart device as an example to describe the structure of the display device, the interaction between the display device and the control device:

FIG. 1 exemplarily shows a schematic diagram of an operation scenario between a display device and a control apparatus according to an embodiment. As shown in FIG. 1 , a user may operate the display apparatus 200 through the mobile terminal 300 and the control apparatus 100 .

In some embodiments, the control device 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or Bluetooth protocol communication, and other short-range communication methods, etc., and controls the display device 200 by wireless or other wired methods. The user can control the display device 200 by inputting user instructions through keys on the remote control, voice input, control panel input, and the like. For example, the user can control the display device 200 by inputting corresponding control commands through the volume up/down key, channel control key, up/down/left/right movement keys, voice input key, menu key, power-on/off key, etc. on the remote control. function.

In some embodiments, mobile terminals, tablet computers, computers, notebook computers, and other smart devices may also be used to control the display device 200 . For example, the display device 200 is controlled using an application running on the smart device. The app can be configured to provide users with various controls in an intuitive user interface (UI) on the screen associated with the smart device.

In some embodiments, the mobile terminal 300 may install a software application with the display device 200 to implement connection communication through a network communication protocol, so as to achieve the purpose of one-to-one control operation and data communication. For example, a control command protocol can be established between the mobile terminal 300 and the display device 200, the remote control keyboard can be synchronized to the mobile terminal 300, and the function of controlling the display device 200 can be realized by controlling the user interface on the mobile terminal 300. The audio and video content displayed on the mobile terminal 300 may also be transmitted to the display device 200 to implement a synchronous display function.

As also shown in FIG. 1 , the display device 200 also performs data communication with the server 400 through various communication methods. The display device 200 may be allowed to communicate via local area network (LAN), wireless local area network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200 . For example, the display device 200 interacts by sending and receiving information, and electronic program guide (EPG), receiving software program updates, or accessing a remotely stored digital media library. The server 400 may be a cluster or multiple clusters, and may include one or more types of servers. Other network service contents such as video-on-demand and advertising services are provided through the server 400 .

The display device 200 may be a liquid crystal display, an OLED display, or a projection display device. The specific display device type, size and resolution are not limited. Those skilled in the art can understand that the display device 200 can make some changes in performance and configuration as required.

The display device 200 may additionally provide a smart IPTV function that provides computer-supported functions, including but not limited to, IPTV, smart TV, Internet Protocol TV (IPTV), and the like, in addition to the broadcast receiving TV function.

FIG. 2 exemplarily shows a block diagram of the hardware configuration of the display device 200 according to the exemplary embodiment.

In some embodiments, the display device 200 includes a controller 250, a tuner 210, a communicator 220, a detector 230, an input/output interface 255, a display 275, an audio output interface 285, a memory 260, a power supply 290, At least one of the user interface 265 and the external device interface 240 .

In some embodiments, the display 275, for receiving the image signal from the output of the first processor, performs components for displaying video content and images and a menu manipulation interface.

In some embodiments, the display 275 includes a display screen component for presenting pictures, and a driving component for driving image display.

In some embodiments, the video content displayed may be from broadcast television content or various broadcast signals that may be received via wired or wireless communication protocols. Alternatively, various image contents sent from the network server side can be displayed and received from the network communication protocol.

In some embodiments, display 275 is used to present a user-manipulated UI interface generated in display device 200 and used to control display device 200 .

In some embodiments, depending on the type of display 275, a driving component for driving the display is also included.

In some embodiments, display 275 is a projection display, and may also include a projection device and projection screen.

In some embodiments, communicator 220 is a component for communicating with external devices or external servers according to various communication protocol types. For example, the communicator may include at least one of a Wifi chip, a Bluetooth communication protocol chip, a wired Ethernet communication protocol chip and other network communication protocol chips or a near field communication protocol chip, and an infrared receiver.

In some embodiments, the display device 200 may establish control signal and data signal transmission and reception between the communicator 220 and the external control device 100 or the content providing device.

In some embodiments, the user interface 265 may be used to receive infrared control signals from the control device 100 (eg, an infrared remote control, etc.).

In some embodiments, the detector 230 is a signal used by the display device 200 to collect the external environment or interact with the outside.

In some embodiments, the detector 230 includes a light receiver, a sensor for collecting ambient light intensity, and can adaptively display parameter changes and the like by collecting ambient light.

In some embodiments, the detector 230 may also include an image collector, such as a camera, a camera, etc., which can be used to collect external environment scenes, and used to collect user attributes or interactive gestures with the user, and can adaptively change display parameters, User gestures can also be recognized to implement functions that interact with users.

In some embodiments, detector 230 may also include a temperature sensor or the like, such as by sensing ambient temperature.

In some embodiments, the display device 200 can adaptively adjust the display color temperature of the image. For example, when the temperature is relatively high, the display device 200 can be adjusted to display a relatively cool color temperature of the image, or when the temperature is relatively low, the display device 200 can be adjusted to display a warmer color of the image.

In some embodiments, the detector 230 may also be a sound collector or the like, such as a microphone, which may be used to receive the user's voice. Exemplarily, it includes a voice signal of a control instruction of the user to control the display device 200, or collects ambient sounds, and is used to identify the type of the ambient scene, so that the display device 200 can adapt to the ambient noise.

In some embodiments, as shown in FIG. 2 , the input/output interface 255 is configured to enable data transfer between the controller 250 and other external devices or other controllers 250 . Such as receiving video signal data and audio signal data of external equipment, or command instruction data, etc.

In some embodiments, the external device interface 240 may include, but is not limited to, the following: any one or more of a high-definition multimedia interface HDMI interface, an analog or data high-definition component input interface, a composite video input interface, a USB input interface, an RGB port, etc. interface. It is also possible to form a composite input/output interface by a plurality of the above-mentioned interfaces.

In some embodiments, as shown in FIG. 2 , the tuner and demodulator 210 is configured to receive broadcast television signals through wired or wireless reception, and can perform modulation and demodulation processing such as amplification, frequency mixing, and resonance, from multiple wireless Or demodulate the audio and video signal from the cable broadcast TV signal, the audio and video signal may include the TV audio and video signal carried in the frequency of the TV channel selected by the user, and the EPG data signal.

In some embodiments, the frequency demodulated by the tuner-demodulator 210 is controlled by the controller 250, and the controller 250 can send a control signal according to the user's selection, so that the modem responds to the user-selected TV signal frequency and modulates and demodulates the frequency. The frequency carried by the television signal.

In some embodiments, broadcast television signals may be classified into terrestrial broadcast signals, cable broadcast signals, satellite broadcast signals, or Internet broadcast signals, etc. according to different broadcast formats of the television signals. Or according to different modulation types, it can be divided into digital modulation signal, analog modulation signal, etc. Or, it can be divided into digital signals, analog signals, etc. according to different types of signals.

In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box Wait. In this way, the set-top box outputs the modulated and demodulated television audio and video signals of the received broadcast television signals to the main device, and the main device receives the audio and video signals through the first input/output interface.

In some embodiments, the controller 250, through various software control programs stored on the memory, controls the operation of the display device and responds to user operations. The controller 250 may control the overall operation of the display apparatus 200 . For example, in response to receiving a user command for selecting a UI object to be displayed on the display 275, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments, the object may be any of the selectable objects, such as a hyperlink or an icon. Operations related to the selected object, such as displaying operations linked to hyperlinked pages, documents, images, etc., or executing operations corresponding to the icon. The user command for selecting the UI object may be an input command through various input devices (eg, a mouse, a keyboard, a touchpad, etc.) connected to the display device 200 or a voice command corresponding to a voice spoken by the user.

As shown in FIG. 2 , the controller 250 includes a random access memory 251 (Random Access Memory, RAM), a read-only memory 252 (Read-Only Memory, ROM), a video processor 270, an audio processor 280, and other processors 253 (For example: at least one of a graphics processing unit (Graphics Processing Unit, GPU), a central processing unit 254 (Central Processing Unit, CPU), a communication interface (Communication Interface), and a communication bus 256 (Bus). Wherein, the communication bus connects various parts.

In some embodiments, RAM 251 is used to store temporary data for the operating system or other running programs.

In some embodiments, ROM 252 is used to store various system startup instructions.

In some embodiments, ROM 252 is used to store a basic input output system, referred to as a Basic Input Output System (BIOS). It is used to complete the power-on self-check of the system, the initialization of each functional module in the system, the driver program of the basic input/output of the system, and the boot operating system.

In some embodiments, when a power-on signal is received, the power supply of the display device 200 starts, and the CPU executes the system start-up instruction in the ROM 252, and copies the temporary data of the operating system stored in the memory to the RAM 251, so as to facilitate the start-up or running operation system. After the startup of the operating system is completed, the CPU copies the temporary data of various application programs in the memory to the RAM 251, so as to facilitate the startup or operation of various application programs.

In some embodiments, the CPU processor 254 executes operating system and application program instructions stored in memory. And various application programs, data and content are executed according to various interactive instructions received from the external input, so as to finally display and play various audio and video content.

In some exemplary embodiments, CPU processor 254 may include multiple processors. The plurality of processors may include a main processor and one or more sub-processors. The main processor is used to perform some operations of the display device 200 in the pre-power-on mode, and/or an operation of displaying a picture in the normal mode. One or more sub-processors for an operation in a state such as standby mode.

In some embodiments, the graphics processor 253 is used to generate various graphic objects, such as: icons, operation menus, and user input instructions to display graphics and the like. It includes an operator, which performs operations by receiving various interactive instructions input by the user, and displays various objects according to the display properties. and includes a renderer, which renders various objects obtained based on the operator, and the rendered objects are used for displaying on a display.

In some embodiments, the video processor 270 is configured to receive the external video signal and perform decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, etc. according to the standard codec protocol of the input signal. After video processing, a signal that can be directly displayed or played on the display device 200 can be obtained.

In some embodiments, the video processor 270 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like.

Wherein, the demultiplexing module is used for demultiplexing the input audio and video data stream. For example, if MPEG-2 is input, the demultiplexing module demultiplexes it into video signals and audio signals.

The video decoding module is used to process the demultiplexed video signal, including decoding and scaling.

The image synthesizing module, such as an image synthesizer, is used for superimposing and mixing the GUI signal generated by the graphics generator according to the user's input or itself, and the zoomed video image, so as to generate an image signal that can be displayed.

The frame rate conversion module is used to convert the input video frame rate, such as converting 60Hz frame rate to 120Hz frame rate or 240Hz frame rate. The usual format is implemented by means of frame insertion.

The display formatting module is used for converting the received frame rate into the video output signal, and changing the signal to conform to the display format signal, such as outputting the RGB data signal.

In some embodiments, the graphics processor 253 may be integrated with the video processor, or may be separately configured. When the integrated setting is performed, the processing of the graphics signal output to the display may be performed. When the separate setting is performed, different functions may be performed respectively. For example, GPU+FRC (Frame Rate Conversion)) architecture.

In some embodiments, the audio processor 280 is configured to receive an external audio signal, perform decompression and decoding, and noise reduction, digital-to-analog conversion, and amplification processing according to a standard codec protocol of the input signal to obtain a The sound signal played in the speaker.

In some embodiments, the video processor 270 may comprise one or more chips. The audio processor may also include one or more chips.

In some embodiments, the video processor 270 and the audio processor 280 may be integrated in a separate chip, or may be integrated in one or more chips together with the controller.

In some embodiments, the audio output, under the control of the controller 250, receives the sound signal output by the audio processor 280, such as the speaker 286, and in addition to the speaker carried by the display device 200 itself, can be output to an external device. The external audio output terminal of the device, such as an external audio interface or an earphone interface, etc., may also include a short-range communication module in the communication interface, such as a Bluetooth module for outputting sound from a Bluetooth speaker.

The power supply 290, under the control of the controller 250, provides power supply support for the display device 200 with the power input from the external power supply. The power supply 290 may include a built-in power supply circuit installed inside the display device 200 , or may be an external power supply installed in the display device 200 , and the display device 200 provides a power interface for external power.

The user interface 265 is used for receiving user input signals, and then sending the received user input signals to the controller 250 . The user input signal may be a remote control signal received through an infrared receiver, and various user control signals may be received through a network communication module.

In some embodiments, the user inputs user commands through the control device 100 or the mobile terminal 300 , the user input interface is based on the user's input, and the display device 200 responds to the user's input through the controller 250 .

In some embodiments, the user may input user commands on a graphical user interface (GUI) displayed on the display 275, and the user input interface receives the user input commands through the graphical user interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through a sensor to receive the user input command.

In some embodiments, a "user interface" is a medium interface for interaction and information exchange between an application program or an operating system and a user, which enables conversion between an internal form of information and a form acceptable to the user. A commonly used form of user interface is a graphical user interface (Graphic User Interface, GUI), which refers to a user interface related to computer operations displayed in a graphical manner. It can be an icon, window, control and other interface elements displayed on the display screen of the electronic device, wherein the control can include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, Widgets, etc. visual interface elements.

The memory 260 includes storing various software modules for driving the display device 200 . For example, various software modules stored in the first memory include at least one of a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules.

The basic module is used for signal communication between various hardwares in the display device 200, and is a low-level software module that sends processing and control signals to the upper-layer module. The detection module is a management module used to collect various information from various sensors or user input interfaces, perform digital-to-analog conversion, and analyze and manage.

For example, the speech recognition module includes a speech parsing module and a speech instruction database module. The display control module is a module used to control the display to display image content, and can be used to play information such as multimedia image content and UI interface. Communication module, a module for control and data communication with external devices. The browser module is a module for performing data communication between browsing servers. Service modules are used to provide various services and modules including various applications. At the same time, the memory 260 is also used to store and receive external data and user data, images of various items in various user interfaces, and visual effect diagrams of focus objects, and the like.

FIG. 3 exemplarily shows a block diagram of the configuration of the control device 100 according to an exemplary embodiment. As shown in FIG. 3 , the control device 100 includes a controller 110 , a communication interface 130 , a user input/output interface, a memory, and a power supply.

The control device 100 is configured to control the display device 200 , and can receive user input operation instructions, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, so as to mediate interaction between the user and the display device 200 . For example, the user operates the channel addition and subtraction keys on the control device 100, and the display device 200 responds to the channel addition and subtraction operations.

In some embodiments, the control device 100 may be a smart device. For example, the control device 100 may install various applications for controlling the display device 200 according to user requirements.

In some embodiments, as shown in FIG. 1 , the mobile terminal 300 or other intelligent electronic device can perform a similar function of controlling the device 100 after installing an application for operating the display device 200 . For example, the user can install the application, various function keys or virtual buttons of the graphical user interface provided on the mobile terminal 300 or other intelligent electronic devices, so as to realize the function of controlling the physical keys of the device 100 .

The controller 110 includes a processor 112 and RAM 113 and ROM 114, a communication interface 130, and a communication bus. The controller is used to control the operation and operation of the control device 100, as well as the communication and cooperation among the internal components and the external and internal data processing functions.

The communication interface 130 realizes the communication of control signals and data signals with the display device 200 under the control of the controller 110 . For example, the received user input signal is sent to the display device 200 . The communication interface 130 may include at least one of other near field communication modules such as a WiFi chip 131 , a Bluetooth module 132 , and an NFC module 133 .

The user input/output interface 140, wherein the input interface includes at least one of other input interfaces such as a microphone 141, a touch panel 142, a sensor 143, and a key 144. For example, the user can implement the user command input function through actions such as voice, touch, gesture, pressing, etc. The input interface converts the received analog signal into a digital signal, and converts the digital signal into a corresponding command signal, and sends it to the display device 200.

The output interface includes an interface for transmitting received user instructions to the display device 200 . In some embodiments, it may be an infrared interface or a radio frequency interface. For example, when the infrared signal interface is used, the user input instruction needs to be converted into an infrared control signal according to the infrared control protocol, and sent to the display device 200 through the infrared sending module. For another example, when a radio frequency signal interface is used, the user input command needs to be converted into a digital signal, and then modulated according to the radio frequency control signal modulation protocol, and then sent to the display device 200 by the radio frequency transmission terminal.

In some embodiments, the control device 100 includes at least one of a communication interface 130 and an input-output interface 140 . The communication interface 130 is configured in the control device 100, such as: WiFi, Bluetooth, NFC and other modules, which can send user input instructions to the display device 200 through WiFi protocol, or Bluetooth protocol, or NFC protocol encoding.

The memory 190 is used to store various operating programs, data and applications for driving and controlling the control device 200 under the control of the controller. The memory 190 can store various control signal instructions input by the user.

The power supply 180 is used to provide operating power support for each element of the control device 100 under the control of the controller. Can battery and related control circuit.

In some embodiments, a system may include a kernel (Kernel), a command parser (shell), a file system, and applications. Together, the kernel, shell, and file system make up the basic operating system structures that allow users to manage files, run programs, and use the system. After power-on, the kernel starts, activates the kernel space, abstracts hardware, initializes hardware parameters, etc., runs and maintains virtual memory, scheduler, signals and inter-process communication (IPC). After the kernel starts, the shell and user applications are loaded. An application is compiled into machine code after startup, forming a process.

Referring to FIG. 4 , in some embodiments, the system is divided into four layers, from top to bottom, the applications layer (referred to as “application layer”), the application framework layer (referred to as “framework layer”) "), the Android runtime (Android runtime) and the system library layer (referred to as "system runtime library layer"), and the kernel layer.

In some embodiments, at least one application program runs in the application program layer, and these application programs may be a Window program, a system setting program, a clock program, a camera application, etc. built into the operating system; they may also be developed by a third party The application programs developed by the author, such as the Hijian program, the K song program, the magic mirror program, etc. During specific implementation, the application package in the application layer is not limited to the above examples, and may actually include other application packages, which is not limited in this embodiment of the present application.

The framework layer provides an application programming interface (application programming interface, API) and a programming framework for the applications of the application layer. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center, which decides to let the applications in the application layer take action. Through the API interface, the application can access the resources in the system and obtain the services of the system during execution

As shown in FIG. 4 , the application framework layer in the embodiment of the present application includes managers (Managers), content providers (Content Provider), etc., wherein the manager includes at least one of the following modules: the activity manager (ActivityManager) is used with Interact with all activities running in the system; Location Manager is used to provide system services or applications with access to system location services; Package Manager is used to retrieve files currently installed on the device. Various information related to the application package; Notification Manager (Notification Manager) is used to control the display and clearing of notification messages; Window Manager (Window Manager) is used to manage icons, windows, toolbars, wallpapers and desktops on the user interface part.

In some embodiments, the activity manager is used to: manage the life cycle of each application and the usual navigation and fallback functions, such as controlling the exit of the application (including switching the user interface currently displayed in the display window to the system desktop), opening the , back (including switching the currently displayed user interface in the display window to the upper-level user interface of the currently displayed user interface), and the like.

In some embodiments, the window manager is used to manage all window programs, such as obtaining the size of the display screen, judging whether there is a status bar, locking the screen, taking screenshots, and controlling the change of the display window (for example, reducing the display window to display, shaking display, twisting deformation display, etc.), etc.

In some embodiments, the system runtime layer provides support for the upper layer, that is, the framework layer. When the framework layer is used, the Android operating system will run the C/C++ library included in the system runtime layer to implement the functions to be implemented by the framework layer.

In some embodiments, the kernel layer is the layer between hardware and software. As shown in Figure 4, the kernel layer at least includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, touch sensors, pressure sensors, etc.), etc.

In some embodiments, the kernel layer further includes a power driver module for power management.

In some embodiments, software programs and/or modules corresponding to the software architecture in FIG. 4 are stored in the first memory or the second memory shown in FIG. 2 or FIG. 3 .

In some embodiments, taking the magic mirror application (photography application) as an example, when the remote control receiving device receives the input operation of the remote control, the corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the input operation into the original input event (including the value of the input operation, the timestamp of the input operation and other information). Raw input events are stored at the kernel layer. The application framework layer obtains the original input event from the kernel layer, identifies the control corresponding to the input event according to the current position of the focus, and regards the input operation as a confirmation operation, and the control corresponding to the confirmation operation is the control of the magic mirror application icon. The mirror application calls the interface of the application framework layer, starts the mirror application, and then starts the camera driver by calling the kernel layer to capture still images or videos through the camera.

In some embodiments, for a display device with a touch function, taking a split-screen operation as an example, the display device receives an input operation (such as a split-screen operation) performed by the user on the display screen, and the kernel layer can generate corresponding input operations according to the input operation. Enter an event and report the event to the application framework layer. The window mode (such as multi-window mode) and window position and size corresponding to the input operation are set by the activity manager of the application framework layer. The window management of the application framework layer draws the window according to the settings of the activity manager, and then sends the drawn window data to the display driver of the kernel layer, and the display driver displays the corresponding application interface in different display areas of the display screen.

In some embodiments, as shown in FIG. 5, the application layer contains at least one application that can display corresponding icon controls in the display, such as: live TV application icon control, video on demand application icon control, media center application Program icon controls, application center icon controls, game application icon controls, etc.

In order to provide a more comprehensive and rich association recommendation, the embodiment of the present application provides an association recommendation method, which can determine the corresponding target entity according to the knowledge graph when it is determined that the target entity needs to be associated recommendation according to the query sentence input by the user. , and output the associated entity.

In order to clearly illustrate the embodiments of the present application, explanations of some related terms are given below.

Entity: refers to things that exist objectively and can be distinguished from each other, including specific people, things, things, institutions, abstract concepts, etc.

Knowledge Graph: Essentially a semantic network that can represent semantic relationships between entities. In the knowledge graph, entities are used as vertices or nodes, and relationships are used as edges. The knowledge graph can be constructed in various ways, and the embodiment of the present application does not focus on how to construct the knowledge graph, so it will not be described in detail.

To clearly illustrate the embodiments of the present application, a network architecture provided by the embodiments of the present application is described below with reference to FIG. 6 .

Referring to FIG. 6, FIG. 6 is a schematic diagram of a network architecture provided by an embodiment of the present application. In Figure 6, the smart device is used to receive the input information and output the processing result of the information; the speech recognition service device is an electronic device deployed with a speech recognition service, the semantic service device is an electronic device deployed with a semantic service, and the business service device Electronic devices deployed with business services. The electronic device here may include a server, a computer, etc. Here, the speech recognition service, the semantic service (also referred to as a semantic engine) and the business service are web services that can be deployed on the electronic device, wherein the speech recognition service is used to convert audio Recognized as text, the semantic service is used for semantic analysis of the text, and the business service is used to provide specific services such as the weather query service of Moji Weather and the music query service of QQ Music. In one embodiment, there may be multiple business service devices deployed with different business services in the architecture shown in FIG. 6 .

The following describes the process of processing the information input to the smart device based on the architecture shown in FIG. 6 . Taking the information input to the smart device as an example of a query sentence input by voice, the above process may include the following three stages:

1. Speech recognition stage

After receiving the query sentence input by voice, the smart device can upload the audio of the query sentence to the voice recognition service device, so that the voice recognition service device can recognize the audio as text through the voice recognition service and return it to the smart device.

In one embodiment, before uploading the audio of the query sentence to the speech recognition service device, the smart device may perform denoising processing on the audio of the query sentence, where the denoising processing may include steps such as removing echoes and ambient noise.

2. Semantic understanding stage

The smart device uploads the text of the query sentence recognized by the speech recognition service to the semantic service device, so that the semantic service device performs semantic analysis on the text through the semantic service to obtain the business field and intent of the text.

3. Response stage

According to the semantic analysis result of the text of the query sentence, the semantic service device sends a query instruction to the corresponding business service device to obtain the query result given by the business service. The smart device can obtain and output the query result from the semantic service device. As an embodiment, the semantic service device may also send the semantic parsing result of the query statement to the smart device, so that the smart device outputs the feedback statement in the semantic parsing result.

So far, the description of the process of processing the information input to the smart device based on the architecture shown in FIG. 6 is completed.

It should be noted that the architecture shown in FIG. 6 is only an example, and does not limit the protection scope of the present application. In the embodiments of the present application, other architectures may also be used to implement similar functions, which will not be repeated here.

The association recommendation method provided by the embodiment of the present application is described below. In one embodiment, the method can be applied to smart devices such as smart TVs, smart speakers, smart phones, and the like. When describing the various embodiments below, the description is mainly based on the application of the association recommendation method to a display device in a smart device. .

From the perspective of a display device, the association recommendation method provided by the embodiment of the present application is described below with reference to FIG. 7 :

FIG. 7 exemplarily shows a flowchart of the association recommendation method provided by the embodiment of the present application. With reference to the display device shown in FIG. 2 and FIG. 7 , the process may include the following steps:

Step S51, sending the received query statement to the service device, so that the service device searches the established knowledge graph for the associated entity corresponding to the target entity, where the target entity is the entity determined according to the query statement.

In one example, the above query statement may include: a query statement input through voice, a query statement input through a control device, and the like. The user can obtain the required information by entering a query statement into the smart device. The query statement can include various contents, for example, it can be a single entity name, such as "actor A", "movie B", etc.; another example, it can be a Sentences, such as "who is the star of movie B"; another example, can be words without actual meaning, such as "that", "I think"; and so on. In one embodiment, the above query statement is a query statement input through an input interface

In one example, the service device in this step S51 is deployed with at least the semantic service. As an embodiment, the display device may invoke a voice recognition service, and send the query sentence inputted by voice to the service device after recognizing it as text.

In this step S51 , how the service device specifically determines the target entity according to the query statement and how to find the associated entity corresponding to the target entity is described in the following example, and will not be described here.

Step S52, the above-mentioned associated entity is acquired from the service device and output.

In one example, the display device outputting the associated entity may include: outputting the associated entity through a voice, displaying the associated entity through a display, and the like. The following description is given by way of example with reference to FIGS. 8A-8G , and details are not repeated here.

So far, the description of the flow shown in FIG. 7 is completed.

Through the process shown in FIG. 7 , the display device can send the received query statement to the service device, so as to obtain and output the associated entity found by the service device according to the query statement. In this way, during the interaction between the display device and the user, a relatively comprehensive association recommendation can be implemented for the query sentence input to the display device.

Figures 8A-8G exemplarily show schematic diagrams of the display screen when the associated entity is output. The following describes how the display device outputs the associated entity in the above step S52 with reference to Figures 8A-8G:

In an example, the service device returns the associated entity in the form of entity information. As an embodiment, the displaying device outputting the associated entity may include: displaying the entity information of the associated entity through a display. The above entity information may include: entity name, entity-related pictures, and the like. The entity-related pictures here, for example, when the entity is a person, the entity-related picture can be a person's avatar, a recent photo of the person, etc.; when the entity is a film and television, the entity-related picture can be a film and television cover, etc.; when the entity is a game, the entity-related pictures The image can be a game icon; etc.

FIG. 8A exemplarily shows a schematic diagram of a GUI provided by the display device when outputting the associated entity.

As shown in FIG. 8A , the display device may provide a GUI 600 to the display, the GUI 600 includes an associated entity display area 61 for displaying associated entities, and the display area includes items 611-618, which correspond to associated entities 1-8, respectively. Items 611-618 may be specifically displayed as names and/or related pictures of associated entities.

As an embodiment, the entity information of the associated entity obtained from the service device may include a business domain to which the associated entity belongs, and the business domain here may also be referred to as an entity category, such as characters, movies, music, and so on. The display device may display associated entities of different business fields in different areas according to the business fields to which the associated entities belong. As shown in 8B, the associated entity display area is further divided into two areas, where associated entities belonging to characters and associated entities belonging to movies are arranged respectively, wherein entities 1-4 belong to characters, and entities 5-8 belong to movies.

In one embodiment, the display device may use at least one associated entity among the associated entities acquired from the service device as a focused associated entity to display. Compared with other associated entities, the display device can display more entity information, occupy more display area for display, and so on, for the highlighted associated entities. As shown in FIG. 8C , entity 1 is an associated entity that is highlighted. As an embodiment, the first associated entity among the associated entities returned by the service device may be used as the highlighted associated entity.

In one example, the displaying device outputting the associated entity may include: outputting entity information of the associated entity through voice. As an embodiment, the display device may generate the text to be outputted by voice according to a preset text template and entity information of the associated entity, and output the text by voice. Taking the text template as "recommend [entity name] for you" and the entity name of the associated entity as "person A", the text to be outputted by voice generated according to the text template and the entity name of the associated entity is "recommended for you" Person A". As another embodiment, the display device may acquire and output the text to be outputted by voice from the service device. As an embodiment, when the display device voice outputs the associated entity, the text corresponding to the voice output may be displayed on the display.

In one example, outputting the associated entity by the display device may include: outputting the associated entity through a voice and displaying the associated entity through a display, which will be described below with reference to FIGS. 8D-8E as examples.

As an embodiment, the associated entity output through the voice may be one of the associated entities displayed on the display. As shown in FIG. 8D , the GUI 600 provided by the display device to the display further includes a voice text display area 62 for displaying the text corresponding to the voice output. In FIG. 8D , the text displayed in the voice text display area 62 is the text corresponding to the voice output entity 1 , and the entity 1 is an associated entity highlighted in the associated entity display area 61 .

As an embodiment, the related entities output through voice may be at least two related entities among the related entities displayed on the display. As shown in FIG. 8E , the text displayed in the voice text display area 62 is the text corresponding to the voice output entities 1 - 4 , and the entities 1 - 4 are a plurality of related entities displayed in the related entity display area 61 .

In one example, when the display device acquires the associated entity from the service device, it also acquires the target entity corresponding to the associated entity. As an embodiment, the display device may output the target entity by voice, and display the target entity and the associated entity through the display.

As shown in FIG. 8F , the GUI 600 provided by the display device to the display further includes a target entity display area 63 for displaying the target entity. Specifically, the target entity display area 63 can be used to display entity information of the target entity. In FIG. 8F , the target entity display area 63 displays the entity A as the target entity, the text displayed in the voice text display area 62 is the text corresponding to the voice output entity A, and the association entity display area 61 displays the association corresponding to the entity A entity.

In one example, when outputting the associated entity, the display device may further display the text of the query statement received in step S51 through the display. As shown in FIG. 8G , the GUI 600 provided by the display device to the display further includes a query statement display area 64 for displaying the text of the received query statement. As an embodiment, the text of the query statement may be the text obtained by calling the speech recognition service on the display device to recognize the query statement.

In an example, when the display device acquires the associated entity from the service device, it can also acquire the query result of the query statement. Here, for the acquisition of the query result, reference may be made to the above description based on the architecture shown in FIG. 6 . In one embodiment, the display device may respectively display the query result and the associated entity in different areas on the display, which will not be described in detail here.

It should be noted that, when outputting an associated entity through the above embodiments, each embodiment may be used separately, or each embodiment may be used in combination, which is not specifically limited in the present application. Moreover, in practical application, there are multiple implementation manners for the display device to output the associated entity, and the above embodiments are only examples, and are not intended to be limiting.

The association recommendation method provided by the embodiment of the present application is described below from the perspective of a service device. It mainly describes how the service device determines the target entity according to the query statement and how to find the associated entity corresponding to the target entity in the knowledge graph.

FIG. 9 exemplarily shows a flowchart of an association recommendation method applied to a service device. As shown in Figure 9, the process includes the following steps:

Step S71, the service device receives the query statement from the display device, and determines whether the query statement satisfies the preset association recommendation condition; if so, determines the target entity according to the query statement.

As an embodiment, after receiving the query statement from the display device, the service device may perform semantic analysis on the query statement, so as to subsequently determine whether the query statement satisfies the associated recommendation condition. In one embodiment, the service device may perform semantic parsing on the query statement through the deployed semantic service. This application does not limit the specific semantic parsing process.

In practical application, there are many ways to determine the target entity according to the query statement. In one example, for a query statement that satisfies the preset association recommendation conditions, if the query statement contains an entity name, the entity corresponding to the entity name contained in the query statement can be determined as the target entity; if the query statement does not contain an entity name If the entity name is included, the query statement is used as the current query statement, and the target entity is determined according to the previous query statement of the current query statement. The previous query statement and the current query statement here come from the same display device, and the process of determining the target entity according to the previous query statement can refer to the above-mentioned process of determining the target entity according to the current query statement.

As an embodiment, the query statement received within a preset time before the current query statement and received most recently from the current query statement may be determined as the previous query statement, if there is no previous query statement, the pre- The default entity set is determined as the target entity.

For ease of understanding, the following describes how to determine the target entity based on the query statement, in conjunction with how to determine whether the query statement satisfies the preset association recommendation conditions:

In one example, when the query statement is a single entity name, it is determined that a preset association recommendation condition is satisfied. The entity name here, such as: character name, movie name, music name, game name, food name, etc. As an embodiment, after the query statement is determined to be a single entity name, the entity corresponding to the single entity name may be determined as the target entity.

In another example, when the information to be acquired by the query statement cannot be found, it is determined that the query statement satisfies the preset association recommendation condition. Here, the information to be obtained by the query statement cannot be found. Taking the query statement as "who is the daughter of person A?" as an example, if the service device does not find the information of the daughter of person A, it can be determined that the query cannot be found. The information to be obtained by the statement. As an embodiment, when the information to be acquired by the query statement cannot be found, the service device may determine the entity included in the query statement as the target entity. When the information to be obtained by the query statement cannot be found, returning the relevant information of the query can achieve a better user experience than simply returning the query result.

In another example, when the query statement does not have explicit semantics, it is determined that a preset association recommendation condition is satisfied. For example, query statements that do not have explicit semantics here may be "that", "I think", and so on. As an embodiment, when the query statement does not have explicit semantics, the service device may determine the entity corresponding to the entity name included in the previous query statement of the received query statement as the target entity. Generally speaking, when the requirements are not clear and the requirements cannot be accurately described, the user will enter a query statement without clear semantics. At this time, the relevant recommendation for the query statement previously output by the user can help the user find the required information. As well as guide the user to the next query.

In another example, when the number of query statements with the same semantics received from the same display device within a certain period of time reaches a threshold, it is determined that a preset association recommendation condition is satisfied. As an embodiment, when the semantic similarity of the two query statements reaches a threshold, it may be determined that the semantics of the two query statements are the same. As an embodiment, the service device may determine the entity contained in the query statement with the same semantics as the target entity. The number of query statements with the same semantics reaches the threshold, indicating that the user has input query statements with the same semantics to the display device multiple times. Generally speaking, this happens because the query that the user has performed does not get the desired query result. In this case, the association recommendation can achieve a better user experience than simply returning the same query results.

It should be noted that, when determining whether the query statement satisfies the preset association recommendation condition through the above embodiments, each embodiment may be used separately, or at least two embodiments may be used in combination. When used in combination, as an embodiment, when the query statement does not satisfy all the association recommendation conditions in the embodiments used in combination, it may be determined that it does not satisfy the association recommendation conditions. The above embodiments are only examples, and other implementation manners that are easy to think of in practical applications will not be described in detail here.

Step S72 , according to the preset association recommendation rule, search for the associated entity corresponding to the target entity in the established knowledge graph.

This step S72 is executed when it is determined in the above step S71 that the query statement satisfies the association recommendation condition, and the target entity has been determined according to the query statement.

In an example, the association recommendation rules in this step S72 include: association recommendation rules corresponding to the business domain to which the target entity belongs. As an embodiment, the service device is provided with a corresponding relationship between a business domain and an association recommendation rule. Before searching for the associated entity corresponding to the target entity according to the associated recommendation rule, the service device may determine the business domain to which the target entity belongs, and search for the associated recommendation rule corresponding to the business domain in the correspondence between the business domain and the associated recommendation rule. As an embodiment, the business domain to which the target entity belongs can be determined in various ways, for example, determining the business domain of the target entity according to the attribute value of the business domain attribute of the target entity, determining the business domain of the target entity according to the tag of the target entity, and so on. .

In one embodiment, the association recommendation rule corresponding to the business domain may be determined according to the analysis of query sentences input by a large number of users. For example, a large number of adjacent query statements input by the user can be obtained to analyze the relationship existing among the entities queried by the user, and the like. As an embodiment, the association recommendation rule may be appropriately adjusted according to the query statement input by the user within a certain period of time.

Specifically, how to find the associated entity corresponding to the target entity in the knowledge graph according to the association recommendation rule is described below with an example, and will not be repeated here.

In one example, the business domain to which the target entity belongs may correspond to one association recommendation rule, or may correspond to at least two association recommendation rules.

When the business domain to which the target entity belongs corresponds to an association recommendation rule, as an embodiment, the service device may search the knowledge graph for the associated entity corresponding to the target entity according to the association recommendation rule.

When the business domain to which the target entity belongs corresponds to at least two association recommendation rules, as an embodiment, the service device may search the knowledge graph for the associated entity corresponding to the target entity according to the at least two association recommendation rules. As an embodiment, the associated entities returned by the service device to the display device are in a certain order. For the same associated entities found according to the above at least two association recommendation rules, they can be placed in the respective associated entities during sorting. front end.

When the business domain to which the target entity belongs corresponds to at least two association recommendation rules, as another embodiment, the service device may search for the associated entity corresponding to the target entity according to one of the above at least two association recommendation rules, and, in the found association, When the entity does not meet the preset conditions, the search is further performed according to other association recommendation rules in the above at least two association recommendation rules. The preset conditions here may include: the number of found associated entities is less than a threshold, and the like.

So far, the description of the flow shown in FIG. 9 is completed.

Through the process shown in FIG. 9 , the association recommendation method provided by the embodiment of the present application is described from the perspective of a service device. Through the process shown in FIG. 9 , target entities in different business fields can be recommended according to different association recommendation rules.

In one example, the service device may execute the process shown in FIG. 9 through multiple modules. As an embodiment, the service device may include a receiving module and an association recommendation module. Among them, the receiving module is used to receive the query statement from the display device; the association recommendation module is used to determine whether the query statement satisfies the preset association recommendation condition; The association recommendation rule of , finds the associated entity corresponding to the target entity in the knowledge graph.

In the process shown in Figure 9, how to find the associated entity corresponding to the target entity in the knowledge graph according to the association recommendation rule is described as an example:

In one example, the business domain may include at least one of characters, movies, music, games, and food. The following is an example description of the association recommendation rules corresponding to each business field:

As an embodiment, the association recommendation rule corresponding to a character may include: recommending a character entity that has a specified character relationship with the target entity, where the specified character relationship may include: spouse, child, parent, teammate, mentor, etc.; recommending a character entity with the target entity Characters belonging to the same occupation, the same occupation here may include: doctors, film and television actors, singers, athletes, etc. For some occupations with multiple subclasses, different subclasses can be determined as different occupations respectively. For example, an athlete has multiple sub-categories according to different sports, such as basketball players, football players, table tennis players, etc., and different sub-categories can be regarded as different occupations respectively.

As an embodiment, the association recommendation rules corresponding to movies may include: recommend movies of the same movie type as the target entity; recommend the star of the target entity; recommend the director of the target entity; recommend the same movie as the star of the target entity; recommend the target entity other films directed by the director;

As an embodiment, the associated recommendation rule corresponding to music may include: recommending music belonging to the same music style as the target entity, and recommending music with a high similarity in name to the target entity when recommending. Here, the music style may include: national style , pop, classical, lyrical, etc.; recommends the same music as the original singer of the target entity; recommends the same music as the target entity's lyricist; recommends the same music as the target entity's composer; recommends singing by a non-original singer the target entity; etc.

As an embodiment, the association recommendation rule corresponding to the game may include: recommending games that belong to the same game type as the target entity; recommending games that belong to the same theme as the target entity. The above-mentioned game types may include: first-person shooter, puzzle, strategy, role-playing, etc., and the above-mentioned themes may include: war, strategy, fashion, etc.

As an embodiment, the associated recommendation rule corresponding to the food may include: recommending the food belonging to the same cuisine as the target entity; recommending the food belonging to the same taste as the target entity. The above-mentioned cuisines may include the eight traditional Chinese cuisines, and may also include other cuisines such as Beijing cuisine and Northeastern cuisine. The above-mentioned tastes may include: one or a combination of sour, sweet, bitter, spicy, salty, and fresh.

The target entity in the association recommendation rule in the above embodiments is the entity determined according to the query statement.

In one example, searching for the associated entity corresponding to the target entity in the knowledge graph according to the association recommendation rule may include: according to the business domain to which the target entity belongs, the association relationship between the target entity and other entities and/or the attributes possessed by the target entity, in the Determine the associated entity corresponding to the target entity in the knowledge graph.

As an embodiment, according to the business domain to which the target entity belongs, an entity with a specified association relationship with the target entity can be searched in the knowledge graph, and the found entity can be determined as the associated entity corresponding to the target entity; The business domain to which it belongs, searches the knowledge graph for entities with the same specified attribute value as the target entity, and determines the found entity as the associated entity corresponding to the target entity.

The above-mentioned specified relationship and specified attribute value may be determined according to the association recommendation rule corresponding to the business domain to which the target entity belongs. For example, if the business field to which the target entity belongs is a person, the specified relationship can be determined to be a specified person relationship according to the association recommendation rules corresponding to the person, and the entity whose relationship with the target entity is a specified person relationship can be searched in the knowledge graph. The received entity is determined to be the associated entity of the target entity; it is also possible to determine the “occupational attribute value” of the target entity with the specified attribute value according to the association recommendation rules corresponding to the character, and find the entity with the specified attribute value in the knowledge graph, The found entity is determined to be the associated entity of the target entity.

In one embodiment, the knowledge graph may be a knowledge graph constructed based on tools such as Neo4j, TigerGraph, and OrientDB. The following takes the knowledge graph constructed based on Neo4j as an example to describe how to find the associated entity corresponding to the target entity in the knowledge graph:

In one example, for a knowledge graph constructed based on Neo4j, a specified entity can be searched in the knowledge graph through a rule expression relationship chain. The rule expresses the relationship chain and can search for the specified entity by defining the attributes of the entity, the relationship between the entity and the entity, etc. As an embodiment, the service device may generate a rule expression relationship chain according to the association recommendation rule, so as to find the associated entity corresponding to the target entity in the knowledge graph.

When generating a rule expression relationship chain according to an association recommendation rule, as an embodiment, the service device may determine the corresponding relationship between the association recommendation rule corresponding to the business domain to which the target entity belongs, according to the preset association recommendation rule and the corresponding relationship between the rule expression relationship chain template. A rule expression relationship chain template, which includes a part that needs to input keywords; the service device can obtain the specified attribute value of the target entity as a keyword, input it into the determined rule expression relationship chain template, and generate a rule expression relationship chain.

As an embodiment, by expressing a relationship chain template by a rule, the number and order of the found associated entities may also be limited.

In order to facilitate the understanding of the above content, the following description is combined with specific examples:

For example: the target entity is sweet and sour pork loin, the business field of the target entity is gourmet, and the associated recommendation rule corresponding to the gourmet is: recommend the gourmet that belongs to the same cuisine as the target entity, then the service device searches for the gourmet that is the same as the "recommended and the target entity belongs to the same cuisine" "The corresponding rule expression relationship chain template.

Suppose the found rule expression relationship chain template is as follows:

"match(n)-[r:relate]-(m)-[t:relate]-(s:'food') where id(n)=ENTITY and r.name='cuisine' and m.name='[ Cuisine attribute value]'and t.name='Cuisine'and n.name='[name attribute value]'and s.describeNum>50RETURN s order by s.describeNum LIMIT 10".

The rule expression relationship chain is used to find entities whose business domain is cuisine and whose cuisine is [cuisine attribute value]. Among them, [cuisine attribute value], [name attribute value] are the parts that need to input keywords.

First, briefly describe the meaning of some content in the rule expression relationship chain template:

"(n)-[r:relate]-(m)-[t:relate]-(s:'food')" means that entity n has relationship r with entity m, and entity m has relationship t with entity s;

"r.name='Cuisine'" means that the name of the relation r is a cuisine, "t.name='Cuisine'" means that the name of the relation t is a cuisine, and "n.name='[name attribute value]'" means that the entity n The name of m is [name attribute value], "m.name='[cuisine attribute value]'" means the name of m is [cuisine attribute value];

"RETURN s" indicates that the output entity is the entity represented by s in the rule expression relationship chain template; "order bys.describeNum" indicates that the output entities are sorted according to the describeNum attribute; "LIMIT 10" indicates that the number of output entities is limited to 10 .

According to the above rule expression relationship chain template, the service device can obtain the attribute value of the "cuisine" attribute and the attribute value of the "name" attribute of the target entity sweet and sour pork loin as a keyword, and input the keyword into the rule expression relationship chain template to generate Rules express chains of relationships.

Taking the attribute value of the "cuisine" attribute of sweet and sour pork loin as "Zhejiang cuisine" as an example, the generated rule expression relationship chain is as follows:

"match(n)-[r:relate]-(m)-[t:relate]-(s:'food')where id(n)=ENTITY andr.name='cuisine' and m.name='Zhe Dish' and t.name='Cuisine' and n.name='Sweet and Sour Tenderloin' ands.describeNum>50RETURN s order by s.describeNum LIMIT 10".

So far, the description of how to search for the associated entity corresponding to the target entity in the knowledge graph according to the association recommendation rule in the process shown in FIG. 9 is completed. It should be noted that the above embodiment is only an example, and other association recommendation rules may exist in practical application, as well as other ways of finding the associated entity corresponding to the target entity in the knowledge graph, which will not be described one by one here.

As described in the above embodiment, the display device can send the received query statement to the service device, so that the service device can determine the target entity that needs to be recommended for association according to the query statement, and search the knowledge graph for the corresponding target entity. The associated entity is obtained by the display device and output, so that during the interaction between the display device and the user, a relatively rich and comprehensive association recommendation can be made for the query statement input by the user, thereby improving the user experience.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: The technical solutions described in the foregoing embodiments can still be modified, or some or all of the technical features thereof can be equivalently replaced; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the technical solutions of the embodiments of the present application. scope.

For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above exemplary discussions are not intended to be exhaustive or to limit implementations to the specific forms disclosed above. Numerous modifications and variations are possible in light of the above teachings. The above embodiments are chosen and described to better explain the principles and practical applications, so as to enable those skilled in the art to better utilize the described embodiments and various modified embodiments suitable for specific use considerations.

Claims (10)

1. an intelligent device, is characterized in that, comprises: input interface and controller; The controller is configured to: Send the query statement input through the input interface to the service device, so that the service device searches for the associated entity corresponding to the target entity in the established knowledge graph, where the knowledge graph is used to represent the semantic relationship between entities, and the The target entity is the entity determined according to the query statement; Acquire the associated entity from the service device and output. 2. The smart device according to claim 1, wherein the smart device is a display device; The controller is configured to output the associated entity by voice, and/or output the associated entity to a display to display the associated entity through the display. 3. A service device, characterized in that, comprising: The receiving module is used to receive the current query statement from the smart device; The association recommendation module is used to find the associated entity corresponding to the target entity in the established knowledge graph, the knowledge graph is used to represent the semantic relationship between the entities, and the target entity is the entity determined according to the current query sentence. 4. The service device according to claim 3, wherein the association recommendation module is specifically used for: According to the business domain to which the target entity belongs, the knowledge graph is searched for an entity having a specified relationship with the target entity, and the found entity is determined as the associated entity corresponding to the target entity. 5. The service device according to claim 3, wherein the association recommendation module is specifically used for: According to the business domain to which the target entity belongs, an entity having the same specified attribute value as the target entity is searched in the knowledge graph, and the found entity is determined as an associated entity corresponding to the target entity. 6. The service device according to any one of claims 4 or 5, wherein the business field includes at least one of characters, movies, music, games and food. 7. The service device according to claim 3, wherein the association recommendation module is specifically used for: When the current query statement satisfies the preset association recommendation condition, if the current query statement contains an entity name, the entity corresponding to the entity name is determined as the target entity; If the current query statement does not contain an entity name, the entity corresponding to the entity name in the received previous query statement is determined as the target entity. 8. A method for association recommendation, characterized in that, applied to a smart device, comprising: Send the query statement input through the input interface to the service device, so that the service device searches for the associated entity corresponding to the target entity in the established knowledge graph, the knowledge graph is used to represent the semantic relationship between entities, and the target entity is the entity determined according to the query statement; Acquire the associated entity from the service device and output. 9. An association recommendation method, characterized in that, applied to a service device, comprising: Receive the current query statement from the smart device; The associated entity corresponding to the target entity is searched in the established knowledge graph, where the knowledge graph is used to represent the semantic relationship between entities, and the target entity is an entity determined according to the current query sentence. 10. The method according to claim 9, wherein the searching for the associated entity corresponding to the target entity in the established knowledge graph comprises: According to the business domain to which the target entity belongs, search the knowledge graph for an entity that has a specified relationship with the target entity, and determine the found entity as the associated entity corresponding to the target entity; and/or, According to the business field to which the target entity belongs, determine the specified attribute value of the target entity, and search the knowledge graph for the entity with the specified attribute value, and determine the found entity as the corresponding entity of the target entity. Associated entity.

Images