CN113495702B - Interactive invitation processing method and display equipment - Google Patents

Abstract

This application discloses an interactive invitation processing method and a display device. The second controller is configured to receive the invitation information sent by the server. When the current signal source of the first controller is not the second controller, respond to the invitation message to the first controller. The controller sends an interaction request; when the current signal source of the first controller is the second controller, generates second incoming call prompt data in response to the invitation message; the first controller is configured to convert the video data in the second incoming call prompt data output to the display, and output the audio data in the second incoming call prompt data to the sound player; the first controller is also configured to generate the first incoming call prompt data in response to receiving the interaction request, and output the video in the first incoming call prompt data to the display. The data is output to the display, and the audio data in the first incoming call prompt data is output to the sound player. When the current signal source of the first controller is not the second controller, the invited party can also receive an incoming call prompt corresponding to the invitation information.

Description

An interactive invitation processing method and display device

Technical field

The present application relates to the technical field of display devices, and in particular, to an interactive invitation processing method and a display device.

Background technique

Figure 1 is a schematic structural diagram of a dual-system display device, including a first controller and a second controller. The first controller and the second controller can communicate through an interface module, such as HDMI (High Definition Multimedia Interface, high definition). Multimedia interface), network port and USB (Universal Serial Bus, Universal Serial Bus), etc. The first controller is connected to the signal source, the display and the sound player respectively, and is used to play the audio and video of the signal output by the signal source. The signal source may be an external device, such as a set-top box, or the signal source may be the second controller.

For the display device with the above dual system structure, after receiving the video invitation information from the inviting party sent by the server, the second controller needs to display a prompt interface on the display and play the incoming call ringtone on the sound player to notify the user that there is a friend. Video call so the user can choose whether to answer the video call.

However, the applicant found in practice that the display of other signal sources of the second controller and the first controller are mutually exclusive. When the user watches the content of other signal sources of the first controller, such as when the user watches cable TV, the display The incoming call prompt corresponding to the invitation information sent by the second controller cannot be displayed, resulting in the user being unable to receive and respond to the friend's video call invitation.

Contents of the invention

In order to solve the above technical problems, this application provides an interactive invitation processing method and a display device.

In a first aspect, this application provides a display device, including:

monitor;

sound player;

The second controller is communicatively connected to the first controller, and the second controller is configured to: receive the invitation information sent by the server; when the current signal source of the first controller is not the second controller, Send an interaction request to the first controller in response to the invitation message; when the current signal source of the first controller is the second controller, generate second incoming call prompt data in response to the invitation message, and send the second incoming call prompt data to the first controller;

A first controller configured to output the video data in the second incoming call prompt data to the display, and to output the audio data in the second incoming call prompt data to the sound player;

The first controller is further configured to: in response to receiving the interaction request, generate first incoming call prompt data, output the video data in the first incoming call prompt data to the display, and output the first incoming call prompt data to the display. The audio data in the first incoming call prompt data is output to the sound player.

In a second aspect, this application also provides a display device, including:

The display displays the first incoming call prompt data or the second incoming call prompt data according to the control of the first controller, wherein the first incoming call prompt data is when the current signal source of the first controller is not the second controller, Generated by the first controller itself; the second incoming call prompt data is received by the first controller from the second controller when the current signal source of the first controller is the second controller;

The second controller is communicatively connected to the first controller and the server respectively, and the second controller is not directly connected to the display;

The first controller is directly connected to the display and does not communicate directly with the server. The first controller is used for:

Receive user input for answering operations;

In response to the answer operation being input when the display displays the second incoming call prompt data, the signal source is not switched, and a first processing instruction is sent to the second controller so that the second The controller processes the answering operation in response to receiving the first processing instruction;

In response to the answer operation being input when the display displays the first incoming call prompt data, the signal source of the first controller is switched to the second controller, and the first signal is sent to the second controller. and three processing instructions, so that the second controller processes the answering operation in response to receiving the third processing instruction.

In a third aspect, this application provides a display device, including:

The display displays the first incoming call prompt data or the second incoming call prompt data according to the control of the first controller; wherein the first incoming call prompt data is when the current signal source of the first controller is not the second controller, Generated by the first controller itself; the second incoming call prompt data is received by the first controller from the second controller when the current signal source of the first controller is the second controller;

The second controller is communicatively connected to the first controller and the server respectively, and the second controller is not directly connected to the display;

The first controller is directly connected to the display and does not communicate directly with the server. The first controller is used for:

Receive the rejection action entered by the user;

In response to the rejection operation being input when the display displays the second incoming call prompt data, the signal source is not switched, and a second processing instruction is sent to the second controller so that the third The second controller destroys the second incoming call prompt data in response to receiving the second processing instruction;

In response to the rejection operation being input when the display displays the first incoming call prompt data, the signal source is not switched and the first incoming call prompt data is destroyed.

In a fourth aspect, the present application provides a method for processing interactive invitations on a display device. The display device includes a first controller, a second controller that is communicatively connected to the first controller and the server, and the first controller. A connected display and sound player by:

The second controller receives the invitation information sent by the server, and when the current signal source of the first controller is not the second controller, sends an interaction request to the first controller in response to the invitation message; When the current signal source of the first controller is the second controller, generate second incoming call prompt data in response to the invitation message, and send the second incoming call prompt data to the first controller;

In response to receiving the second incoming call prompt data, the first controller outputs the video data in the second incoming call prompt data to the display, and outputs the audio data in the second incoming call prompt data to a sound player. device;

In response to receiving the interaction request, the first controller generates first incoming call prompt data, outputs the video data in the first incoming call prompt data to the display, and converts the audio data in the first incoming call prompt data to the display. Data is output to the sound player.

The technical solution provided by this application has the following beneficial effects: after the second controller receives the invitation information sent by the receiving server, if the current signal source of the first controller is the second controller, there is no need to switch the signal source, and the The second controller generates the second incoming call prompt data. After receiving the second incoming call prompt data, the first controller prompts the incoming call through the display and sound player; if the current signal source of the first controller is not the second controller, The first controller sends an interaction request, and after responding to the interaction request, the first controller generates the first incoming call prompt data, and controls the display and the sound player to prompt according to the first incoming call prompt data, so that even if the current signal source of the first controller is not In the second controller, the invited user can also receive the incoming call prompt corresponding to the invitation information, and then the signal source of the first controller can be switched to realize the interaction between the inviting party and the invited party.

Description of the drawings

In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the drawings needed to be used in the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some of the drawings of the present invention. Embodiments, for those of ordinary skill in the art, other drawings can also be obtained based on these drawings without exerting creative efforts.

Figure 1 is an architecture diagram of a dual-system display device;

Figure 2 is a schematic diagram of the operation scenario between the display device and the control device according to the embodiment of the present application;

Figure 3 is a hardware configuration block diagram of the control device 100 shown in the embodiment of the present application;

Figure 4 is a hardware configuration block diagram of the display device 200 shown in the embodiment of the present application;

Figure 5 is a hardware architecture block diagram of the display device 200 shown in an embodiment of the present application;

Figure 6 is a schematic functional configuration diagram of the display device 200 according to an embodiment of the present application;

Figure 7(a) is a schematic diagram of the software configuration in the display device 200 according to the embodiment of the present application;

Figure 7(b) is a schematic diagram of the configuration of an application program in the display device 200 according to an embodiment of the present application;

Figure 8 is a schematic diagram of the user interface in the display device 200 according to the embodiment of the present application;

Figure 9 is an application scenario diagram illustrating an embodiment of the present application;

Figure 10 is a flow chart of a display device executing an interactive invitation processing method according to an embodiment of the present application;

Figure 11 is an interaction diagram between the first controller and the second controller inside the display device according to the embodiment of the present application;

Figure 12 is an interactive logic diagram of the branch line solution 1 shown in the embodiment of the present application;

Figure 13 is an interactive logic diagram of the second branch line solution shown in the embodiment of the present application;

Figure 14 is an interactive logic diagram of the third branch line solution shown in the embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the scope of protection of the present invention.

This application is mainly directed to a display device with a dual system structure, that is, a first controller and a second controller, and an interactive invitation processing method thereof. The signal source of the first controller may be an external device, such as connecting a set-top box to play cable TV; or the signal source of the first controller may be the second controller to play online videos and make video calls. First, the structure, function and implementation method of the display device with dual system hardware structure will be described in detail below.

For the convenience of users, various external device interfaces are usually provided on the display device to facilitate the connection of different peripheral devices or cables to achieve corresponding functions. When a high-definition camera is connected to the interface of the display device, if the hardware system of the display device does not have a hardware interface for the high-pixel camera that receives the source code, it will be impossible to present the data received by the camera to the display of the display device. on the screen.

Moreover, due to the hardware structure, the hardware system of traditional display devices only supports one hard decoding resource, and usually can only support video decoding with a maximum resolution of 4K. Therefore, when you want to watch online TV while video chatting, in order not to reduce the To improve the picture quality of network video, it is necessary to use hard decoding resources (usually the GPU in the hardware system) to decode the network video. In this case, the only way to decode the video is to use a general-purpose processor (such as CPU) in the hardware system to decode the video. Process the video chat screen using soft decoding.

Using soft decoding to process video chat screens will greatly increase the data processing burden on the CPU. When the data processing load on the CPU is too heavy, the screen may freeze or become unsmooth. Furthermore, due to the data processing capabilities of the CPU, when using CPU soft decoding to process video chat images, multi-channel video calls are usually not possible. When a user wants to video chat with multiple other users in the same chat scene at the same time, it will Access is blocked.

Based on the above considerations, in order to overcome the above defects, this application discloses a dual hardware system architecture to realize multiple channels of video chat data (at least one channel of local video).

The concepts involved in this application will first be described below with reference to the accompanying drawings. It should be noted here that the following description of each concept is only to make the content of the present application easier to understand, and does not limit the protection scope of the present application.

The term "module" as used in various embodiments of this application may refer to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code capable of executing tasks related to that element. function.

The term "remote control" used in various embodiments of this application refers to a component of an electronic device (such as the display device disclosed in this application), which component can generally wirelessly control the electronic device within a short distance range. This component can generally use infrared and/or radio frequency (RF) signals and/or Bluetooth to connect to electronic devices, and can also include functional modules such as WiFi, wireless USB, Bluetooth, and motion sensors. For example: a handheld touch remote control uses a touch screen user interface to replace most of the physical built-in hard keys in a general remote control device.

The term "gesture" used in various embodiments of this application refers to user behavior in which the user expresses expected thoughts, actions, purposes/or results through a change in hand shape or hand movement.

The term "hardware system" used in various embodiments of this application may refer to a computing, optical, electrical, and magnetic device composed of integrated circuits (ICs), printed circuit boards (PCBs), and other mechanical, optical, electrical, and magnetic devices. Physical components that control, store, input, and output functions. In various embodiments of the present application, the hardware system is usually also called a motherboard or a chip.

FIG. 2 exemplarily shows a schematic diagram of an operation scenario between the display device and the control device according to the embodiment. As shown in FIG. 2 , the user can operate the display device 200 through the control device 100 .

The control device 100 may be a remote control 100A, which may communicate with the display device 200 through infrared protocol communication, Bluetooth protocol communication, Zig Bee protocol communication or other short-distance communication methods, for wireless or Other wired ways to control display device 200. The user can control the display device 200 by inputting user instructions through buttons on the remote control, voice input, control panel input, etc. For example, the user can control the display device 200 by inputting corresponding control instructions through the volume up and down keys, channel control keys, up/down/left/right movement keys, voice input keys, menu keys, power on/off keys, etc. on the remote control. function.

The control device 100 can also be an intelligent device, such as a mobile terminal 100B, a tablet computer, a computer, a notebook computer, etc., which can be controlled through a local area network (LAN), a wide area network (WAN), or a wireless local area network (WLAN). , Wireless Local Area Network) or other networks communicate with the display device 200, and control the display device 200 through an application program corresponding to the display device 200. For example, an application program running on a smart device is used to control the display device 200 .The application can provide users with various controls through an intuitive user interface (UI, User Interface) on the screen associated with the smart device.

For example, both the mobile terminal 100B and the display device 200 can install software applications, so that connection and communication between the two can be realized through a network communication protocol, thereby achieving one-to-one control operations and data communication purposes. For example, the mobile terminal 100B can establish a control command protocol with the display device 200, synchronize the remote control keyboard to the mobile terminal 100B, and control the user interface on the mobile terminal 100B to realize the function of controlling the display device 200; the mobile terminal 100B can also be The audio and video content displayed on the display device 200 is transmitted to the display device 200 to realize the synchronous display function.

As shown in FIG. 2 , the display device 200 can also perform data communication with the server 300 through various communication methods. In various embodiments of the present application, the display device 200 may be allowed to communicate with the server 300 through a local area network, a wireless local area network, or other networks. The server 300 can provide various content and interactions to the display device 200.

For example, the display device 200 interacts with an electronic program guide (EPG, Electronic Program Guide) by sending and receiving information, receiving software program updates, or accessing a remotely stored digital media library. The server 300 may be one group or multiple groups, or one type or multiple types of servers. Other network service contents such as video on demand and advertising services are provided through the server 300 .

The display device 200, on the one hand, can be a liquid crystal display, an OLED (Organic Light Emitting Diode) display, or a projection display device; on the other hand, the display device can be a smart TV or a display system composed of a monitor and a set-top box. The specific display device type, size, resolution, etc. are not limited. Those skilled in the art can understand that the display device 200 can make some changes in performance and configuration as needed.

In addition to providing broadcast reception and television functions, the display device 200 may also additionally provide a smart network television function that provides computer support functions. Examples include Internet TV, smart TV, Internet Protocol TV (IPTV), etc. In some embodiments, the display device may not be capable of receiving broadcast television.

As shown in Figure 2, a camera can be connected or installed on the display device to present the images captured by the camera on the display interface of the display device or other display devices to enable interactive chatting between users. Specifically, the picture captured by the camera can be displayed in full screen, half screen, or any optional area on the display device.

As an optional connection method, the camera is connected to the back shell of the monitor through a connecting plate and is fixedly installed on the upper middle part of the back shell of the monitor. As an installable method, it can be fixedly installed at any position on the back shell of the monitor to ensure that it is The image capture area only needs to be not blocked by the back shell. For example, the image capture area must be in the same display orientation as the display device.

As another optional connection method, the camera can be lifted and lowered to the display back shell through a connecting plate or other conceivable connector. A lifting motor is installed on the connector. When the user wants to use the camera or has an application to use the camera when the camera is not needed, it can be embedded behind the back shell to protect the camera from damage and protect the user's privacy.

As an embodiment, the camera used in this application can be 16 million pixels to achieve ultra-high definition display purposes. In actual use, cameras higher or lower than 16 million pixels can also be used.

When a camera is installed on a display device, the content displayed in different application scenarios of the display device can be integrated in many different ways, thereby achieving functions that cannot be achieved by traditional display devices.

For example, a user can conduct a video chat with at least one other user while watching a video program. The presentation of the video program can be used as a background screen, and the video chat window is displayed on the background screen. Figuratively speaking, this function can be called “chatting while watching”.

Optionally, in the "chat while watching" scenario, conduct at least one video chat across terminals while watching live video or online video.

In another example, a user can video chat with at least one other user while entering an educational application to study. For example, students can interact with teachers remotely while learning content from educational applications. Figuratively speaking, this function can be called "chatting while learning".

In another example, while playing a card game, a user conducts a video chat with players who enter the game. For example, when players enter a game application to participate in the game, they can interact with other players remotely. Figuratively speaking, this function can be called "playing while watching".

Optionally, the game scene and the video screen are integrated, and the portraits in the video screen are cut out and displayed on the game screen to improve the user experience.

Optionally, in somatosensory games (such as playing ball, boxing, running, dancing, etc.), the camera can be used to obtain human body posture and movements, limb detection and tracking, and detection of human skeleton key point data, and then use it with the game Animation is integrated to realize games with scenes such as sports and dance.

In another example, the user can interact with at least one other user via video and voice in the Karaoke application. Figuratively speaking, this function can be called "singing while watching". Optionally, when at least one user enters the application in a chat scene, multiple users can complete the recording of a song together.

In another example, the user can open the camera locally to obtain pictures and videos. This function can be called "looking in the mirror".

In other examples, more functionality may be added or the above functionality may be reduced. This application does not specifically limit the functions of the display device.

A configuration block diagram of the control device 100 according to an exemplary embodiment is schematically shown in FIG. 3 . As shown in FIG. 3 , the control device 100 includes a controller 110 , a communicator 130 , a user input/output interface 140 , a memory 190 , and a power supply 180 .

The control device 100 is configured to control the display device 200 and receive input operation instructions from the user, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, thereby acting as an interactive mediator between the user and the display device 200 effect. For example, the user operates the channel increase and decrease keys on the control device 100, and the display device 200 responds to the channel increase and decrease operations.

In some embodiments, the control device 100 may be a smart device. For example, the control device 100 can install various applications for controlling the display device 200 according to user needs.

In some embodiments, as shown in FIG. 2 , the mobile terminal 100B or other intelligent electronic devices can play similar functions of the control device 100 after installing an application for controlling the display device 200 . For example, the user can install various function keys or virtual buttons of the graphical user interface provided on the mobile terminal 100B or other intelligent electronic devices to realize the functions of the physical keys of the control device 100 by installing applications.

The controller 110 includes a processor 112, RAM 113 and ROM 114, a communication interface, and a communication bus. The controller 110 is used to control the running and operation of the control device 100, as well as communication and cooperation between internal components and external and internal data processing functions.

Under the control of the controller 110, the communicator 130 implements communication of control signals and data signals with the display device 200. For example: sending the received user input signal to the display device 200 . The communicator 130 may include at least one communication module such as a WIFI module 131, a Bluetooth module 132, an NFC module 133, and the like.

User input/output interface 140, wherein the input interface includes at least one of input interfaces such as a microphone 141, a touch panel 142, a sensor 143, and a button 144. For example, the user can realize the user command input function through voice, touch, gesture, pressing and other actions. The input interface converts the received analog signal into a digital signal, and converts the digital signal into a corresponding command signal, and sends it to the display device 200 .

The output interface includes an interface that sends received user instructions to the display device 200 . In some embodiments, it may be an infrared interface or a radio frequency interface. For example, when using an infrared signal interface, user input instructions need to be converted into infrared control signals according to the infrared control protocol, and then sent to the display device 200 through the infrared sending module. Another example: when using a radio frequency signal interface, the user input instructions need to be converted into digital signals, and then modulated according to the radio frequency control signal modulation protocol, and then sent to the display device 200 through the radio frequency sending terminal.

In some embodiments, the control device 100 includes at least one of a communicator 130 and an output interface. The control device 100 is equipped with a communicator 130, such as WIFI, Bluetooth, NFC and other modules, which can send user input instructions to the display device 200 through WIFI protocol, Bluetooth protocol, or NFC protocol encoding.

The memory 190 is used to store various operating programs, data and applications that drive and control the control device 100 under the control of the controller 110 . The memory 190 can store various control signal instructions input by the user.

The power supply 180 is used to provide operating power support for each electrical component of the control device 100 under the control of the controller 110 . Can use batteries and related control circuits.

FIG. 4 schematically illustrates a hardware configuration block diagram of the hardware system in the display device 200 according to an exemplary embodiment.

When using a dual hardware system architecture, the institutional relationship of the hardware system can be shown in Figure 4. The first controller includes various processors and various interfaces of the first controller, and the second controller includes various processors and various interfaces of the second controller. The first controller and the second controller may each be installed with relatively independent operating systems. The operating systems of the second controller and the operating systems of the first controller may communicate with each other through a communication protocol. For example: the second controller The framework layer of the operating system and the framework layer of the operating system of the first controller can communicate to transmit commands and data, so that there are two independent but interrelated subsystems in the display device 200 .

As shown in Figure 4, the second controller and the first controller can realize connection, communication and power supply through multiple different types of interfaces. The interface type of the interface between the second controller and the first controller may include a general-purpose input/output interface (GPIO), USB interface, HDMI interface, UART interface, etc. One or more of these interfaces may be used for communication or power transmission between the second controller and the first controller. For example, as shown in Figure 4, in a dual hardware system architecture, the first controller can be powered by an external power supply, while the second controller can be powered by the first controller instead of an external power supply. Optionally, an external power supply can also be connected to the first controller and the second controller respectively to provide power to the first controller and the second controller.

In addition to the interface for connecting to the first controller, the second controller may also include an interface for connecting to other devices or components, such as the MIPI interface for connecting to the camera (Camera) shown in Figure 4. Bluetooth interface, etc.

Similarly, in addition to the interface for connecting to the first controller, the first controller may also include a VBY interface for connecting to the display screen TCON (Timer Control Register) for connecting to a power amplifier (Amplifier, AMP) And the I2S interface of the speaker (Speaker); as well as the IR/Key interface, USB interface, VVifi interface, Bluetooth interface, HDMI interface, Tuner interface, etc.

The dual hardware system architecture of the present application will be further described below in conjunction with Figure 5 . It should be noted that Figure 5 is only an exemplary illustration of the dual hardware system architecture of the present application and does not limit the present application. In practical applications, both hardware systems can contain more or less hardware or interfaces as needed.

FIG. 5 exemplarily shows a hardware architecture block diagram of the display device 200 according to FIG. 4 . As shown in FIG. 5 , the hardware system of the display device 200 includes a first controller 210 and a second controller 310 , as well as modules connected to the first controller 210 or the second controller 310 through various types of interfaces.

The first controller 210 mainly implements traditional TV functions (for example, it can be connected to an external set-top box, etc.), and the second controller 310 can be used to receive instructions sent by the first controller 210 .

Modules connected to the first controller 210 may include a tuner and demodulator 220, a communicator 230, an external device interface 250, a memory 290, a user input interface 260-3, a video processor 260-1, an audio processor 260-2, The first display 280, the audio output interface 270, and the power supply module 240. In other embodiments, the first controller 210 may also include more or fewer modules.

In other embodiments, the first controller 210 may also be connected to more or fewer modules.

In other embodiments, the first controller 210 may include any one or more modules mentioned above. When any one or more of the above modules are included in the first controller 210, the first controller 210 may not be connected to modules with the same functions.

Among them, the tuner-demodulator 220 is used to perform modulation and demodulation processing such as amplification, mixing, and resonance on radio and television signals received through wired or wireless methods, so as to demodulate the user's desired signal from multiple wireless or wired radio and television signals. Select the audio and video signals carried in the frequency of the television channel, as well as additional information (such as EPG data signals). According to different television signal broadcasting formats, the signal paths of the tuner and demodulator 220 can have many types, such as: terrestrial broadcasting, cable broadcasting, satellite broadcasting or Internet broadcasting, etc.; and according to different modulation types, the signal adjustment method can be digital modulation. The mode may also be an analog modulation mode; and depending on the type of received television signal, the tuner-demodulator 220 may demodulate analog signals and/or digital signals.

The tuner and demodulator 220 is also used to respond to the television channel frequency selected by the user and the television signal carried by the frequency according to the user selection and controlled by the first controller 210 .

In some other exemplary embodiments, the tuner-demodulator 220 may also be in an external device, such as an external set-top box. In this way, the set-top box outputs the television audio and video signals through modulation and demodulation, and then inputs them into the display device 200 through the external device interface 250 .

The communicator 230 is a component for communicating with external devices or external servers according to various communication protocol types. For example, the communicator 230 may include a WIFI module 231, a Bluetooth communication protocol module 232, a wired Ethernet communication protocol module 233, and other network communication protocol modules such as infrared communication protocol modules or near field communication protocol modules (not shown in the figure).

The display device 200 may establish a connection of control signals and data signals with an external control device or content providing device through the communicator 230 . For example, the communicator may receive a control signal of the remote controller 100A according to the control of the controller.

The external device interface 250 is a component that provides data transmission between the first controller 210 and the second controller and other external devices. The external device interface 250 can be connected to external devices such as set-top boxes, game devices, laptops, etc. in a wired/wireless manner, and can receive external devices such as video signals (such as moving images), audio signals (such as music), additional information (such as EPG) and other data.

Among them, the external device interface 250 may include: a high-definition multimedia interface (HDMI) terminal also called HDMI251, a composite video blanking sync (CVBS) terminal also called AV252, an analog or digital component terminal also called component 253, a universal The serial bus (USB) terminal is also called any one or more of USB254, red, green, and blue (RGB) terminals (not shown in the figure). This application does not limit the number and type of external device interfaces.

The first controller 210 controls the operation of the display device 200 and responds to user operations by running various software control programs (such as operating systems and/or various application programs) stored on the memory 290 .

As shown in FIG. 5 , the first controller 210 includes a read-only memory RAM 214, a random access memory ROM 213, a graphics processor 216, a CPU processor 212, a communication interface 218, and a communication bus. Among them, RAM214 and ROM213, graphics processor 216, CPU processor 212, and communication interface 218 are connected through a bus.

ROM213 is used to store various system startup instructions. For example, when a power-on signal is received, the power supply of the display device 200 starts. The CPU processor 212 runs the system startup command in the ROM 213 and copies the operating system stored in the memory 290 to the RAM 214 to start running the operating system. After the operating system is started, the CPU processor 212 copies the various application programs in the memory 290 to the RAM 214, and then starts running and launching the various application programs.

The graphics processor 216 is used to generate various graphic objects, such as icons, operation menus, and user input instruction display graphics, etc. It includes a calculator, which performs calculations by receiving user input of various interactive instructions, and displays various objects according to display attributes. It also includes a renderer that generates various objects obtained based on the operator, and the rendering results are displayed on the first display 280 .

CPU processor 212 for executing operating system and application program instructions stored in memory 290 . And execute various applications, data and content according to various interactive instructions receiving external input, so as to ultimately display and play various audio and video contents.

In some exemplary embodiments, CPU processor 212 may include multiple processors. The plurality of processors may include a main processor and multiple or one sub-processors. The main processor is used to perform some operations of the display device 200 in the pre-power-on mode and/or to display images in the normal mode. Multiple or one sub-processor used to perform an operation in a state such as standby mode.

The communication interface 218 may include a first interface 218-1 to an n-th interface 218-n. These interfaces may be network interfaces connected to external devices via a network.

The first controller 210 may control the overall operation of the display device 200. For example, in response to receiving a user command for selecting a UI object to be displayed on the first display 280, the first controller 210 may perform an operation related to the object selected by the user command.

The object may be any one of the selectable objects, such as a hyperlink or an icon. Operations related to the selected object, such as: displaying operations connected to hyperlinked pages, documents, images, etc., or operations of executing programs corresponding to icons. The user command for selecting the UI object may be a command input through various input devices (eg, mouse, keyboard, touch panel, etc.) connected to the display device 200 or a voice command corresponding to a voice spoken by the user.

The memory 290 includes storing various software modules for driving and controlling the display device 200 . For example, various software modules stored in the memory 290 include: basic module, detection module, communication module, display control module, browser module, and various service modules (not shown in the figure).

Among them, the basic module is a bottom-level software module used for signal communication between various hardware in the display device 200 and sending processing and control signals to upper-layer modules. The detection module is a management module used to collect various information from various sensors or user input interfaces, perform digital-to-analog conversion, and perform analysis and management. The speech recognition module includes a speech analysis module and a speech command database module. The display control module is a module used to control the first display 280 to display image content, and can be used to play multimedia image content, UI interface and other information. The communication module is a module used for control and data communication with external devices. The browser module is a module used to perform data communication between browsing servers. The service module is a module used to provide various services and various applications.

At the same time, the memory 290 is also used to store received external data and user data, images of various items in various user interfaces, visual effects diagrams of focus objects, etc.

The user input interface 260-3 is used to send the user's input signal to the first controller 210, or to send the signal output from the first controller 210 to the user. Exemplarily, the control device (such as the mobile terminal 100B or the remote control 100A) can send input signals input by the user, such as power switch signals, channel selection signals, volume adjustment signals, etc., to the user input interface, and then the user input interface 260-3 forwarded to the first controller 210; alternatively, the control device may receive an output signal such as audio, video or data output from the user input interface 260-3 processed by the first controller 210, and display the received output signal or the output to be received. The signal output is in the form of audio or vibration.

In some embodiments, the user may input a user command on a graphical user interface (GUI) displayed on the first display 280, and the user input interface 260-3 receives the user input command through the graphical user interface (GUI). Alternatively, the user can input a user command by inputting a specific sound or gesture, and then the user input interface 260-3 recognizes the sound or gesture through the sensor to receive the user input command.

The video signal is displayed or played on the display 280.

For example, the video processor 260-1 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, etc. (not shown in the figure).

The video signal displayed or played on the display 280.

For example, the video processor 260-1 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, etc. (not shown in the figure).

Among them, the demultiplexing module is used to demultiplex the input audio and video data streams. For example, if MPEG-2 is input, the demultiplexing module will demultiplex into video signals and audio signals.

The video decoding module is used to process the demultiplexed video signal, including decoding and scaling processing.

The image synthesis module, such as an image synthesizer, is used to overlay and mix the graphics generator based on user input or the GUI signal generated by itself, and the zoomed video picture to generate an image signal for display.

The frame rate conversion module is used to convert the frame rate of the input video, such as converting the frame rate of the input 24Hz, 25Hz, 30Hz, and 60Hz video to a frame rate of 60Hz, 120Hz, or 240Hz. The input frame rate can be the same as the source Related to video streaming, the output frame rate can be related to the refresh rate of the monitor. The display formatting module is used to change the signal output by the frame rate conversion module into a signal that conforms to the display format of a monitor, for example, convert the format of the signal output by the frame rate conversion module to output an RGB data signal.

The first display 280 is used to receive image signals input from the video processor 260-1 and display video content and images as well as a menu control interface. The first display 280 includes a display component for presenting a picture and a driving component for driving image display. The displayed video content may come from the video in the broadcast signal received by the tuner and demodulator 220, or may come from the video content input from the communicator or external device interface. The first display 280 simultaneously displays the user control interface UI generated in the display device 200 and used to control the display device 200 .

And, depending on the type of the first display 280, a driving component for driving the display is also included. Alternatively, if the first display 280 is a projection display, it may also include a projection device and a projection screen.

The audio processor 260-2 is used to receive audio signals, perform decompression and decoding according to the standard encoding and decoding protocol of the input signal, and perform audio data processing such as noise reduction, digital-to-analog conversion, and amplification processing to obtain audio data that can be output in the speaker 272 The audio signal played.

The audio output interface 270 is used to receive the audio signal output by the audio processor 260-2 under the control of the first controller 210. The audio output interface may include a speaker 272, or an external audio output terminal 274 output to a generating device of an external device. , such as: external audio terminal or headphone output terminal, etc.

In some other exemplary embodiments, the video processor 260-1 may include one or more chips. The audio processor 260-2 may also include one or more chips.

And, in some other exemplary embodiments, the video processor 260-1 and the audio processor 260-2 may be separate chips, or may be integrated with the first controller 210 in one or more chips.

The power supply module 240 is used to provide power supply support for the display device 200 with power input from an external power source under the control of the first controller 210 . The power supply module 240 may include a built-in power circuit installed inside the display device 200 , or may be a power supply installed outside the display device 200 , such as a power interface that provides external power in the display device 200 .

As shown in FIG. 5 , the modules connected to the second controller 310 may include a communicator 330 , a detector 340 , and a memory 390 . In some embodiments, a user input interface, a video processor 360-1, an audio processor 360-2, a display, and an audio output interface (not shown in the figure) may also be included. In some embodiments, there may also be a power supply module that independently supplies power to the second controller 310 ((not shown in the figure)).

In some embodiments, the second controller 310 may also connect more or fewer modules.

In some embodiments, the second controller 310 may include any one or more modules mentioned above. When any one or more of the above modules are included in the second controller 310, the first controller 210 may not be connected to modules with the same functions.

The communicator 330 is a component for communicating with external devices or external servers according to various communication protocol types. For example, the communicator 330 may include a WIFI module 331, a Bluetooth communication protocol module 332, a wired Ethernet communication protocol module 333, and an infrared communication protocol module and other network communication protocol modules or near field communication protocol modules. (not shown in the picture)

The communicator 330 of the second controller 310 and the communicator 230 of the first controller 210 also interact with each other. For example, the WiFi module 231 in the hardware system of the first controller 210 is used to connect to an external network and generate network communication with external servers and the like. The WiFi module 331 in the hardware system of the second controller 310 is used to connect to the WiFi module 231 of the first controller 210 without directly connecting to external networks. The second controller 310 connects to external networks through the first controller 210 . Therefore, for the user, a display device as in the above embodiment displays a WiFi account to the outside.

The detector 340 is a component used by the second controller 310 of the display device to collect signals from the external environment or interactions with the outside. The detector 340 may include a light receiver 342, a sensor used to collect ambient light intensity, which can adapt to changes in display parameters by collecting ambient light; it may also include an image collector 341, such as a camera, a camera, etc., which may be used to collect external light. Environmental scenes, as well as for collecting the user's attributes or interacting with the user's gestures, can adaptively change the display parameters, and can also recognize user gestures to realize the function of interacting with the user.

The external device interface 350 provides a component for data transmission between the second controller 310 and the first controller 210 or other external devices. The external device interface 350 can be connected with external devices such as a set-top box, a game device, a notebook computer, etc. in a wired/wireless manner.

Video processor 360-1 is used to process related video signals.

The second controller 310 controls the work of the display device 200 and responds to the user by running various software control programs stored on the memory 390 (such as installed third-party applications, etc.) and interacting with the first controller 210 operation.

As shown in FIG. 5 , the second controller 310 includes a read-only memory ROM 313, a random access memory RAM 314, a graphics processor 316, a CPU processor 312, a communication interface 318, and a communication bus. Among them, ROM313 and RAM314, graphics processor 316, CPU processor 312, and communication interface 318 are connected through a bus.

ROM313 is used to store various system startup instructions. The CPU processor 312 executes the system startup instructions in the ROM 313 and copies the operating system stored in the memory 390 to the RAM 314 to start running and booting the operating system. After the operating system is started, the CPU processor 312 copies the various application programs in the memory 390 to the RAM 314, and then starts running and launching the various application programs.

The CPU processor 312 is used to execute operating system and application program instructions stored in the memory 390, and to communicate, transmit and interact with the first controller 210 such as signals, data, instructions, etc., and to receive various interactive instructions based on external input. , to execute various applications, data and content in order to ultimately display and play various audio and video contents.

There are multiple communication interfaces 318, which may include a first interface 318-1 to an n-th interface 318-n. These interfaces may be network interfaces connected to external devices via a network, or may be network interfaces connected to the first controller 210 via a network.

The second controller 310 may control the overall operation of the display device 200. For example, in response to receiving a user command for selecting a UI object to be displayed on the display 280, the first controller 210 may perform an operation related to the object selected by the user command.

The graphics processor 316 is used to generate various graphic objects, such as icons, operation menus, and user input instruction display graphics, etc. It includes a calculator, which performs calculations by receiving user input of various interactive instructions, and displays various objects according to display attributes. It also includes a renderer that generates various objects obtained based on the operator, and the rendering results are displayed on the first display 280 .

Both the graphics processor 316 of the second controller 310 and the graphics processor 216 of the first controller 210 can generate various graphics objects. The difference is that if application 1 is installed on the second controller 310 and application 2 is installed on the first controller 210, when the user is on the interface of application 1 and performs user input instructions in application 1, the second controller Graphics processor 316 of 310 generates graphics objects. When the user is on the interface of application 2 and performs user input instructions in application 2, the graphics processor 216 of the first controller 210 generates a graphics object.

FIG. 6 schematically illustrates a functional configuration diagram of a display device according to an exemplary embodiment.

As shown in Figure 6, the memory 390 of the second controller and the memory 290 of the first controller are respectively used to store operating systems, application programs, content, user data, etc., between the second controller 310 and the first controller 210. The system operation of driving the display device 200 and responding to various operations of the user are performed under control. The memory 390 of the second controller and the memory 290 of the first controller may include volatile and/or non-volatile memory.

For the first controller 210, the memory 290 is specifically used to store the running program for driving the first controller 210 in the display device 200, and to store various applications built into the display device 200, as well as various applications downloaded by the user from external devices. , as well as various graphical user interfaces related to the application, as well as various objects related to the graphical user interface, user data information, and various internal data supporting the application. The memory 290 is used to store system software such as operating system (OS) kernel, middleware, and applications, as well as to store input video data, audio data, and other user data.

The memory 290 is specifically used to store drivers and related data such as the video processor 260-1 and the audio processor 260-2, the first display 280, the communicator 230, the tuner and demodulator 220, and the input/output interface.

In some embodiments, memory 290 may store software and/or programs representing an operating system (OS) including, for example, a kernel, middleware, application programming interfaces (APIs), and/or applications. For example, the kernel can control or manage system resources, or functions implemented by other programs (such as the middleware, API, or applications), and the kernel can provide interfaces to allow middleware and APIs, or applications to access the controller. , to control or manage system resources.

As an example, the memory 290 includes a broadcast receiving module 2901, a channel control module 2902, a volume control module 2903, an image control module 2904, a display control module 2905, a first audio control module 2906, an external instruction identification module 2907, and a communication control module 2908. The light receiving module 2909, the power control module 2910, the operating system 2911, the application program 2912, the browser module (not shown in the figure) and so on. The first controller 210 runs various software programs in the memory 290 to perform functions such as: broadcast and television signal reception and demodulation functions, television channel selection control functions, volume selection control functions, image control functions, display control functions, and audio control functions. Various functions such as external command recognition function, communication control function, optical signal receiving function, power control function, software control platform that supports various functions, and browser function.

Memory 390 includes storage of various software modules for driving and controlling the display device 200 . For example, various software modules stored in the memory 390 include: basic module, detection module, communication module, display control module, browser module, and various service modules (not shown in the figure). Since the functions of the memory 390 and the memory 290 are relatively similar, please refer to the memory 290 for relevant information and will not be described again here.

As an example, the memory 390 includes an image control module 3904, a second audio control module 3906, an external instruction recognition module 3907, a communication control module 3908, a light receiving module 3909, an operating system 3911, an application program 3912, a browser module 3913, etc. . The second controller 310 runs various software programs in the memory 390 to perform functions such as: image control function, display control function, audio control function, external instruction recognition function, communication control function, optical signal receiving function, power control function, support Various functions such as software control platform and browser functions.

Differently, the external instruction identification module 2907 of the first controller and the external instruction identification module 3907 of the second controller can identify different instructions.

For example, since an image receiving device such as a camera is connected to the second controller 310, the external instruction recognition module 3907 of the second controller may include a pattern recognition module 3907-1, and a pattern database is stored in the pattern recognition module 3907-1. When the camera receives external graphics instructions, it corresponds to the instructions in the graphics database to control the display device. Since the voice receiving device and the remote control are connected to the first controller 210, the external command recognition module 2907 of the first controller may include a voice recognition module 2907-2, and a voice database is stored in the voice recognition module 2907-2. When the receiving device receives voice commands from the outside world, it corresponds to the commands in the voice database to control the display device. Similarly, the control device 100 such as a remote control is connected to the first controller 210, and the key command recognition module 2907-3 performs command interaction with the control device 100.

FIG. 7(a) schematically illustrates a configuration block diagram of the software system in the display device 200 according to an exemplary embodiment.

For the first controller 210, as shown in Figure 7(a), the operating system 2911, including execution operating software for handling various basic system services and for performing hardware-related tasks, serves as an interface between application programs and hardware components. The medium through which data processing is completed.

In some embodiments, part of the operating system kernel may include a series of software to manage display device hardware resources and provide services for other programs or software codes.

In other embodiments, part of the operating system kernel may include one or more device drivers. The device driver may be a set of software codes in the operating system that help operate or control devices or hardware associated with the display device. Drivers may contain code that operates video, audio, and/or other multimedia components. Examples include monitors, cameras, Flash, WiFi and audio drivers.

Among them, the accessibility module 2911-1 is used to modify or access the application program to achieve the accessibility of the application program and the operability of its displayed content.

Communication module 2911-2 is used to connect with other peripheral devices via relevant communication interfaces and communication networks.

The user interface module 2911-3 is used to provide objects for displaying user interfaces for access by various applications, thereby achieving user operability.

Control application 2911-4, used to control process management, including runtime applications, etc.

The event transmission system 2914 can be implemented in the operating system 2911 or in the application program 2912. In some embodiments, on the one hand, it is implemented in the operating system 2911 and at the same time, it is implemented in the application program 2912 to monitor various user input events and respond to the recognition results of various events or sub-events according to various event references. Instead, a handler implements one or more predefined sets of operations.

Among them, the event monitoring module 2914-1 is used to monitor user input interface input events or sub-events.

The event identification module 2914-2 is used to input definitions of various events to various user input interfaces, identify various events or sub-events, and transfer them to processing to execute one or more groups of corresponding processing programs. .

The event or sub-event refers to the input detected by one or more sensors in the display device 200, as well as the input from the external control device (such as the control device 100, etc.). For example: various sub-events of voice input, gesture input sub-events of gesture recognition, and sub-events of remote control key command input of the control device, etc. For example, one or more sub-events in the remote control include multiple forms, including but not limited to one or a combination of button presses up/down/left/right, OK key, button press and hold, etc. As well as non-physical key operations, such as moving, holding, releasing, etc.

The interface layout management module 2913 directly or indirectly receives each user input event or sub-event monitored from the event transmission system 2914, and is used to update the layout of the user interface, including but not limited to the position of each control or sub-control in the interface, and the container. The size, position, level, etc. are related to various execution operations related to the interface layout.

Since the functions of the operating system 3911 of the second controller are relatively similar to the operating system 2911 of the first controller, please refer to the operating system 2911 for relevant information, which will not be described again here.

As shown in FIG. 7( b ), the application program of the display device includes various application programs that can be executed on the display device 200 .

The application program 2912 of the first controller may include but is not limited to one or more application programs, such as: video on demand application, application center, game application, etc. The application program 3912 of the second controller may include, but is not limited to, one or more applications, such as a live TV application, a media center application, etc. It should be noted that the application programs included on the second controller and the first controller are determined based on the operating system and other designs. The present invention does not need to modify the application programs included on the second controller and the first controller. Specific limitations and divisions.

Live TV app that provides live TV from different sources. For example, a live TV application may provide a television signal using input from cable television, over-the-air broadcast, satellite service, or other types of live television services. And, the live TV application can display the video of the live TV signal on the display device 200 .

Video on demand application that can provide videos from different storage sources. Unlike live TV applications, video on demand offers the display of video from certain storage sources. For example, video on demand can come from a cloud storage server or from a local hard drive storage containing stored video programs.

Media center application can provide various multimedia content playback applications. For example, a media center can provide services other than live TV or video on demand, where users can access various images or audio through a media center application.

The application center can provide storage for various applications. An application can be a game, application, or some other application that is associated with a computer system or other device but can run on a display device. The application center can obtain these applications from different sources, store them in local storage, and then run them on the display device 200.

The modules included in the hardware in the above embodiments are examples of an achievable real-time manner and are not necessary for the display device or method of this application. Those skilled in the art can make appropriate additions and subtractions based on the above hardware implementation. , as long as it does not affect the implementation of the plan.

FIG. 8 is a schematic diagram of a user interface in the display device 200 according to an exemplary embodiment. As shown in FIG. 8 , the user interface includes multiple view display areas, for example, a first view display area 201 and a playback screen 202 , where the playback screen includes laying out one or more different items. The user interface also includes a selector indicating that the item is selected, and the position of the selector can be moved through user input to change the selection of different items.

It should be noted that multiple view display areas can present display screens at different levels. For example, the first view display area can present the video chat project content, and the second view display area can present the application layer project content (such as web video, VOD display, application screen, etc.).

Optionally, there are differences in priorities in the presentation of different view display areas. View display areas with different priorities have different display priorities. For example, the priority of the system layer is higher than that of the application layer. When the user uses the acquisition selector and screen switching in the application layer, the screen display in the view display area of the system layer is not blocked; and, according to the user's selection, the application layer When the size and position of the view display area changes, the size and position of the system layer's view display area are not affected.

Displays of the same level can also be presented. At this time, the selector can switch between the first view display area and the second view display area, and when the size and position of the first view display area change, the second view display area changes. The size and position of the display area can be changed accordingly.

Since independent operating systems may be installed in the second controller 310 and the first controller 210 respectively, there are two independent but interrelated subsystems in the display device 200 . For example, both the second controller 310 and the first controller 210 can be independently installed with Android and various APPs, so that each chip can implement certain functions, and the second controller 310 and the first controller 210 collaborate to achieve a certain function.

Based on the aforementioned dual-system display device, as shown in Figure 9, an application scenario diagram is shown in an embodiment of the present application, which involves the first display device 10, the server 20 and the second display device 30. The first display device 10 and the second display device 30 communicate and interact through the server 20. The first display device 10 and the server 20, and the second display device 30 and the server 20 can communicate through a local area network (LAN) or a wireless local area network (WLAN). ) to communicate with other Internet networks.

At least one end of the first display device 10 and the second display device 30 that is the inviting party has a dual system structure as described above. If the first display device 10 is the end that initiates the interactive invitation, the second display device 30 is the one designated by the inviting party. On the end that receives the interactive invitation, after the first display device 10 initiates the interactive invitation, it sends the invitation information to the second display device 30 through the server 20, and the second controller in the second display device 30 receives the invitation information, then the second controller That is, it is the signal source of the video call in the second display device 30 . The interactive invitations described in this article include but are not limited to video calls, game invitations, etc. In order to facilitate the description of the application scenario, the display devices of the inviting party and the invited party are given here as an example. In actual applications, the first display device 10 can be the invited party, and the second display device 30 can also be the inviting party. square.

This application is mainly aimed at the display device corresponding to the invited party, and solves the problem of how to effectively prompt the invited party user for an incoming call with an interactive invitation when the display device corresponding to the invited party plays content transmitted by a signal source other than the second controller. Referring to the aforementioned dual system structure, a display device provided by an embodiment of the present application includes a first controller 210, a second controller 310, a display (ie, the first display 280 in Figure 5) and a sound player. The second controller 310 is respectively connected to the server 20 and the first controller 210 for communication. The first controller 210 is connected to the display and the sound player respectively. The display is used to display video images, and the sound player is used to play audio. The sound player is the figure. The audio output interface 270 in 5 includes a speaker 272 of a display device, or an external audio output terminal 274 for connecting to an external audio device to realize sound playback. Specifically, as shown in Figure 10:

Wherein, the second controller 310 is configured to: receive the invitation information sent by the server; when the current signal source of the first controller is not the second controller, respond to the invitation message to the first control The controller sends an interaction request; when the current signal source of the first controller is the second controller, generate second incoming call prompt data in response to the invitation message, and send the second incoming call prompt data to the Describe the first controller.

The first controller 210 is configured to: output the video data in the second incoming call prompt data to the display, and output the audio data in the second incoming call prompt data to the sound player.

Taking the interactive invitation as a video call as an example, when the display device receives the video call initiated by the inviting party, a temporary prompt interface can be created. The invited user displays the prompt interface through the display and the prompt sound played synchronously by the sound player. , you will be notified of incoming video calls from your friends. In the dual-SIM system, the second controller 310 serves as the signal source for the video call. If the current signal source of the first controller is the second controller, the second controller directly generates the second incoming call prompt data corresponding to the invitation information. , the second incoming call prompt data includes video data corresponding to the prompt interface displayed on the display, and audio data played in the sound player, and the second incoming call prompt data is sent to the first controller, so that the first control The controller controls the monitor to display the prompt interface and controls the sound player to play the prompt tone synchronously. The invited user can view the prompt interface and hear the prompt tone to learn that there is an incoming video call, and then choose whether to answer the video call. When the video call is answered, There is no need to switch signal sources, and the second controller 310 is directly used as the signal source for the video call to handle incoming calls.

The first controller 210 is further configured to: in response to receiving the interaction request, generate first incoming call prompt data, output the video data in the first incoming call prompt data to the display, and, The audio data in the first incoming call prompt data is output to the sound player.

When the current signal source of the first controller is not the second controller, for example, the current signal source is a set-top box device, the display is currently playing the video image corresponding to the cable TV signal, and the sound player is currently playing the audio corresponding to the cable TV signal. , that is, in this case, the display device cannot play the pictures and sounds sent by the second controller, and therefore cannot prompt the invited user with an incoming call based on the incoming call prompt data generated by the second controller. In this case, in this embodiment, the second controller will send an interaction request to the first controller. The interaction request may carry the inviter's information, such as the name, nickname and avatar of the inviter. The interaction request may also include other information related to the inviter. Information and data related to interactive invitations.

In response to the interaction request, the first controller generates first incoming call prompt data by itself. The first incoming call prompt data includes video data corresponding to the prompt interface displayed on the display and audio data played in the sound player. The first controller The controller controls the monitor to display the prompt interface and controls the sound player to play the prompt tone synchronously. The invited user can view the prompt interface and hear the prompt tone to learn that there is an incoming video call, and then choose whether to answer the video call. When the video call is answered, The signal source needs to be switched from the current signal source to the second controller, and the second controller 310 serves as the signal source for the video call to handle incoming calls.

In a possible implementation, as shown in Figure 11, a first manager and a first application may be built into the first controller, and a second manager and a second application may be built into the second controller. The second manager is used to receive the invitation information sent by the server, and determine whether the current signal source of the first controller is the second controller. If the current signal source of the first controller is the second controller, start the second application, The second application generates the second incoming call prompt data, and performs corresponding logical processing based on the response operation input by the invited user. For example, after the user answers the call, the second application processes the call answering program, so that the inviting party and the invited party The party enters the formal video call interface; the second manager feeds back the invited party's response status information to the server, so that the server sends the status information to the inviting party's display device, so that the inviting party can learn the invited party's response to the interactive invitation. Response status.

If the current signal source of the first controller is not the second controller, the second manager sends an interaction request to the first manager; after receiving and responding to the interaction request, the first manager starts the first application, which is generated by the first application. The first incoming call prompts data, and after the user inputs the answer operation, the first application controls the switching of the signal source, switches the current signal source of the first controller to the second controller, and then processes it by the second application of the second controller The call answering program enables interaction between the inviting party and the invited party.

For the first incoming call prompt data and the second incoming call prompt data, the audio data included therein can be presented in the form of a prompt interface on the display. The prompt interface can be a temporarily created display interface that covers the upper layer of the original interface. In this way, the prompt interface can be seen by the user; or, the top-level display interface can be used directly as the prompt interface to display information related to the interaction request in the prompt interface, such as the inviter's information, avatar, nickname, etc., and the prompt interface can also It includes controls that facilitate users to perform response operations, such as answering controls, refusing to answer controls, etc. It should be noted that the interface layout, display effect, and display content of the prompt interface are not limited.

In this embodiment, when the invited user learns that there is an interactive invitation based on the prompt interface and the prompt sound, he can perform a response operation through the prompt interface. The response operation includes the invited party answering, the invited party refusing to answer, response timeout and pressing Return key, etc., if the invited party answers, it means the invited party accepts the friend's invitation for interaction; if the invited party refuses to answer, it means the invited party does not accept the friend's invitation and does not participate in the interaction; the response times out, which means the invited party does not choose to answer or interact within the threshold time. Refuse to answer; pressing the return key returns the user from the prompt interface to the original display interface, indicating that the invited party does not accept the friend invitation and does not participate in the interaction. The response operation can be a click operation performed by the user through an input device, including a remote control, mouse, keyboard, etc.; or the response operation can also be a user's manual touch operation, such as click, double-click, slide, and preset gesture operation. etc.; or, the response operation is an operation in which the user inputs audio information through the voice device. For example, the user's super voice device reads out synonymous keywords such as answer, do not answer, etc., or the user does not need to perform voice input, and the response status is recognized through voice recognition.

In a first implementation manner, when the display device displays the second incoming call prompt data and the user inputs an answering operation, the first controller is further configured to: receive the answering operation input by the user; and respond to the answering operation. is input when the second incoming call prompt data is displayed, and a first processing instruction is sent to the second controller; the first processing instruction is used to cause the second controller to respond to receiving the first Processing instructions, controlling the second application to process the answering operation.

In this case, the response operation is for the invited party to answer the call, which means that the invited party user accepts the invitation and wants to participate in the interaction with the inviting party. At this time, the interactive interface needs to be displayed on the display, because the second controller is the third controller. The current signal source of one controller, so the second controller responds to the first processing instruction and controls the second application in the second controller to process the incoming call answering program. In this way, the interactive interface of both parties can be displayed on the display. After entering the interactive interface Afterwards, the prompt interface for incoming calls is automatically destroyed.

In the second implementation, when the display device displays the second incoming call prompt data and the user inputs a refusal to answer operation, the first controller is further configured to: receive the refusal operation input by the user; in response to the The rejection operation is input when the second incoming call prompt data is displayed, and a second processing instruction is sent to the second controller. The second processing instruction is used to cause the second controller to respond to receiving the The second processing instruction is to destroy the second incoming call prompt data.

When the response operation is that the invited party refuses to answer, the response times out, or the return key is pressed, it means that the invited party user refuses or cannot accept the invitation, and there will be no interaction between the two parties, that is, the playback status of the current signal source will be maintained, and the second controller will respond The second processing instruction is to destroy the second incoming call prompt data. When the second incoming call prompt data is destroyed, the prompt interface will no longer be displayed on the monitor, and the sound player will no longer play the prompt tone. Everything will remain in the signal source playback state before the incoming call prompt.

In the third implementation, for the situation where the user inputs an answering operation when the display device displays the first incoming call prompt data, the first controller is further configured to: receive the answering operation input by the user; respond to the answering operation is input when the first incoming call prompt data is displayed, the signal source of the first controller is switched to the second controller, and a third processing instruction is sent to the second controller. The third processing instruction is used to cause the second controller to control the second application to process the answering operation in response to receiving the third processing instruction.

In the third case, since the current signal source of the first controller is not the second controller, when the user inputs the answer operation, the signal source of the first controller needs to be switched to the second controller, so that the first controller The audio and video of the original signal source will no longer be played, but the answering operation will be processed by the second application of the second controller, so that the display device plays the audio and video content related to the interactive process. After entering the interactive interface, the incoming call The prompt interface is automatically destroyed.

In a fourth implementation, for the situation where the user inputs a refusal to answer operation when the display device displays the first incoming call prompt data, the first controller is further configured to: receive the refusal operation input by the user; and respond to the If the reject answer operation is input when the first incoming call prompt data is displayed, or the first incoming call prompt data response times out, the first incoming call prompt data is destroyed and the current signal source of the first controller is maintained. play status.

When the response operation is that the invited party refuses to answer, the response times out, or the return key is pressed, it means that the invited party user refuses or is unable to accept the invitation, and there will be no interaction between the two parties, that is, the playback status of the current signal source of the first controller will be maintained. The first controller controls the destruction of the first incoming call prompt data. When the first incoming call prompt data is destroyed, the prompt interface will no longer be displayed on the monitor, and the sound player will no longer play the prompt tone. Everything will remain in the signal source playback state before the incoming call prompt.

The above four implementation methods are the response operations of the invited party to the interactive request after the inviting party initiates the interactive invitation. However, in actual applications, the inviting party may also perform some operations on the interactive invitation, such as the inviting party actively hangs up or the invitation times out. , the invitation times out, that is, if the interactive invitation is not answered within the preset time, the interactive invitation will be automatically canceled. By setting the invitation timeout and response timeout, you can provide double insurance to prevent the interactive invitation delay from being too long, and the threshold time corresponding to the response timeout being greater than the preset time corresponding to the invitation timeout.

In this regard, in a fifth implementation manner, the second controller is further configured to: receive the inviting party operation status information sent by the server; in response to receiving the inviting party operation status information sent by the server, in the When the current signal source of a controller is the second controller, the second incoming call prompt data is destroyed; wherein the inviting party operation status information includes the inviting party hangup indication information and the invitation timeout information.

If the inviting party hangs up or the invitation times out, the display device corresponding to the inviting party sends the inviting party hanging up indication information or the invitation timeout information to the server, and then the server sends the inviting party operation status information to the second controller. Since the second controller is the current signal source of the first controller, the second controller only needs to destroy the second incoming call prompt data so that the display will no longer continue to display the prompt interface and the sound player will no longer play the prompt tone. At that time, the invited user was unable to respond, thus canceling the interaction invitation.

In a sixth implementation, the second controller is further configured to: in response to receiving the invitation operation status information sent by the server, when the current signal source of the first controller is not the second controller, Send a hang-up request to the first controller, where the hang-up request is used to cause the first controller to respond to receiving the hang-up request, destroy the first incoming call prompt data, and maintain the first call prompt data. The current signal source playback status of a controller.

When the second controller is not the current signal source of the first controller, if the operating status information of the inviting party is received, in order to cancel the interaction invitation, the second controller sends a hangup request to the first controller; the first controller The server responds to the hang-up request and destroys the first call prompt data generated by the first application, so that the display no longer displays the prompt interface and the sound player no longer plays the prompt sound. At this time, the invited user cannot perform response operations and does not need to Switch the signal source.

In each of the above implementation methods, after the inviting party hangs up/the invitation times out, or the invited party makes a response operation, the prompt interface is destroyed, thereby exiting the display of the prompt interface. After obtaining the response operation, it means that the invited party has chosen to answer, refuse to answer or the response has timed out through the prompt interface. The function of the prompt interface has been completed and there is no need to continue to display it. If a hang-up request is received, it means that the inviting party has taken the initiative. Hang up the interactive invitation or the invitation times out. In this case, even if the invited party responds, the interactive invitation cannot be answered, so there is no need to display the prompt interface. Therefore, after the invited party responds or the inviting party operates, the display of the prompt interface needs to be canceled immediately. At this time, the prompt interface is equivalent to an abandoned interface window. The prompt interface can be a temporarily created display interface, and the prompt interface can be destroyed. Way.

There are two situations when the monitor cannot display the prompt interface: one is that the current signal source of the first controller is not the second controller, for example, the current signal source is a set-top box device, and the monitor is currently playing video images and sounds corresponding to cable TV signals. The player is currently playing the audio corresponding to the cable TV signal, that is, in this case, the display device cannot play the pictures and sounds sent by the second controller, which is the situation described in the previous embodiment; the other is the current situation of the first controller. The signal source is the second controller, but other application interfaces of the first controller are being displayed, such as the display device setting interface or the pop-up advertising interface, covering the image of the signal source of the second controller, that is, what is displayed on the top layer of the monitor at this time It is not the video image sent by the second controller, but the sound player still plays the audio sent by the second controller.

For the situation where the current signal source of the first controller is not the second controller, the display device cannot play the picture and sound of the second controller, so while displaying the prompt interface, it is also necessary to make the sound player play the prompt sound; for the second controller, the display device cannot play the picture and sound of the second controller. When the current signal source of one controller is the second controller, but the video data sent by the second controller is not displayed on the top layer of the display, since the sound player can spontaneously play the prompt tone generated in the second controller, only The prompt interface needs to be generated by the first controller.

In other possible implementations, the first controller is further configured to: when the current signal source of the first controller is the second controller, in response to detecting the video sent by the second controller, If the data is not displayed on the top layer of the display, a fourth processing instruction is sent to the second controller and controls the first application to generate prompt interface data; the fourth processing instruction is used to cause the second controller to respond Upon receiving the fourth processing instruction, control the second application to generate prompt sound data and send the prompt sound data to the first controller;

The received prompt tone data is output to the sound player, and the prompt interface data is synchronously output to the display, so that the top layer of the display displays an incoming call interface corresponding to the prompt interface data.

After determining that the current signal source of the first controller is the second controller, it is still necessary to continue to detect whether the video data sent by the second controller is displayed on the top layer of the display; if so, the second application generates the second incoming call prompt data, and send the second incoming call prompt data to the first controller; if not, the first application of the first controller generates prompt interface data, and the second application of the second controller generates prompt tone data; the first controller will The prompt sound data received by the second controller is output to the sound player, and the prompt interface data generated by itself is output to the display. During this process, the prompt sound data and prompt interface data should be output synchronously to ensure that the display device Audio and video prompts are synchronized.

This application notifies the invited user that there is an interactive invitation to visit from the perspective of visual and auditory senses, and has high prompting efficiency. In this application, the prompt sounds can be pre-stored in the first application and the second application respectively. For the case where the current signal source of the first controller is not the second controller, the first controller can directly control the sound playback. The sound player plays the prompt sound prestored in the first application; if the current signal source of the first controller is the second controller, the sound player plays the prompt sound prestored in the second application.

Based on the aforementioned sixth implementation manner, in other possible implementation manners of this embodiment, the second controller is further configured to: in response to receiving the inviting party operation status information sent by the server, generate the hangup indication information and send the hang-up indication information to the first controller; the hang-up indication information is used to instruct the first controller to control the display to display prompt information that matches the operation status information of the inviting party.

When the second controller receives the operation status information of the inviting party, it means that the inviting party has canceled the interaction invitation. At this time, the second controller sends the generated hang-up indication information to the first controller, and the first controller controls The display displays prompt information that matches the operating status information of the inviting party, such as indicating that the inviting party has hung up or that the invitation has timed out, so that the invited party can understand the operating status of the inviting party. This prompt information can be displayed in the prompt interface of the incoming call, or in After the prompt interface is destroyed, the prompt information is displayed in the original display interface.

In order to enable the inviting party to learn the response status of the invited party in a timely manner, in other possible implementations of this embodiment, the first controller is further configured to: receive the user's response when displaying the first incoming call prompt data or the The response operation input when prompting data for the second incoming call generates corresponding response status information; wherein the response status information includes one of the invited party has answered, the invited party has refused to answer, and the invited party has responded to a timeout; The response status information is sent to the second controller, so that the second controller sends the response status information to the server.

Then, the server sends the received response status information to the display device of the inviting party, so that the display device of the inviting party displays the response status information, so that the inviting party can view the status of the invited party's response to the interactive invitation.

In the interactive logic of the interactive invitation processing method in this embodiment, the interactive terminal includes a first display device (inviter), a server and a second display device (invitee). In each display device, the first controller and the second control device Servers can communicate and interact with each other through RPC (Remote Procedure Call). The interactive invitation is initiated by the first display device, and the server detects the interactive invitation initiated by the first display device, and sends the invitation information to the second display device indicated by the invited party information according to the invited party information carried in the interactive invitation. The following program steps are mainly performed in the second display device.

The second controller: receives the invitation information sent by the server; determines whether the current signal source of the first controller is the second controller. If not, then follow the branch plan 1 shown in Figure 12 to send the interactive message to the first controller. ask;

When the current signal source of the first controller is the second controller, the first controller detects whether the video data sent by the second controller is displayed on the top layer of the display; if it is detected that the video data sent by the second controller is If displayed on the top layer of the display, follow the branch line plan 2 as shown in Figure 13. The second controller generates the second incoming call prompt data and sends the second incoming call prompt data to the first controller; if the second controller is detected If the sent video data is not displayed on the top layer of the display, the third branch scheme shown in Figure 14 is adopted, that is, the application can be divided into three branch schemes.

Referring to Figure 12, branch line plan one includes:

The first controller: in response to receiving the interaction request, generate the first incoming call prompt data, output the video data in the first incoming call prompt data to the display, and output the audio data in the first incoming call prompt data to the sound player device;

A1, first controller: in response to receiving the answer operation of user input, switches the signal source of the first controller to the second controller, and sends a third processing instruction to the second controller;

A2, second controller: in response to the third processing instruction, controls the second application to process the answering operation;

B. The first controller: destroys the first incoming call prompt data in response to response timeout or receipt of a user-input rejection operation;

C1, the second controller: responds to receiving the invitation operation status information sent by the server, generates hang-up indication information, and sends the hang-up indication information and hang-up request to the first controller;

C2, the first controller: destroys the first incoming call prompt data in response to the hang-up request, and controls the display to display prompt information matching the inviting party's operation status information in response to the hang-up instruction information;

D1, the first controller: generates corresponding response status information according to the response operation input by the user, and sends the response status information to the second controller;

D2, second controller: sends response status information to the server;

Server: Send response status information to the first display device.

In branch plan one, A1+A2, B, and C1+C2 are parallel plans. In actual applications, only one of them is executed. When A1+A2 and B are executed, since the user inputs a response operation, it is accompanied by Through the execution of D1+D2, the invited party's response status is fed back to the inviting party; through C1+C2, the invited party can learn the operating status of the inviting party.

Referring to Figure 13, the second branch line plan includes:

The first controller: outputs the video data in the second incoming call prompt data to the display, and outputs the audio data in the second incoming call prompt data to the sound player;

E1, the first controller: in response to receiving the answer operation input by the user, sends the first processing instruction to the second controller;

E2, second controller: in response to the first processing instruction, controls the second application to process the answering operation;

F1, the first controller: in response to response timeout or receipt of a reject operation input by the user, send a second processing instruction to the second controller;

F2, second controller: in response to the second processing instruction, destroy the second incoming call prompt data;

G1, the second controller: in response to receiving the operation status information of the inviter sent by the server, destroy the second incoming call prompt data, generate the hang-up indication information, and send the hang-up indication information to the first controller;

G2, the first controller: in response to the hang-up indication information, control the display to display prompt information matching the operating status information of the inviting party.

D1, the first controller: generates corresponding response status information according to the response operation input by the user, and sends the response status information to the second controller;

D2, second controller: sends response status information to the server;

Server: Send response status information to the first display device.

In the second branch plan, E1+E2, F1+F2, and G1+G2 are parallel plans. In actual applications, only one of them is executed. When E1+E2 and F1+F2 are executed, the user inputs a response operation. , so with the execution of D1+D2, the response status of the invited party is fed back to the inviting party; through G1+G2, the invited party can learn the operating status of the inviting party.

Referring to Figure 14, the third branch line plan includes:

The first controller: sends the fourth processing instruction to the second controller, and controls the first application to generate prompt interface data;

The second controller: in response to the fourth processing instruction, controls the second application to generate prompt sound data and sends the prompt sound data to the first controller;

The first controller: outputs the received prompt tone data to the sound player, and synchronously outputs the prompt interface data to the display, so that the top layer of the display displays the incoming call interface corresponding to the prompt interface data;

H1, the first controller: in response to receiving the answer operation input by the user, sends the fifth processing instruction to the second controller;

H2, second controller: in response to the fifth processing instruction, control the second application to process the answering operation;

J1, the first controller: in response to response timeout or receipt of a user input rejection operation, destroy the prompt interface data and send the sixth processing instruction to the second controller;

J2, second controller: in response to the sixth processing instruction, destroy the prompt tone data;

K1, the second controller: in response to receiving the invitation operation status information sent by the server, destroy the prompt tone data, generate the hang-up instruction information, and send the hang-up instruction information and the seventh processing instruction to the first controller;

K2, the first controller: destroys the prompt interface data in response to the seventh processing instruction, and controls the display to display prompt information matching the inviting party's operation status information in response to the hang-up instruction information;

D1, the first controller: generates corresponding response status information according to the response operation input by the user, and sends the response status information to the second controller;

D2, second controller: sends response status information to the server;

Server: Send response status information to the first display device.

In the third branch plan, H1+H2, J1+J2, and K1+K2 are parallel plans. In actual applications, only one of them is executed. When H1+H2 and J1+J2 are executed, the user inputs a response operation. , so with the execution of D1+D2, the response status of the invited party is fed back to the inviting party; through K1+K2, the invited party can learn the operating status of the inviting party.

It can be seen from the above technical solution that after receiving the invitation information from the server, the second controller determines whether the signal source of the first controller is the second controller. If the current signal source is not the second controller, it sends an interactive message to the first controller. request, the first controller generates a first incoming call prompt interface and controls the display of the prompt interface. The prompt interface can be temporarily created. The prompt interface can include some information corresponding to the interaction request, such as the inviting party information, and It can include controls that facilitate the user's response operations, such as answering controls, refusing to answer controls, etc. At the same time, the sound player plays a prompt sound. After the user sees the prompt interface and hears the prompt sound, he or she learns that a friend has sent a video call invitation. Perform a response operation. If the invited user inputs an answering operation by clicking the answer control, it means that the invited party accepts the interactive invitation. The current signal source of the first controller needs to be switched to the second controller, and the current signal source of the second controller needs to be switched. The second application handles the answering operation to play the audio and video content corresponding to the interactive invitation on the display device, thus connecting the interaction between the inviting party and the invited party; for another example, if the invited party inputs a refusing to answer operation by clicking the reject answering control , the invited party does not want to accept the interaction invitation, then the first controller does not switch the signal source and maintains the current signal source. Therefore, this application can prompt the user for the interaction request sent by the second controller as the signal source when the signal source other than the second controller is playing, so that the user can receive the incoming call prompt and respond according to the user's response to the interaction request. operation, thereby controlling the playback of the signal source and improving the social interaction experience between display devices.

This application provides another display device, including:

The display displays the first incoming call prompt data or the second incoming call prompt data according to the control of the first controller, wherein the first incoming call prompt data is when the current signal source of the first controller is not the second controller, Generated by the first controller itself; the second incoming call prompt data is received by the first controller from the second controller when the current signal source of the first controller is the second controller;

The second controller is communicatively connected to the first controller and the server respectively, and the second controller is not directly connected to the display;

The first controller is directly connected to the display and does not communicate directly with the server. The first controller is used for:

Receive user input for answering operations;

In response to the answer operation being input when the display displays the second incoming call prompt data, the signal source is not switched, and a first processing instruction is sent to the second controller so that the second The controller processes the answering operation in response to receiving the first processing instruction;

In response to the answer operation being input when the display displays the first incoming call prompt data, the signal source of the first controller is switched to the second controller, and the first signal is sent to the second controller. and three processing instructions, so that the second controller processes the answering operation in response to receiving the third processing instruction.

This application also provides a display device, including:

The display displays the first incoming call prompt data or the second incoming call prompt data according to the control of the first controller; wherein the first incoming call prompt data is when the current signal source of the first controller is not the second controller, Generated by the first controller itself; the second incoming call prompt data is received by the first controller from the second controller when the current signal source of the first controller is the second controller;

The second controller is communicatively connected to the first controller and the server respectively, and the second controller is not directly connected to the display;

The first controller is directly connected to the display and does not communicate directly with the server. The first controller is used for:

Receive the rejection action entered by the user;

In response to the rejection operation being input when the display displays the second incoming call prompt data, the signal source is not switched, and a second processing instruction is sent to the second controller so that the third The second controller destroys the second incoming call prompt data in response to receiving the second processing instruction;

In response to the rejection operation being input when the display displays the first incoming call prompt data, the signal source is not switched and the first incoming call prompt data is destroyed.

This application also provides an embodiment of a server that is communicatively connected to the second controller in the display device described in the previous embodiment, and the server is configured to:

Send invitation information to the second display device according to the interactive invitation initiated by the first display device;

Receive response status information sent by the second display device; the response status information includes one of the invited party has answered, the invited party has refused to answer, and the invited party response timeout;

The response status information is sent to the first display device, so that the first display device displays the response status information.

Further, the server is configured to:

Receive the inviting party's operating status information sent by the first display device; the inviting party's operating status information includes the inviting party's hangup indication information and the invitation timeout information;

Send the inviting party's operation status information to the second display device.

In this embodiment, the first display device is the inviting end, the second display device is the invited end, and the server is communicatively connected to the signaling layer of the second controller corresponding to the first display device and the second display device. The server sends invitation information to the second display device according to the interactive invitation initiated by the first display device. After receiving the invitation information, the second display device prompts for an incoming call according to the solution of the aforementioned embodiment, and according to the response operation input by the user, The corresponding response status information is sent to the server, and then the server feeds back the response operation information to the first display device, so that the inviting party knows whether the invited party answers, refuses to answer, or the response times out; if the inviting party cancels the interactive invitation, the first display device The device sends the operating status information of the inviting party to the server, and the server sends the operating status information of the inviting party to the second display device, so that the second display device can choose to destroy the first incoming call prompt data or the second incoming call prompt according to the signal source of the first controller. data, and at the same time, prompt information matching the operation status information of the inviting party is displayed on the display of the second display device, so that the invited party knows the operating status of the inviting party for the interaction request. Through the server of this embodiment, interactive communication between the display devices of the inviting party and the invited party can be realized, as well as status display of the inviting party and the invited party, thereby improving the interactive experience.

This application also provides an embodiment of an interactive invitation processing method for display devices. The method includes:

The second controller receives the invitation information sent by the server, and when the current signal source of the first controller is not the second controller, sends an interaction request to the first controller in response to the invitation message; When the current signal source of the first controller is the second controller, generate second incoming call prompt data in response to the invitation message, and send the second incoming call prompt data to the first controller;

In response to receiving the second incoming call prompt data, the first controller outputs the video data in the second incoming call prompt data to the display, and outputs the audio data in the second incoming call prompt data to a sound player. device;

In response to receiving the interaction request, the first controller generates first incoming call prompt data, outputs the video data in the first incoming call prompt data to the display, and converts the audio data in the first incoming call prompt data to the display. Data is output to the sound player.

The method also includes other program steps as shown in any of the above display device embodiments, which will not be described again in this embodiment.

Corresponding to the server embodiment, another embodiment of this application provides another embodiment of a method for processing interactive invitations. The method includes:

Send invitation information to the second display device according to the interactive invitation initiated by the first display device;

Receive response status information sent by the second display device; the response status information includes one of the invited party has answered, the invited party has refused to answer, and the invited party response timeout;

The response status information is sent to the first display device, so that the first display device displays the response status information.

Further, the method also includes:

Receive the inviting party's operating status information sent by the first display device; the inviting party's operating status information includes the inviting party's hangup indication information and the invitation timeout information;

Send the inviting party's operation status information to the second display device.

The same or similar contents between the various embodiments of the present application may be referred to each other, and the relevant embodiments will not be described again.

Those skilled in the art can clearly understand that the technology in the embodiments of the present application can be implemented by means of software plus the necessary general hardware platform. In specific implementation, the present application also provides a computer storage medium, wherein the computer storage medium can store a program, and the program can include a part configured to execute by the first controller, the second controller or the server provided by the present application, or All steps. The computer storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM), etc.

Other embodiments of the invention will be readily apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention that follow the general principles of the invention and include common knowledge or customary technical means in the technical field that are not disclosed in the invention. . The description and examples are considered to be illustrative only and do not limit the scope of the present invention. The true scope and spirit of the invention are indicated by the appended claims.

Claims (15)

1. A display device, characterized by comprising:

a display;

a sound player;

a second controller in communication with the first controller, the second controller configured to: receiving invitation information sent by a server; when the current signal source of the first controller is not the second controller, responding to the invitation information and sending an interaction request to the first controller; when the current signal source of the first controller is the second controller, generating second incoming call prompt data in response to the invitation information, and sending the second incoming call prompt data to the first controller;

The first controller is configured to output video data in the second incoming call prompt data to the display and output audio data in the second incoming call prompt data to the sound player;

when the display displays the second incoming call prompt data, responding to the answering operation input when the display displays the second incoming call prompt data, and processing the answering operation by taking the second controller as a signal source without cutting off the signal source;

generating first incoming call prompt data in response to receiving the interaction request, outputting video data in the first incoming call prompt data to the display, and outputting audio data in the first incoming call prompt data to the sound player;

when the display displays the first incoming call prompt data, responding to the answering operation input when the display displays the first incoming call prompt data, switching the signal source of the first controller into the second controller, and processing the answering operation by using the second controller as the signal source.

2. The display device of claim 1, wherein the display device comprises a display device,

The first controller is further configured to:

receiving a receiving operation input by a user;

responding to the answering operation input when the second incoming call prompt data is displayed, and sending a first processing instruction to the second controller; the first processing instruction is used for enabling the second controller to control a second application to process the answering operation in response to receiving the first processing instruction.

3. The display device of claim 1, wherein the display device comprises a display device,

the first controller is further configured to:

receiving refusal answering operation input by a user;

and responding to the refusal answering operation which is input when the second incoming call prompt data is displayed, and sending a second processing instruction to the second controller, wherein the second processing instruction is used for enabling the second controller to destroy the second incoming call prompt data in response to receiving the second processing instruction.

4. The display device of claim 1, wherein the display device comprises a display device,

the first controller is further configured to:

receiving a receiving operation input by a user;

and responding to the answering operation which is input when the first incoming call prompt data is displayed, switching the signal source of the first controller into the second controller, and sending a third processing instruction to the second controller, wherein the third processing instruction is used for enabling the second controller to control a second application to process the answering operation in response to receiving the third processing instruction.

5. The display device of claim 1, wherein the first controller is further configured to:

receiving refusal answering operation input by a user;

and responding to the refusal answering operation which is input when the first incoming call prompt data is displayed or the response of the first incoming call prompt data is overtime, destroying the first incoming call prompt data and maintaining the playing state of the current signal source of the first controller.

6. The display device of claim 1, wherein the second controller is further configured to:

receiving the operation state information of the inviting party sent by the server;

in response to receiving the operation state information of the inviting party sent by the server, destroying the second incoming call prompt data when the current signal source of the first controller is the second controller; the operation state information of the inviting party comprises inviting party hang-up indication information and invitation timeout information.

7. The display device of claim 6, wherein the display device comprises a display device,

the second controller is further configured to: and in response to receiving the operation state information of the inviting party sent by the server, when the current signal source of the first controller is not the second controller, sending a hang-up request to the first controller, wherein the hang-up request is used for enabling the first controller to destroy the first incoming call prompt data and maintain the playing state of the current signal source of the first controller in response to receiving the hang-up request.

8. The display device according to claim 1, wherein;

the first controller is further configured to: when the current signal source of the first controller is the second controller, a fourth processing instruction is sent to the second controller and a first application is controlled to generate prompt interface data in response to the fact that video data sent by the second controller is not displayed on the top layer of the display; the fourth processing instruction is used for enabling the second controller to respond to the fourth processing instruction, controlling a second application to generate prompt tone data and sending the prompt tone data to the first controller;

and outputting the received prompting voice data to the sound player, and synchronously outputting the prompting interface data to the display so that the top layer of the display displays an incoming call interface corresponding to the prompting interface data.

9. The display device of claim 1, wherein the display device comprises a display device,

the first controller is further configured to:

receiving response operation input by a user when the first incoming call prompt data or the second incoming call prompt data are displayed, and generating corresponding response state information; the response state information comprises one of answering by the invitee, refusing answering by the invitee and response timeout of the invitee;

And sending the response state information to the second controller so that the second controller sends the response state information to the server.

10. The display device of claim 6 or 7, wherein the second controller is further configured to:

generating the hang-up indication information in response to receiving the operation state information of the inviting party sent by the server, and sending the hang-up indication information to the first controller; the hang-up indication information is used for indicating the first controller to control a display to display prompt information matched with the operation state information of the inviting party.

11. A display device, characterized by comprising:

the display is used for displaying first incoming call prompt data or second incoming call prompt data according to control of the first controller, wherein the first incoming call prompt data is generated by the first controller in response to an interaction request when a current signal source of the first controller is not the second controller, and the interaction request is a request sent to the first controller by the second controller in response to a request message sent by a server; the second incoming call prompt data is received by the first controller from the second controller when the current signal source of the first controller is the second controller;

The second controller is respectively in communication connection with the first controller and the server, and is not directly connected with the display;

the first controller is directly connected with the display and is not directly connected with the server in a communication way, and the first controller is used for:

receiving a receiving operation input by a user;

responding to the answering operation, which is input when the display displays the second incoming call prompt data, without switching signal sources, and sending a first processing instruction to the second controller so that the second controller responds to the receiving of the first processing instruction to process the answering operation;

and responding to the answering operation which is input when the display displays the first incoming call prompt data, switching a signal source of the first controller into a second controller, and sending a third processing instruction to the second controller so that the second controller responds to the receiving of the third processing instruction to process the answering operation.

12. A display device, characterized by comprising:

the display is used for displaying first incoming call prompt data or second incoming call prompt data according to the control of the first controller; when the current signal source of the first controller is not a second controller, the first controller responds to an interaction request, wherein the interaction request is a request sent to the first controller by the second controller in response to a request message sent by a server; the second incoming call prompt data is received by the first controller from the second controller when the current signal source of the first controller is the second controller;

The second controller is respectively in communication connection with the first controller and the server, and is not directly connected with the display;

the first controller is directly connected with the display and is not directly connected with the server in a communication way, and the first controller is used for:

receiving refusal answering operation input by a user;

responding to the rejection answering operation, which is input when the display displays the second incoming call prompting data, without switching signal sources, and sending a second processing instruction to the second controller, so that the second controller destroys the second incoming call prompting data and maintains the current signal source playing state of the first controller in response to receiving the second processing instruction;

and responding to the refusal answering operation, which is input when the display displays the first incoming call prompt data, without switching signal sources, destroying the first incoming call prompt data, and maintaining the current signal source playing state of the first controller.

13. An interactive invitation processing method of a display device, the display device including a first controller, a second controller communicatively connected to the first controller and a server, respectively, a display and a sound player connected to the first controller, the method comprising:

The second controller receives the invitation information sent by the server, and when the current signal source of the first controller is not the second controller, the second controller responds to the invitation information to send an interaction request to the first controller; when the current signal source of the first controller is the second controller, generating second incoming call prompt data in response to the invitation information, and sending the second incoming call prompt data to the first controller;

the first controller responds to the received second incoming call prompt data, outputs video data in the second incoming call prompt data to a display, and outputs audio data in the second incoming call prompt data to a sound player;

when the display displays the second incoming call prompt data, responding to the answering operation input when the display displays the second incoming call prompt data, and processing the answering operation by taking the second controller as a signal source without cutting off the signal source;

the first controller responds to the received interaction request, generates first incoming call prompt data, outputs video data in the first incoming call prompt data to a display, and outputs audio data in the first incoming call prompt data to a sound player;

When the display displays the first incoming call prompt data, responding to the answering operation input when the display displays the first incoming call prompt data, switching the signal source of the first controller into the second controller, and processing the answering operation by using the second controller as the signal source.

14. The method of claim 13, wherein the method further comprises:

receiving a receiving operation input by a user;

responding to the answering operation, which is input when the display displays the second incoming call prompt data, without switching signal sources, and sending a first processing instruction to the second controller so that the second controller responds to the receiving of the first processing instruction to process the answering operation;

and responding to the answering operation which is input when the display displays the first incoming call prompt data, switching a signal source of the first controller into a second controller, and sending a third processing instruction to the second controller so that the second controller responds to the receiving of the third processing instruction to process the answering operation.

15. The method of claim 13, wherein the method further comprises:

Receiving refusal answering operation input by a user;

responding to the rejection answering operation, which is input when the display displays the second incoming call prompting data, without switching signal sources, and sending a second processing instruction to the second controller, so that the second controller destroys the second incoming call prompting data and maintains the current signal source playing state of the first controller in response to receiving the second processing instruction;

and responding to the refusal answering operation, which is input when the display displays the first incoming call prompt data, without switching signal sources, destroying the first incoming call prompt data, and maintaining the current signal source playing state of the first controller.