CN114501048A - Cross-screen real-time communication interaction method and system centered on large-screen display - Google Patents

Abstract

The invention discloses a cross-screen real-time communication interaction method and a cross-screen real-time communication interaction system with large-screen display as a center, which relate to the technical field of data communication methods and cross-screen display, wherein the cross-screen real-time communication interaction system with the large-screen end is realized by taking an OTT large screen as the center, through application programs loaded in a mobile end and the OTT large screen end and depending on a mobile 4G/5G, WiFi network; the method comprises the steps of establishing an information communication channel between people by constructing an interactive link between a mobile terminal and an OTT large screen, solving the problems of inconvenient operation, complex functions, narrow screen and visual fatigue of a mobile phone, focusing information communication and sharing between a small mobile phone screen and a television large screen by the OTT large screen, and constructing a communication channel between the small mobile phone screen and the large mobile phone screen, so that people can realize multimedia information connection of characters, voice, pictures and video between people in a very convenient mode, and the most basic and common communication requirements of people are met.

Description

Cross-screen real-time communication interaction method and system centered on large-screen display

technical field

The invention relates to the technical field of data communication methods and cross-screen display, and in particular to a cross-screen real-time communication interaction method and system centered on large-screen display.

Background technique

The mobile client is an APP that not only has the function of instant messaging between the mobile terminal and the mobile terminal, but also realizes the multimedia instant messaging service between the mobile terminal and the OTT large screen. Among them, the OTT large-screen APP is used to download and install in the OTT smart TV, OTT smart projection or OTT set-top box, and the mobile APP is used to download and install in the mobile phone (including Android and Apple). Realize instant communication between the mobile phone and the large screen Serve.

The functions, operation UI, UE, etc. of the OTT large-screen APP and the mobile small-screen APP are different from each other, so as to meet the establishment of "people-to-people" channels between different terminals, different users, different scenarios and different needs. and communication to achieve. Among them, the mobile APP fully considers factors such as the busy life of the user, the fragmentation of time, the movement and change of the place, etc. The design of the OTT large-screen APP takes more into account the use needs, characteristics, abilities, scenarios, physiology of the middle-aged and elderly people. and other special factors, and strive to provide both parties with a convenient and powerful means of communication.

SUMMARY OF THE INVENTION

The purpose of the present invention is to propose a cross-screen real-time communication interaction method and system centered on large-screen display, so as to solve one or more technical problems existing in the prior art, and at least provide a beneficial option or create conditions.

The invention is based on the OTT large screen as the center, through the mobile terminal and the application program loaded in the OTT large screen terminal, relying on the mobile 4G/5G, wifi network, to realize the mobile terminal and the large screen terminal cross-screen real-time communication interactive system, It is composed of service platform, mobile client, and OTT large-screen client software. The cross-screen real-time communication and interaction method includes three parties: the sending end (information sending), the platform end and the information receiving end (information receiving).

In order to achieve the above object, according to an aspect of the present invention, a cross-screen real-time communication interaction method centered on a large-screen display is provided, and the method includes the following steps:

S100, the sender selects an information receiving object;

S200, the sending end sends data information to the platform end, and displays a thumbnail of one-dimensional information or two-dimensional information contained in the sent data information;

S300: After receiving the data information, the platform side checks the validity of the received data information, and if illegal content is detected, the sending process is terminated and a reminder of the illegal content and the failure of sending is returned to the sender. Then go to step S400;

S400, if the content is legal, store the data information in the storage medium of the platform side, and return a sending success message to the sender that sends the data information at the same time;

S500, the platform side parses the information receiving object in the data information, determines whether the contact of the information receiving object is online, if the contact of the information receiving object is online, transmits the data information to the information receiving end corresponding to the online receiving object and enters the step S700; if the contact person of the information receiving object is offline, enter step S600;

S600, when it is detected that the contact person of the information receiving object is offline, the data information is suspended, and the online monitoring process of the object is started at the same time, until when it is monitored that the contact of the information receiving object is online, the data information is transmitted to the corresponding online receiving object. Information receiving end; that is, if the contact of the information receiving object is offline, the data information will be suspended, and the online monitoring process of the object will be started at the same time, and the data information will be transmitted to the online receiving object when the contact of the monitoring information receiving object is online;

S700, the platform terminal generates a thumbnail image of the data information and sends it to the information receiving terminal, and the information receiving terminal performs an information reminder after receiving the thumbnail image of the data information;

S800, when the information receiving end displays a thumbnail of the data information and requests the platform to download a clear view of the data information, the platform generates a clear view of the data information and sends the clear view of the data information to the information receiving end , the information receiving end replaces the thumbnail of the data information after downloading the clear view of the data information to display the clear view of the data information, and simultaneously stores the clear view of the data information in the cache ;When the information receiving end checks the data information again, it will check the cache first, if there is a clear view of the data information, it will read the clear view of the data information in the cache, if not, download the clear view of the data information from the platform; the clear view It is a video screenshot of the data information or the first frame of the data information; this step is mainly set to consider that the storage space of the OTT large screen is generally limited, and if the cache is not set, it is easy to cause insufficient system space;

S900, the information receiving end sends a receipt of completion of information reception to the platform, and the platform receives the receipt of completion of information reception, changes the state of the information, and completes the entire information sending and receiving process.

Further, in S100, the information receiving object includes any one or more combinations of one or more mobile terminal users, one or more OTT large-screen terminals, and a combination of a mobile terminal and an OTT large-screen terminal. .

Further, in S200, the data information includes any one of the input text content, picture content, video content, audio content, real-time input voice content, and real-time shooting audio and video content, wherein the input text content, real-time audio and video content The recorded voice content and the instantly shot audio and video content can only occur one at a time, while the selected files for sending can be selected at a time.

Further, in S100, the sending end selecting the information receiving object also includes the following steps:

S101, enter a two-dimensional rich media content editing interface; wherein, the two-dimensional rich media includes animation, sound, video or interactive information;

S102, select and edit the cover content to obtain the two-dimensional rich media theme cover content; wherein, selecting the cover content refers to selecting and editing the cover content from the input text content, picture content, video content, audio content, input voice content, and real-time shooting audio and video content. Select one of them as the 2D rich media cover content;

S103, confirming the selected or edited two-dimensional rich media cover content, and the confirmed cover content is the first-dimensional content of the two-dimensional rich media, that is, one-dimensional information;

S104, select second-dimensional content in the two-dimensional rich media, where the second-dimensional content may be one or more pictures, one or more videos, one or more audios, one or more types of one or more PDF documents combination of documents;

S105, editing and sorting the selected second-dimensional content;

S106, confirming the entire two-dimensional rich media content, and forming a two-dimensional rich media information set on the mobile terminal, that is, two-dimensional information;

S107, compressing the pictures and video documents in the two-dimensional information to generate thumbnails;

S108, the data collection of the two-dimensional rich media is used as data information, and the data information includes a two-dimensional rich media data structure document, a cover file, a thumbnail file, and a two-dimensional file package; the two-dimensional rich media data structure document includes a contact person Information, two-dimensional information structure content; wherein, the two-dimensional information structure content includes cover content record, text content, thumbnail size and name, etc.

Further, in S200, sending the data information from the sending end to the platform end also includes the following steps:

S201, performing image processing on the content of the data information, generating silhouette thumbnails for pictures and videos, and correspondingly generating default icons for text files;

S202, the interface of the sending end displays an animation waiting to be sent;

S203, adding the content of the data information to the sending queue to wait for sending;

S204, send the content of the data information one by one in the order of the sending queue; send a notification to the information receiving object when the content starts to be sent;

S205, when receiving the sending notification, stop waiting for the sending animation and display the sending progress;

S206, determine whether the content in the sending queue is successfully sent, and if the sending is unsuccessful, a notification of unsuccessful sending is returned;

S207, when receiving a notification of unsuccessful sending, displaying that the sending failed, and displaying a re-send button identifier;

S208, if the sending is successful, check whether the sent content has been sent, and if it has been sent, send the next content in the queue in the order of the sending queue;

S209, if the sending has been completed, return a sending completion notification and display that the information has been sent successfully.

Further, in S300, the method for checking the validity of the received data information specifically includes: one is compliance inspection, and the other is copyright inspection; wherein the objects involved in the compliance problem include illegal information and illegal information; Technical means and/or manual review to complete the review inspection; technical means using deep learning model related literature (Goodfellow, Ian J., Jonathon Shlens, and Christian Szegedy. "Explaining andharnessing adversarial examples." arXiv preprint arXiv:1412.6572 (2014 )) for a legality check.

Further, in S800, all the received information is browsed, and the browse is to automatically play the received information one by one, and at the same time, the content can be switched left and right through the remote control.

Among them, the sender is a mobile terminal, and the mobile terminal refers to a smart phone or a smart tablet computer loaded with a mobile terminal APP.

The platform side refers to a cloud service platform loaded with a management system, including cloud computing and cloud storage platforms.

The information receiving terminal may be one or more mobile terminals, OTT large-screen terminals corresponding to one or more mobile terminals, or a combination of multiple mobile terminals and OTT large-screen terminals corresponding to multiple mobile terminals, and the OTT large-screen terminal refers to It is a terminal device that can be displayed on a large screen, such as a smart TV, smart projection or smart set-top box installed with an OTT large-screen APP; among them, the mobile terminal can be the information sender or the information receiver; the OTT large-screen terminal can only be The information receiver corresponding to the mobile terminal.

The present invention also provides a cross-screen real-time communication interaction system centered on large-screen display, the system comprising: a memory, a processor, and a computer program stored in the memory and running on the processor, the The processor executes the computer program running in the following system units:

a receiving object selection unit, used for the sending end to select the information receiving object;

an information sending unit, used for sending data information from the sending end to the platform end, and displaying a thumbnail of one-dimensional information or two-dimensional information contained in the sent data information;

The legality checking unit is used to check the legality of the received data information after the platform receives the data information. If illegal content is detected, the sending process will be terminated and the sending end will be sent back to the sending end. If it passes the legality check, go to the information storage unit;

The information storage unit is used to store the data information in the storage medium of the platform side if the content is legal, and return a successful message to the sender that sends the data information at the same time;

The online judgment unit is used for the platform to analyze the information receiving object in the data information, judge whether the contact of the information receiving object is online, and if the contact of the information receiving object is online, transmit the data information to the information receiving corresponding to the online receiving object terminal and enter the information receiving unit; if the contact of the information receiving object is offline, enter the offline detection unit;

The offline detection unit is used to suspend the data information when it is detected that the contact of the information receiving object is offline, and at the same time start the online monitoring process of the object, until when the contact of the information receiving object is detected to be online, the data information is transmitted to the online receiver The information receiver corresponding to the object;

an information receiving unit, used for the platform terminal to generate a thumbnail of the data information and send the thumbnail of the data information to the information receiving terminal, and the information receiving terminal will send an information reminder after receiving the thumbnail of the data information;

The clear view download unit is used for when the information receiving end displays the thumbnail of the data information and requests the platform to download the clear view of the data information, the platform generates the clear view of the data information and sends the clear view of the data information to The information receiving end replaces the thumbnail of the data information after downloading the clear view of the data information, so as to display the clear view of the data information, and synchronize the clear view of the data information. The view is stored in the cache; when the information receiver checks the data information again, it will check the cache first. If there is a clear view of the data information, it will read the clear view of the data information in the cache, and if not, download the clear view of the data information from the platform. ; Setting this unit is mainly to consider that the storage space of the OTT large screen is generally limited, and if the cache is not set, it is easy to cause insufficient system space;

The information receiving completion unit is used for the information receiving end to send the information receiving completion receipt to the platform end, and the platform end receives the information receiving completion receipt, changes the information state, and completes the entire information sending and receiving process.

The beneficial effects of the present invention are as follows: the present invention provides a cross-screen real-time communication interaction method and system centered on large-screen display, and establishes an information communication channel between "people" by constructing an interactive link between the mobile terminal and the OTT large-screen. Although mobile phones such as WeChat can provide a wealth of interactive communication methods, mobile phones are inconvenient to operate, have complex functions, small screens, and visual fatigue. The OTT large screen focuses on the information exchange and sharing between the small screen of the mobile phone and the large screen of the TV, and builds a communication channel between the small screen of the mobile phone and the large screen, so that people can realize the text, Multimedia information connection of voice, picture and video to meet people's most basic and common communication needs.

Description of drawings

The above and other features of the present invention will become more apparent from the detailed description of the embodiments shown in conjunction with the accompanying drawings, in which the same reference numerals denote the same or similar elements of the present invention. The drawings are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can also be obtained from these drawings without creative work. In the drawings:

Fig. 1 shows the flow chart of the cross-screen real-time communication interaction method centered on the large-screen display;

Fig. 2 shows the flow chart of two-dimensional rich media content processing;

Figure 3 shows a flow chart of two-dimensional rich media sending;

Figure 4 shows the structure diagram of the cross-screen real-time communication interaction system centered on the large-screen display.

Detailed ways

The concept, specific structure and technical effects of the present invention will be clearly and completely described below in conjunction with the embodiments and the accompanying drawings, so as to fully understand the purpose, solutions and effects of the present invention. It should be noted that the embodiments in the present application and the features of the embodiments may be combined with each other in the case of no conflict.

FIG. 1 is a flow chart of the cross-screen real-time communication and interaction method centered on large-screen display according to the present invention. The following describes the cross-screen real-time communication method centered on large-screen display according to an embodiment of the present invention with reference to FIG. 1 . Communication interaction method.

The present invention proposes a cross-screen real-time communication interaction method centered on large-screen display, which specifically includes the following steps:

1. The application objects of this method include three parties: information sending, platform and information receiving;

2. The sender of information can only be the mobile terminal, and the mobile terminal refers to the smart phone and smart tablet computer loaded with the mobile terminal APP;

3. The platform side refers to the cloud service platform loaded with the management system, including cloud computing and cloud storage platforms;

4. The information receiving terminal can be one or more mobile terminals, OTT large-screen terminals corresponding to one or more mobile terminals, and a combination of multiple mobile terminals and OTT large-screen terminals corresponding to multiple mobile terminals;

5. The mobile terminal can be the information sender or the information receiver;

6. The OTT large screen terminal can only be the receiver of information corresponding to the mobile terminal.

7. The OTT large-screen terminal refers to the terminal equipment that can be displayed on the large screen, such as smart TVs, smart projectors or smart set-top boxes installed with OTT large-screen APPs.

Its specific characteristics are:

A. Select the information receiving object, which can be a group of one or more mobile terminal users, or a combination of OTT large-screen terminal terminals corresponding to one or more mobile terminal users;

B. Choose to send one-dimensional information for object A. The content to be sent can be input text content, picture content, video content, audio content, instant recorded voice content, instant shot audio and video content, etc. The content to be sent can only be sent at one time. One of them, in which the input text content, the instant recorded voice content, and the instant recorded audio and video content can only occur one at a time, and the selected files can be selected at a time for sending;

C. Select two-dimensional rich media content for object A, and its content includes cover, content collection, etc.;

D. Information sending;

E. Display thumbnails on the sending end;

F. Send the sent information set D to the platform through the X network;

G. The platform side checks the legality of the received information;

H. If the platform side detects illegal content, it will stop the sending process, and return a reminder to the mobile terminal that the content is illegal and that the sending fails;

1. If the content is legal, then the information is formally stored in the platform storage medium, and a successful message J is returned to the mobile terminal that sends the information simultaneously;

K. Content After completing step H on the platform side, analyze the information receiving objects in the two-dimensional information set, and monitor whether the information receiving objects are online or not. If the receiving object is online, the information is transmitted to the online receiving object through the Y network; if the receiving object is offline, then enter step M;

M. If the receiving object is not online, the information will be suspended, and the online monitoring process of the object will be started at the same time. When it is detected that the offline object is online, the information will be transmitted to the online receiving object through the Y network;

O. The online recipient receives the abbreviated information content;

P. After receiving the abbreviated information, the information receiving end will remind the information;

Q. When viewing the thumbnail information, at the same time, request the platform I to download the clear view. After downloading, replace the thumbnail display, and store the clear view in the cache R synchronously; when viewing the information again, the cache R will be checked first, and if there is a clear view, the Read the content in the cache R, if there is no request to the platform side I; this step is mainly set up to consider that the storage space of the OTT large screen is generally limited, if the cache is not set, it is easy to cause insufficient system space;

S. There are three ways to display information, S is to browse the information according to the information reminder;

T. Browse through all the received information. The so-called browse is to automatically play one by one, and at the same time, the content can be switched left and right through the remote control;

U. After opening the information, all information thumbnails are displayed below, and the playback information can be selected left and right through the remote control;

V. Thumbnails are also displayed first for information browsing, and a clear view will be displayed during official viewing;

W. Send the information receipt to the platform to receive the completion receipt;

N. The platform side receives the receipt of completion of information reception, changes the information status, and completes the entire information sending and receiving process;

X/Y: refers to 3G, 4G, 5G, WIFI or wired network;

As shown in Figure 2, wherein, described also includes the step of two-dimensional rich media content processing in Figure 2:

B1. Enter the two-dimensional rich media content editing interface;

B2/B3. Select and edit the two-dimensional rich media theme cover; the selected cover content can be input text content, picture content, video content, audio content, input voice content, real-time captured audio and video content, etc. Item as 2D rich media cover content;

B4. Confirm the selected or edited 2D rich media cover content, and the confirmed content is the first dimension of 2D rich media;

B5/B6. Select the second-dimensional content in the two-dimensional rich media, and the content can be one or more types of one or more pictures, one or more videos, one or more audios, and one or more PDF documents combination of documents;

B7. Edit and sort the selected second dimension content;

B8. Confirm the entire 2D rich media content;

B9. After step B8, a two-dimensional rich media information collection is formed on the mobile terminal;

B10. Carry out a secondary processing process according to the content of the information collection, and compress the pictures and video documents therein to generate thumbnails;

B11. Generate a two-dimensional rich media data collection, which includes a two-dimensional rich media data structure document, a cover file, a thumbnail file, and a two-dimensional file package; the document contains recipient information and two-dimensional information structure content;

B12. The document contains receiving object information and two-dimensional information structure content, which includes cover content record, text content, thumbnail size and name, etc.;

B13. One-dimensional cover file package;

B14. Thumbnail file;

B15. Two-dimensional content file package.

As shown in Figure 3, wherein, described step C also includes two-dimensional rich media sending flow process in Figure 3:

C1. Confirm that the sent content enters C2;

C2. Perform image processing on the content determined by C1, generate silhouette thumbnails for pictures and videos, and generate default icons for text files;

C3. The mobile terminal interface displays the animation waiting to be sent;

C4. Add the content to the sending queue to wait for sending, and enter the C5 mobile terminal sending function module;

C5. The mobile terminal content sending function module, this function module belongs to middleware;

C6. The sending content enters the sending queue of the sending function module of the mobile terminal;

C7/C8. Content is sent, and sent one by one in the order of the C8 sending queue; when the content starts to be sent, the function module enters C9 and returns the information to start sending notifications;

C10. When receiving the sending notification returned from the sending function module, stop waiting for the sending animation and display the sending progress;

C11. Detect whether the content in the sending queue is sent successfully or not, and return an unsuccessful notification if the sending is unsuccessful;

C12. When receiving the notification of unsuccessful sending, display the sending failure, and display the re-send button logo;

C13. If the sending is successful, check whether the sent content has been sent. If it has been sent, enter C8 to send the next content in the queue in order;

C14. If the sending has been completed, return the sending completion notification, and display the information sent successfully on the display layer.

The cross-screen real-time communication interaction system centered on the large-screen display provided by the embodiment of the present invention is shown in FIG. A cross-screen real-time communication interaction system centered on large-screen display includes: a processor, a memory, and a computer program stored in the memory and running on the processor, and the processor implements the computer program when the processor executes the computer program. The steps in the above embodiments of the cross-screen real-time communication interaction system centered on the large-screen display.

The system includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, the processor executing the computer program and running in elements of the following system:

a receiving object selection unit, used for the sending end to select the information receiving object;

an information sending unit, used for sending data information from the sending end to the platform end, and displaying a thumbnail of one-dimensional information or two-dimensional information contained in the sent data information;

The legality checking unit is used to check the legality of the received data information after the platform receives the data information. If illegal content is detected, the sending process will be terminated and the sending end will be sent back to the sending end. If it passes the legality check, go to the information storage unit;

The information storage unit is used to store the data information in the storage medium of the platform side if the content is legal, and return a successful message to the sender that sends the data information at the same time;

The online judgment unit is used for the platform to analyze the information receiving object in the data information, judge whether the contact of the information receiving object is online, and if the contact of the information receiving object is online, transmit the data information to the information receiving corresponding to the online receiving object terminal and enter the information receiving unit; if the contact of the information receiving object is offline, enter the offline detection unit;

The offline detection unit is used to suspend the data information when it is detected that the contact of the information receiving object is offline, and at the same time start the online monitoring process of the object, until when the contact of the information receiving object is detected to be online, the data information is transmitted to the online receiver The information receiver corresponding to the object;

an information receiving unit, used for the platform terminal to generate a thumbnail of the data information and send the thumbnail of the data information to the information receiving terminal, and the information receiving terminal will send an information reminder after receiving the thumbnail of the data information;

The clear view download unit is used for when the information receiving end displays the thumbnail of the data information and requests the platform to download the clear view of the data information, the platform generates the clear view of the data information and sends the clear view of the data information to The information receiving end replaces the thumbnail of the data information after downloading the clear view of the data information, so as to display the clear view of the data information, and synchronize the clear view of the data information. The view is stored in the cache; when the information receiver checks the data information again, it will check the cache first. If there is a clear view of the data information, it will read the clear view of the data information in the cache, and if not, download the clear view of the data information from the platform. ; Setting this unit is mainly to consider that the storage space of the OTT large screen is generally limited, and if the cache is not set, it is easy to cause insufficient system space;

The information receiving completion unit is used for the information receiving end to send the information receiving completion receipt to the platform end, and the platform end receives the information receiving completion receipt, changes the information state, and completes the entire information sending and receiving process.

The cross-screen real-time communication and interaction system centered on the large-screen display can run in computing devices such as desktop computers, notebook computers, palmtop computers, and cloud servers. For the cross-screen real-time communication and interaction system centered on the large-screen display, the operable system may include, but is not limited to, a processor and a memory. Those skilled in the art can understand that the example is only an example of a cross-screen real-time communication interaction system centered on large-screen display, and does not constitute a limitation on the cross-screen real-time communication and interaction system centered on large-screen display, which may include There are more or less components, or some components are combined, or different components, for example, the cross-screen real-time communication interaction system centered on the large-screen display may also include input and output devices, network access devices, buses Wait.

The processor may be a central processing unit (Central Processing Unit, CPU), or other general-purpose processors, digital signal processors (Digital Signal Processors, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), field Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc. The processor is the control center of the operating system of the cross-screen real-time communication interactive system centered on the large-screen display. Such interfaces and lines connect all parts of the entire operating system of the cross-screen real-time communication interactive system centered on the large-screen display.

The memory can be used to store the computer program and/or module, and the processor implements the process by running or executing the computer program and/or module stored in the memory and calling the data stored in the memory. Various functions of the cross-screen real-time communication interaction system centered on the large-screen display. The memory may mainly include a stored program area and a stored data area, wherein the stored program area may store an operating system, an application program required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the storage data area may store Data created according to the usage of the mobile phone (such as audio data, phone book, etc.), etc. In addition, the memory may include high-speed random access memory, and may also include non-volatile memory such as hard disk, internal memory, plug-in hard disk, Smart Media Card (SMC), Secure Digital (SD) card , a flash memory card (Flash Card), at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device.

Although the present invention has been described in considerable detail and with particular reference to a few of the described embodiments, it is not intended to be limited to any of these details or embodiments or any particular embodiment so as to effectively encompass the intended scope of the invention. Furthermore, the foregoing description of the invention in terms of embodiments foreseen by the inventors is intended to provide a useful description, while insubstantial modifications of the invention not presently foreseen may still represent equivalent modifications of the invention.

Claims (8)

1. The cross-screen real-time communication interaction method taking large-screen display as a center is characterized by comprising the following steps of:

s100, a sending end selects an information receiving object;

s200, the sending end sends data information to the platform end and displays a thumbnail of one-dimensional information or two-dimensional information contained in the sent data information;

s300, after the platform receives the data information, the platform checks the validity of the received data information, if illegal contents are monitored, the sending process is stopped, illegal reminding of the sent contents and reminding of sending failure are returned to the sending end, and if the illegal contents pass the validity check, the platform goes to the step S400;

s400, if the content contract rule is adopted, the data information is stored in a storage medium of the platform end, and meanwhile, a successful sending message is returned to a sending end for sending the data information;

s500, the platform terminal analyzes the information receiving object in the data information, judges whether the contact person of the information receiving object is online, transmits the data information to the information receiving terminal corresponding to the online receiving object if the contact person of the information receiving object is online, and enters the step S700; if the contact of the information receiving object is off-line, the step S600 is carried out;

s600, when the contact person of the information receiving object is monitored to be offline, the data information is suspended, meanwhile, an object online monitoring process is started, and until the contact person of the information receiving object is monitored to be online, the data information is transmitted to an information receiving end corresponding to the online receiving object;

s700, the platform terminal generates a thumbnail of the data information and sends the thumbnail of the data information to the information receiving terminal, and the information receiving terminal receives the thumbnail of the data information and then carries out information reminding;

s800, when the information receiving end displays a thumbnail of the data information and requests a platform end to download a clear view of the data information, the platform end generates the clear view of the data information and sends the clear view of the data information to the information receiving end, and the information receiving end replaces the thumbnail of the data information after downloading the clear view of the data information to display the clear view of the data information and synchronously stores the clear view of the data information in a cache; when the information receiving end checks the data information again, the cache is checked first, if the clear view of the data information exists, the clear view of the data information in the cache is read, and if the clear view of the data information does not exist, the clear view of the data information is downloaded from the platform end;

s900, the information receiving end sends the information receiving completion receipt to the platform end, and the platform end receives the information receiving completion receipt, changes the information state and completes the whole information sending and receiving process.

2. The method according to claim 1, wherein in S100, the information receiving object includes any one or more of a group consisting of one or more mobile end users, one or more OTT large-screen terminals, and a combination of a mobile end and an OTT large-screen end.

3. The cross-screen real-time communication interaction method centered on large-screen display according to claim 1, wherein in S200, the data information includes any one of input text content, picture content, video content, audio content, instant-entry voice content, and instant-taken audio/video content, wherein the input text content, the instant-entry voice content, and the instant-taken audio/video content can only occur one at a time, and a plurality of files can be selected at a time when the selected file is sent.

4. The method for cross-screen real-time communication interaction centered on large-screen display of claim 1, wherein in S100, the step of the sender selecting the information receiving object further comprises the steps of:

s101, entering a two-dimensional rich media content editing interface; wherein the two-dimensional rich media comprises information of animation, sound, video or interactivity;

s102, selecting and editing cover content to obtain two-dimensional rich media theme cover content; selecting cover content refers to selecting one of input text content, picture content, video content, audio content, input voice content and real-time shot audio and video content as two-dimensional rich media cover content;

s103, confirming the selected or edited two-dimensional rich media cover content, wherein the confirmed cover content is the first-dimensional content of the two-dimensional rich media, namely one-dimensional information;

s104, selecting second-dimension content in the two-dimension rich media, wherein the second-dimension content can be a combination of one or more pictures, one or more videos, one or more audios and one or more type files in one or more PDF documents;

s105, editing, sorting and sequencing the selected second-dimension content;

s106, confirming the whole two-dimensional rich media content, and forming a two-dimensional rich media information set at the mobile terminal, wherein the two-dimensional rich media information set is two-dimensional information;

s107, compressing the pictures and the video documents in the two-dimensional information to generate thumbnails;

s108, taking a data set of the two-dimensional rich media as data information, wherein the data information comprises a two-dimensional rich media data structure document, a cover file, a thumbnail file and a two-dimensional file package; the two-dimensional rich media data structure document comprises contact information and two-dimensional information structure content; the two-dimensional information structure content comprises a cover page content record, text content, a thumbnail size, a thumbnail name and the like.

5. The cross-screen real-time communication interaction method based on large-screen display as a center according to claim 1, wherein in S200, the step of sending the data information to the platform end by the sending end further comprises the steps of:

s201, performing picture processing on the content of the data information, generating a silhouette thumbnail for the picture and the video, and correspondingly generating a default icon for the text file;

s202, displaying a to-be-sent animation on an interface of a sending end;

s203, adding the content of the data information into a sending queue to wait for sending;

s204, sending the content of the data information one by one according to the sequence of the sending queue, and sending a notice to an information receiving object when the content starts to be sent;

s205, when receiving the sending notice, stopping waiting for sending the animation and displaying the sending progress;

s206, judging whether the content in the transmission queue is successfully transmitted or not, and if the transmission is unsuccessful, returning a transmission unsuccessful notification;

s207, when receiving the transmission unsuccessful notification, displaying the transmission failure and displaying the re-transmission button identification;

s208, if the transmission is successful, checking whether the transmission of the transmitted content is completed, and if the transmission is completed, transmitting the next content in the queue according to the sequence of the transmission queue;

s209, if the transmission is completed, returning a transmission completion notice and displaying that the information transmission is successful.

6. The method for cross-screen real-time communication interaction centered on large-screen display as claimed in claim 1, wherein in S800, all received information is browsed, wherein the browsing is a piece of information that automatically plays the received information, and the content can be switched from left to right through a remote controller.

7. The cross-screen real-time communication interaction method taking large-screen display as a center according to claim 1, wherein the information receiving end can be one or more mobile ends, an OTT large-screen end corresponding to the one or more mobile ends, or a combination of the plurality of mobile ends and the OTT large-screen end corresponding to the plurality of mobile ends, and the OTT large-screen end refers to a terminal device which can display on a large screen, such as an intelligent television, an intelligent projection or an intelligent set-top box, and the like, and is provided with an OTT large-screen APP; the mobile terminal can be an information sending party or an information receiving party; the OTT large screen end can only be an information receiver corresponding to the mobile end.

8. A cross-screen real-time communication interactive system taking large-screen display as a center is characterized by comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, the processor executing the computer program to run in the units of the following system:

a receiving object selection unit, which is used for the sending end to select the information receiving object;

the information sending unit is used for sending data information to the platform end by the sending end and displaying a thumbnail of one-dimensional information or two-dimensional information contained in the sent data information;

the legality checking unit is used for checking the legality of the received data information after the platform end receives the data information, stopping a sending process and returning illegal sending content reminding and sending failure reminding to a sending end if illegal content is monitored, and transferring to the information storage unit if the illegal content passes the legality checking;

the information storage unit is used for storing the data information in a storage medium of the platform end if the content contract rule is satisfied, and simultaneously returning a successful sending message to a sending end for sending the data information;

the online judging unit is used for analyzing the information receiving object in the data information by the platform end, judging whether the contact person of the information receiving object is online or not, and if the contact person of the information receiving object is online, transmitting the data information to the information receiving end corresponding to the online receiving object and entering the information receiving unit; if the contact of the information receiving object is offline, entering an offline detection unit;

the offline detection unit is used for suspending the data information when the contact person monitoring the information receiving object is offline, starting an object online monitoring process at the same time, and transmitting the data information to an information receiving end corresponding to the online receiving object when the contact person monitoring the information receiving object is online;

the information receiving unit is used for generating a thumbnail of data information by the platform end and sending the thumbnail of the data information to the information receiving end, and the information receiving end receives the thumbnail of the data information and then carries out information reminding;

the clear view downloading unit is used for generating a clear view of the data information and sending the clear view of the data information to the information receiving end when the information receiving end displays the thumbnail of the data information and requests the platform end to download the clear view of the data information, and the information receiving end replaces the thumbnail of the data information after downloading the clear view of the data information so as to display the clear view of the data information and synchronously stores the clear view of the data information in a cache; when the information receiving end checks the data information again, the cache is checked first, if the clear view of the data information exists, the clear view of the data information in the cache is read, and if the clear view of the data information does not exist, the clear view of the data information is downloaded from the platform end;

and the information receiving completion unit is used for sending the information receiving completion receipt to the platform end by the information receiving end, and the platform end receives the information receiving completion receipt, changes the information state and completes the whole information sending and receiving process.

Images