CN108632376B - A data processing method, terminal, server and computer storage medium - Google Patents

Abstract

The embodiment of the invention discloses a data processing method, a terminal, a server and a computer storage medium. The method comprises the following steps: obtaining three-dimensional image data; and extracting key data associated with a transmission algorithm from the three-dimensional image data, and sending the key data.

Description

A data processing method, terminal, server and computer storage medium

technical field

The present invention relates to data processing technology, in particular to a data processing method, terminal, server and computer storage medium.

Background technique

With the continuous development of the mobile communication network, the transmission rate of the mobile communication network is rapidly increasing, thus providing strong technical support for the generation and development of the 3D video service. The three-dimensional video data includes two-dimensional image data (eg, RGB data) and depth data (Depth data), and the transmission of the three-dimensional video data is to transmit the two-dimensional video data and the depth data respectively. During the transmission of 3D video data, due to various reasons (such as packet loss), the respectively transmitted 2D video data and depth data cannot be kept aligned all the time, so that the 2D video data and depth data received by the receiver end in After synthesis, there will be problems such as inconsistency with the original data, image reconstruction errors, and unrecognized image content.

SUMMARY OF THE INVENTION

In order to solve the existing technical problems, the embodiments of the present invention provide a data processing method, a terminal, a server and a computer storage medium.

In order to achieve the above-mentioned purpose, the technical scheme of the embodiment of the present invention is realized as follows:

An embodiment of the present invention provides a data processing method, which is applied to a terminal; the method includes:

obtaining three-dimensional video data including at least depth data;

The key data associated with the transmission algorithm is extracted from the three-dimensional video data, and the key data is sent according to the transmission algorithm.

In the above solution, after the three-dimensional video data is obtained, the method further includes:

determining the first configuration information;

Then, extracting the key data associated with the transmission algorithm from the 3D video data and sending the key data includes: extracting the key data associated with the transmission algorithm from the 3D video data according to the first configuration information. The key data is sent according to the transmission algorithm.

In the above solution, after the three-dimensional video data is obtained, the method further includes:

determining the second configuration information;

Then the method further includes: dividing the 3D video data, and sending the divided 3D video data according to the second configuration information.

In the above solution, the dividing the 3D video data and sending the divided 3D video data according to the second transmission mode includes:

dividing the 3D video data into a plurality of 3D video data blocks, and each 3D video data block in the plurality of 3D video data blocks carries tag information;

The plurality of three-dimensional video data blocks are respectively sent.

In the above solution, the three-dimensional video data includes two-dimensional video data and depth data; the three-dimensional video data is divided, and the divided three-dimensional video data is sent according to the second transmission mode, including:

dividing the two-dimensional video data into at least two sub-two-dimensional video data, and dividing the depth data into at least two sub-depth data;

The at least two sub-2D video data and the at least two sub-depth data are respectively sent.

In the above solution, determining the configuration information includes: detecting the first parameter of the transmission channel;

Based on the first parameter, the pre-configured mapping relationship between multiple groups of parameters and configuration information is queried, and first configuration information or second configuration information matching the first parameter is obtained.

In the above solution, the obtaining of 3D video data including at least depth data includes:

The terminal obtains three-dimensional video data from an acquisition component capable of at least acquiring depth data; the acquisition component can establish a communication link with at least one terminal to enable the corresponding terminal to acquire the three-dimensional video data.

The embodiment of the present invention also provides a data processing method, which is applied to a mobile edge computing (MEC) server; the method includes:

receive key data associated with the transmission algorithm;

analyze the key data to obtain an analysis result;

The pre-received depth data and two-dimensional video data are synthesized into three-dimensional video data based on the analysis result.

In the above scheme, the analysis of the key data to obtain the analysis result includes:

Obtain the variation of the key data received within the receiving time interval, and determine whether the variation of the key data exceeds a preset threshold; or,

Analyze whether the key data received within the receiving time interval is continuous;

Correspondingly, the analysis result indicates that the stability of the key data does not meet the preset stability requirements, including: when the change of the key data exceeds a preset threshold, or the key data received within the receiving time interval is discontinuous. , indicating that the stability of the key data does not meet the preset stability requirements.

In the above solution, the method further includes: when the analysis result indicates that the stability of the key data does not meet a preset stability requirement, determining the 3D video data corresponding to the key data, and discarding the 3D video data.

In the above solution, the method further includes: respectively receiving the divided 3D video data, and combining the divided 3D video data into 3D video data according to a preset algorithm.

In the above solution, the step of respectively receiving the divided 3D video data includes: respectively receiving a plurality of 3D video data blocks; each 3D video data block in the plurality of 3D video data blocks carries label information;

Correspondingly, merging the divided 3D video data into 3D video data according to a preset algorithm includes: according to a preset algorithm, based on that each 3D video data block in the plurality of 3D video data blocks carries tag information, merge the data into the 3D video data. The plurality of 3D video data blocks are combined into 3D video data.

In the above solution, receiving the divided 3D video data respectively includes: respectively receiving at least two sub-2D video data and at least two sub-depth data;

Correspondingly, merging the divided 3D video data into 3D video data according to a preset algorithm includes: merging the at least two sub-2D video data and the at least two sub-depth data into 3D video data according to a preset algorithm.

An embodiment of the present invention further provides a terminal, where the terminal includes: an acquisition unit, an extraction unit, and a first communication unit; wherein,

The obtaining unit is used to obtain at least three-dimensional video data including depth data;

The extracting unit is configured to extract key data associated with the transmission algorithm from the three-dimensional video data obtained by the acquiring unit.

The first communication unit is configured to send the key data according to the transmission algorithm.

In the above solution, the terminal further includes a determining unit for determining the first configuration information;

the extracting unit, configured to extract key data associated with the transmission algorithm from the 3D video data according to the first configuration information determined by the determining unit;

The first communication unit is configured to send the key data according to the transmission algorithm.

In the above solution, the terminal further includes a determining unit and a dividing unit; wherein,

the determining unit, configured to determine the second configuration information;

the segmentation unit, configured to segment the 3D video data;

The first communication unit is configured to send the divided three-dimensional video data according to the second configuration information determined by the determining unit.

In the above solution, the dividing unit is used to divide the 3D video data into multiple 3D video data blocks, and each 3D video data block in the multiple 3D video data blocks carries label information;

The first communication unit is configured to send the multiple 3D video data blocks respectively.

In the above scheme, the three-dimensional video data includes two-dimensional video data and depth data;

the dividing unit, configured to divide the two-dimensional video data into at least two sub-two-dimensional video data, and divide the depth data into at least two sub-depth data;

The first communication unit is configured to send the at least two sub-2D video data and the at least two sub-depth data respectively.

In the above solution, the terminal further includes a detection unit for detecting the first parameter of the transmission channel;

The determining unit is configured to query the mapping relationship between multiple groups of parameters and configuration information preconfigured based on the first parameter obtained by the detection unit, and obtain first configuration information or second configuration matching the first parameter information.

In the above solution, the first communication unit is further configured to obtain 3D video data from an acquisition component capable of at least acquiring depth data; the acquisition component can establish a communication link with at least one terminal so that the corresponding terminal can obtain the 3D video data.

An embodiment of the present invention further provides an MEC server, where the server includes: a second communication unit, an analysis and processing unit, and a merging unit; wherein,

the second communication unit for receiving key data associated with the transmission algorithm;

the analysis and processing unit, configured to analyze the key data received by the second communication unit to obtain an analysis result;

The combining unit is configured to combine the pre-received depth data and the two-dimensional video data into three-dimensional video data based on the analysis result obtained by the analysis and processing unit.

In the above solution, the analysis and processing unit is used to obtain the change amount of the key data received within the receiving time interval, and determine whether the change amount of the key data exceeds a preset threshold; or, analyze the received data within the receiving time interval. Whether the key data is continuous; when the variation of the key data exceeds a preset threshold, or the key data received within the receiving time interval is discontinuous, it indicates that the stability of the key data does not meet the preset stability requirements.

In the above solution, the server further includes a discarding processing unit, configured to determine the 3D corresponding to the key data when the analysis result obtained by the analysis processing unit indicates that the stability of the key data does not meet the preset stability requirement. video data, discarding the 3D video data.

In the above solution, the second communication unit is further configured to respectively receive the divided 3D video data;

The combining unit is configured to combine the divided 3D video data received by the second communication unit into 3D video data according to a preset algorithm.

In the above solution, the second communication unit is configured to respectively receive a plurality of 3D video data blocks; each 3D video data block in the plurality of 3D video data blocks carries label information;

The merging unit is configured to merge the plurality of 3D video data blocks into 3D video data according to a preset algorithm based on the flag information carried by each 3D video data block in the plurality of 3D video data blocks.

In the above solution, the second communication unit is configured to receive at least two sub-2D video data and at least two sub-depth data respectively;

The combining unit is configured to combine the at least two sub-2D video data and the at least two sub-depth data into three-dimensional video data according to a preset algorithm.

The embodiments of the present invention further provide a computer storage medium, which stores computer instructions, and when the instructions are executed by the processor, implements the steps of the data processing method applied to the terminal described in the embodiments of the present invention; or, the instructions are When executed by the processor, the steps of the data processing method applied to the MEC server according to the embodiment of the present invention are implemented.

An embodiment of the present invention further provides a terminal, including a memory, a processor, and a computer program stored in the memory and running on the processor, where the processor implements the application described in the embodiment of the present invention when the processor executes the program The steps of the data processing method for the terminal.

An embodiment of the present invention further provides an MEC server, including a memory, a processor, and a computer program stored in the memory and running on the processor, where the processor implements the method described in the embodiments of the present invention when the processor executes the program. Steps of the data processing method applied to the MEC server.

The data processing method, terminal, server, and computer storage medium provided by the embodiments of the present invention, the method applied to the terminal includes: obtaining three-dimensional video data including at least depth data; The key data is sent according to the transmission algorithm. The method applied to the server includes: receiving key data associated with a transmission algorithm; analyzing the key data to obtain an analysis result; and synthesizing pre-received depth data and two-dimensional video data into three-dimensional video data based on the analysis result. By adopting the technical solution of the embodiment of the present invention, the terminal sends the key data associated with the transmission algorithm, so that the server performs analysis and processing according to the key data, and uses a specific processing method to synthesize the two-dimensional video data and the depth data based on the analysis result, It avoids problems such as image reconstruction errors and unrecognizable image content due to abnormal transmission or data loss during the transmission process of 3D video data. To a certain extent, it also improves data transmission efficiency and service quality by avoiding data retransmission. Improved user experience.

Description of drawings

1 is a schematic diagram of a system architecture to which a data processing method according to an embodiment of the present invention is applied;

2 is a schematic flowchart of a data processing method according to an embodiment of the present invention;

3 is another schematic flowchart of a data processing method according to an embodiment of the present invention;

FIG. 4 is a schematic diagram of a composition structure of a terminal according to an embodiment of the present invention;

5 is a schematic diagram of another composition structure of a terminal according to an embodiment of the present invention;

6 is a schematic diagram of another composition structure of a terminal according to an embodiment of the present invention;

7 is a schematic diagram of a composition structure of a server according to an embodiment of the present invention;

FIG. 8 is a schematic diagram of another composition structure of a server according to an embodiment of the present invention;

FIG. 9 is a schematic structural diagram of a hardware composition of a data processing device according to an embodiment of the present invention.

Detailed ways

Before the technical solutions of the embodiments of the present invention are described in detail, the system architecture to which the data processing methods of the embodiments of the present invention are applied is briefly described first. The data processing method of the embodiment of the present invention is applied to a service related to 3D video data, such as a service of sharing 3D video data, or a live broadcast service based on 3D video data, and the like. In this case, due to the large amount of 3D video data, the depth data and 2D video data transmitted respectively require high technical support in the data transmission process, so the mobile communication network needs to have a faster data transmission rate , and a more stable data transmission environment.

1 is a schematic diagram of a system architecture of an application of a data processing method according to an embodiment of the present invention; as shown in FIG. 1 , the system may include a terminal, a base station, a Mobile Edge Computing (MEC, Mobile Edge Computing) server, a service processing server, a core network, and the Internet (Internet), etc.; establish a high-speed channel between the MEC server and the business processing server through the core network to achieve data synchronization.

Taking the application scenario of the interaction between two terminals shown in Figure 1 as an example, the MEC server A is the MEC server deployed near the terminal A (sender), and the core network A is the core network in the area where the terminal A is located; correspondingly, the MEC server B is the MEC server deployed near the terminal B (receiving end), and the core network B is the core network in the area where the terminal B is located; Establish high-speed channels for data synchronization.

Wherein, after the 3D video data sent by terminal A is transmitted to MEC server A, MEC server A synchronizes the data to the service processing server through core network A; and then MEC server B obtains the 3D video data sent by terminal A from the service processing server, and sent to terminal B for presentation.

Here, if terminal B and terminal A realize transmission through the same MEC server, then terminal B and terminal A directly realize the transmission of 3D video data through an MEC server without the participation of the service processing server. This method is called local return method. Specifically, it is assumed that terminal B and terminal A transmit 3D video data through MEC server A. After the 3D video data sent by terminal A is transmitted to MEC server A, MEC server A sends the 3D video data to terminal B for presentation.

Here, the terminal may select an evolved base station (eNB) to access the 4G network, or a next-generation evolved base station (gNB) to access the 5G network based on the network conditions, or the configuration of the terminal itself, or an algorithm configured by itself, so that the The eNB is connected to the MEC server through a Long Term Evolution (LTE, Long Term Evolution) access network, so that the gNB is connected to the MEC server through a Next Generation Access Network (NG-RAN).

Here, the MEC server is deployed on the edge of the network close to the terminal or data source. The so-called close to the terminal or close to the data source is not only logically located, but also geographically close to the terminal or close to the data source. Different from the existing mobile communication network where the main service processing servers are deployed in several large cities, multiple MEC servers can be deployed in one city. For example, in an office building with many users, an MEC server can be deployed near the office building.

Among them, the MEC server, as an edge computing gateway with core capabilities of integrating network, computing, storage and application, provides platform support for edge computing including device domain, network domain, data domain and application domain. It connects various smart devices and sensors, provides smart connection and data processing services nearby, and allows different types of applications and data to be processed in the MEC server to achieve real-time business, business intelligence, data aggregation and interoperability, security and privacy protection, etc. Key intelligent services can effectively improve the efficiency of intelligent business decision-making.

The present invention will be described in further detail below with reference to the accompanying drawings and specific embodiments.

An embodiment of the present invention provides a data processing method, which is applied to a terminal, and the terminal may be a mobile terminal such as a mobile phone and a tablet computer, or a terminal of a type such as a computer. FIG. 2 is a schematic flowchart of a data processing method according to an embodiment of the present invention; as shown in FIG. 2 , the method includes:

Step 101: Obtain three-dimensional video data including at least depth data.

Step 102: Extract key data associated with a transmission algorithm from the 3D video data, and send the key data according to the transmission algorithm.

In this embodiment, as an implementation manner, the obtaining of 3D video data includes: the terminal obtains 3D video data from a collection component capable of collecting at least depth data; the collection component can establish a communication link with at least one terminal so that the corresponding terminal obtains the three-dimensional video data.

Specifically, in this embodiment, since the acquisition component capable of collecting depth data is relatively expensive, the terminal does not have the acquisition function of 3D video data, but collects 3D video data through the acquisition component independent of the terminal, and then collects the 3D video data through the acquisition component and The communication component in the terminal establishes a communication link, so that the terminal obtains the three-dimensional video data collected by the collecting component. Wherein, the acquisition component can be specifically implemented by at least one of the following: a depth camera, a binocular camera, a 3D structured light camera module, and a Time Of Flight (TOF, Time Of Flight) camera module.

Here, the collection component can establish a communication link with at least one terminal to transmit the collected 3D video data to the at least one terminal, so that the corresponding terminal can obtain the 3D video data, so that the 3D video data collected by one collection component can be shared. To at least one terminal, so as to realize the sharing of acquisition components.

As another embodiment, the terminal itself has the function of collecting 3D video data. It can be understood that the terminal is provided with a collection component capable of collecting depth data at least, for example, at least one of the following components is provided: a depth camera, a binocular camera, a 3D structure Optical camera module and TOF camera module to collect 3D video data.

Wherein, the obtained three-dimensional video data includes two-dimensional video data and depth data; the two-dimensional video data is used to represent a plane image, such as RGB data; distance between.

In this embodiment, the terminal extracts the key data associated with the transmission algorithm from the 3D video data, which may specifically include: the terminal extracts the key data associated with the transmission algorithm from the 3D video data according to a preset sending interval data, and use the transmission algorithm to send the key data according to the preset sending interval.

Here, the key data is the data associated with the transmission algorithm; in the process of using the transmission algorithm to transmit data, the stability of the key data usually does not meet the preset stability requirement. It can be understood that the key data is prone to errors in the process of transmission using this transmission algorithm, that is, the key data is sensitive data and data with poor stability. For example, in the process of data transmission using the H.265 coding standard, the probability of error in the depth data is high, that is, the stability of the depth data does not meet the preset stability requirement. For another example, in the process of using a coding standard to transmit data, the probability of errors occurring in the two-dimensional video data is relatively high, and the two-dimensional video data can be used as key data. For another example, in the transmission process using another coding standard, the probability of error in the time axis data is relatively high, and the time axis data can be used as the key data.

Wherein, the key data may also be the change amount of the data whose stability does not meet the preset stability requirement during the transmission process using the transmission algorithm. If the stability of the depth data does not meet the preset stability requirement, the key data may be the variation of two adjacent depth data.

In an embodiment, the method further comprises: sending the 3D video data according to the transmission algorithm. It can be understood that in addition to sending key data, the terminal also needs to send the obtained 3D video data.

In one embodiment, after obtaining the 3D video data, the method further includes: determining first configuration information; then extracting key data associated with the transmission algorithm from the 3D video data, and sending the The key data includes: extracting key data associated with a transmission algorithm from the 3D video data according to the first configuration information, and sending the key data according to the transmission algorithm.

In another embodiment, after obtaining the 3D video data, the method further includes: determining second configuration information; then the method further includes: dividing the 3D video data, according to the second configuration information The divided three-dimensional video data is sent.

Specifically, in this embodiment, there are at least two configuration modes, and each configuration mode corresponds to corresponding data transmission content and mode. For example, the first configuration mode is used to instruct the sending of key data, and the second configuration mode is used to instruct the transmission of all data, but the divided data is sent by the method of dividing the data in this embodiment, so as to reduce the data of each data transmission quantity. The two configuration modes can be implemented by the first configuration information and the second configuration information. After the first configuration information is determined, the first configuration mode is determined to be selected; correspondingly, after the second configuration information is determined, the second configuration mode is determined to be selected. configuration method.

In this embodiment, as an implementation manner, determining the configuration information includes: detecting the first parameter of the transmission channel; querying the mapping relationship between the pre-configured groups of parameters and the configuration information based on the first parameter, and obtaining the mapping relationship with the first parameter. A parameter matches the first configuration information or the second configuration information.

Specifically, the terminal is pre-configured with multiple sets of parameters and the mapping relationship of the configuration information; wherein the parameters may represent parameters of the transmission channel, for example, may include bandwidth; it can be understood that the parameters may represent the current network environment. In this embodiment, the configuration information is adaptively selected based on the detected parameters, and the first configuration information is selected when the network environment is good; the second configuration information is selected when the network environment is poor to reduce the amount of data sent each time.

As another implementation manner, the configuration information may be determined by manual configuration, for example, the first configuration information or the second configuration information is selected by manual configuration for data processing.

In this embodiment, after the second configuration information is determined, as an implementation manner, the dividing the 3D video data and sending the divided 3D video data according to the second transmission mode includes: dividing the 3D video data into The 3D video data is divided into a plurality of 3D video data blocks, and each 3D video data block in the plurality of 3D video data blocks carries label information; the plurality of 3D video data blocks are sent respectively.

Specifically, each 3D video data can be divided into a plurality of 3D video data blocks, for example, divided into N*N 3D video data blocks, each 3D video data block carries a corresponding mark, and the mark is used to represent each 3D video data block. The location of the video data block is convenient for subsequent merging processing. Further, multiple 3D video data blocks are respectively sent, for example, the first 3D video data block is sent at time T0, the second 3D video data block is sent at time T1, and so on.

As another implementation manner, the 3D video data includes 2D video data and depth data; the dividing the 3D video data, and sending the divided 3D video data according to the second transmission mode, including : dividing the two-dimensional video data into at least two sub-two-dimensional video data, dividing the depth data into at least two sub-depth data; respectively sending the at least two sub-two-dimensional video data and the at least two sub-depth data .

Specifically, the two-dimensional video data and depth data included in the three-dimensional video data may be divided into at least two sub-two-dimensional video data and at least two sub-depth data, respectively. Taking dividing the 2D video data and the depth data into two sub-2D video data as an example, the division method can be up-down division or left-right division, but is not limited to the above two division methods. Taking the upper and lower segmentation methods as an example, the two-dimensional video data and the depth data are equally divided into upper and lower parts of data, and the left and right segmentation methods are similar, which will not be repeated here. Further, at least two sub-two-dimensional video data and at least two sub-depth data are respectively sent. For example, taking the two-dimensional video data and depth data as an example of dividing the two-dimensional video data and depth data into two sub-two-dimensional video data and two depth sub-data respectively, at time T0, the first two-dimensional video sub-data is sent, and at time T1, the second two-dimensional video data is sent. Two-dimensional video sub-data, the first sub-depth data is sent at time T2, and the second sub-depth data is sent at time T3.

By adopting the technical solution of the embodiment of the present invention, the terminal sends the key data associated with the transmission algorithm, so that the server performs analysis and processing according to the key data, and uses a specific processing method to synthesize the two-dimensional video data and the depth data based on the analysis result, It avoids problems such as image reconstruction errors and unrecognizable image content due to abnormal transmission or data loss during the transmission process of 3D video data. To a certain extent, it also improves data transmission efficiency and service quality by avoiding data retransmission. Improved user experience.

Correspondingly, an embodiment of the present invention further provides a data processing method, which is applied to a server, and the server is specifically the MEC server shown in FIG. 1 . FIG. 3 is a schematic flowchart of a data processing method according to Embodiment 2 of the present invention; as shown in FIG. 3 , the method includes:

Step 201: Receive key data associated with the transmission algorithm.

Step 202: Analyze the key data to obtain an analysis result.

Step 203: Synthesize the pre-received depth data and the two-dimensional video data into three-dimensional video data based on the analysis result.

In this embodiment, the key data is the data associated with the transmission algorithm; in the process of using the transmission algorithm to transmit data, the stability of the key data usually does not meet the preset stability requirement. It can be understood that the key data is prone to errors in the process of transmission using this transmission algorithm, that is, the key data is sensitive data and data with poor stability. For example, in the process of data transmission using the H.265 coding standard, the probability of error in the depth data is high, that is, the stability of the depth data does not meet the preset stability requirement. For another example, in the process of using a coding standard to transmit data, the probability of errors occurring in the two-dimensional video data is relatively high, and the two-dimensional video data can be used as key data. For another example, in the transmission process using another coding standard, the probability of error in the time axis data is relatively high, and the time axis data can be used as the key data.

Wherein, the key data may also be the change amount of the data whose stability does not meet the preset stability requirement during the transmission process using the transmission algorithm. If the stability of the depth data does not meet the preset stability requirement, the key data may be the variation of two adjacent depth data.

In this embodiment, the analyzing the key data to obtain the analysis result includes: obtaining the change amount of the key data received within the receiving time interval, and judging whether the change amount of the key data exceeds a preset threshold; or, analyzing Whether the key data received within the receiving time interval is continuous;

Correspondingly, the analysis result indicates that the stability of the key data does not meet the preset stability requirements, including: when the change of the key data exceeds a preset threshold, or the key data received within the receiving time interval is discontinuous. , indicating that the stability of the key data does not meet the preset stability requirements.

Specifically, taking the key data as the depth data as an example, the server analyzes the change of two adjacent depth data, or analyzes the change of the depth data received in one receiving interval; Whether the subsequent depth data is abnormal; if the change exceeds the preset threshold, it can be determined that the subsequent depth data is abnormal; or whether the change of the depth data in a receiving interval obtained by analysis satisfies a specific law to determine the receiving interval. Whether at least some of the depth data of .

Or, the server analyzes whether the key data received within the receiving time interval is continuous. The so-called continuity indicates whether the key data received during the receiving time interval is missing. For example, key data is received at T0 time, but key data is not received at T1 time. Key data is received at time T2, which indicates that the received key data is discontinuous. The server analyzes and determines that the received key data is discontinuous within the receiving time interval, or determines that the number of discontinuous key data within the receiving time interval exceeds a preset threshold, which may indicate that the stability of the key data does not meet the preset stability requirement.

In this embodiment, the server performs synthesis processing on the pre-received depth data and the 2D video data by using a specific processing method based on the analysis result of the key data, and synthesizes the 3D video data.

As an embodiment, the method further includes: when the analysis result indicates that the stability of the key data does not meet a preset stability requirement, determining the 3D video data corresponding to the key data, and discarding the 3D video data.

In this embodiment, when the analysis result indicates that the stability of the key data does not meet the preset stability requirement, the 3D video data corresponding to the key data is determined. For example, if the stability of the key data corresponding to the time T0-T1 is stable If the stability does not meet the preset stability requirement, the 3D video data corresponding to time T0-T1 is discarded.

Wherein, the three-dimensional video data is obtained by the server from the terminal in advance, and in an embodiment, the method further includes: the server receives the three-dimensional video data.

In this embodiment, the server may use a preset convolution algorithm to process the depth data and the two-dimensional image data to be combined, so as to optimize the image quality. Especially in the case where the depth data is partially lost during transmission, the preset convolution algorithm can play a role in smoothing the data. Of course, in other embodiments, interpolation fitting and other methods may also be used to smooth the three-dimensional image data of the missing frame data.

Based on the foregoing embodiments, the terminal has at least two configuration modes, and each configuration mode corresponds to corresponding data transmission content and mode. For example, the first configuration mode is used to instruct the sending of key data, and the second configuration mode is used to instruct the transmission of all data, but the divided data is sent by the method of dividing the data in this embodiment, so as to reduce the data of each data transmission quantity. Then, the above technical solution in this embodiment uses the first configuration information for data processing and transmission for the terminal.

Correspondingly, in an embodiment, when the terminal uses the second configuration information for data processing and transmission, the method further includes: respectively receiving the divided 3D video data, and dividing the divided 3D video data according to a preset algorithm. The data is merged into 3D video data.

As an embodiment, the separately receiving the divided 3D video data includes: respectively receiving a plurality of 3D video data blocks; each 3D video data block in the plurality of 3D video data blocks carries label information;

Correspondingly, merging the divided 3D video data into 3D video data according to a preset algorithm includes: according to a preset algorithm, based on that each 3D video data block in the plurality of 3D video data blocks carries tag information, merge the data into the 3D video data. The plurality of 3D video data blocks are combined into 3D video data.

Specifically, the terminal divides each 3D video data into multiple 3D video data blocks and transmits them respectively. Correspondingly, the server receives the multiple 3D video data blocks respectively. For example, the first 3D video data block is received at time T0, The second block of 3D video data is received at time T1, and so on. Wherein, each 3D video data block carries a mark, and the mark is used to indicate the position of each 3D video data block. After receiving all the 3D video data blocks for one 3D video data, the server can The tags carried by the video data blocks combine all the 3D video data blocks to reconstruct the 3D video data.

As another implementation manner, the separately receiving the divided 3D video data includes: respectively receiving at least two sub-2D video data and at least two sub-depth data;

Correspondingly, merging the divided 3D video data into 3D video data according to a preset algorithm includes: merging the at least two sub-2D video data and the at least two sub-depth data into 3D video data according to a preset algorithm.

Specifically, the terminal divides the two-dimensional video data and depth data in each three-dimensional video data into at least two sub-two-dimensional video data and at least two sub-depth data, and transmits them respectively, and the server receives the at least two sub-two-dimensional video data respectively. and at least two sub-depth data. For example, taking the two-dimensional video data and depth data as an example of dividing the two-dimensional video data and depth data into two sub-two-dimensional video data and two depth sub-data respectively, at time T0, the first two-dimensional video sub-data is received, and at time T1, the first two-dimensional video sub-data is received. For the second two-dimensional video sub-data, at time T2, the first sub-depth data is received, and at time T3, the second sub-depth data is received. Further, the server combines the received at least two sub-two-dimensional video data and at least two sub-depth data to reconstruct the three-dimensional video data.

In this embodiment, the splitting manner of the 3D video data of the terminal and the combining manner of the split 3D video data by the server may be pre-configured in the manner of pre-agreed or signaling instruction.

In this embodiment, the server receives the divided 3D video data in batches, and combines the divided 3D video data into 3D video data. Wherein, as an implementation manner, the server may extract and analyze key data for the received divided 3D video data, and identify whether the stability of the extracted key data meets the preset stability requirements, and if the stability of the extracted key data does not meet the preset stability requirements, In the case of meeting the performance requirements, other segmented 3D video data related to the segmented 3D video data are discarded, that is, other segmented 3D video data belonging to the same 3D video data as the segmented 3D video data are discarded. As another implementation manner, the server may extract and analyze key data for the merged 3D video data, and identify whether the stability of the extracted key data meets the preset stability requirement. In this case, the merged 3D video data is discarded.

By adopting the technical solution of the embodiment of the present invention, the terminal sends the key data associated with the transmission algorithm, so that the server performs analysis and processing according to the key data, and uses a specific processing method to synthesize the two-dimensional video data and the depth data based on the analysis result, It avoids problems such as image reconstruction errors and unrecognizable image content due to abnormal transmission or data loss during the transmission process of 3D video data. To a certain extent, it also improves data transmission efficiency and service quality by avoiding data retransmission. Improved user experience.

To implement the method on the terminal side of the embodiment of the present invention, the embodiment of the present invention further provides a terminal. FIG. 4 is a schematic diagram of a composition structure of a terminal according to an embodiment of the present invention; as shown in FIG. 4 , the terminal includes: an acquisition unit 31, an extraction unit 32 and a first communication unit 33; wherein,

The obtaining unit 31 is used to obtain at least three-dimensional video data including depth data;

The extracting unit 32 is configured to extract key data associated with the transmission algorithm from the three-dimensional video data obtained by the acquiring unit 31 .

The first communication unit 33 is configured to send the key data according to the transmission algorithm.

In an embodiment, as shown in FIG. 5 , the terminal further includes a determining unit 34, configured to determine the first configuration information;

The extraction unit 32 is configured to extract key data associated with the transmission algorithm from the 3D video data according to the first configuration information determined by the determination unit 34;

The first communication unit 33 is configured to send the key data according to the transmission algorithm.

In an embodiment, as shown in FIG. 6 , the terminal further includes a determining unit 34 and a dividing unit 35; wherein,

the determining unit 34, configured to determine the second configuration information;

The dividing unit 35 is used to divide the three-dimensional video data;

The first communication unit 33 is configured to send the divided 3D video data according to the second configuration information determined by the determining unit 34 .

As an embodiment, the dividing unit 35 is configured to divide the 3D video data into a plurality of 3D video data blocks, and each 3D video data block in the plurality of 3D video data blocks carries tag information;

The first communication unit 33 is configured to send the multiple three-dimensional video data blocks respectively.

As another embodiment, the three-dimensional video data includes two-dimensional video data and depth data;

The dividing unit 35 is configured to divide the two-dimensional video data into at least two sub-two-dimensional video data, and divide the depth data into at least two sub-depth data;

The first communication unit 33 is configured to send the at least two sub-2D video data and the at least two sub-depth data respectively.

In an embodiment, the terminal further includes a detection unit for detecting the first parameter of the transmission channel;

The determining unit 34 is configured to query the mapping relationship between pre-configured multiple groups of parameters and configuration information based on the first parameter obtained by the detection unit, and obtain first configuration information or second configuration information matching the first parameter. configuration information.

In this embodiment, the first communication unit 33 is further configured to obtain 3D video data from an acquisition component capable of at least acquiring depth data; the acquisition component can establish a communication link with at least one terminal so that the corresponding terminal can obtain the 3D video data. 3D video data.

In this embodiment of the present invention, the extraction unit 32, the determination unit 34, and the segmentation unit 35 in the terminal can be implemented by a processor in the terminal, such as a central processing unit (CPU, Central Processing Unit), a digital signal, in practical applications. processor (DSP, Digital Signal Processor), Microcontroller Unit (MCU, Microcontroller Unit) or Programmable Gate Array (FPGA, Field-Programmable Gate Array), etc.; the first communication unit 33 in the terminal, in practical application can be realized through a communication module (including: basic communication suite, operating system, communication module, standardized interface and protocol, etc.) and a transceiver antenna; the acquisition unit 31 in the terminal can be realized through a stereo camera, binocular The camera or structured light camera can be realized, or it can be realized by the communication module (including: basic communication suite, operating system, communication module, standardized interface and protocol, etc.) and the transceiver antenna; the detection unit in the terminal can be realized by Processors such as CPU, DSP, MCU or FPGA are implemented in combination with communication modules.

It should be noted that: when the terminal provided in the above embodiment performs data processing, only the division of the above program modules is used as an example for illustration. The internal structure is divided into different program modules to complete all or part of the processing described above. In addition, the terminal and the data processing method embodiments provided by the above embodiments belong to the same concept, and the specific implementation process thereof is detailed in the method embodiments, which will not be repeated here.

Correspondingly, in order to implement the method on the server side of the embodiment of the present invention, the embodiment of the present invention further provides a server, specifically an MEC server. FIG. 7 is a schematic diagram of the composition structure of a server according to an embodiment of the present invention; as shown in FIG. 7 , the server includes: a second communication unit 41, an analysis and processing unit 42 and a merging unit 43; wherein,

The second communication unit 41 is used to receive key data associated with the transmission algorithm;

The analysis and processing unit 42 is configured to analyze the key data received by the second communication unit 41 to obtain an analysis result;

The combining unit 43 is configured to combine the pre-received depth data and the two-dimensional video data into three-dimensional video data based on the analysis result obtained by the analysis and processing unit.

In one embodiment, the analysis and processing unit 42 is configured to obtain the change amount of the key data received within the receiving time interval, and judge whether the change amount of the key data exceeds a preset threshold; or, analyze the change within the receiving time interval. Whether the received key data is continuous; when the variation of the key data exceeds a preset threshold, or the received key data is discontinuous within the receiving time interval, it indicates that the stability of the key data does not meet the preset stability requirements.

In one embodiment, as shown in FIG. 8 , the server further includes a discard processing unit 44 for when the analysis result obtained by the analysis processing unit 42 indicates that the stability of the key data does not meet the preset stability requirement When the 3D video data corresponding to the key data is determined, the 3D video data is discarded.

In one embodiment, the second communication unit 41 is further configured to respectively receive the divided 3D video data;

The combining unit 43 is configured to combine the divided three-dimensional video data received by the second communication unit 41 into three-dimensional video data according to a preset algorithm.

As an implementation manner, the second communication unit 41 is configured to respectively receive a plurality of 3D video data blocks; each 3D video data block in the plurality of 3D video data blocks carries tag information;

The merging unit 43 is configured to merge the plurality of 3D video data blocks into 3D video data according to a preset algorithm based on the flag information carried by each 3D video data block in the plurality of 3D video data blocks.

As another implementation manner, the second communication unit 41 is configured to respectively receive at least two sub-two-dimensional video data and at least two sub-depth data;

The combining unit 43 is configured to combine the at least two sub-two-dimensional video data and the at least two sub-depth data into three-dimensional video data according to a preset algorithm.

In this embodiment of the present invention, the analysis and processing unit 42, the discarding processing unit 44, and the merging unit 43 in the server may be implemented by a processor in the server, such as a CPU, DSP, MCU, or FPGA, in practical applications; The second communication unit 41 in the server can be implemented by a communication module (including: a basic communication suite, an operating system, a communication module, standardized interfaces and protocols, etc.) and a transceiver antenna in practical applications.

It should be noted that: when the server provided by the above embodiment performs data processing, only the division of the above program modules is used as an example for illustration. The internal structure is divided into different program modules to complete all or part of the processing described above. In addition, the server provided by the above embodiments and the data processing method embodiments belong to the same concept, and the specific implementation process is detailed in the method embodiments, which will not be repeated here.

Based on the hardware implementation of the above device, an embodiment of the present invention further provides a data processing device. FIG. 9 is a schematic diagram of a hardware structure of the data processing device according to an embodiment of the present invention. As shown in FIG. 9 , the data processing device includes a memory, a processing device and a computer program stored in the memory and running on the processor; as a first embodiment, when the data processing device is a terminal, when the processor located in the terminal executes the program, it realizes: obtaining a three-dimensional image including depth data at least Video data; extract key data associated with a transmission algorithm from the three-dimensional video data, and send the key data according to the transmission algorithm.

In one embodiment, when the processor located in the terminal executes the program, it realizes: after obtaining the 3D video data, first configuration information is determined; link key data, and send the key data according to the transmission algorithm.

In one embodiment, when the processor located in the terminal executes the program, it realizes: after obtaining the three-dimensional video data, determining the second configuration information; dividing the three-dimensional video data, and sending the divided data according to the second configuration information. the three-dimensional video data.

In one embodiment, when the processor located in the terminal executes the program, it realizes: dividing the 3D video data into a plurality of 3D video data blocks, and each 3D video data block in the plurality of 3D video data blocks carries There is tag information; the plurality of three-dimensional video data blocks are sent separately.

In one embodiment, when the processor located in the terminal executes the program, it realizes: dividing the two-dimensional video data into at least two sub-two-dimensional video data, dividing the depth data into at least two sub-depth data; sending the data separately; the at least two sub-two-dimensional video data and the at least two sub-depth data. Wherein, the three-dimensional video data includes two-dimensional video data and depth data.

In an embodiment, when the processor located in the terminal executes the program, it is implemented: based on the first parameter, query the mapping relationship between multiple groups of parameters and configuration information that are preconfigured, and obtain a first configuration matching the first parameter information or second configuration information.

In one embodiment, when the processor located in the terminal executes the program, it realizes: obtaining three-dimensional video data from an acquisition component capable of at least acquiring depth data; the acquisition component can establish a communication link with at least one terminal to enable the corresponding terminal to obtain the three-dimensional video data.

As a second implementation manner, when the data processing device is an MEC server, when the processor located in the server executes the program, it realizes: receiving key data associated with the transmission algorithm; analyzing the key data to obtain an analysis result; based on the The analysis result synthesizes the pre-received depth data and 2D video data into 3D video data.

In one embodiment, when the processor located in the terminal executes the program, it realizes: obtaining the variation of the key data received within the receiving time interval, and judging whether the variation of the key data exceeds a preset threshold; or, analyzing the received Whether the key data received within the time interval is continuous; when the variation of the key data exceeds the preset threshold, or the key data received within the receiving time interval is discontinuous, it indicates that the stability of the key data has not reached the preset stability sexual requirements.

In one embodiment, when the processor at the terminal executes the program, it is realized: when the analysis result indicates that the stability of the key data does not meet the preset stability requirement, determine the three-dimensional video data corresponding to the key data. , discarding the 3D video data.

In one embodiment, when the processor located in the terminal executes the program, it realizes: respectively receiving the divided 3D video data, and combining the divided 3D video data into 3D video data according to a preset algorithm.

In one embodiment, when the processor located in the terminal executes the program, it realizes: receiving a plurality of 3D video data blocks respectively; each 3D video data block in the plurality of 3D video data blocks carries label information; It is assumed that the algorithm combines the plurality of 3D video data blocks into 3D video data based on the flag information carried by each 3D video data block in the plurality of 3D video data blocks.

In one embodiment, when the processor located in the terminal executes the program, it realizes: respectively receiving at least two sub-two-dimensional video data and at least two sub-depth data; The two sub-depth data are merged into 3D video data.

It can be understood that the data processing device (terminal or server) also includes a communication interface; various components in the data processing device (terminal or server) are coupled together through a bus system. It can be understood that the bus system is used to realize the connection communication between these components. In addition to the data bus, the bus system also includes a power bus, a control bus and a status signal bus.

It can be understood that the memory in this embodiment may be a volatile memory or a non-volatile memory, and may also include both volatile and non-volatile memory. Among them, the non-volatile memory may be a read-only memory (ROM, ReadOnly Memory), a programmable read-only memory (PROM, Programmable Read-Only Memory), an erasable programmable read-only memory (EPROM, Erasable Programmable Read-Only Memory) Memory), Electrically Erasable Programmable Read-Only Memory (EEPROM, Electrically Erasable Programmable Read-Only Memory), Magnetic Random Access Memory (FRAM, ferromagnetic random access memory), Flash Memory, Magnetic Surface Memory, Optical disk, or Compact Disc Read-Only Memory (CD-ROM); the magnetic surface memory can be a magnetic disk memory or a magnetic tape memory. The volatile memory may be a random access memory (RAM, Random Access Memory), which is used as an external cache memory. By way of example and not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Synchronous Static Random Access Memory (SSRAM), Dynamic Random Access Memory Memory (DRAM, Dynamic Random Access Memory), Synchronous Dynamic Random Access Memory (SDRAM, SynchronousDynamic Random Access Memory), Double Data Rate Synchronous Dynamic Random Access Memory (DDRSDRAM, Double Data Rate Synchronous Dynamic Random Access Memory), Enhanced Synchronous Dynamic Random Access Memory (ESDRAM, Enhanced Synchronous Dynamic Random Access Memory), Synchronous Link Dynamic Random Access Memory (SLDRAM, SyncLink Dynamic Random Access Memory), Direct Memory Bus Random Access Memory (DRRAM, Direct Rambus Random Access Memory) . The memory described in the embodiments of the present invention is intended to include, but not be limited to, these and any other suitable types of memory.

The methods disclosed in the foregoing embodiments of the present invention may be applied to a processor, or implemented by a processor. A processor may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above-mentioned method can be completed by a hardware integrated logic circuit in a processor or an instruction in the form of software. The above-mentioned processors may be general-purpose processors, DSPs, or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, and the like. The processor may implement or execute the methods, steps, and logical block diagrams disclosed in the embodiments of the present invention. A general purpose processor may be a microprocessor or any conventional processor or the like. The steps of the method disclosed in combination with the embodiments of the present invention can be directly embodied as being executed by a hardware decoding processor, or executed by a combination of hardware and software modules in the decoding processor. The software module may be located in a storage medium, the storage medium is located in a memory, and the processor reads the information in the memory, and completes the steps of the foregoing method in combination with its hardware.

Embodiments of the present invention further provide a computer storage medium, specifically a computer-readable storage medium. Computer instructions are stored thereon, and as a first implementation manner, when the computer storage medium is located in the terminal, the computer instructions are executed by the processor to achieve: obtaining three-dimensional video data including at least depth data; extracting from the three-dimensional video data The key data associated with the transmission algorithm is output, and the key data is sent according to the transmission algorithm.

In one embodiment, the computer instructions are implemented when executed by the processor: after obtaining the 3D video data, first configuration information is determined; The key data is sent according to the transmission algorithm.

In one embodiment, when the computer instruction is executed by the processor: after obtaining the three-dimensional video data, determine the second configuration information; divide the three-dimensional video data, and send the divided 3D video data.

In one embodiment, the computer instructions, when executed by the processor, implement: dividing the 3D video data into a plurality of 3D video data blocks, each 3D video data block in the plurality of 3D video data blocks carrying a flag information; respectively sending the plurality of three-dimensional video data blocks.

In one embodiment, when the computer instruction is executed by the processor, it realizes: dividing the two-dimensional video data into at least two sub-two-dimensional video data, dividing the depth data into at least two sub-depth data; sending the two-dimensional video data respectively; At least two sub-two-dimensional video data and the at least two sub-depth data. Wherein, the three-dimensional video data includes two-dimensional video data and depth data.

In one embodiment, when the computer instruction is executed by the processor, it is implemented: query the mapping relationship between a plurality of preconfigured groups of parameters and configuration information based on the first parameter, and obtain first configuration information matching the first parameter or second configuration information.

In one embodiment, when the computer instructions are executed by the processor, the three-dimensional video data is obtained from an acquisition component capable of at least acquiring depth data; the acquisition component can establish a communication link with at least one terminal so that the corresponding terminal can acquire the 3D video data.

As a second implementation manner, when the computer storage medium is located on the server, the computer instructions are executed by the processor to achieve: receiving key data associated with the transmission algorithm; analyzing the key data to obtain an analysis result; based on the analysis result The pre-received depth data and 2D video data are synthesized into 3D video data.

In one embodiment, when the computer instruction is executed by the processor, it realizes: obtains the variation of the key data received within the receiving time interval, and judges whether the variation of the key data exceeds a preset threshold; or, analyzes the receiving time interval Whether the received key data is continuous; when the variation of the key data exceeds the preset threshold, or the key data received within the receiving time interval is discontinuous, it indicates that the stability of the key data does not meet the preset stability requirements .

In one embodiment, when the computer instruction is executed by the processor: when the analysis result indicates that the stability of the key data does not meet the preset stability requirement, determine the three-dimensional video data corresponding to the key data, and discard the data. the three-dimensional video data.

In one embodiment, when the computer instruction is executed by the processor, the divided 3D video data are respectively received, and the divided 3D video data are combined into 3D video data according to a preset algorithm.

In one embodiment, when the computer instruction is executed by the processor, it realizes: receiving a plurality of 3D video data blocks respectively; each 3D video data block in the plurality of 3D video data blocks carries label information; according to a preset algorithm The plurality of 3D video data blocks are combined into 3D video data based on the flag information carried by each 3D video data block in the plurality of 3D video data blocks.

In one embodiment, the computer instructions are implemented when executed by the processor: respectively receiving at least two sub-2D video data and at least two sub-depth data; The depth data is merged into 3D video data.

In the several embodiments provided in this application, it should be understood that the disclosed apparatus and method may be implemented in other manners. The device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined, or Can be integrated into another system, or some features can be ignored, or not implemented. In addition, the coupling, or direct coupling, or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be electrical, mechanical or other forms. of.

The unit described above as a separate component may or may not be physically separated, and the component displayed as a unit may or may not be a physical unit, that is, it may be located in one place or distributed to multiple network units; Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional unit in each embodiment of the present invention may all be integrated into one processing unit, or each unit may be separately used as a unit, or at least two units may be integrated into one unit; the above-mentioned integrated units are both It can be implemented in the form of hardware, or it can be implemented in the form of hardware plus software functional units.

Those of ordinary skill in the art can understand that all or part of the steps of implementing the above method embodiments can be completed by program instructions related to hardware, the aforementioned program can be stored in a computer-readable storage medium, and when the program is executed, execute It includes the steps of the above method embodiments; and the aforementioned storage medium includes: a removable storage device, a ROM, a RAM, a magnetic disk or an optical disk and other media that can store program codes.

Alternatively, if the above-mentioned integrated unit of the present invention is implemented in the form of a software function module and sold or used as an independent product, it may also be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the embodiments of the present invention may be embodied in the form of software products in essence or the parts that make contributions to the prior art. The computer software products are stored in a storage medium and include several instructions for A computer device (which may be a personal computer, a server, or a network device, etc.) is caused to execute all or part of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes: a removable storage device, a ROM, a RAM, a magnetic disk or an optical disk and other mediums that can store program codes.

It should be noted that the technical solutions described in the embodiments of the present invention may be combined arbitrarily unless there is a conflict.

The above are only specific embodiments of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed by the present invention. should be included within the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Claims (29)

1. A data processing method is characterized in that the method is applied to a terminal; the method comprises the following steps:

obtaining three-dimensional video data comprising at least depth data;

extracting key data associated with a transmission algorithm from the three-dimensional video data, and sending the key data according to the transmission algorithm; the key data are data or variable quantity of which the stability does not reach the preset stability requirement in the transmission process by adopting the transmission algorithm.

2. The method of claim 1, wherein after obtaining the three-dimensional video data, the method further comprises:

determining first configuration information;

extracting key data associated with a transmission algorithm from the three-dimensional video data, and sending the key data, including: and extracting key data associated with a transmission algorithm from the three-dimensional video data according to the first configuration information, and sending the key data according to the transmission algorithm.

3. The method of claim 1, wherein after obtaining the three-dimensional video data, the method further comprises:

determining second configuration information;

the method further comprises: and dividing the three-dimensional video data, and sending the divided three-dimensional video data according to the second configuration information.

4. The method according to claim 3, wherein the dividing the three-dimensional video data and transmitting the divided three-dimensional video data according to the second transmission mode comprises:

dividing the three-dimensional video data into a plurality of three-dimensional video data blocks, wherein each three-dimensional video data block in the plurality of three-dimensional video data blocks carries mark information;

and respectively transmitting the plurality of three-dimensional video data blocks.

5. The method of claim 3, wherein the three-dimensional video data comprises two-dimensional video data and depth data; the dividing the three-dimensional video data and sending the divided three-dimensional video data according to the second transmission mode includes:

dividing the two-dimensional video data into at least two sub two-dimensional video data, and dividing the depth data into at least two sub depth data;

and respectively transmitting the at least two sub-two-dimensional video data and the at least two sub-depth data.

6. The method of claim 2 or 3, wherein determining configuration information comprises: detecting a first parameter of a transmission channel;

and inquiring a mapping relation between a plurality of groups of pre-configured parameters and configuration information based on the first parameter to obtain first configuration information or second configuration information matched with the first parameter.

7. The method of claim 1, wherein obtaining three-dimensional video data including at least depth data comprises:

the terminal obtains three-dimensional video data from a collection assembly capable of collecting at least depth data; the acquisition component can establish a communication link with at least one terminal so that the corresponding terminal can obtain the three-dimensional video data.

8. A data processing method is characterized in that the method is applied to a Mobile Edge Computing (MEC) server; the method comprises the following steps:

receiving critical data associated with a transmission algorithm; the key data are data or variable quantity of which the stability does not reach the preset stability requirement in the transmission process by adopting the transmission algorithm;

analyzing the key data to obtain an analysis result;

and synthesizing the depth data and the two-dimensional video data which are received in advance into three-dimensional video data based on the analysis result.

9. The method of claim 8, wherein analyzing the key data to obtain an analysis result comprises:

obtaining the variable quantity of key data received in a receiving time interval, and judging whether the variable quantity of the key data exceeds a preset threshold value; or,

analyzing whether the received key data in the receiving time interval is continuous;

correspondingly, the analysis result shows that the stability of the key data does not meet the preset stability requirement, and the analysis result comprises the following steps: and when the variation of the key data exceeds a preset threshold value or the key data received within the receiving time interval is discontinuous, indicating that the stability of the key data does not meet the preset stability requirement.

10. The method according to claim 8 or 9, characterized in that the method further comprises: and when the analysis result shows that the stability of the key data does not meet the preset stability requirement, determining the three-dimensional video data corresponding to the key data, and discarding the three-dimensional video data.

11. The method of claim 8, further comprising: and respectively receiving the segmented three-dimensional video data, and combining the segmented three-dimensional video data into three-dimensional video data according to a preset algorithm.

12. The method of claim 11, wherein separately receiving segmented three-dimensional video data comprises: respectively receiving a plurality of three-dimensional video data blocks; each three-dimensional video data block in the plurality of three-dimensional video data blocks carries label information;

correspondingly, the merging the segmented three-dimensional video data into three-dimensional video data according to a preset algorithm includes: and merging the plurality of three-dimensional video data blocks into three-dimensional video data according to a preset algorithm based on the fact that each three-dimensional video data block in the plurality of three-dimensional video data blocks carries mark information.

13. The method of claim 11, wherein separately receiving segmented three-dimensional video data comprises: receiving at least two sub two-dimensional video data and at least two sub depth data, respectively;

correspondingly, the merging the segmented three-dimensional video data into three-dimensional video data according to a preset algorithm includes: and merging the at least two sub-two-dimensional video data and the at least two sub-depth data into three-dimensional video data according to a preset algorithm.

14. A terminal, characterized in that the terminal comprises: the device comprises an acquisition unit, an extraction unit and a first communication unit; wherein,

the acquisition unit is used for acquiring three-dimensional video data at least comprising depth data;

the extraction unit is used for extracting key data associated with a transmission algorithm from the three-dimensional video data obtained by the acquisition unit; the key data are data or variable quantity of which the stability does not reach the preset stability requirement in the transmission process by adopting the transmission algorithm;

the first communication unit is configured to send the critical data according to the transmission algorithm.

15. The terminal according to claim 14, wherein the terminal further comprises a determining unit configured to determine the first configuration information;

the extracting unit is used for extracting key data associated with a transmission algorithm from the three-dimensional video data according to the first configuration information determined by the determining unit;

the first communication unit is configured to send the critical data according to the transmission algorithm.

16. The terminal according to claim 14, wherein the terminal further comprises a determining unit and a dividing unit; wherein,

the determining unit is used for determining second configuration information;

the segmentation unit is used for segmenting the three-dimensional video data;

the first communication unit is configured to send the segmented three-dimensional video data according to the second configuration information determined by the determination unit.

17. The terminal according to claim 16, wherein the dividing unit is configured to divide the three-dimensional video data into a plurality of three-dimensional video data blocks, and each of the three-dimensional video data blocks carries tag information;

the first communication unit is configured to transmit the plurality of three-dimensional video data blocks, respectively.

18. The terminal of claim 16, wherein the three-dimensional video data comprises two-dimensional video data and depth data;

the dividing unit is configured to divide the two-dimensional video data into at least two sub two-dimensional video data, and divide the depth data into at least two sub depth data;

the first communication unit is configured to transmit the at least two sub-two-dimensional video data and the at least two sub-depth data, respectively.

19. The terminal according to claim 15 or 16, characterized in that the terminal further comprises a detection unit for detecting a first parameter of the transmission channel;

the determining unit is configured to query, based on the first parameter obtained by the detecting unit, a mapping relationship between a plurality of sets of pre-configured parameters and configuration information, and obtain first configuration information or second configuration information matched with the first parameter.

20. The terminal of claim 14, wherein the first communication unit is further configured to obtain three-dimensional video data from an acquisition component capable of acquiring at least depth data; the acquisition component can establish a communication link with at least one terminal so that the corresponding terminal can obtain the three-dimensional video data.

21. An MEC server, wherein the server comprises: the device comprises a second communication unit, an analysis processing unit and a merging unit; wherein,

the second communication unit is used for receiving key data associated with a transmission algorithm; the key data are data or variable quantity of which the stability does not reach the preset stability requirement in the transmission process by adopting the transmission algorithm;

the analysis processing unit is used for analyzing the key data received by the second communication unit to obtain an analysis result;

the merging unit is used for synthesizing the depth data and the two-dimensional video data which are received in advance into three-dimensional video data based on the analysis result obtained by the analysis processing unit.

22. The server according to claim 21, wherein the analysis processing unit is configured to obtain a variation of the key data received within a receiving time interval, and determine whether the variation of the key data exceeds a preset threshold; or, whether the key data received in the receiving time interval is continuous or not is analyzed; and when the variation of the key data exceeds a preset threshold value or the key data received within the receiving time interval is discontinuous, indicating that the stability of the key data does not meet the preset stability requirement.

23. The server according to claim 21 or 22, wherein the server further comprises a discarding processing unit, configured to determine three-dimensional video data corresponding to the key data and discard the three-dimensional video data when the analysis result obtained by the analysis processing unit indicates that the stability of the key data does not meet a preset stability requirement.

24. The server according to claim 21, wherein the second communication unit is further configured to receive the segmented three-dimensional video data;

and the merging unit is used for merging the segmented three-dimensional video data received by the second communication unit into three-dimensional video data according to a preset algorithm.

25. The server according to claim 24, wherein the second communication unit is configured to receive a plurality of three-dimensional video data blocks respectively; each three-dimensional video data block in the plurality of three-dimensional video data blocks carries label information;

the merging unit is used for merging the three-dimensional video data blocks into three-dimensional video data according to a preset algorithm based on the fact that each three-dimensional video data block in the three-dimensional video data blocks carries the mark information.

26. The server according to claim 24, wherein the second communication unit is configured to receive at least two sub-two-dimensional video data and at least two sub-depth data, respectively;

and the merging unit is used for merging the at least two sub-two-dimensional video data and the at least two sub-depth data into three-dimensional video data according to a preset algorithm.

27. A computer storage medium having stored thereon computer instructions, characterized in that the instructions, when executed by a processor, carry out the steps of the data processing method according to any one of claims 1 to 7; alternatively, the instructions when executed by the processor implement the steps of the data processing method of any of claims 8 to 13.

28. A terminal comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the steps of the data processing method according to any of claims 1 to 7 are implemented by the processor when executing the program.

29. An MEC server comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the steps of the data processing method according to any one of claims 8 to 13 are implemented when the program is executed by the processor.

Images