CN115037965B

CN115037965B - Multichannel data transmission method and device based on occupation coordination mechanism

Info

Publication number: CN115037965B
Application number: CN202210655307.XA
Authority: CN
Inventors: 魏巍; 殷建东
Original assignee: Suzhou HYC Technology Co Ltd
Current assignee: Suzhou HYC Technology Co Ltd
Priority date: 2022-06-10
Filing date: 2022-06-10
Publication date: 2024-01-19
Anticipated expiration: 2042-06-10
Also published as: CN115037965A

Abstract

The disclosure relates to a multichannel data transmission method and device based on an occupancy coordination mechanism, wherein the method comprises the following steps: distributing occupied coordination pixel data resources in a preset frame structure to a first receiving end according to performance parameters of the first receiving end connected with a transmission end; if the fact that the occupied coordination pixel data resources are not normally allocated is determined according to the mapping field, allocating the resources identical to the occupied coordination pixel data resources to the receiving end identical to the performance parameters of the first receiving end, and transmitting the pixel data to the receiving end identical to the performance parameters of the first receiving end; under the condition that the allocated resources cannot meet the pixel data transmitted by the second receiving end, enabling the occupied coordination data in the frame structure, allocating occupied coordination data and occupied coordination pixel data resources for the second receiving end, and transmitting the pixel data to the second receiving end through the occupied coordination data and occupied coordination pixel data resources. The method can improve the effective load of the video transmission link.

Description

Multichannel data transmission method and device based on occupation coordination mechanism

Technical Field

The disclosure relates to the technical field of data transmission, and in particular relates to a multichannel data transmission method and device based on an occupancy coordination mechanism.

Background

Currently, video image systems, and more particularly, to a video image processing system with VESA (Video Electronics Standards Association ) DisplayPort (DP, digital video interface standard), MIPI (Mobile Industry Processor Interface, mobile industry processor interface standard), HDMI (High Definition Multimedia Interface, high definition multimedia interface standard) and the like to drive and display a display panel and a terminal such as a liquid crystal (LCD, liquid Crystal Display), an Organic Light-Emitting Diode (OLED), etc., when supporting multi-channel display, a video source may need to consider transmission of a large number of different-capability video data when transmitting the video data when a link in a multi-channel video data transmission topology has a large number of different-capability nodes and/or video terminals, and the payload of the video transmission link may be significantly reduced when the different-capability data is time-division transmitted.

Disclosure of Invention

In view of the foregoing, it is desirable to provide a method and apparatus for transmitting multi-channel data based on an occupancy coordination mechanism, which can improve the transmission state of the payload of the video transmission link when performing time-division transmission.

In a first aspect, the present disclosure provides a multi-channel data transmission method based on an occupancy coordination mechanism. The method is applied to a video image processing system, wherein a transmission end in the video image processing system is used for transmitting pixel data to a plurality of receiving ends, and the method comprises the following steps:

according to the performance parameters of a first receiving end connected with the transmission end, allocating the occupied coordination pixel data resources in a preset frame structure to the first receiving end;

receiving a mapping field fed back by the first receiving end, if the fact that the occupied coordination pixel data resources are not normally allocated is determined according to the mapping field, allocating resources identical to the occupied coordination pixel data resources to the receiving end with the same performance parameters as the first receiving end, and transmitting pixel data to the receiving end identical to the performance parameters of the first receiving end;

and under the condition that the allocated resources cannot meet the pixel data transmitted by the second receiving end, enabling the occupied coordination data in the frame structure, allocating the occupied coordination data and occupied coordination pixel data resources for the second receiving end, and transmitting the pixel data to the second receiving end through the occupied coordination data and occupied coordination pixel data resources.

In one embodiment, the preset frame structure includes: virtual video time slots, filling video time slots, and occupying coordinated pixel data resources;

the virtual video time slot includes: occupying coordination zone bit, resource occupying table, first protection time slot, dividing virtual video time slot;

the occupation coordination flag bit is used for indicating whether a preset frame structure is used or not;

the resource occupation table is used for identifying occupation coordination pixel data resources and/or occupation coordination data used when the receiving end transmits the pixel data under the condition of using a preset frame structure, and indicating the receiving end to form video data according to the corresponding resource mapping table, the occupation coordination pixel data resources and/or the occupation coordination data;

the dividing virtual video time slot is used for filling the pseudo data;

the first protection time slot is used for distinguishing the resource occupation table from the divided virtual video time slot;

the occupation coordination pixel data resources are used for arranging and combining the pixel data according to the mode in the resource occupation table;

the filling video slots includes: occupying coordination data, a second protection time slot, and dividing and filling video time slots;

The occupation coordination data are used for transmitting the pixel data with the occupation coordination pixel data resources in a preset use mode;

the segmentation filling video time slot is used for filling when the data is insufficient;

the second protection time slot is used for distinguishing the occupation coordination data from the division filling video time slot.

In one embodiment, in a case where the virtual video slots are all occupied as the occupancy coordination flag bit and the resource occupancy table, the first protection slot is zero; in the case where the filler video slots are all occupied as the occupancy coordination data, the second guard slot is zero.

In one embodiment, the transmitting the pixel data to the second receiving end through the occupancy coordination data and occupancy coordination pixel data resource combination includes:

and completing the transmission of the pixel data by combining the occupation coordination data and the occupation coordination pixel data resources according to a combined use mode in preset use modes, wherein the preset use modes at least comprise: the method comprises a single use mode, a joint use mode and a use mode according to a transmission type, wherein the transmission type at least comprises: normal transmission, retransmission, error correction transmission.

In one embodiment, the method further comprises: and under the condition that the transmission type is error correction transmission, the error correction pixel data in error correction transmission is placed on resources occupied by an error correction receiving end to be transmitted, or the transmission is carried out through the occupied coordination data and/or the occupied coordination pixel data, wherein the error correction receiving end is a receiving end for transmitting the pixel data identical to the error correction pixel data.

In one embodiment, the method further comprises: under the condition that the transmission type is retransmitted, determining pixel data to be retransmitted according to retransmission information, and determining resources of the pixel data to be retransmitted in an occupied third receiving end, wherein the third receiving end comprises a receiving end which is larger than or equal to performance parameters of the receiving end to be retransmitted;

and adjusting the resource occupation table according to the pixel data to be retransmitted and the resources of the pixel data to be retransmitted in the occupied third receiving end, wherein the adjusted resource occupation table is used for indicating the receiving end to be retransmitted to retransmit the pixel data in a predetermined retransmission area.

In one embodiment, the method further comprises: and transmitting the pixel data in any one of the following modes under the condition that the transmission of the pixel data of the second receiving end cannot be completed by combining the occupation coordination data and the occupation coordination pixel data resource:

Determining a master receiving end, creating a resource occupation table of a slave receiving end through the master receiving end, and transmitting the pixel data to the slave receiving end, wherein the slave receiving end comprises a receiving end which is connected with the master receiving end and is not allocated with resources, and the resource occupation table of the slave receiving end is used for indicating the slave receiving end to acquire the pixel data;

or displaying the video data cached by the receiving end with the allocated resources, receiving the pixel data of the receiving end with the unallocated resources by the receiving end with the allocated resources, and readjusting a resource occupation table of the receiving end with the unallocated resources, wherein the resource occupation table of the receiving end with the unallocated resources is used for indicating the receiving end with the unallocated resources to acquire the pixel data;

or determining a receiving end with unallocated resources, wherein the receiving end with unallocated resources comprises a fourth receiving end and a fifth receiving end;

closing the fourth receiving end, and redefining a resource occupation table of the fifth receiving end, wherein the resource occupation table of the fifth receiving end is used for indicating the fifth receiving end to acquire the pixel data;

and after the fifth receiving end finishes acquiring the pixel data, accessing the fourth receiving end into a video transmission link, and determining a resource occupation table of the fourth receiving end, wherein the resource occupation table of the fourth receiving end is used for indicating the fourth receiving end to acquire the pixel data.

In a second aspect, the present disclosure further provides a multi-channel data transmission method based on an occupancy coordination mechanism, which is applied to a receiving end in a video image processing system, where the method includes:

under the condition that the occupied coordination pixel data resources in the preset frame structure do not meet the requirements of the pixel data to be transmitted;

feeding back first information of a mapping field to a transmission end, wherein the first information represents that the transmission end does not normally allocate the occupied coordination pixel data resource;

under the condition that the occupied coordination pixel data resources in a preset frame structure meet the requirements of pixel data to be transmitted, forming video data by the pixel data and displaying the video data;

and feeding back second information of the mapping field to the transmission end, wherein the second information characterizes that the transmission end normally distributes the occupied coordination pixel data resources.

In one embodiment, after the feedback mapping the first information of the field to the transmitting end, the method further includes:

determining the occupation coordination pixel data resources and the occupation coordination data used when pixel data are received according to a preset resource occupation table in a frame structure;

and acquiring pixel data according to the resource mapping table, the used occupied coordination pixel data resources and the occupied coordination data, forming video data and displaying the video data.

In one embodiment, the composing and displaying video data by the pixel data includes:

determining the occupied coordination pixel data resources used when receiving the pixel data, wherein the occupied coordination pixel data resources are distributed by a transmission end according to performance parameters;

and acquiring pixel data according to the resource mapping table and the used occupied coordination pixel data resources, forming video data and displaying the video data.

In a third aspect, the present disclosure further provides a multi-channel data transmission device based on an occupancy coordination mechanism. The device is applied to a video image processing system, wherein a transmission end in the video image processing system is used for transmitting pixel data to a plurality of receiving ends, and the device comprises:

the resource allocation module is used for allocating occupation coordination pixel data resources in a preset frame structure to a first receiving end according to the performance parameters of the first receiving end connected with the transmission end;

the allocation adjustment module is used for receiving a mapping field fed back by the first receiving end, determining that the occupied coordination pixel data resources are not normally allocated according to the mapping field, allocating resources identical to the occupied coordination pixel data resources for the receiving end identical to the performance parameters of the first receiving end, and transmitting pixel data to the receiving end identical to the performance parameters of the first receiving end;

And the joint allocation module is used for starting the occupation coordination data in the frame structure under the condition that the allocated resources cannot meet the pixel data received by the second receiving end, allocating the occupation coordination data and the occupation coordination pixel data resources for the second receiving end, and transmitting the pixel data to the second receiving end through the occupation coordination data and the occupation coordination pixel data resources.

In a fourth aspect, the present disclosure further provides a multi-channel data transmission device based on an occupancy coordination mechanism, which is applied to a receiving end in a video image processing system, where the device includes:

the first feedback module is used for feeding back first information of a mapping field when the occupied coordination pixel data resources in the preset frame structure do not meet the requirement of pixel data to be transmitted, wherein the first information characterizes that a transmission end does not normally allocate the occupied coordination pixel data resources;

the display module is used for forming and displaying video data through the pixel data under the condition that the occupation coordination pixel data resources in the preset frame structure meet the requirements of the pixel data to be transmitted;

and the second feedback module is used for feeding back second information of the mapping field to the transmission end, wherein the second information characterizes that the transmission end normally distributes the occupied coordination pixel data resources.

In a fifth aspect, the present disclosure also provides a computer device. The computer device comprises a memory and a processor, wherein the memory stores a computer program, and the processor realizes the steps of the multichannel data transmission method based on the occupancy coordination mechanism when executing the computer program.

In a sixth aspect, the present disclosure also provides a computer-readable storage medium. The computer readable storage medium has stored thereon a computer program which, when executed by a processor, implements the steps of a multi-channel data transmission method based on an occupancy coordination mechanism.

In a seventh aspect, the present disclosure also provides a computer program product. The computer program product comprises a computer program which, when executed by a processor, implements the steps of the above-described multi-channel data transmission method based on an occupancy coordination mechanism.

In the above embodiments, when the resources of the first receiving end allocated by the transmitting end are insufficient, the same resources as the resources of the occupied coordination pixel data may be allocated to the receiving end with the same performance parameters as the first receiving end according to the mapping field fed back by the first receiving end, and the pixel data may be transmitted through the receiving end without adding other timeslots. And if the allocated resources cannot meet the condition of pixel data transmitted by the second receiving end, the transmission of the pixel data can be jointly completed by occupying the coordinated data and occupying the coordinated pixel data resources, when different pixel data are transmitted, the transmission is performed in different modes (comprising the independent transmission by using the occupied coordinated pixel data resources, the combined transmission by using the occupied coordinated data and the occupied coordinated pixel data resources), and only the occupied coordinated data and the occupied coordinated pixel data resources can complete the pixel transmission of the receiving end by occupying a small amount of time slots, so that the effective load of a video transmission link is improved.

Drawings

In order to more clearly illustrate the embodiments of the present disclosure or the prior art, the drawings that are required in the detailed description or the prior art will be briefly described, it will be apparent that the drawings in the following description are some embodiments of the present disclosure, and other drawings may be obtained according to the drawings without inventive effort for a person of ordinary skill in the art.

FIG. 1 is a schematic diagram of a video image processing system in one embodiment;

FIG. 2 is a flow chart of a multi-channel data transmission method based on an occupancy coordination mechanism in one embodiment;

FIG. 3 is a schematic diagram of a preset frame structure in one embodiment;

FIG. 4 is a schematic diagram of a standard frame structure in one embodiment;

fig. 5 is a flow chart of a multi-channel data transmission method based on an occupancy coordination mechanism according to another embodiment;

FIG. 6 is a flowchart illustrating a step S504 according to another embodiment;

FIG. 7 is a flowchart illustrating the step S504 in another embodiment;

FIG. 8 is a block diagram schematically illustrating the structure of a multi-channel data transmission device based on an occupancy coordination mechanism in one embodiment;

Fig. 9 is a schematic block diagram of a multi-channel data transmission device based on an occupancy coordination mechanism according to another embodiment;

FIG. 10 is a schematic diagram of the internal structure of a computer device in one embodiment.

Detailed Description

In order to make the objects, technical solutions and advantages of the present disclosure more apparent, the present disclosure will be further described in detail with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the present disclosure.

It should be noted that the terms "first," "second," and the like in the description and claims herein and in the foregoing figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments described herein may be capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, apparatus, article, or device that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed or inherent to such process, method, article, or device.

In this document, the term "and/or" is merely one association relationship describing the associated object, meaning that three relationships may exist. For example, a and/or B may represent: a exists alone, A and B exist together, and B exists alone. In addition, the character "/" herein generally indicates that the front and rear associated objects are an "or" relationship.

As described in the background art, when pixel data with different performance parameters are transmitted in a time-sharing manner, a large amount of signaling is required to be transmitted interactively between a video source (transmission end) and nodes and/or video terminals (receiving end), so as to confirm the capability of each node and/or video terminal, which increases the overhead of the whole system. Particularly when certain nodes and/or video terminals for system reasons cause transmission interruptions or transmission errors, a significant amount of resources/time slots are further occupied.

Therefore, in order to solve the above-mentioned problems, the embodiments of the present disclosure provide a method and an apparatus for multi-channel data transmission based on an occupancy coordination mechanism.

First, a video image processing system according to an embodiment of the present disclosure is described below, as shown in fig. 1, including: the system comprises an embedded control module, an FPGA module, an external storage module, a rapid storage module, a peripheral module, a video interface physical layer realization module and a video transmission link.

The embedded control module can use any embedded chip and system, and is mainly responsible for initiating signaling interaction, such as reading/writing registers, starting/closing a video display module, peripheral control, setting parameters of the video display module and the like. The FPGA module is mainly responsible for realizing the implementation parts which need a large amount of data processing and low round trip delay (latency), such as storage control, peripheral control, video interface IP core implementation and the like. The external storage module is mainly responsible for storing the original data stream of the video image to be displayed in the video image processing system, and storage media such as NandFlash, SSD are applied to the part, but not limited to the part. The fast memory module is used in the implementation process of the FPGA module requiring a large amount of data processing and low round trip delay (latency), and the module for storing the latency for reducing the latency is applied to a fast and low latency physical device, such as DDR3, but not limited thereto. Peripheral modules including, but not limited to, GPIO (General-purpose input/output), UART (Universal Asynchronous Receiver/Transmitter, universal asynchronous receiver Transmitter), USB (Universal Serial Bus ), network ports, and the like. The video interface physical layer implementation module is mainly responsible for the physical layer implementation required for driving the display module, such as, but not limited to, TX/RX (Transmitter/Receiver) -PHY of DisplayPort, DPHY of MIPI, etc.

Further, the FPGA module comprises a bus interaction module, an MCU (Microcontroller Unit, micro control module) video stream preprocessing module, a video data stream transmission control module, a clock control module, an embedded soft core control module, a bus controller module, an internal storage controller module, an external control module, a display clock generator module, a video time sequence controller module and a video interface IP core module. The bus interaction module is mainly responsible for the functions of selection, decision and the like of all other modules connected to the bus interaction module. The MCU video stream preprocessing module is mainly responsible for preprocessing and converting the video data stream input from the external storage module according to the format and the parameter type set by the system so as to facilitate the processing of the later stage. The video data stream transmission control module is mainly responsible for controlling the time sequence, parameters and the like of the data stream after the data stream pretreatment and conversion. The clock control module is mainly responsible for generating and controlling a global clock in the video image processing system. The embedded soft core control module is a control core of the FPGA module and is mainly responsible for the core functions of time sequence control, parameter configuration, physical process realization and the like of all modules in the FPGA module, and the embedded soft core control module can be used in the realization of the time sequence control, parameter configuration, physical process realization and the like, such as Xilinx MicroBlaze and the like, but is not limited to the realization of the time sequence control, parameter configuration, physical process realization and the like. The bus controller module is mainly responsible for controlling all modules connected with the bus interaction module, but is not limited to the bus interaction module. The video pattern processing module is mainly responsible for mode conversion, time sequence control and the like of the video image data stream corresponding to the video interface IP core module, but is not limited to the video pattern processing module. The internal memory controller module is mainly responsible for controlling the flash memory module, including writing/reading of data stream, frame control, etc., but not limited thereto. The peripheral control module is mainly responsible for controlling all peripheral modules, including the starting/closing of peripheral, the control of working mode and the like, but is not limited thereto. The display clock generator module is mainly responsible for time sequence control of all the IP core modules and the physical layer realization modules of the video interface, but is not limited to the time sequence control. The video timing controller module is mainly responsible for processing such as data conversion and timing control when the data input from the video pattern processing module is transmitted to the video interface IP core module, but is not limited to the video timing controller module.

The video transmission link includes a transmission end (video transmission source), a reception end (embedded physical repeater, cable with source ID, detachable physical repeater, video reception end, etc.), but is not limited thereto. The receiving end in this embodiment may include: nodes and/or video terminals.

In one embodiment, as shown in fig. 2, a multi-channel data transmission method based on an occupancy coordination mechanism is provided, which can be applied to the video image processing system shown in fig. 1 and other video image processing systems, where a transmission end is used to transmit pixel data to a plurality of receiving ends. The application environment in this embodiment is exemplified by the transmission side of the video image processing system shown in fig. 1. The method comprises the following steps:

step 202, according to the performance parameter of the first receiving end connected with the transmitting end, allocating the occupation coordination pixel data resource in the preset frame structure to the first receiving end.

Wherein, the transmitting end may generally include: video transmission source or other receiving end. The first receiving end and the further receiving ends may typically be nodes in a video transmission link and/or video terminals. Performance parameters may generally include, for example, frame rate, refresh rate, resolution, etc. The preset frame structure may generally be a frame structure different from a standard frame structure, which may generally be applicable to the manner in which pixel data is transmitted in the present application. Occupying coordinated pixel data resources may generally transfer pixel data in a manner specified in the present application.

Specifically, the transmitting end may determine a performance parameter of the first receiving end connected to the transmitting end, and allocate resources used when transmitting pixel data for occupying coordinated pixel data resources in a preset frame structure to the first receiving end according to the performance parameter.

Step 204, receiving a mapping field fed back by the first receiving end, if it is determined that the coordinated pixel data resources are not normally allocated according to the mapping field, allocating resources identical to the coordinated pixel data resources to the first receiving end as the receiving end with the same performance parameters as the first receiving end, and transmitting pixel data to the receiving end with the same performance parameters as the first receiving end.

The mapping field may be a field that the receiving end feeds back to the transmitting end, and the transmitting end may determine whether resources are normally allocated after receiving the mapping field.

Specifically, after the resource is allocated to the first receiving end, when the first receiving end acquires or transmits the pixel data, it needs to determine whether the resource meets the requirement of the pixel data that needs to be acquired or transmitted. If yes, the first receiving end feeds back a mapping field, wherein the mapping field comprises first information. If not, the first receiving end feeds back the mapping field, and the mapping field comprises second information. The transmitting end can receive the mapping field fed back by the first receiving end, and determine whether to normally allocate and occupy the coordinated pixel data resource according to the information contained in the mapping field. If the mapping field contains the second information, it is determined that the occupied coordinated pixel data resource is not normally allocated, and the occupied coordinated pixel data resource does not meet the requirement of the pixel data to be acquired or transmitted. Such a reason may be that the current first receiving end occupies too much resources of itself, and thus cannot meet the requirements of the current first receiving end. At this time, a receiving end with the same performance parameter as the first receiving end can be searched, the same resource as the resource occupying the coordinated pixel data is allocated to the receiving end, the pixel data is transmitted to the receiving end, and the corresponding pixel data is transmitted or acquired through the receiving end and displayed. It is understood that the receiving end is occupied to complete the pixel data that the first receiving end needs to process.

Step 206, under the condition that the allocated resources cannot meet the pixel data transmitted by the second receiving end, enabling the occupied coordination data in the frame structure, allocating the occupied coordination data and occupied coordination pixel data resources for the second receiving end, and transmitting the pixel data to the second receiving end through the occupied coordination data and occupied coordination pixel data resources.

The second receiving end may be a receiving end that cannot normally acquire the pixel data in the video transmission link, and may be a receiving end that does not normally allocate resources in general. The receiving end of the non-normally allocated resource may include the first receiving end, the receiving end with the same performance parameter as the first receiving end, and other receiving ends.

Specifically, in the case where the allocated resources of the occupancy coordination pixel or the same resources as the resources of the occupancy coordination pixel data cannot satisfy the pixel data transmitted by one or more receiving ends, the allocated resources of the occupancy coordination pixel data and the conventional resources in the receiving ends cannot satisfy the transmission, where the occupancy coordination data in the preset frame structure may be enabled. The occupancy coordination data acts the same as occupancy coordination pixel data. And allocating the occupation coordination data and the occupation coordination pixel data resources to the second receiving end, and transmitting the pixel data to the second receiving end through the combination of the occupation coordination data and the occupation coordination pixel data resources.

It will be appreciated that the transmission in this embodiment may include: the receiving end obtains pixel data and the receiving end sends the pixel data. The occupancy coordination mechanism in this case may be a way to utilize occupancy coordination pixel data resources and/or occupancy coordination data transmission pixel data.

In the above multi-channel data transmission method based on the occupation coordination mechanism, when the resources of the first receiving end allocated by the transmitting end are insufficient, the resources identical to the occupation coordination pixel data resources can be allocated to the receiving end identical to the performance parameters of the first receiving end according to the mapping field fed back by the first receiving end, and the pixel data can be transmitted without adding other time slots through the receiving end. And if the allocated resources cannot meet the condition of pixel data transmitted by the second receiving end, the transmission of the pixel data can be jointly completed by occupying the coordinated data and occupying the coordinated pixel data resources, when different pixel data are transmitted, the transmission is performed in different modes (comprising the independent transmission by using the occupied coordinated pixel data resources, the combined transmission by using the occupied coordinated data and the occupied coordinated pixel data resources), and only the occupied coordinated data and the occupied coordinated pixel data resources can complete the pixel transmission of the receiving end by occupying a small amount of time slots, so that the effective load of a video transmission link is improved.

As described above, a preset frame structure is introduced in the present application, and the present application uses the preset frame structure to transmit pixel data, and the preset frame structure is described in detail below.

In one embodiment, as shown in fig. 3, the preset frame structure includes: virtual video time slots, filling video time slots, and occupying coordinated pixel data resources;

the dividing virtual video time slot is used for filling the pseudo data;

the occupation coordination data are used for transmitting the pixel data with the occupation coordination pixel data resources through a preset strategy;

the second protection time slot is used for distinguishing the occupation coordination data from the division filling video time slot;

the division filling video time slot is used for filling when the data is insufficient.

Specifically, before describing a preset frame structure of the present application, a standard frame structure is first described, and as shown in fig. 4, a standard frame structure diagram is displayed, where BS (Blanking Start), VB-ID (Vertical Blanking Identifier, field Blanking flag), mvid (timer value of Video data), naud (timer value of audio data), dummy Video (for Dummy data filling), BE (Blanking End), pixel data (for transmission of Video data), FS (Fill Start), fill Video (Fill data for filling when data is insufficient), FE (Fill End).

Still referring to fig. 3, in this application, the preset frame structure may be that the Dummy Video in the standard frame structure is split into four parts and the Fill Video is split into three parts, the preset virtual Video time slot in the preset frame structure may be that the Dummy Video in the standard frame structure is split into four parts: the method comprises the steps of occupying a coordination zone bit, a resource occupation table, a first protection time slot and dividing a virtual video time slot. The filling Video slots in the preset frame structure may typically be Fill Video in a standard frame structure. The three split portions may include: occupy coordination data, second guard time slot, split fill video time slot.

The occupation coordination flag bit is used for indicating whether a preset frame structure is used, and in general, if the scheme is used, the occupation coordination flag bit becomes an enabling state. If the scheme is not used, the occupation coordination flag bit is forbidden, and new resources in other preset frame structures are forbidden (including a resource occupation table, occupation coordination pixel data resources and the like); if the flag bit is adopted, enabling all new resources in the rest preset frame structures; the use condition of the scheme is introduced under the condition that the standard frame structure resource (time slot) is not affected by the use of the occupied coordination flag bit in the Dummy Video resource (time slot).

And the resource occupation table is used for identifying resources used by the receiving end for transmitting the pixel data in the video transmission link under the condition of using the preset frame structure of the scheme, so that the receiving end can select the specified pixel data to form the video data according to the resources used by the corresponding resource mapping table. The resource may include: one or more of its own regular resources, occupancy coordination pixel data resources, and occupancy coordination data. Different resources may be used according to different situations. The resource mapping table may generally be an indication of the resources used by the receiving end. For example, node 1 uses resources 1, 2, and 6; video terminal 2 uses resources 1, 3, and 6; when a node and/or a video terminal acquire pixel data for framing, the pixel data must be acquired according to the resources (time slots) indicated in the resource mapping table, so that the video data can be correctly formed and displayed.

The virtual Video slots are divided, which may be Dummy Video resources and their corresponding functions in the standard frame structure in the normal case, for Dummy data stuffing, in order to be compatible with the standard frame structure. The split virtual Video may be generally formed by removing the remaining portions of the occupation coordination flag bit, the resource occupation coordination table and the first protection time slot from the Dummy Video in the original standard frame structure.

The first guard slot is typically used to distinguish between the resource occupancy table and the split virtual video slots. The first guard time slot may be zero if the virtual video time slot is fully occupied as an occupancy coordination flag and an occupancy resource table. To further lift the payload.

Occupying coordinated pixel data resources, which may typically be derived from a transformation of pixel data in a standard frame structure. The pixel data in the occupancy coordination pixel data resources are arranged and organized in a manner in the resource occupancy table (as referred to above for the role of the resource occupancy table). If the preset frame structure is not used, the occupied coordinated pixel data resources are restored to pixel data resources, and at the moment, the pixel data arrangement and composition are arranged according to the mode of the standard frame structure, so that the compatibility with the standard frame structure is kept under the condition that the pixel data resources are basically kept unchanged.

The occupation coordination data is used for transmitting the pixel data with the occupation coordination pixel data resources in a preset use mode, and can comprise normal transmission, retransmission, error correction transmission and the like. The size of the occupancy coordination data resources is variable, with a minimum of zero (i.e., no use) and a maximum of full Video resources being fully occupied.

The division fills the Video time slot, which may be the Fill Video resource and its corresponding function in the standard frame structure in the normal case, is used for filling when the data is insufficient, in order to be compatible with the standard frame structure. The division filling Video can be generally formed by removing the remaining part of the occupation coordination data and the second protection time slot from the Fill Video in the original standard frame structure.

The second protection time slot is used for distinguishing the occupation coordination data from the division filling video time slot. In the case where the filler video slots are all occupied as the occupancy coordination data, the second guard slot is zero to further promote the payload.

In this embodiment, all the newly added slots in the preset frame structure are added in the fixed slots in the original standard frame structure, and can be kept compatible with the standard frame, so as to avoid more switching requests; i.e. the switching between the two frame structures does not require excessive signalling interactions. And the time slots in the preset frame structure, such as (resource occupation table, first protection time slot, occupation coordination pixel data resource, etc.), can be adjusted, so that the payload can be promoted.

Specifically, the preset usage manner may be a manner of using occupancy coordination data and/or occupancy coordination pixel data resources in general. The person skilled in the art can choose different modes of use according to different circumstances. In this embodiment, the pixel data transmitted by the second receiving end cannot be satisfied because the coordinated pixel data resources are occupied by the use of the pixel data resources alone. Therefore, the pixel data transmitted by the second receiving end can be satisfied by occupying coordination data and coordinated pixel data resources. The usage modes also comprise a single usage mode, a combined usage mode and a usage mode according to the transmission type. The individual use may be generally the above-mentioned individual use of the coordinated pixel data resources for transmitting pixel data. The joint usage may be a manner in which the occupancy coordination data and the occupancy coordination pixel data resources jointly transmit pixel data. The manner of use according to the type of transmission is generally based on different types of transmission, such as normal transmission, retransmission, error correction transmission. The manner in which the coordination data is occupied and/or the coordination pixel data resources are occupied is used. Specific modes of use can be found in the examples below.

In this embodiment, the transmission of the pixel data is completed by combining the occupancy coordination data and the occupancy coordination pixel data resource in a joint usage manner, so that the transmission of the pixel data of the second receiving end can be ensured. According to the using mode and the independent using mode of the transmission type, the pixel data corresponding to different performance parameters can be transmitted to different receiving ends needing to be transmitted, other time slots are not required to be occupied, and the effective load of a video transmission link can be improved.

In one embodiment, the method further comprises: in the case that the transmission type is error correction, the error correction pixel data in error correction transmission is put on the resources occupied by the error correction receiving end for transmission, or transmitted by the occupation coordination data and/or the occupation coordination pixel data,

the error correction receiving end is a receiving end for transmitting the same pixel data as the error correction pixel data. The error correction transmission may typically be CRC (Cyclic Redundancy Check) errors; i.e. the transmitted pixel data or video data is incorrect.

Specifically, in the case that the transmission type is error correction transmission, resources can be allocated to the receiving end of the video transmission error for the transmitting end of the video transmitting source to complete the error correction transmission of the video data. The time slot occupied in error correction transmission can be specified by the video transmission source. The error correction pixel data during error correction transmission can be transmitted on the resources occupied by the error correction receiving end. The error correction pixel data may also be transmitted via occupancy coordination data and/or occupancy coordination pixel data. If the error correction pixel data is too large, the occupation coordination pixel data cannot be met, and transmission can be carried out through the occupation coordination data and the occupation coordination pixel data.

In this embodiment, the error correction receiving end transmits the error correction pixel data, which is favorable for saving resources (time slots), improving the payload, and further improving the throughput. The transmission is carried out by occupying coordination data and/or occupying coordination pixel data, and the normal transmission of the pixel data of other receiving ends is not influenced while the error correction transmission is completed under the condition of occupying a small amount of resources (time slots).

In one embodiment, the method further comprises: and carrying out parameter multiplexing on the transmission end of the video transmission source according to the performance parameters of each receiving end. If the receiving end with the same performance parameter uses the same resource, and the receiving end with lower performance parameter uses the appointed part in the resource of the receiving end with higher performance parameter to form video data; and multiplexing additional resources to form video data by using resources occupied by the receiving end with the performance parameters similar to those of the receiving end with the higher performance parameters.

In this embodiment, resources can be saved and the payload can be promoted by means of parameter multiplexing.

In one embodiment, in the case of retransmission of the transmission type, determining pixel data to be retransmitted according to retransmission information, and determining resources of the pixel data to be retransmitted in an occupied third receiving end, where the third receiving end includes a receiving end greater than or equal to a performance parameter of the receiving end to be retransmitted;

The third receiving end may be a receiving end that occupies its resources to retransmit the pixel data, and may be one or more. The predetermined retransmission area may be the resources of the third receiving end that are normally occupied and specified in the adjusted resource occupancy table. The retransmission information generally includes resources that need to be retransmitted.

Specifically, in the case where retransmission is required, the pixel data that needs to be retransmitted is determined from the retransmission information. And determining a receiving end of the pixel data which accords with the need of retransmission, wherein the receiving end is a third receiving end. The performance parameter of the third receiving end is generally greater than or equal to the performance parameter of the receiving end to be retransmitted, so that the pixel data can be retransmitted through the resource of the third receiving end. After the third receiving end is determined, the resources occupied by the pixel data to be retransmitted in the third receiving end are determined. And adjusting a resource occupation table according to the occupied resources, and setting a retransmission area in the resource occupation table. The receiving end to be retransmitted can retransmit the pixel data to be retransmitted through the retransmission data.

In other implementations of this embodiment, when multiple receiving ends commonly occupy the same resource, the video transmission source needs to identify the common occupation, and when an error occurs in the next receiving end, two strategies may recover the data, one is to send a request directly to the previous receiving end, and resend the data on the allocated occupied resource; in another method, a request for restoring video data is sent to a video sending source, if the original allocated resources are not reused according to the resource occupation condition of the current multi-channel video data transmission link, the original allocated resources can be adopted to retransmit the data, in order to improve throughput, the video source can inform a receiving end using the resources to temporarily use locally stored frame data to complete display, or can allocate additional resources (time slots) for retransmitting the data, and the resources are specially used for retransmitting the resources.

In this embodiment, the retransmission of the pixel data is completed by occupying the resources of the third receiving end, so that no additional resources are required to be occupied for retransmission, resources are saved, the payload is improved, and the throughput is further improved.

In one embodiment, in a case that the transmission of the pixel data of the second receiving end cannot be completed by combining the occupancy coordination data and the occupancy coordination pixel data resource, the pixel data is transmitted by any one of the following manners:

the number of the main receiving ends can be determined according to the topology structure of an actual transmission link by a person skilled in the art, and the method has the capability of creating a resource occupation table. The slave receiver may be a subordinate receiver that is generally connected to the master receiver, and it typically does not allocate resources. A receiving end is understood here to mean a node and/or a video terminal, which usually does not comprise a video transmission source.

Specifically, the video transmission source may set the designated node and/or the video terminal as the master reception end. The video transmitting source deletes the resources allocated in the master receiving end and the slave receiving end, and the resources may include: occupancy coordination pixel data resources and the same resources as the occupancy coordination pixel data resources. The main receiving terminal receives the pixel data transmitted by the video source, forms video data and displays the video data. In general, the video source does not need to allocate resources to the main receiving end, and the pixel data transmitted by the video source is the pixel data conforming to the main receiving end. If the resources allocated to the primary receiving end do not conform to the pixel data transmitted by the primary receiving end, the primary receiving end may perform processing in the manner mentioned in the foregoing embodiment, which is not described herein. The master receiver may mark the slave receivers that have no allocated resources. And constructing a new resource occupation table for the slave receiving end through the master receiving end. The master receiver allocates resources of the slave receiver using its own resources. The slave receiving end acquires pixel data transmitted by the master receiving end according to the resource occupation table created by the master receiving end, and forms video data and displays the video data.

In some specific embodiments, the specific operation of the master and slave receivers may be found in the first policy table of table 1.

TABLE 1 first policy table

Or displaying the video data cached by the receiving end with the allocated resources, receiving the pixel data of the receiving end with the unallocated resources by the receiving end with the allocated resources, and readjusting a resource occupation table of the receiving end with the unallocated resources, wherein the resource occupation table of the receiving end with the unallocated resources is used for indicating the receiving end with the unallocated resources to acquire the pixel data.

Specifically, the receiving end with the completed resource allocation in all the receiving ends is determined, the receiving end with the completed resource allocation is displayed through the video cached by the receiving end, at the moment, the receiving end with the completed resource allocation can be utilized to receive pixel data, and the pixel data can be the receiving end with the unassigned resource transmitted by the transmitting end. And the receiving end with incomplete resource allocation readjusts the corresponding resource occupation table. The resource occupation table is used for indicating that the receiving end with unassigned resources acquires the pixel data, and the pixel data is formed and displayed.

In some embodiments, the operations of the receiving end with completed resource allocation and the receiving end with non-completed resource allocation can be referred to the alternate resource buffer table in table 2.

Table 2 alternate resource cache table

The fourth receiving end and the fifth receiving end may be usually determined by those skilled in the art according to actual situations, where the resources are not allocated to the receiving ends. Only differentiation is used in this embodiment. The fourth receiving end may typically be a large share of occupied resources.

Specifically, the video transmitting source determines a receiving end with non-allocated resources among the receiving ends. And determining a part of the receiving ends with the non-allocated resources as a fourth receiving end, and determining the receiving ends with the non-allocated resources as a fifth receiving end. And closing and/or deleting the fourth receiving end in the video transmission link. The video source redetermines the resource occupancy table of the fifth receiving end. And the fifth receiving end acquires pixel data according to the corresponding resource occupation table, and forms and displays video data. When the fifth receiving end displays the video data, if the fourth receiving end is deleted in the video transmission link, no operation is performed. And if the fourth receiving end is closed, the fourth receiving end is accessed to the video transmission link again. And determining a resource occupation table corresponding to the fourth receiving end. And the fourth receiving end acquires pixel data according to the corresponding resource occupation table, and forms video data and displays the video data.

In some specific embodiments, the specific operations of the fourth receiving end and the fifth receiving end may be referred to in table 3 to delete the closing table.

Table 3 delete close table

The embodiment of the disclosure also provides another multichannel data transmission method based on an occupancy coordination mechanism, as shown in fig. 5, applied to a receiving end in a video image processing system, where the method includes:

s502, in the case that the occupation coordination pixel data resource in the preset frame structure does not meet the requirement of the pixel data to be transmitted.

S504, feeding back first information of a mapping field to a transmission end, wherein the first information characterizes that the transmission end does not normally allocate the occupied coordination pixel data resource.

S506, under the condition that the occupation coordination pixel data resources in the preset frame structure meet the requirement of the pixel data to be transmitted, the video data are formed and displayed through the pixel data.

S508, feeding back second information of the mapping field to the transmission end, wherein the second information characterizes that the transmission end normally distributes the occupied coordination pixel data resource.

Specifically, the current receiving end judges whether the occupied coordination pixel data resource in the preset frame structure allocated by the transmitting end meets the pixel data needing to be transmitted or not, and if the occupied coordination pixel data resource in the preset frame structure does not meet the requirement of the pixel data to be transmitted. The current receiving end feeds back the first information of the mapping field to the transmitting end. The transmitting end is processed in the manner mentioned in the above embodiments. Under the condition that the occupied coordinated pixel data resources in the preset frame structure meet the requirement of pixel data to be transmitted, the current receiving end is proved to be capable of normally transmitting the pixel data, the video data are formed and displayed through the pixel data, and the second information of the mapping field is fed back to the transmitting end.

In this embodiment, the current receiving end may feed back the mapping field carrying different information to the transmitting end according to different conditions, so that the transmitting end determines the resource allocation condition of the current receiving end according to different information. And can respond in time.

In one embodiment, as shown in fig. 6, after the feedback mapping the first information of the field to the transmitting end, the method further includes:

s602, determining the occupation coordination pixel data resources and the occupation coordination data used when pixel data are received according to a preset resource occupation table in a frame structure;

s604, obtaining pixel data according to the resource mapping table, the used occupied coordination pixel data resources and the occupied coordination data, forming video data and displaying the video data.

Specifically, after the first information of the mapping field is fed back to the transmitting end, the transmitting end may first perform processing according to step 204, and then, in a case where the transmitted pixel data is not satisfied yet, the transmitting end may perform processing according to step 206. The current receiving end can determine the occupied coordination pixel data resources and occupied coordination data used when receiving the pixel data according to a preset resource occupancy table in a frame structure, acquire correct pixel data according to the resource mapping table of the current receiving end and the occupied coordination pixel data resources and occupied coordination data used, and form the pixel data into video data and display the video data.

In this embodiment, the current transmission node may only use the resources of occupied coordinated pixel data and occupied coordinated data to satisfy the resources of pixel data transmission, and can complete the transmission of pixel data by occupying a small number of time slots, thereby improving the payload of the video transmission link.

In one embodiment, as shown in fig. 7, the composing and displaying video data by the pixel data includes:

s702, determining the occupied coordination pixel data resources used when receiving pixel data, wherein the occupied coordination pixel data resources are distributed by a transmission end according to performance parameters;

s704, acquiring pixel data according to the resource mapping table and the used occupied coordination pixel data resource, forming video data and displaying the video data.

Specifically, the current receiving end determines the occupation coordination pixel data resources used when receiving the pixel data through a preset resource occupation table in the frame structure. Then the current receiving end can obtain correct pixel data according to the self resource mapping table and the used occupied coordination pixel data resource, and the correct pixel data is formed into video data and displayed.

In this embodiment, when the occupied coordination pixel data resource allocated by the transmitting end meets the pixel data transmitted by the current receiving end, the pixel data is transmitted only by occupying the coordination pixel data, and the transmission of the pixel data can be completed by occupying a small number of time slots, so that the payload of the video transmission link is improved.

It will be appreciated that in embodiments of the present disclosure, a fixed round trip delay is typically required for the transmission or receiving end of the previous and next stages during video data transmission, for the transfer of resource occupancy information between the two stages, and for the preparation of the next stage before receiving the data, including: acquisition of reception resources, regeneration of timing information, and execution of necessary physical processes such as link training, on/off of PHY layer, and the like.

It should be understood that, although the steps in the flowcharts related to the embodiments described above are sequentially shown as indicated by arrows, these steps are not necessarily sequentially performed in the order indicated by the arrows. The steps are not strictly limited to the order of execution unless explicitly recited herein, and the steps may be executed in other orders. Moreover, at least some of the steps in the flowcharts described in the above embodiments may include a plurality of steps or a plurality of stages, which are not necessarily performed at the same time, but may be performed at different times, and the order of the steps or stages is not necessarily performed sequentially, but may be performed alternately or alternately with at least some of the other steps or stages.

Based on the same inventive concept, the embodiment of the disclosure further provides a multi-channel data transmission device based on the occupancy coordination mechanism, which is used for implementing the multi-channel data transmission method based on the occupancy coordination mechanism. The implementation of the solution provided by the device is similar to the implementation described in the above method, so the specific limitation in the embodiments of the multi-channel data transmission device based on the occupancy coordination mechanism provided below may be referred to the limitation of the multi-channel data transmission method based on the occupancy coordination mechanism hereinabove, and will not be repeated herein.

In one embodiment, as shown in fig. 8, a multi-channel data transmission device 800 based on an occupancy coordination mechanism is provided, and is applied to a video image processing system, where a transmission end is used for transmitting pixel data to a plurality of receiving ends, and the multi-channel data transmission device includes: a resource allocation module 802, an allocation adjustment module 804, and a joint allocation module 806, wherein:

a resource allocation module 802, configured to allocate, according to a performance parameter of a first receiving end connected to the transmitting end, an occupation coordination pixel data resource in a preset frame structure to the first receiving end;

An allocation adjustment module 804, configured to receive a mapping field fed back by the first receiving end, and determine that the coordinated pixel data resources are not normally allocated according to the mapping field, allocate the resources identical to the coordinated pixel data resources to the receiving end with the same performance parameter as the first receiving end, and transmit pixel data to the receiving end identical to the performance parameter as the first receiving end;

and a joint allocation module 806, configured to enable the occupancy coordination data in the frame structure, allocate the occupancy coordination data and the occupancy coordination pixel data resources to the second receiving end, and perform transmission of the pixel data to the second receiving end through the occupancy coordination data and the occupancy coordination pixel data resources in a joint manner when the allocated resources cannot satisfy the pixel data received by the second receiving end.

In an embodiment of the apparatus, the preset frame structure includes: virtual video time slots, filling video time slots, and occupying coordinated pixel data resources;

the dividing virtual video time slot is used for filling the pseudo data;

In one embodiment of the apparatus, the first guard time slot is zero if the virtual video time slot is fully occupied as the occupancy coordination flag and the resource occupancy table; in the case where the filler video slots are all occupied as the occupancy coordination data, the second guard slot is zero.

In an embodiment of the apparatus, the joint allocation module 806 is further configured to jointly complete the transmission of the pixel data by using the occupancy coordination data and the occupancy coordination pixel data resource according to a joint usage mode among preset usage modes, where the preset usage modes at least include: the method comprises a single use mode, a joint use mode and a use mode according to a transmission type, wherein the transmission type at least comprises: normal transmission, retransmission, error correction transmission.

In an embodiment of the apparatus, the apparatus further includes an error correction transmission module, configured to, in a case where the transmission type is error correction transmission, transmit error correction pixel data during the error correction transmission on a resource occupied by an error correction receiving end, or transmit the error correction pixel data through the occupancy coordination data and/or the occupancy coordination pixel data, where the error correction receiving end is a receiving end that transmits pixel data identical to the error correction pixel data.

In one embodiment of the apparatus, the apparatus further comprises: a retransmission module, configured to determine, under the condition that the transmission type is retransmission, pixel data to be retransmitted according to retransmission information, and determine resources of the pixel data to be retransmitted in an occupied third receiving end, where the third receiving end includes a receiving end that is greater than or equal to a performance parameter of the receiving end to be retransmitted;

In one embodiment of the apparatus, the apparatus further comprises: under the condition that the transmission of the pixel data of the second receiving end cannot be completed by combining the occupation coordination data and the occupation coordination pixel data resources, the pixel data is transmitted through any one of the following modules, namely a master-slave transmission module, an alternate display module and a temporary closing module;

the master-slave transmission module is used for determining a master receiving end, creating a resource occupation table of a slave receiving end through the master receiving end, and transmitting the pixel data to the slave receiving end, wherein the slave receiving end comprises a receiving end which is connected with the master receiving end and is not allocated with resources, and the resource occupation table of the slave receiving end is used for indicating the slave receiving end to acquire the pixel data.

The alternate display module is configured to display video data buffered by the receiving end with the allocated resources, receive pixel data of the receiving end with the unallocated resources through the receiving end with the allocated resources, and readjust a resource occupation table of the receiving end with the unallocated resources, where the resource occupation table of the receiving end with the unallocated resources is used to instruct the receiving end with the unallocated resources to acquire the pixel data.

The temporary closing module is used for determining a receiving end with unallocated resources, wherein the receiving end with unallocated resources comprises a fourth receiving end and a fifth receiving end;

The modules in the multi-channel data transmission device based on the occupancy coordination mechanism can be all or partially implemented by software, hardware and a combination thereof. The above modules may be embedded in hardware or may be independent of a processor in the computer device, or may be stored in software in a memory in the computer device, so that the processor may call and execute operations corresponding to the above modules.

The embodiment of the present disclosure further provides another multi-channel data transmission device 900 based on an occupancy coordination mechanism, as shown in fig. 9, applied to a receiving end, where the device includes:

a first feedback module 902, configured to feedback, when an occupation coordination pixel data resource in a preset frame structure does not meet a requirement of pixel data to be transmitted, first information of a mapping field, where the first information indicates that a transmitting end does not normally allocate the occupation coordination pixel data resource;

a display module 904, configured to compose and display video data by using pixel data under a condition that an occupation coordination pixel data resource in a preset frame structure meets a requirement of the pixel data to be transmitted;

and a second feedback module 906, configured to feedback second information of the mapping field to the transmitting end, where the second information characterizes that the transmitting end normally allocates the occupied coordination pixel data resource.

In one embodiment of the apparatus, the apparatus further comprises: the comprehensive display module is used for determining the occupation coordination pixel data resources and the occupation coordination data used when receiving the pixel data according to a preset resource occupation table in the frame structure;

In one embodiment of the apparatus, the display module 904 includes: a pixel data acquisition module using a resource determination module;

the usage resource determining module is configured to determine the occupation coordination pixel data resource used when receiving pixel data, where the occupation coordination pixel data resource is allocated by a transmission end according to a performance parameter;

the pixel data acquisition module is used for acquiring pixel data according to the resource mapping table and the used occupied coordination pixel data resources, forming video data and displaying the video data.

In one embodiment, a computer device is provided, which may be a server, and the internal structure of which may be as shown in fig. 10. The computer device includes a processor, a memory, and a network interface connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, computer programs, and a database. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The database of the computer device is for storing pixel data. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program, when executed by a processor, implements a multi-channel data transmission method based on an occupancy coordination mechanism.

Those skilled in the art will appreciate that the structures shown in FIG. 10 are only block diagrams of portions of structures associated with the disclosed aspects and are not limiting as to the computer device on which the disclosed aspects may be implemented, and that a particular computer device may include more or less components than those shown, or may combine some of the components, or have a different arrangement of components.

In one embodiment, a computer device is provided, comprising a memory and a processor, the memory having stored therein a computer program, the processor implementing the steps of the method embodiments described above when the computer program is executed.

In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored which, when executed by a processor, implements the steps of the method embodiments described above.

In an embodiment, a computer program product is provided, comprising a computer program which, when executed by a processor, implements the steps of the method embodiments described above.

Those skilled in the art will appreciate that implementing all or part of the above described methods may be accomplished by way of a computer program stored on a non-transitory computer readable storage medium, which when executed, may comprise the steps of the embodiments of the methods described above. Any reference to memory, database, or other medium used in embodiments provided by the present disclosure may include at least one of non-volatile and volatile memory, among others. The nonvolatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical Memory, high density embedded nonvolatile Memory, resistive random access Memory (ReRAM), magnetic random access Memory (Magnetoresistive Random Access Memory, MRAM), ferroelectric Memory (Ferroelectric Random Access Memory, FRAM), phase change Memory (Phase Change Memory, PCM), graphene Memory, and the like. Volatile memory can include random access memory (Random Access Memory, RAM) or external cache memory, and the like. By way of illustration, and not limitation, RAM can be in the form of a variety of forms, such as static random access memory (Static Random Access Memory, SRAM) or dynamic random access memory (Dynamic Random Access Memory, DRAM), and the like. The databases referred to in the various embodiments provided by the present disclosure may include at least one of a relational database and a non-relational database. The non-relational database may include, but is not limited to, a blockchain-based distributed database, and the like. The processors involved in the embodiments provided by the present disclosure may be general-purpose processors, central processing units, graphics processors, digital signal processors, programmable logic, quantum computing-based data processing logic, etc., without limitation thereto.

The technical features of the above embodiments may be arbitrarily combined, and all possible combinations of the technical features in the above embodiments are not described for brevity of description, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.

The foregoing examples have expressed only a few embodiments of the present disclosure, which are described in more detail and detail, but are not to be construed as limiting the scope of the present disclosure. It should be noted that variations and modifications can be made by those skilled in the art without departing from the spirit of the disclosure, which are within the scope of the disclosure. Accordingly, the scope of the present disclosure should be determined from the following claims.

Claims

1. The multichannel data transmission method based on the occupation coordination mechanism is characterized by being applied to a video image processing system, wherein a transmission end in the video image processing system is used for transmitting pixel data to a plurality of receiving ends, and the method comprises the following steps:

under the condition that the allocated resources cannot meet the pixel data transmitted by a second receiving end, enabling the occupied coordination data in the frame structure, allocating the occupied coordination data and occupied coordination pixel data resources for the second receiving end, and transmitting the pixel data to the second receiving end through the occupied coordination data and occupied coordination pixel data resources;

the preset frame structure includes: virtual video time slots, filling video time slots, and occupying coordinated pixel data resources; the virtual video time slot, the filling video time slot and the occupied coordination pixel data resource in the preset frame structure are added in the fixed time slot in the original standard frame structure;

the dividing virtual video time slot is used for filling the pseudo data;

the second protection time slot is used for distinguishing the occupation coordination data from the division filling video time slot; the virtual video time slot, the filling video time slot and the occupied coordination pixel data resource in the preset frame structure are added in the fixed time slot in the original standard frame structure, and the method comprises the following steps:

The preset frame structure is obtained by splitting the Dummy Video in the standard frame structure into four parts and splitting the Fill Video into three parts, the virtual Video time slot in the preset frame structure is the Dummy Video in the standard frame structure, and the split four parts are respectively: occupying coordination zone bit, resource occupying table, first protection time slot, dividing virtual video time slot; filling Video time slots in a preset frame structure is Fill Video in a standard frame structure; the three split portions include: occupy coordination data, second guard time slot, split fill video time slot.

2. The method of claim 1, wherein the first guard time slot is zero if the virtual video time slot is fully occupied as the occupancy coordination flag and the resource occupancy table; in the case where the filler video slots are all occupied as the occupancy coordination data, the second guard slot is zero.

3. The method according to claim 1, wherein said transmitting the pixel data to the second receiving end through the occupancy coordination data and occupancy coordination pixel data resource association comprises:

4. A method according to claim 3, characterized in that the method further comprises: and under the condition that the transmission type is error correction transmission, the error correction pixel data in error correction transmission is placed on resources occupied by an error correction receiving end to be transmitted, or the transmission is carried out through the occupied coordination data and/or the occupied coordination pixel data, wherein the error correction receiving end is a receiving end for transmitting the pixel data identical to the error correction pixel data.

5. A method according to claim 3, characterized in that the method further comprises: under the condition that the transmission type is retransmitted, determining pixel data to be retransmitted according to retransmission information, and determining resources of the pixel data to be retransmitted in an occupied third receiving end, wherein the third receiving end comprises a receiving end which is larger than or equal to performance parameters of the receiving end to be retransmitted;

6. The method according to claim 1, wherein the method further comprises: and transmitting the pixel data in any one of the following modes under the condition that the transmission of the pixel data of the second receiving end cannot be completed by combining the occupation coordination data and the occupation coordination pixel data resource:

7. The multichannel data transmission method based on the occupation coordination mechanism is characterized by being applied to a receiving end in a video image processing system, and comprises the following steps:

under the condition that the occupied coordination pixel data resources in the preset frame structure do not meet the requirements of the pixel data to be transmitted; the preset frame structure includes: virtual video time slots, filling video time slots, and occupying coordinated pixel data resources; the virtual video time slot, the filling video time slot and the occupied coordination pixel data resource in the preset frame structure are added in the fixed time slot in the original standard frame structure;

the dividing virtual video time slot is used for filling the pseudo data;

feeding back second information of the mapping field to the transmission end, wherein the second information characterizes that the transmission end normally distributes the occupied coordination pixel data resources;

the virtual video time slot, the filling video time slot and the occupied coordination pixel data resource in the preset frame structure are added in the fixed time slot in the original standard frame structure, and the method comprises the following steps:

8. The method of claim 7, wherein after the feedback mapping the first information of the field to the transmitting end, the method further comprises:

9. The method of claim 7, wherein said composing and displaying video data from said pixel data comprises:

10. A multi-channel data transmission device based on an occupancy coordination mechanism, which is applied to a video image processing system, wherein a transmission end in the video image processing system is used for transmitting pixel data to a plurality of receiving ends, and the device comprises:

The resource allocation module is configured to allocate, according to a performance parameter of a first receiving end connected to the transmitting end, an occupation coordination pixel data resource in a preset frame structure to the first receiving end, where the preset frame structure includes: virtual video time slots, filling video time slots, and occupying coordinated pixel data resources;

the virtual video time slot, the filling video time slot and the occupied coordination pixel data resource in the preset frame structure are added in the fixed time slot in the original standard frame structure;

the dividing virtual video time slot is used for filling the pseudo data;

the preset frame structure is obtained by splitting the Dummy Video in the standard frame structure into four parts and splitting the Fillvideo into three parts, the virtual Video time slot in the preset frame structure is the Dummy Video in the standard frame structure, and the split four parts are respectively: occupying coordination zone bit, resource occupying table, first protection time slot, dividing virtual video time slot; filling Video time slots in a preset frame structure is Fill Video in a standard frame structure; the three split portions include: occupying coordination data, a second protection time slot, and dividing and filling video time slots;

11. A multi-channel data transmission device based on an occupancy coordination mechanism, which is applied to a receiving end in a video image processing system, the device comprising:

the first feedback module is configured to feedback first information of a mapping field when an occupation coordination pixel data resource in a preset frame structure does not meet a requirement of pixel data to be transmitted, where the first information characterizes that a transmitting end does not normally allocate the occupation coordination pixel data resource, and the preset frame structure includes: virtual video time slots, filling video time slots, and occupying coordinated pixel data resources;

the dividing virtual video time slot is used for filling the pseudo data;

the second feedback module is used for feeding back second information of the mapping field to the transmission end, wherein the second information characterizes that the transmission end normally distributes the occupied coordination pixel data resource;

12. A computer device comprising a memory and a processor, the memory storing a computer program, characterized in that the processor implements the steps of the method of any one of claims 1 to 6 or 7 to 9 when the computer program is executed.

13. A computer readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the steps of the method of any one of claims 1 to 6 or 7 to 9.