CN100568958C - Program remote editing method based on network - Google Patents

Abstract

The invention discloses a remote editing method of data, in particular to a program remote editing method based on a network. Transmitting the mirror image program data information of the pre-made low-data-volume program file to be edited to a client computer from a server through a remote network; when the client computer browses or edits a certain frame through the mirror image program data information, the server transmits the current frame data to the client computer in real time; the client computer edits and dots the program and records the frame sequence number corresponding to the start point and the stop point; the client computer generates the recorded information into editing control information and transmits the editing control information to the server; and the server extracts corresponding program frame data from the associated high-bit-rate program file according to the editing control information to form a program editing file. The invention realizes the smooth playing and the accurate editing of the frame of the remote program file under the condition of a complex high-delay network.

Description

A Method for Remote Editing of Programs Based on Network

technical field

The invention relates to a method for remotely editing programs based on a network, and relates to a method for remotely editing data, in particular to a method for remotely editing programs based on a network.

Background technique

In order to facilitate the digital management and editing of media program materials, TV stations store media program materials as low-bit-rate (bitrate) program files for editing and high-definition high-bit-rate program files for playback. , Program files with high and low bit rates are only different in resolution, that is, in bit rate. When editing, by editing the low-bit-rate program file, determine the starting point and end point of the program frame to be selected, and then the computer system will use the set relationship or setting between the low-bit-rate program file and the high-bit-rate program file The path pointing to the high-bit-rate program file automatically extracts the edited and selected program frame data from the corresponding high-bit-rate program file, and generates an edited media program that meets the playback conditions for storage or direct playback. Program editing is usually done in-house. In the following description, the low bit rate program file is called "source program file".

With the development of digital technology and network technology, it is possible to edit and produce programs remotely. Media content production and data sharing will not be limited to traditional production units, and the scope of program production will gradually expand beyond TV stations. In any location with IP network support, the shared production and broadcast technology of media programs on a global scale has gradually begun. However, users have been plagued by problems such as network congestion and long transmission paths leading to excessive access delays, especially in ultra-remote network environments (for example, more than 6,000 kilometers). Due to too many network relay links, even if the leased bandwidth is sufficient For large dedicated lines, the longer the distance, the longer the network delay, even reaching more than 600ms. In this case, even the remote playback of the most basic video and audio program materials will be very difficult, and there will be intermittent stuttering and stuttering, and it is even more difficult to realize accurate remote program editing of program materials, and the problem of network delay Limited by the performance and technology of the network equipment itself, it is difficult to solve it from the aspect of hardware.

At present, the common way to realize remote editing of programs at home and abroad is to firstly perform remote preview through standard streaming media protocols, such as Microsoft's WMS protocol or REAL NETWORK's RA protocol. The server side downloads it to the local client side through the FTP transfer protocol and then edits it. Then, the edited results are packaged and sent back to the location of the high-bit rate program file, and the program is transcoded and synthesized to generate the edited video and audio files. But this method has the following disadvantages:

(1) In order to realize remote preview, in addition to the high and low bit rate program materials required for program editing, each material also needs to generate a certain format of streaming media files, which not only takes up a lot of disk space, but also requires additional transcoding time;

(2) When using streaming media technology for remote preview, due to the limitation of streaming media technology itself, it can only realize sequential playback, and cannot search, search, drag and drop at will, let alone realize frame-accurate remote editing;

(3) Low bit rate programs need to be downloaded and then edited locally. Due to the high delay characteristics of the network, it will take a long time to download from the network, and the timeliness is poor;

(4) All the program frame data of the program to be edited are transmitted during the editing process, the data volume is large, and the network transmission burden is heavy, which is not conducive to the full utilization of limited network resources.

Contents of the invention

The technical problem to be solved by the present invention is to provide a network-based remote program editing method, so that in the high-delay ultra-remote network environment, without downloading the program data of the material to be edited to the local network, the real-time editing of the program data can be performed. Remote smooth browsing editor.

In order to achieve the above object, the present invention provides a network-based program remote editing method, which is applied to a network composed of existing servers, client computers and network devices, and is characterized in that it includes the following steps:

(1) The server CPU takes out the source program file data from the media material library of the server, and extracts information and frame data from the file data to establish mirror image program data information associated with the source program file data, and saves it to the server In the media material library, wherein, the information extracted includes: the starting point and the offset of the frame data;

(2) The server transmits the mirrored program data information selected by the client computer to the client computer through the network equipment according to the request sent by the client computer;

(3) the client CPU parses the mirrored program data information, and displays it on the display device of the client computer;

(4) When the input device in the client computer receives the user's control information, the client CPU takes out the starting point and offset of the current frame data from the analyzed mirror image program data information according to the control information of the input device , and send a transmission request to the server, the server takes out the current frame data from its media material library and transmits it to the client computer through the network device, and displays it on the display device after the client computer parses and restores it;

(5) When the client CPU collects the control information of selecting the current frame according to the input device, take out the frame sequence number of the current frame as the starting point or end point of the edited paragraph, and store it in the buffer memory in the client computer; return to step (4) and repeat Execute until the frame numbers corresponding to the start point and the end point of the editing paragraph are all stored in the buffer in the client computer;

(6) The client CPU fetches from the cache memory the associated information parsed from the mirror image program data information in step (3) and the frames corresponding to the start and end points of the edited paragraph recorded in step (5) ordinal, generate edit control information, store it in a storage device on the client computer, and/or send it over a network to a server.

The program remote editing method described in the present invention further includes:

(7) The server CPU extracts the corresponding program frame data from the associated high-bit-rate program data according to the editing control information, generates program editing data, and saves the program data to the memory of the program playback device through the network, and/or the cache of the program playback device server, and/or storage device on the client computer.

The program remote editing method according to the present invention, wherein the step (1) includes:

The server CPU takes out the source program file data from the media material storehouse of the server and opens it, and extracts the metadata information, the frame sequence in the index information, the starting point and offset of each frame data, and the necessary frame data in the media material. The image program data information associated with the source program file data is established in the library, and the path information associated with the source program file and the corresponding high bit rate program file, the extracted metadata information, and the frame sequence are sequentially written in the image program data information. , the starting point and offset of each frame data, and necessary frame data, and store them; wherein, the metadata information includes: encoding format, total frame number, key frame interval; the necessary frame data is the first frame data, other key frame data and/or tail frame data.

The program remote editing method described above, wherein, the step (3) includes:

The client CPU takes out the mirrored program data information from the storage device of the client computer and analyzes it, displays the editing desktop on the display device of the client computer, and starts the decoder of the client computer to decode and restore the necessary frames according to the encoding format The image is displayed in the browsing window of the editing desktop; and the frame coordinate axis is displayed on the editing desktop, the relationship between the coordinate point of the coordinate axis and the corresponding starting point and offset of the frame data in the source program file is displayed, and the image and the frame are displayed The corresponding relationship between the position of the slider on the coordinate axis;

Wherein, described step (4) comprises:

(41) When the user uses the input device of the client computer to control the slider displayed on the display device to slide to a certain coordinate point on the coordinate axis, the client CPU obtains the slider specified by the slider. Frame, and according to the key frame distance that metadata information provides, carry out key frame judgment to it, if this frame is key frame then go to step (44), if then go to step (42) for non-key frame;

(42) The client CPU calculates the frame number of the previous key frame according to the encoding format through the frame specified by the key frame interval and the slider;

(43) The client CPU determines and takes out the selected frame and the key frame according to the frame number of the previous key frame determined by the current frame number and the frame number of the step (42), through the association between the coordinate point and the starting point of the frame data and the offset. The data starting point and the offset are stored in the buffer in the client computer, and turn to step (45);

(44) the client CPU determines and takes out the data starting point and the offset of the selected frame according to the association established between the frame coordinate point and the frame data starting point and the offset and stores them in the buffer memory in the client computer, and then proceeds to step (45) );

(45) The client CPU sends a data transmission request to the server through the network, and takes out the starting point and offset of the data and the path of the source program file from the buffer of the client computer and sends them to the server;

(46) The server CPU retrieves the required data from the media material library of the server according to the received data transmission request and data information;

(47) The server CPU will take out the data that meets the requirements and send it to the client computer through the network equipment;

(48) The client computer receives the above-mentioned data, decodes the data and restores the image to display in the display device by starting the decoder of the client computer, and returns to step (41) to continue execution;

Wherein, the step (41) further includes:

When in the step of pointing to the frame number, the number of frames that the slider on the editing desktop moves quickly on the frame coordinate axis per unit time exceeds the specified data, the client CPU only determines and points to the pause of the slider on the frame coordinate axis or the frame corresponding to the stopping point.

The aforementioned program remote editing method, wherein the step (5) further includes:

The user controls the dot operation of the editing desktop through the input device in the client computer, and the client CPU records the corresponding frame number on the frame coordinate axis where the instant slider is located, and stores it in the buffer in the client computer, and then returns to step (4 ) continue to execute until the end of editing;

The program remote editing method described above, wherein, the step (5) further includes:

When the client CPU stores the recorded frame number into the client computer buffer, it detects whether there is a frame number in the buffer, and if so, compares the recorded frame number with the frame existing in the buffer The ordinal number is confirmed in turn as the starting point and end point of the edited paragraph and stored in the buffer according to the order of the two on the frame coordinate axis; if not, it is defaulted as the starting point of the edited paragraph and stored in the buffer.

The program remote editing method according to the present invention, wherein the step (4) further includes:

The client CPU of the client computer executes the user to add a paragraph mark through the input device, and displays it through the display device;

Described step (5) further comprises:

The client CPU of the client computer executes the user to adjust the order of each paragraph through the input device, and re-stores it in the buffer memory of the client computer;

The client CPU of the client computer executes the user to delete the currently selected paragraph through the input device, and clears the corresponding data from the buffer memory of the client computer; and determines whether to execute adding a paragraph mark.

The program remote editing method according to the present invention, wherein, the server includes: an edge server in the same local area network or metropolitan area network as the client computer, which is used to provide source program files and mirror image program data information;

In described step (2), further comprise:

The client computer first sends a request to the edge server to find out whether there is required mirror image program data information in the media material library of the edge server, and if it exists, the client computer directly obtains the required mirror image program data information from the edge server; If it does not exist, then the client computer sends a request to a server other than the edge server, and the server transmits the mirrored program data information selected by the client computer to the client computer through the network equipment, and stores it in the same location as the edge server. The client computer is on the edge server on the same LAN or MAN.

The program remote editing method described in the present invention realizes the smooth playback of remote program files and the precise editing of frames under complex and high-delay network conditions, and effectively solves the problem that in the past under such network conditions, it can only be played by streaming media technology However, the problem of frame-accurate editing cannot be achieved. The present invention can be directly applied to remote program cooperative production network, fast return of remote program fragments and other applications.

Description of drawings

Fig. 1 is the system structural block diagram of the program remote editing method based on the network of the embodiment of the present invention;

Fig. 2 is a data transmission block diagram of the network-based program remote editing method according to the embodiment of the present invention;

3 is a data structure diagram of source program files in the network-based program remote editing method according to the embodiment of the present invention;

4 is a data structure diagram of mirror image program data information in the network-based program remote editing method according to the embodiment of the present invention;

5 is a data structure diagram of editing control information in the network-based remote program editing method according to the embodiment of the present invention;

6 is a schematic diagram of the editing desktop displayed on the display device of the client computer in the network-based program remote editing method according to the embodiment of the present invention;

FIG. 7 is a main flow chart of a network-based program remote editing method according to the embodiment of the present invention;

Fig. 8 is the flow chart that step B1 among Fig. 7 establishes mirror image program information;

Fig. 9 is the flow chart that step B4 opens mirror image program information among Fig. 7;

FIG. 10 is a flow chart of step B6 browsing in FIG. 7 .

Detailed ways

The basic technical idea adopted by the network-based program remote editing method of the present invention is to transmit only necessary data information with a low amount of data in the editing process, and use a self-defined frame mode media transmission protocol for transmission; Mirroring the program data information of the data volume, the required program frame data is transmitted in real time during preview and editing, and the editing control information is sent back to the server after the editing is completed.

In order to facilitate a further understanding of the method of the present invention, the present invention will be described in detail below in conjunction with the accompanying drawings and embodiments:

As shown in Figure 1, a system structure diagram of the network-based program remote editing method for realizing the embodiment of the present invention is provided; wherein, the server S101 and the client computer S110 are respectively connected to the network S108 through network devices S107 and S109, Realize the remote access and data transmission of the server S101 and the client computer S110; the server S101 used to provide source program files and generate mirror image program data information, including: media material library S102 containing source program files and mirror image program data information, processing The server CPUS104 for data and execution instructions, the data storage device S103 for storing data, etc.; the program playback device S106 is used to realize the playback of edited programs, and the program playback device buffer S105 is used for temporary storage of program data during program playback. sexual storage.

In order to further improve the efficiency of remote editing of programs and reduce the load on the remote network and server, the above-mentioned system may further include: a network for providing source program files and mirrored program data information set on the same local area network or metropolitan area network as the client computer S110 The edge server S116 includes: the media material library S118 is used to store the source program files and mirror image program data information that the server S101 has transmitted to the client computer S110, the server CPUS117 is used to process data and execute instructions, and the data storage device S119 is used to for storing data.

As shown in Figure 2, the remote editing method realized by the present invention is provided with a data frame diagram transmitted through the network; wherein,

Step S201, before editing, what the server transmits to the client computer through the network is mirror image program data information;

Step S202, during the editing process, the server receives the program frame data offset and transmission request of the client computer through the network;

Step S203, the server transmits the source program frame data specified in the above step S202 to the client computer through the network, where the source program frame data is low bit rate frame data;

Step S204, after the editing of the client computer is completed, the server receives the editing control information of the client computer through the network;

Step S205, of course, if the data required by the client computer already exists in the edge server, that is, it only needs to be obtained from the edge server without being transmitted from the server through the remote network again; if the data required by the client computer is in the server, the server Then send it to the client computer according to the high bit rate program frame data specified in the editing control information.

According to the source program file data structure diagram provided in the network-based program remote editing method of the embodiment shown in Figure 3, no matter what encoding format is used to encode and compress the digital media program, the data structure of its program file includes three Basic components: Metadata information S301 is at the head of the file, describing the characterization information of the file, which includes: the encoding format adopted by the program file, the total number of frames, key frame spacing, resolution, etc.; followed by index information S302, The content of the description includes: the frame sequence of the program file, the starting point and offset of each frame data, the corresponding key frame and the relationship with the key frame, etc., which are used to read the data of the corresponding frame when playing the program; The frame data S303 is the data body of the program file, which is the specific data information of each frame encoded and stored according to the information determined by the preceding metadata information S301 and index information S302.

Referring to Figure 1 and Figure 7 below, the process described in the embodiment of the present invention will be described in detail:

As shown in Figure 7, step B1, set up mirror image program information, complete by server S101 among Fig. Step flow chart, where the server S101 executes in sequence:

As shown in Fig. 8, step B101, open source program file; Server CPUS104 takes out source program file from its media material storehouse S102 and opens, and establishes corresponding mirror image program data information data starting point in media material storehouse S102 according to agreement, writes this source In the path information S401 of the program file and the corresponding high-bit-rate program file, an association with the source program file is formed;

Step B102, extracting metadata information; according to the source program file data structure shown in Figure 3, server CPUS104 extracts metadata information S301 from the head of the source program file, and writes in the mirror image program data information set up in step B101 successively, Forming metadata information S402; wherein the metadata information includes: encoding format, total number of frames, key frame interval, etc.;

Step B103, extracting index information; the server CPUS104 extracts index information S302 from the source program file, takes out the frame sequence, the starting point and offset of each frame data, and writes them in the above-mentioned mirror image program data information in order to form frame data description S403 ;

Step B104, extracting the first frame data of the program; the server CPUS104 extracts the first frame data from the frame data S303 according to the metadata information S301 and the index information S302 in the source program file, and stores them in the above-mentioned mirror image program data information to form the necessary frame data S404;

Step B105, extracting other necessary frame data of the program; as required, the server CPUS104 can be designated to extract other frame data from the frame data S303 according to the metadata information S301 and index information S302 in the source program file, such as the end frame, a certain key frame in the middle, etc. , stored in the above mirror image program data information;

Step B106, generate and store a mirror image file; the server CPUS104 establishes a file end point for the above mirror image program data information, generates a file and stores it.

As shown in Figure 7, step B2, search mirror image program information; Client computer S110 is connected with server S101 by network S108, and client CPUS113 sends request to server S101, and server S101 searches needed mirror image program data information from media material storehouse S102 , this kind of search can use precise or fuzzy search methods according to needs, and the inclusion can be directly searched by including material path, material name, time, keywords, and category name, or can be searched by establishing a query database and coordinating with the guide to mirror program data information ;

Step B3, transmit mirror image program information; Server CPUS101 transmits the mirror image program data information selected by client computer S110 to client computer S110 through network S108 according to the request sent by client CPUS113, and saves to client computer storage device S115 or its In cache memory S112; Also can save this file in its media material storehouse S118 by the server CPUS117 of edge server S116 at the same time, in case client computer S110 uses this data again;

Step B4, open the mirrored program information; combined with the flow chart of steps shown in Figure 9, the editing desktop picture shown in Figure 6, and Figure 4, execute in sequence on the client computer:

As shown in Figure 9, step B401 is to analyze the mirror image program data information; the client CPUS113 takes out the mirror image program data information from its storage device S115 or buffer S112 and opens it, analyzes according to the protocol, and stores the program path S401 taken out into the cache device S112, displaying the editing desktop on its display device S111, and displaying paragraph mark 1 by default in the editing information sequence S609 of the editing desktop;

Step B402, read the encoding format of the program data; the client CPUS113 reads the metadata information S402 from the metadata information S401 of the above-mentioned analyzed mirror image program data information and puts it into the buffer S112, and takes out the encoding format of the program data;

Step B403, displaying the encoding format; the encoding format taken out by the client CPUS113 is displayed on the editing desktop;

Step B404, take out the first frame data and decode and display; the client CPUS113 finds and starts the decoder in the client computer S110 according to the encoding format, takes out the first frame data from the necessary frame data S404 of the above-mentioned mirror image program data information, and decodes it through the encoder Restore, display the frame image on the editing desktop browsing window S601, if the data in the necessary frame data S404 is other key frame data or tail frame data, then decode the corresponding data and display the corresponding image;

After the analysis in the above step B401, the client CPUS113 also executes:

Step B405, read the metadata information and frame data description; the client CPUS113 reads the metadata information from the buffer S112, and reads the frame data description from the above-mentioned analyzed image program data information and stores it in the buffer S112;

Step B406, displaying the total number of frames; the client CPUS113 takes out the total number of frames from the metadata information, and displays it on the editing desktop. This display can also be converted and displayed as the playing time of the source program file. Divide by the number of frames played per second (for example: 25) to get the duration in seconds;

Step B407, establish frame coordinates; client CPUS113 fetches metadata information S402, frame data description S403 from buffer S112, generates frame coordinates, displays on the editing desktop as frame coordinate axis S602, frame sequence number of coordinate point of description coordinate axis S602 S603, S603 can also be the time point display of the corresponding frame of the source program file as the time. At the same time, the slider S608 is at the position of the frame corresponding to the image displayed in the browsing window S601 on the coordinate axis S602. If it is displayed as the first frame image, slide The block S608 is at the position on the coordinate axis S602 of the first frame, and if it is displayed as other frame images, the slider S608 is at the position on the corresponding coordinate axis S602;

Step B408, establish the association between the frame coordinates and the frame data offset information; the client CPUS113 associates each coordinate point with the corresponding frame data offset in the source program file according to the frame data description and the program path information S401 , for example: the coordinate point of the 100th frame is associated with the starting point and offset of the 100th frame data in the source program file; when the slider S608 is at a certain frame coordinate point, the client CPUS113 can directly take out the frame data corresponding to this point The starting point and offset of the data.

As shown in Figure 7, step B5, add editing information sequence; The execution of this step is controlled by the input device S114 of client computer S110, because when step B401 shown in Figure 9 is executed, only in the editing information sequence S609 of Figure 6 The default value is 1, that is, only one segment of the program is selected for editing from the source program file. If multiple program segments need to be selected, it needs to be added. Add a paragraph mark in the information sequence S609, such as 2, 3, 4, etc.;

Step B6, browse; this step realizes controlling the browsing window S601 to display the image of the corresponding frame through the position of the slider S608 in the frame coordinate axis S602 in Figure 6, and in combination with Figure 10, execute in sequence:

Step B601, pointing to the frame number; the input device S114 of the client computer S110 controls the slider S608 to slide to a certain coordinate point on the coordinate axis S602, and the client CPUS113 obtains the frame specified by the slider, and according to the key provided by the metadata information Frame spacing, key frame judgment is carried out on it, if the frame is a key frame then go to step B604, if it is a non-key frame then go to step B602;

Step B602, calculate the position of the previous key frame; the client CPUS113 calculates the position of the previous key frame through the key frame interval and the frame specified by the slider S608, such as the 50th frame;

Step B603, taking out the corresponding frame and its key frame data offset; the client CPUS113 determines and takes out the data starting point and offset of the selected frame and key frame according to the association established between the frame coordinate point and the frame data offset and stores them in the buffer S112;

Step B604, taking out the data offset of the corresponding frame; the client CPUS113 determines and takes out the data starting point and offset of the selected frame according to the association established between the frame coordinate point and the frame data offset and stores them in the buffer S112;

Step B605, transmission request; the client CPUS113 sends a data transmission request to the server S101 through the network equipment and the network S108, and takes out the data offset and the source program file path from the buffer S112 and sends them to the server S101;

Step B606, taking out the program frame data: the server S101 receives the above-mentioned data transmission request and data information, and the server CPUS104 takes out the required data from the media material library S102 according to the data information;

Step B607, transmit program frame data: the server CPUS104 will take out the data that meets the requirements and send it to the client computer S110 through the network equipment and the network S108;

Step B608, decoding and displaying: the client computer S110 receives the above data, decodes and restores the data to an image through the activated decoder and displays it in the browsing window S601; and returns to step B601 for repeated execution.

In this browsing process, the edge server CPUS117 can generate the source program files sequentially according to the encoding format of the source program files according to the encoding format of the source program files and store them in the media material storehouse S118 of the edge server S116; For all the data of the source program file, after the browsing is completed, the remaining data will continue to be transmitted to generate a complete file that is the same as the source program file in the server media material library S102, so that the client computer S110 can use it again.

If the input device S114 drags the slider S608 too quickly during the browsing process, the client computer S110 continuously executes the above steps B601 to B608, and the slider S608 will be sequentially displayed in the browsing window S601 of the client display device S111 through the frame coordinate axis S602 However, if the client CPUS113 skips the associated data corresponding to the coordinate point on the frame coordinate axis S602 that slides in the middle, directly confirm the frame coordinate point where the slider S608 is currently located, and take out the corresponding The starting point and offset of the frame data, send a transmission request to the server S101 to avoid the transmission of unnecessary frame data, the value of the fast drag is manually set, for example, it can be set when dragging 50 frames within 1 second When data is executed, data transmission at the stop point of slider S608 is performed.

As shown in Figure 7, step B7, editing and dotting; when browsing to the desired image, control the dot button S604 on the editing desktop through the input device S114, and the client CPUS113 records the corresponding frame on the frame coordinate axis S602 where the instant slider S608 is located Ordinal number, such as the 109th frame, is stored in buffer S112, if there is a frame ordinal number of this paragraph in buffer S112, then compare with it, confirm respectively as this paragraph starting point with its order on frame coordinate axis S602 and the end point, if there is none, it defaults to the start point of this paragraph;

Return to step B6 and continue to execute until the start point and end point of the paragraph selected in the edit information sequence S609 are marked.

Step B8, adjust/delete the editing information sequence; according to the needs of editing, the client CPUS113 controls the order of each paragraph in the editing information sequence S609 through the input device S114, and re-stores it in the buffer S112. Paragraph, delete the currently selected paragraph by controlling the delete button S606 through the input device S114, and remove the corresponding data from the cache memory S112, if you need to add a paragraph, then return to step B5 and execute in sequence;

Step B9, transmit the editing control information; combined with that shown in Figure 5, the client CPUS113 takes out the high bit rate program path information from the buffer S112 to generate the program path information S501 of the editing control information, and sequentially takes out the sequence of paragraphs according to the editing information sequence S609 The frame start point and end point data of all the edited dots recorded generate the frame number start and end sequence S502 of the edit control information, and the edit control information is transmitted to the server through the network S108; and/or stored in the storage device S115 of the client computer S110 as edit control information;

Step B10, generate program editing data; server CPUS104 points to the high bit rate program file according to the program path information S501 in the editing control information, takes out the frame number start and end sequence S502 from the editing control information, and records the frame of each paragraph according to the information Start point, end point, take out the corresponding high bit rate program frame data from the high bit rate program file data, successively save in the buffer memory S105 of the program playback device for playing; also can, successively store and generate the program editing file in the program playing Store in the memory of the device, and/or transmit the program editing file to the client computer S110 through the network, and save it in its storage device S115.

In order to reduce the load on the remote network S108 and the server S101, and improve the efficiency of remote editing, during the above-mentioned remote editing process, the client computer S110 accesses and transmits the mirrored program data information files and the browsed source program files have been saved to the edge server at the same time In the media material storehouse S118 of S116, client computer S110 at first sends a request to the local edge server S116 when executing step B2 to search for the mirror image program information, if there is required file in the edge server media material storehouse S118, then edit as above The step is to fetch data from the edge server S116 for editing. If the required data does not exist in the edge server S116, send a request to the server S101 to perform the above steps.

The mirrored program data information transmitted before editing the content described in the embodiments of the present invention only contains mirrored program data information with a small amount of data, and the transmission speed is fast, and browsing and editing can be started without waiting; the frame mode media transmission protocol is used when browsing, only Transmit the program frame data in the specified source program file, the amount of real-time transmission data is small, without data buffering and waiting, even if the client uses conventional ADSL Internet access, it can be realized (700K bandwidth is enough); at the same time, it can realize For the skipped segment browsing and editing of the edited program, there is no need to continuously transmit the skipped data; when editing, only the start and end sequence of the frame number is recorded, that is, the corresponding frame number and its arrangement order, etc., which occupy less resources on the client computer; The editing control information to the server only includes the path of the high-bit-rate program file and the start and end sequence of the frame number, without program frame data, the returned data is small, and the transmission speed is fast; even if the program is to be released directly on the client, The server also only needs to transmit the program frame data in the high-bit-rate program file specified in the received edit control information to the client, without other redundant data, so that the limited network resources can be effectively utilized.

The remote program editing method of the above invention realizes the smooth playback and frame-accurate editing of remote program files under complex and high-delay network conditions, and effectively solves the problem that in the past, under such network conditions, it could only be played through streaming media technology and could not be realized. The puzzle of frame-accurate editing. The present invention can be directly applied to remote program collaborative production network, fast return of remote program fragments and other applications.

Certainly, the present invention can also have other various embodiments, without departing from the spirit and essence of the present invention, those skilled in the art can make various corresponding changes and deformations according to the present invention, but these corresponding Changes and deformations should belong to the scope of protection of the appended claims of the present invention.

Claims (10)

1. A program remote editing method based on network is applied to the network composed of the existing server, client computer and network equipment, and is characterized by comprising the following steps:

(1) the method comprises the following steps that a server CPU (central processing unit) takes source program file data from a media material library of the server, extracts information and frame data from the file data to establish mirror image program data information related to the source program file data, and stores the mirror image program data information into the media material library of the server, wherein the extracted information comprises: starting point and offset of frame data;

(2) the server transmits the mirror image program data information selected by the client computer to the client computer through the network equipment according to the request sent by the client computer;

(3) the client CPU analyzes the mirror image program data information and displays the mirror image program data information on the display equipment of the client computer;

(4) when the input equipment in the client computer receives the control information of a user, the CPU of the client takes out the starting point and the offset of the current frame data from the analyzed mirror image program data information according to the control information of the input equipment and sends out a transmission request to the server, and the server takes out the current frame data from the media material library of the server and transmits the current frame data to the client computer through the network equipment, and the current frame data is displayed on the display equipment of the client computer after being analyzed and restored by the client computer;

(5) when the CPU of the client acquires the control information of the selected current frame according to the input equipment, the frame sequence number of the current frame is taken out as the starting point or the end point of the editing paragraph and is stored in a buffer in the computer of the client; returning to the step (4) to execute repeatedly until the frame sequence numbers respectively corresponding to the starting point and the end point of the edited paragraph are stored in a buffer in the client computer;

(6) and (3) the client CPU takes out the association information analyzed from the mirror image program data information in the step (3) and the frame sequence numbers respectively corresponding to the starting point and the ending point of the editing paragraph recorded in the step (5) from the buffer to generate editing control information, and the editing control information is stored in a storage device of a client computer and/or is sent to a server through a network.

2. The program remote editing method according to claim 1, further comprising:

(7) and the server CPU takes out corresponding program frame data from the associated high-bit-rate program data according to the editing control information to generate program editing data, and stores the program editing data in a program playing equipment memory,/or a program playing equipment buffer and/or a storage device of a client computer through a network.

3. The program remote editing method according to claim 1, wherein said step (1) comprises:

the method comprises the steps that a server CPU (central processing unit) takes source program file data out of a media material library of the server and opens the source program file data, sequentially extracts metadata information, a frame sequence in index information, a starting point and an offset of each frame of data and necessary frame data, establishes mirror image program data information related to the source program file data in the media material library, sequentially writes path information, the extracted metadata information, the frame sequence, the starting point and the offset of each frame of data and the necessary frame data related to the source program file and a corresponding high-code-rate program file in the mirror image program data information, and stores the path information, the extracted metadata information, the frame sequence, the starting point and; wherein the metadata information includes: coding format, total frame number and key frame interval; the necessary frame data is first frame data, other key frame data and/or tail frame data.

4. A program remote editing method according to claim 3, wherein said step (3) comprises:

the client CPU takes out the image program data information from the storage device of the client computer, opens and analyzes the image program data information, displays an editing desktop on the display device of the client computer, and starts a decoder of the client computer to decode and restore necessary frame images to display on a browsing window of the editing desktop according to the coding format; and displaying a frame coordinate axis on the editing desktop, describing the association established by the coordinate axis coordinate point and the corresponding frame data starting point and offset in the source program file, and displaying the corresponding relation between the image and the slide block position on the frame coordinate axis.

5. The program remote editing method according to claim 4, wherein said step (4) comprises:

(41) when a user controls a slide block in a display device to slide to a certain coordinate point on a coordinate axis through an input device of the client computer, the client CPU obtains a frame appointed by the slide block, carries out key frame judgment on the frame according to a key frame interval provided by metadata information, and goes to a step (44) if the frame is a key frame or goes to a step (42) if the frame is a non-key frame;

(42) the client CPU calculates the frame sequence number of the previous key frame according to the coding format through the key frame interval and the frame appointed by the slider;

(43) the client CPU determines and takes out the data starting point and the offset of the selected frame and the key frame and stores the data starting point and the offset into a buffer in a client computer according to the frame sequence of the current frame and the frame sequence number of the previous key frame determined in the step (42) and the association established by the coordinate point and the starting point and the offset of the frame data, and then the step (45) is carried out;

(44) the client CPU determines and takes out the data starting point and the offset of the selected frame and stores the data starting point and the offset into a buffer in a client computer according to the association established by the frame coordinate point and the frame data starting point and the offset, and then the step (45) is carried out;

(45) the client CPU sends a data transmission request to the server through the network, and takes out a data starting point and offset and a source program file path from a buffer of the client computer and sends the data starting point and offset and the source program file path to the server;

(46) the server CPU takes out data meeting the requirements from a media material library of the server according to the received data transmission request and the data information;

(47) the server CPU sends the data meeting the requirements to a client computer through network equipment;

(48) and the client computer receives the data, decodes and restores the data into an image by starting a decoder of the client computer, displays the image in the display device, and returns to the step (41) to continue execution.

6. The program remote editing method according to claim 5, wherein said step (41) further comprises:

when the number of frames that the slider on the editing desktop rapidly moves through on the frame coordinate axis in unit time exceeds the specified data in the step of pointing to the frame ordinal number, the client CPU only determines and points to the frames corresponding to the pause or stop points of the slider on the frame coordinate axis.

7. The program remote editing method according to claim 4, wherein the step (5) further comprises:

and (4) controlling the dotting operation of the editing desktop through an input device in the client computer by a user, recording the frame sequence number corresponding to the frame coordinate axis of the instant slider by the client CPU, storing the frame sequence number in a buffer memory in the client computer, and returning to the step (4) to continue executing until the end of the dotting operation.

8. The program remote editing method according to claim 7, wherein the step (5) further comprises:

when the client CPU stores the recorded frame ordinal number into a buffer of a client computer, detecting whether the buffer has a frame ordinal number, if so, comparing the recorded frame ordinal number with the frame ordinal number in the buffer, and sequentially determining the start point and the end point of the editing paragraph as the sequence of the recorded frame ordinal number and the frame ordinal number on a frame coordinate axis to store into the buffer; if not, the default is the start of the present editing paragraph and stored in the buffer.

9. The program remote editing method according to claim 1, wherein said step (4) further comprises:

a client CPU of the client computer executes that a user adds a paragraph mark through an input device and displays the paragraph mark through a display device;

the step (5) further comprises:

the CPU at the client end of the client computer executes the sequence of each paragraph adjusted by the user through the input device and stores the sequence into the buffer of the client computer again;

a client CPU of the client computer executes that a user deletes the currently selected paragraph through input equipment and clears corresponding data from a buffer of the client computer; and determines whether to perform add paragraph marking.

10. The program remote editing method according to claim 1, wherein said server comprises: the edge server is positioned in the same local area network or metropolitan area network with the client computer and is used for providing source program files and mirror image program data information;

the step (2) further comprises:

the client computer firstly sends a request to an edge server, searches whether the media material library of the edge server has the needed mirror image program data information, and if so, the client computer directly obtains the needed mirror image program data information from the edge server; if the mirror image program data information does not exist, the client computer sends a request to a server except the edge server, and the server transmits the mirror image program data information selected by the client computer to the client computer through network equipment and stores the mirror image program data information on the edge server of the same local area network or metropolitan area network with the client computer.

Images