WO2008098441A1 - Network-based program remote editing method - Google Patents

Abstract

A data remote editing method, especially a network-based program remote editing method, comprises the following steps: transmitting a mirror program data information of the pre-processed quasi-editing program file with low data volume from a server (S101) to a client side computer (S110) through a remote network; when the client side computer (S110) browses the program or edits a certain frame by the mirror program data information, the server (S101) transmits a current frame data to the client side computer (S110) in real time; the client side computer (S110) edits and dots the program, and records a frame ordinal number corresponding to the start-stop point; the client side computer (S110) generates an editing control information from the recorded information, and transmits it to the server (S101); and the server (S101) extracts the corresponding program frame data from the associated high code rate program file according to the editing control information to form a program editing file.

Description

 Network-based program remote editing method

Technical field

 The invention relates to a network-based program remote editing method, relating to a remote editing method of data, in particular to a network-based program remote editing method.

Background technique

 In order to facilitate the digital management and editing of media program material, the television station stores the media program material as a low bit rate (Bat Rate) program file for editing and a high bit rate in accordance with the high definition of playback. Program files, high and low bit rate program files are only different in resolution, ie code rate. During editing, by editing the low-rate program file, determining the start and end points of the program frame to be selected, and then the computer system according to the association relationship or setting between the set low-rate program file and the high-rate program file. The path pointing to the high code rate program file automatically extracts the program frame data selected from the corresponding high code rate program file, and generates the edited media program that satisfies the playing condition for storage or direct playback. The editing of the program is usually done internally within the production unit. The low bit rate program file is referred to as a "source program file" in the following description.

 With the development of digital technology and network technology, it is possible to remotely edit and produce the program. The content production and data sharing of the media will not only be in the traditional production unit, but the production scope of the program will gradually expand to the TV station. In addition to any location with IP network support, the global production of broadcast technology for media programs has gradually begun. However, problems such as network congestion and excessive transmission delays have been plagued by users, especially in ultra-long-range network environments (for example, over 6,000 kilometers). Because there are too many network relay links, even the leased bandwidth is sufficient. Large dedicated lines also have a longer network delay than the distance, even reaching more than 600ms. In this case, even the most basic video and audio program material remote playback will be very difficult, there will be intermittent cards, and so on, it is more difficult to achieve accurate remote program editing of the program material, and the problem of network delay Due to the performance and technical limitations of the network device itself, it is difficult to solve from the hardware side.

At present, the common practice of remote programming of programs at home and abroad is to first perform remote preview through standard streaming protocols, such as Microsoft's WMS protocol or REAL NETWOR's RA protocol. After the program that meets the requirements, the low-rate material is downloaded from the server to the client through the FTP transmission protocol, and then edited, and then the edited result is packaged and then transmitted back to the location of the high-rate program file. The program is transcoded to generate an edited video and audio file. But this method has the following shortcomings:

 (1) In order to realize remote preview, in addition to the high and low code rate program material required for program editing, each material needs to generate a certain format of streaming media file, which not only occupies a large amount of disk space, but also requires additional transcoding. Time

 (2) When using streaming media technology for remote preview, the streaming media technology itself can only achieve sequential playback, can not search, find, drag and drop, and can not achieve frame-accurate remote editing;

 (3) The low bit rate program needs to be downloaded and then edited locally. Due to the high latency characteristics of the network, a long network download time will be required, and the timeliness is poor.

 (4) All program frame data of the program to be edited during the editing process, the data volume is large, and the network transmission burden is heavy, which is not conducive to the full utilization of limited network resources.

 .

Summary of the invention

 The technical problem to be solved by the present invention is to provide a network-based program spear rendering method, which can program data in a high-latency ultra-long-distance network environment without downloading the section PI data of the material to be edited to the local network. Real-time remote smooth browsing editing.

 In order to achieve the above object, the present invention provides a network-based program remote editing method, which is applied to a network composed of an existing server, a client computer, and a network device, and is characterized by the following steps:

 (1) The server CPU extracts source program file data from the media material library of the server, and extracts information and frame data from the file data to establish mirror program data information associated with the source program file data, and saves the data to the server. The media material library, wherein the extracted information comprises: a starting point and an offset of the frame data;

(2) the server transmits the mirrored program data information selected by the guest terminal computer to the client computer through the network device according to the request sent by the client computer; (3) the client CPU parses the mirrored program data information and displays it on a display device of the client computer;

 (4) when the input device in the client computer receives the control information of the user, the client CPU extracts the starting point and the offset of the current frame data from the parsed mirror program data information according to the control information of the input device. And sending a transmission request to the server, the server takes the current frame data from its media material library and transmits it to the client computer through the network device, and then displays it on the display device after being parsed and restored by the client computer;

 (5) when the client CPU collects the control information of the selected current frame according to the input device, extracts the frame ordinal number of the current frame as the starting point or end point information of the editing paragraph, and stores it in the buffer in the client computer;

 (6) the client CPU fetches from the buffer step (3) parses out the associated information and the edited paragraph frame start number and end point information recorded in step (5), generates edit control information, and stores the edit control information on the client computer. In the storage device, and/or sent to the server over the network.

The remote editing of the program of the present invention _{: the} method further includes:

 (7) The server CPU of the server extracts corresponding program frame data from the associated high-rate program data according to the edit control information, generates program edit data, and saves it to the program play device memory through the network, and/or plays the program. In the device buffer, and/or in the storage device of the client computer.

 The program remote editing method according to the present invention, wherein the step (1) comprises: the server CPU extracts the source program file data from the media material library of the server and opens, sequentially extracts metadata information, and frames in the index information. The sequence, the start point and the offset of each frame of data, and the necessary frame data, and the mirrored program data information associated with the source program file data is created in the media material library, and the mirrored program data information is sequentially associated with the source program file and The path information of the corresponding high-rate program file, the extracted metadata information, the frame sequence, the start and offset of each frame of data, and the necessary frame data, and stored therein; wherein the metadata information includes: an encoding format, Total frame number, key frame spacing; The necessary frame data is the first frame data, other key frame data, and/or tail frame data.

The program remote editing method described above, wherein the step (3) comprises: The client CPU takes out the mirror thrift data information from the storage device of the client computer, opens and parses, displays the edit desktop on the display device of the client computer, and starts decoding of the decoder of the client computer according to the encoding format. a frame image is displayed in a browsing window of the editing desktop; and displaying a frame coordinate axis on the editing desktop, describing an association between the coordinate axis coordinate point and a corresponding frame data offset in the source program file, and displaying the image and the frame coordinate The position of the slider position on the shaft;

 The step (4) includes:

 (41) when the user controls the display device on the display device to slide on the coordinate axis to a coordinate point through the input device of the client computer, the client CPU obtains the specified by the slider Frame, and according to the key frame spacing provided by the metadata information, the key frame is judged, if the frame is a key frame, the process proceeds to step (44), and if the result is a non-key frame, the process proceeds to step (42);

(42) the client CPU calculates the previous key frame frame number according to the coding format by using a key frame spacing and a t贞 specified by the slider;

(43) the number of previous keyframe frame sequential client CPU (4 ²⁾ is determined based on the current frame number of frame sequence and steps association establishment by coordinate points and the frame data offset is determined and taken data of the selected frame and key frame The starting point and the offset are stored in the buffer in the client computer, and the process proceeds to step (45);

(44) the client CPU determines and extracts the data start point and offset of the selected frame into the buffer in the client computer according to the association established by the frame coordinate point and the frame data offset, and proceeds to step (45);

 (45) the client CPU sends a data transmission request to the server through the network, and takes the data offset and the source program file path from the buffer of the client computer and sends the data to the server;

(46) the server CPU fetches the data that meets the requirements from the media material library of the server according to the received data transmission request and the data information;

 (47) the server CPU sends the data that meets the requirements to the client computer through the network device;

(48) the client computer receives the above data, and restores the data to an image by displaying a decoder of the client computer to display the image in the display device, and returns to step (41) to continue execution; wherein the step (41) Further includes: When in the Point to Frame Ordinal step, the slider on the editing desktop quickly moves over the frame axis per unit time through the specified number of frames, the client CPU only determines and points to the pause of the slider on the frame axis. Or stop the corresponding frame. '

 The remote editing method of the program described above, wherein the step (5) further comprises: the user controls the management operation of the editing desktop through the input device in the client computer, the client

The CPU records the corresponding frame number on the frame axis of the instant slider, and stores it in the buffer in the client computer, and then returns to step (4) to continue execution until the editing dot ends;

 The program remote editing method described above, wherein the step (5) further comprises: the client CPU detecting whether the buffer has a frame number, and if so, comparing with the frame number of the current frame corresponding to the fetching , in the order of the frame axis, it is confirmed that the start point and the end point information of the paragraph are stored in the buffer; if not, the start point information of the paragraph is defaulted and stored in the buffer.

 The program remote editing method of the present invention, wherein the step (4) further comprises: the client CPU of the client computer executes a user to add a paragraph mark through the input device, and displays the same through the display device;

 The step (5) further includes:

 The client CPU of the client computer performs the adjustment of the order of each paragraph through the input device and re-saves it into the buffer of the client computer;

 The client CPU of the client computer deletes the currently selected segment through the input device, and clears the corresponding data from the client computer's buffer; and performs the addition of the paragraph mark.

 The remote editing method of the program of the present invention, wherein the server comprises: an edge server in the same local area network or a metropolitan area network as the client computer, for providing source program files and mirrored program data information;

The step (2) further includes: the client computer first sending a request to the edge server to find whether the required mirror program data information exists in the media material library of the edge server, and if present, the client computer is from the edge The server directly obtains the required mirror program data information; if not, the client The computer then sends a request to the server, and the server transmits the mirrored program data information selected by the client computer to the client computer through the network device, and stores it on the edge server of the same local area network or metropolitan area network as the client computer.

 The program remote editing method of the invention realizes smooth playback of remote program files and accurate editing of frames under complex high-latency network conditions, and effectively solves the problem that in the past, under such network conditions, only through streaming media technology can be played. The problem of accurate frame editing cannot be achieved. The invention can be directly applied to applications such as remote program collaborative production network and remote program segment fast return.

BRIEF abstract

 1 is a block diagram showing a system structure of a network-based program remote editing method according to an embodiment of the present invention;

 2 is a block diagram of data transmission of a network-based program remote coding method according to an embodiment of the present invention;

 3 is a data structure diagram of a source program file in a network-based program remote editing method according to an embodiment of the present invention;

 4 is a structural diagram of data of mirrored program data information in a network-based program remote editing method according to an embodiment of the present invention;

 FIG. 5 is a structural diagram of data of an edit control information in a network-based program remote editing method according to an embodiment of the present invention; FIG.

 6 is a schematic diagram of an editing desktop displayed on a display device of a client computer in a network-based program remote editing method according to an embodiment of the present invention; FIG. 7 is a network-based program remote editing according to an embodiment of the present invention; Main flow chart of the method;

 8 is a flow chart of establishing mirror image information in step B1 of FIG. 7;

 9 is a flow chart of opening mirror image information in step B4 of FIG. 7;

FIG. 10 is a flow chart of step B6 of FIG. 7. BEST MODE FOR CARRYING OUT THE INVENTION

 The basic technical idea of the network-based section remote editing method is to transmit only the necessary data information of low data amount in the editing process, and transmit by using a customized frame mode media transmission protocol; and transmit to the client through a remote network server. The low-data-capturing image data of the program shows the required program frame data in real time during preview and editing. After the editing is completed, the editing control information is sent back to the server.

 In order to facilitate a further understanding of the method of the present invention, the present invention will be described in detail below with reference to the accompanying drawings and embodiments.

 As shown in FIG. 1, a system block diagram of a network-based program remote editing method for implementing the embodiment of the present invention is provided. The server S101 and the client computer S110 are connected to the network S108 through network devices S107 and S109, respectively. Realizing remote access and data transmission of the server S101 and the client computer S110; a server S101 for providing source program text and generating mirror image program data, comprising: a media material library S102 containing source program files and mirror program data information a server OHJS 104 for processing data and executing instructions, a data storage device S103 for storing data, and the like; a program playing device S106 for implementing playback of the edited program, and a playback device buffer S105 for playing during the program Temporary storage of program data.

 In order to further improve the efficiency of remote editing of the program and reduce the load on the remote network and the server, the above system may further include: setting the source program file and the mirrored program data information in the same local area network or metropolitan area network as the client computer S110. The edge server S 116 includes: a media material library S118 for storing source program files and mirror program data information that the server S101 has transmitted to the client computer S110, the server CPUS 117 for processing data and executing instructions, the data storage device S 119 is used to store data.

 As shown in FIG. 2, a data frame diagram for transmitting a remote editing method implemented by the present invention through a network is provided;

 Step S201, the mirror program data information is transmitted by the server to the client computer through the network before editing;

Step S20 ² , during the editing process, the server receives the program frame of the client computer through the network. Data offset and transmission request;

 Step S203, the server transmits the source program frame data specified in the above step S202 to the client computer through the network, where the source program frame data is frame data of a low code rate;

 Step S204, after the editing of the client computer is completed, the server receives the editing control information of the client computer through the network; Step S205, of course, if the data required by the client computer already exists in the edge server, that is, only the edge server is obtained. It is not necessary to transmit through the remote network server again; if the data required by the client computer is at the server, the server then sends the high-rate program frame data specified in the edit control information to the client computer.

 According to FIG. 3, the source program file data structure diagram provided in the network-based program remote editing method of the embodiment, regardless of the encoding format used to encode the compressed digital media program, the data structure of the program file includes three The basic component: the metadata information S301 is at the head of the file, and describes the characterization information of the file, including: the encoding format, the total number of frames, the key frame spacing, the resolution, etc. used by the program file; followed by the index information S302 The description includes: a sequence of frames of the program file, a starting point and an offset of each frame of data, a corresponding key frame, and a relationship with a key frame, etc., for reading data of a corresponding frame when playing a program; The frame data S303 is the data body of the program file, and is specific data information of each frame that is encoded and stored according to the information determined by the previous metadata information S301 and the index information S302.

 The flow described in the embodiment of the present invention is described in detail below with reference to FIG. 1 and FIG. 7. As shown in FIG. 7, the step B1 is used to establish the mirrored program information, which is completed by the server 'S101 in FIG. The data structure diagram of the mirrored program data information shown in FIG. 4 and the flow chart of the steps of creating mirrored program information shown in FIG. 8, where the server S101 executes in sequence: .

As shown in FIG. 8, step B101, the source program file is opened; the server CPUS 10 ⁴ takes out the source program file from its media library S102 and opens it, and establishes a corresponding mirror image data information data starting point and writes in the media material library S102 according to the protocol. Forming an association with the source program file in the path information S401 of the source program file and the corresponding high rate program file;

Step B102, extracting metadata information; according to the source program file data structure shown in FIG. 3, the server CPUS 104 extracts the metadata information S301 from the head of the source program file, and sequentially writes the steps. In the mirror program data information established in step B101, metadata information S40 ^{2 is} formed; wherein the metadata information includes: an encoding format, a total number of turns, a key frame spacing, and the like;

 Step B103, extracting index information; the server CPUS 104 extracts the index information S302 from the source program file, extracts the frame sequence, the start point and the offset of each frame of data, and sequentially writes the image data information into the mirror program data information to form a frame data description S403. ;

 Step B104, extracting the first frame data of the program; the server CPUS 104 extracts the first frame data from the frame data S303 according to the metadata information S301 and the index information S302 in the source program file, and stores the first frame data into the mirrored program data information to form the necessary frame data S404;

 Step B105, extracting other necessary frame data of the program; if necessary, the server CPUS 104 may be configured to extract other frame data, such as a tail frame and a key frame in the middle, from the frame data S303 according to the metadata information S301. and the index information S302 in the source program file. Etc., stored in the above mirrored program data information;

 Step B106: Generate an image file and store it; the server CPUS1 Q4 creates a file end point for the mirrored program bran information, generates a file, and stores the file.

 As shown in FIG. 7, step B2, the mirrored program information is searched; the client computer S110 is connected to the server S101 via the network S108, the client CPUS113 issues a request to the server S101. The server S101 searches for the required mirrored program data from the media material library S102. Information, this search can be based on the need to use accurate or fuzzy search methods, including the material path, material name, time, keyword, category name can be directly searched, or used to establish a query database and guide to the mirror program data information Find; '

 Step B3, transmitting the mirrored program information; the server CPUS101 transmits the mirrored program data information selected by the client computer S110 to the client computer S110 via the network. S108 according to the request sent by the client CPUS113, and saves it to the client computer storage device S115 or In the buffer S112; the file may also be saved in the media material library S118 by the server CPUS117 of the edge server S116, so that the client computer S110 can use the data again;

 Step B4, the mirrored program information is opened; in combination with the step flow chart shown in FIG. 9, the edit desktop map shown in S6, and FIG. 4, the client computer sequentially executes:

As shown in FIG. 9, step B401, parsing the mirrored program data information; the client CHJS.113 from The storage device S115 or the buffer S112 takes out the mirrored program data information and opens it, parses according to the protocol, stores the extracted program path S401 in the buffer S112, displays the editing desktop on the display device S111, and edits the desktop. The edit information sequence S609 displays the paragraph mark 1 by default;

 Step B402, reading the program data encoding format; the client CPUS 113 reads the metadata information S402 from the metadata information S401 of the parsed mirror program data information into the buffer S112, and extracts the encoding format of the program data;

 Step B403, displaying the encoding format; the client CPUS113 displays the extracted encoding format on the editing desktop;

 Step B404, the first frame data is taken out and the display is decoded; the client CPUS113 finds the decoder in the client computer S110 according to the encoding format and starts, and extracts the first frame data from the necessary frame data S404 of the mirrored program data information, and decodes it by the encoder. Restore, display the frame image on the edit desktop browsing window S601, if the data in the necessary frame data S404 is other key frame data or tail frame data, decode the corresponding data to display the corresponding image;

 After parsing in the above step B401, the client CPUS113 also executes:

 Step B405, reading the metadata information and the frame data description; the client CPUS113 reads the metadata information from the buffer S112, and reads from the parsed rust image program data information: ^ frame data description is stored in the buffer S112;

 Step B406, displaying the total number of frames; the client CPUS113 extracts the total number of frames from the metadata information, and displays it on the desktop, and the display can also be converted and displayed as the playback length of the source section file, and the conversion manner is according to the total frame. The number of frames divided by the number of frames played per second (for example: 25) gives the length in seconds;

Step B407, establishing frame coordinates; the client CPUS113 extracts the metadata information S402 and the frame data description S403 from the buffer S112, generates frame coordinates, displays the frame coordinate axis S602 on the editing desktop, and describes the frame number of the coordinate point of the coordinate axis S602. S603, S603 may also be displayed as a time point of the corresponding frame of the source program file, and at the same time, the slider S608 is in the position of the frame corresponding to the image displayed by the browsing window S601 on the coordinate axis S602, if displayed as the first frame image, clear Block S608 is in the position on the first frame coordinate axis S602, if displayed as another frame image, the slider S608 is in its right The position on the coordinate axis S602;

 Step B408, establishing association between frame coordinates and frame data offset ; information; the client CPUS113 describes the frame data and the path information S401 of the program according to the frame data; and offsets each coordinate point from the corresponding frame data in the source node file. Establishing an association, for example: the coordinate point of the .100th frame is associated with the data starting point and offset of the 100th frame in the source program file; when the slider S608 is at a certain frame coordinate point, the client CPUS113 can directly take out the point. The data start and offset of the corresponding frame data. '

 As shown in FIG. 7, step B5, adding an edit information sequence; the execution of this step is controlled by the input device S114 of the client computer S110, since the step B401 shown in FIG. 9 is executed only in the edit information sequence S609 of FIG. The default is 1, that is, only one program segment is selected from the source program file. If multiple program segments need to be selected, it needs to be added. The implementation is that the input device S114 controls the add button S607 on the editing desktop, and then edits. A paragraph mark is added to the information sequence S609, such as 2, 3, 4, etc.;

Step B6, browse; implemented step S608 in the present position of the frame axis S60 ^'2 S601 to control the browser window displaying an image of the corresponding frame by sliders in FIG. 6, in conjunction with FIG. 10, by ^: Step B601, pointing to frame The input device S114 of the client computer S110 controls the slider S608 to slide to a coordinate point on the coordinate axis S602, the client CPUS113 obtains the frame specified by the slider, and according to the key frame spacing provided by the metadata information, It performs key frame determination, if the frame is a key frame, then proceeds to step B604, if it is a non-key frame, then proceeds to step B602;

 Step B602, calculating the position of the previous key frame; the client CPUS113 calculates the position of the previous key frame by the key frame spacing and the frame specified by the slider S608, as in the 50th frame;

 Step B603, extracting the corresponding frame and its key frame data offset; the client CPUS113 determines and extracts the data start point and the offset amount of the selected frame and the key frame into the buffer according to the association established between the frame coordinate point and the frame data offset. Step S604, the data offset of the corresponding frame is fetched; the client CPUS113 determines and extracts the data start point and the offset of the selected frame into the buffer S112 according to the association between the frame coordinate point and the frame data offset. Medium

Step B605, transmitting a request; the client CPUS113. sends a data transmission request to the server S101 through the network device and the network S108, and extracts the data offset and the source section from the buffer S112. The destination file path is sent to the server S101;

 Step B606, the node data is fetched: the server S101 receives the data transmission request and the data information, and the server CPUS104 extracts the data conforming to the request from the media material library S10'2 according to the data information;

 Step B607, transmitting program frame data: the server CPUS104 will take out the data that meets the requirements, and send it to the client computer S110 through the network device and the network S108;

 Step B608, decoding is performed: the client computer S110 receives the above data, and the decoded data is restored to an image by the activated decoder and displayed in the browsing window S601; and returns to step B601 to execute repeatedly.

 During the browsing process, the browsing edge server CPUS117 may sequentially generate the source program file in the media material library S118 of the edge server S116 according to the encoding format of the source program file according to the encoding format of the source program file; if not all the transmissions during the browsing process All data of the source program file is transferred to the complete file, which is the same as the source program file in the server media material library S102, after the browsing is completed, for the client computer S110 to use again.

 If the input device S114 is over the 'f夬 drag slider S608, the client computer during the browsing process

S110 continuously performs the above steps B601 to B608, and the frame image pointed by the coordinate point of the slider S608 through the frame coordinate axis S602 is sequentially displayed in the browsing window S601 of the client display device S111; however, if the client CPUS113 skips the middle The associated data corresponding to the coordinate point on the frame coordinate axis S602 is directly confirmed, the frame coordinate point where the slider S608 is currently located is directly confirmed, the corresponding frame data starting point and the offset amount are taken out, and a transmission request is sent to the server S101 to avoid transmission of the wood. The required frame data, the value of the fast drag is manually set, 'If you can set the data transmission of the stop point of the slider S608 when the data of 50 frames is dragged within 1 second.

As shown in FIG. 7, step B7, editing the dot; when browsing to the desired image, controlling the dot button S604 of the editing desktop through the input device S114, the client CPUS113 records the corresponding frame coordinate S602 of the instant slider S608. The frame number, such as the 109th frame, is stored in the buffer S112. If a frame number of the paragraph already exists in the buffer S112, it is compared with it, and is confirmed as the order on the frame coordinate axis S60 ² The beginning and end of the paragraph, if not there, the default is the starting point of the paragraph; Returning to step B6, execution is continued until the start and end points of the paragraph selected in the edit information sequence S609 are completed.

 Step B8, adjusting/deleting the edit information sequence; according to the need of editing, the client CPUS113 controls the order of each paragraph in the edit information sequence S609 through the input device S114, and re-stores it in the buffer S112, if the edit information sequence S609 is to be deleted. a paragraph, the delete button S606 is controlled by the input device S114 to delete the currently selected paragraph, and the corresponding data is cleared from the buffer S112, if it is necessary to add a paragraph, return to step B5 to execute sequentially;

 In step B9, the edit control information is transmitted. Referring to FIG. 5, the client CPUS 113 extracts the program path information S501 of the high-rate program path information generation edit control information from the buffer S112, and sequentially extracts the edit information sequence S609. The frame start point and end point data of all the edit points recorded in the paragraph sequence, the frame ordinal start sequence S502 of the edit control information is generated, and the edit control information is transmitted to the server via the network S108; and/or the storage device S115 at the client computer S110 Stored as edit control information;

 Step B10, generating program editing data; the server CPUS1044 points to the high code rate program file according to the program path information S501 in the editing control information; and extracts the frame ordinal start and stop sequence S502 from the editing control information, and each paragraph recorded according to the information The start and end points of the frame are taken out from the high code rate program file data, and the corresponding high code rate program frame data is sequentially saved to the program playing device buffer S105 for playing; or, the program editing file is generated continuously in sequence. The program playback device stores, and/or transmits the program editing file over the network to the client computer S110 and saves it to its storage device S 115.

 In order to reduce the load on the remote network S108 and the server S101 and improve the efficiency of remote editing, in the above-mentioned remote editing process, the client computer S110 accesses and transmits the mirrored program data information file and the browsed source program file are simultaneously saved to the edge server. In the media material library S118 of S116, the client computer S110 first sends a request to the local edge server S116 when performing the step B2 search for the mirror program information, and if the required file exists in the edge server media material library S118, Data is retrieved from the edge server S116 for editing as described above. If the required data does not exist in the edge server S116, the server S101 issues a request to perform the above steps.

The image program data information transmitted before editing in the content of the embodiment of the present invention only contains data. A small amount of mirrored program data information, fast transmission speed, no need to wait to start browsing and editing; browsing using frame mode media transmission protocol, only transmitting program frame data in the specified source program file, the amount of data transmitted in real time is small, no need Data buffering, waiting, the client can achieve even the conventional ADSL Internet access (700K bandwidth can be satisfied); At the same time, it can realize the skip segment browsing editing of the birch series without continuous transmission skipping. Data; only the frame ordinal start and end sequence, that is, the corresponding frame number and its sorting order, are recorded during editing, and the resources of the client computer are less occupied; the edit control information transmitted back to the server only includes the path of the high code rate program file. And the sequence start sequence of the frame sequence, without the program frame data, the data returned is small, and the transmission speed is fast; even if the direct release of the program on the client is implemented, the server only needs to specify the high code specified in the edit control information. Rate the program frame data in the program file to the client, no other redundant data, making the limited network Efficient use of resources.

 It is a matter of course that the invention may be embodied in various other forms and modifications without departing from the spirit and scope of the invention.

Industrial applicability

 The remote editing method of the program of the invention realizes the smooth playback of the remote program file and the precise editing of the frame under the condition of complex high-latency network, and effectively solves the problem that in the past, under the network condition, only through the streaming media technology The problem of playing the frame and not being able to accurately edit the frame. The invention can be directly applied to remote program collaborative production networks, remote program segment fast return and the like.

Claims

Claims  A network-based remote editing method for a program, which is applied to a network composed of an existing server, a client computer, and a network device, and is characterized by the following steps: (1) The server CPU extracts source program file data from the media material library of the server, and extracts information and frame data from the file data to establish mirror program data information associated with the source program file data, and saves the data to the server. The media material library, wherein the extracted information comprises: a starting point and an offset of the frame data;  (2) the server transmits the mirrored program data information selected by the client computer to the client computer through the network device according to the request sent by the client computer;  (3) the client CPU parses the mirrored program data information and displays it on a display device of the client computer;  (4) When the input device in the client computer receives the control information of the user, the client CPU extracts the starting point and the partial of the current frame data from the parsed image data of the parsed program according to the control information of the input device. Transfer the amount, and send a transmission request to the server, the server takes out the current frame data from its bee body material library and transmits it to the client computer through the network device, and then displays it on the display device after being parsed and restored by the client computer;  (5) When the client CPU collects the control information of the current frame according to the input device, the frame number of the current frame is taken out as the starting point or the end point information of the editing paragraph, and is stored in the buffer in the client computer;  (6) the client CPU extracts from the cache buffer (3) parses out the associated information and the edited paragraph frame start number and end point information recorded in step (5), generates edit control information, and stores the edit control information on the client computer. In the storage device, and/or sent to the server over the network.  2. The remote editing method of a program according to claim 1, wherein the method further comprises: (7) The server CPU of the server extracts the corresponding program frame data from the associated high-rate program data according to the edit control information, generates program edit data, and saves the program edit data to the program play device memory through the network, and/ Or in a program playback device, and/or in a storage device of a client computer. 3. The remote editing method of a program according to claim 1, wherein said step (1) Includes:  The server CPU extracts the source program file from the media material of the server and opens it, sequentially extracts the metadata information, the frame sequence in the index information, the starting point and the partial amount of each frame of data, and the necessary frame data. Mirroring program data information associated with the source program file data is created in the media material library, and the path information associated with the source program file and the corresponding high rate program file is sequentially written into the image program data information, and the extracted metadata information is a frame sequence, a start point and an offset of the data of each frame, and the necessary frame data, and stored; wherein the metadata information includes: an encoding format, a total number of frames, and a key frame spacing; the necessary frame data is the first frame data, Other key frame data and/or tail frame data.  4. The program remote programming method according to claim 3, wherein the step (3) comprises:  The client CPU removes the mirrored program from the storage device of the client computer, opens and parses the information, displays the editing desktop on the display device of the client computer, and starts decoding of the decoder of the client computer according to the encoding format. The frame image is displayed in the browsing window of the edited desktop; and the frame coordinate axis is displayed on the editing desktop, the association between the coordinate axis coordinate point and the corresponding frame data offset in the source program file is established, and the image and the frame are displayed. The position of the slider position on the target axis.  The remote editing method of the program according to claim 4, wherein the step (4) comprises:  (41) when the user controls the display device on the display device to slide on the coordinate axis to a certain punctuation point through the input device of the client computer, the client CPU obtains the frame specified by the slider And according to the metadata information provided: the key frame spacing, judging the trace US key frame, if the frame is a key frame, then proceeds to step (44), if it is a non-key frame, then proceeds to step (42);  (42) the client CPU calculates the previous key frame frame number according to the coding format by using a key frame spacing and the slider. (43) the client CPU determines and extracts the selected frame and the key by the association between the coordinate point and the frame data offset according to the current frame frame number and the previous key frame frame number determined in step (42). The data start and offset of the frame are stored in the buffer in the client computer, and the process proceeds to step (45); (44) the client CPU determines the association between the frame coordinate point and the frame data offset and determines the data start point and offset of the selected frame to be stored in the buffer in the client computer, and proceeds to the step (45). ) ;  (45) the client CPU sends a data transmission request to the server through the network, and takes the data offset and the source program file path from the buffer of the client computer and sends the data to the server; (46) the server CPU fetches the data that meets the requirements from the media material library of the server according to the received data transmission request and the data information;  (47) the server CPU sends the data that meets the requirements to the client computer through the network device;  (48) The client computer receives the above data, and restores the data decoding to an image in the display device by starting the decoder of the client computer, and returns to step (41) to continue execution.  The remote editing method of the program according to claim 5, wherein the step (41) further comprises:  When in the Point to Frame Ordinal step, the slider on the editing desktop quickly moves over the frame axis per unit time through the specified number of frames, the client CPU only determines and points to the pause of the slider on the frame axis. Or stop the corresponding frame.  The method of remotely editing a program according to claim 4, wherein the step (5) further comprises:  The user controls the management of the desktop by the input device in the client computer, the client The CPU records the corresponding frame number on the frame axis of the instant slider and stores it in the buffer in the client computer, and then returns to step (4) to continue execution until the editing dot ends.  The remote editing method of the program according to claim 7, wherein the step (5) further comprises: The client CPU detects whether the buffer has a frame number, and if so, compares with the frame number of the current frame corresponding to the fetch, and sequentially confirms the start and end point information of the segment in the order of the frame coordinate axis. In the buffer; if not, it defaults to the starting point information of this paragraph and is stored in the buffer. 9. The remote editing method of a program according to claim 1, wherein the step (4) further comprises:  The client CPU of the client computer adds a paragraph to the user through the input device and displays it through the display device;  The step (5) further includes:  The client CPU of the client computer executes the user to adjust the order of each paragraph through the input device and re-saves it into the buffer of the client computer;  The client CPU of the client computer deletes the currently selected segment through the input device and clears the corresponding data from the client computer's buffer; and performs the addition of a paragraph mark.  The remote editing method of the program according to claim 1, wherein the server comprises: an edge server in the same local area network or a metropolitan area network as the client computer, configured to provide source program files and mirror program data information. ;  The step (2) further includes:  The client computer first sends a request to the edge server to find whether the required mirror program data information exists in the media material library of the edge server, and if so, the client computer directly obtains the required mirror program data information from the edge server; If not, the client computer sends a request to the server, and the server transmits the mirrored program data information selected by the client computer to the client computer through the network, and stores it on the same local area network as the client computer or On the edge server of the metropolitan area network.