[go: up one dir, main page]

CN104954850A - Nonlinear editing software dispatching method and device - Google Patents

Nonlinear editing software dispatching method and device Download PDF

Info

Publication number
CN104954850A
CN104954850A CN201510300770.2A CN201510300770A CN104954850A CN 104954850 A CN104954850 A CN 104954850A CN 201510300770 A CN201510300770 A CN 201510300770A CN 104954850 A CN104954850 A CN 104954850A
Authority
CN
China
Prior art keywords
video
request
server
audio
user operation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510300770.2A
Other languages
Chinese (zh)
Other versions
CN104954850B (en
Inventor
黄裔
郑鹏程
严玄
刘铁华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Digital Video Beijing Ltd
Original Assignee
China Digital Video Beijing Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Digital Video Beijing Ltd filed Critical China Digital Video Beijing Ltd
Priority to CN201510300770.2A priority Critical patent/CN104954850B/en
Publication of CN104954850A publication Critical patent/CN104954850A/en
Application granted granted Critical
Publication of CN104954850B publication Critical patent/CN104954850B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/432Content retrieval operation from a local storage medium, e.g. hard-disk
    • H04N21/4325Content retrieval operation from a local storage medium, e.g. hard-disk by playing back content from the storage medium
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47205End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65Transmission of management data between client and server
    • H04N21/654Transmission by server directed to the client
    • H04N21/6543Transmission by server directed to the client for forcing some client operations, e.g. recording

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Television Signal Processing For Recording (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本发明实施例提供了一种非线性编辑软件的调度方法和装置,其中,方法包括:接收用户操作请求;其中,所述用户操作请求包括:对剪辑的音视频文件或工程文件进行预览的请求、对剪辑的视频画面帧或工程画面帧进行预览的请求;确定用户操作请求的类型;依据确定结果调用与类型相对应的调度策略从服务器获取所述用户操作请求所请求的数据并播放;当用户操作请求为对剪辑的音视频文件或工程文件进行预览的请求时,调用播放策略;当用户操作请求为对剪辑视频画面帧或工程画面帧进行预览的请求时,调用搜索策略。通过本发明实施例,用户无需将素材下载到制作系统内部,即可随时挑选所需要的素材,并把编辑完成的音视频直接下载到制作系统即浏览器客户端。

An embodiment of the present invention provides a scheduling method and device for nonlinear editing software, wherein the method includes: receiving a user operation request; wherein the user operation request includes: a request for previewing a clipped audio and video file or project file 1. A request for previewing the clipped video frame or engineering frame; determining the type of user operation request; invoking a scheduling policy corresponding to the type according to the determination result to obtain and play the data requested by the user operation request from the server; When the user operation request is a request for previewing edited audio and video files or project files, call the play strategy; when the user operation request is a request for previewing edited video frame or project frame, call the search strategy. Through the embodiment of the present invention, the user can select the desired material at any time without downloading the material into the production system, and download the edited audio and video directly to the production system, that is, the browser client.

Description

非线性编辑软件的调度方法和装置Scheduling method and device for nonlinear editing software

技术领域technical field

本发明涉及视频编辑处理技术领域,特别是涉及一种非线性编辑软件的调度方法与装置。The invention relates to the technical field of video editing and processing, in particular to a scheduling method and device for nonlinear editing software.

背景技术Background technique

传统电视台进行视频编辑一般是通过专业的有卡编辑工作站来完成的,这些编辑工作站一般价格比较昂贵,资源比较紧张,需要按使用时间进行计费。整个编辑过程分为了素材挑选、特效制作、素材打包等环节,而其中,素材包挑选所花费的时间在其中占用的比例是很高的,尤其是一些需要特效较少的节目编辑中,素材挑选占用的时间比例甚至超过了百分之五十。实际上,素材挑选过程的主要工作就是找到和制作节目相关的素材,打点选择好需要使用的素材片段,并把这些素材片段按顺序铺放到故事版上,这一过程并不是必需在专业的编辑工作站完成的,如果能把这一过程独立出来,将极大的提高电视台的工作效率,节省电视台宝贵的制作资源。Video editing by traditional TV stations is generally done through professional editing workstations with cards. These editing workstations are generally expensive and resources are tight, and they need to be billed according to the usage time. The entire editing process is divided into material selection, special effects production, material packaging and other links, and among them, the time spent on material package selection occupies a high proportion, especially in some program editing that requires less special effects, material selection The proportion of time taken up even exceeds 50%. In fact, the main task of the material selection process is to find the material related to the production of the program, manage and select the material fragments to be used, and lay these material fragments on the story board in order. This process is not necessary in professional If this process can be separated from the editing workstation, it will greatly improve the work efficiency of the TV station and save the precious production resources of the TV station.

随着电视台网络化编辑的发展,素材不再使用传统的录像带作为存储介质,而是作为数字化媒体保存在网络存储中,同时出现了媒体资源管理系统来对素材进行统一管理。媒体资源管理系统的出现,为制作人员提供了更多的素材选择,但也增加了制作人员的操作步骤。制作人员首先需要登录媒体资源管理的检索系统检索到所需要的素材并下载到制作系统,然后,再在制作系统内部进行简单检索,把所需要的素材片段按照顺序铺放到故事版中以完成制作音视频的编辑。With the development of TV station network editing, materials no longer use traditional video tapes as storage media, but are stored in network storage as digital media. At the same time, media resource management systems have emerged to manage materials uniformly. The emergence of the media resource management system provides more material choices for the production staff, but also increases the operation steps of the production staff. The production staff first needs to log in to the retrieval system of the media resource management to retrieve the required materials and download them to the production system, and then perform a simple search in the production system, laying the required material fragments into the storyboard in order to complete Make audio and video editing.

现有的这种网络化编辑方案,在整个制作过程中间实际经历了两次检索过程,花费制作人员大量精力的同时,还为媒体资源管理系统造成工作负担。此外,需要将所需要的素材下载到制作系统中,然后进行进一步地检索确定真实所需要的素材,增加了制作系统与媒体资源管理的检索系统的传输负担。The existing network-based editing scheme has actually gone through two retrieval processes during the entire production process, which consumes a lot of energy of the production staff and also creates a workload for the media resource management system. In addition, the required material needs to be downloaded to the production system, and then further searched to determine the real required material, which increases the transmission burden of the production system and the retrieval system of media resource management.

可见,目前亟待解决的技术问题为:提供一种新的编辑方案,使用户进行音视频编辑时不再需要将素材从检索系统下载下来,然后再在制作系统内部进行简单检索,把所需要的素材片段按照顺序铺放到故事版中才完成制作过程。而是可以使用户无需将素材下载到制作系统内部,即可随时挑选所需要的素材,并把编辑完成的音视频直接下载到制作系统即浏览器客户端。It can be seen that the technical problem to be solved urgently is: to provide a new editing solution, so that users no longer need to download materials from the retrieval system when editing audio and video, and then perform simple retrieval in the production system to upload the required files. The clips are layered into the storyboard in order to complete the production process. Instead, the user can select the desired material at any time without downloading the material into the production system, and download the edited audio and video directly to the production system, that is, the browser client.

发明内容Contents of the invention

鉴于上述现有的网络化编辑方案存在的上述问题,提出了本发明以便提供一种克服上述问题或者至少部分地解决上述问题的非线性编辑软件的调度方法与装置。In view of the above-mentioned problems existing in the above-mentioned existing network editing solutions, the present invention is proposed to provide a scheduling method and device for non-linear editing software that overcome the above-mentioned problems or at least partly solve the above-mentioned problems.

依据本发明的一个方面,提供了一种非线性编辑软件的调度方法,包括:接收用户操作请求;其中,所述用户操作请求包括:对剪辑的音视频文件或工程文件进行预览的请求、对剪辑的视频画面帧或工程画面帧进行预览的请求;确定所述用户操作请求的类型;依据确定结果调用与所述类型相对应的调度策略从服务器获取所述用户操作请求所请求的数据并播放;其中,当所述用户操作请求为对剪辑的音视频文件或工程文件进行预览的请求时,调用播放策略;当所述用户操作请求为对剪辑视频画面帧或工程画面帧进行预览的请求时,调用搜索策略。According to one aspect of the present invention, a scheduling method of nonlinear editing software is provided, including: receiving a user operation request; wherein, the user operation request includes: a request for previewing a clipped audio and video file or project file; A request for previewing clipped video frames or engineering frame frames; determining the type of the user operation request; invoking a scheduling strategy corresponding to the type according to the determination result to obtain the data requested by the user operation request from the server and play it ; Wherein, when the user operation request is a request for previewing audio and video files or project files of clipping, the playback strategy is called; when the user operation request is a request for previewing clipped video frame or project frame , calling the search strategy.

优选地,当所述用户操作请求为对剪辑的音视频文件或工程文件进行预览的请求时,调用播放策略从服务器获取所述用户操作请求所请求的数据并播放的步骤包括:向服务器发送播放请求,其中,所述播放请求中携带有待预览的音视频文件信息,或待预览的工程文件的数据结构信息;工程文件的数据结构信息包含多段音视频素材信息以及各段音视频素材的排列关系信息;接收所述服务器返回的与所述音视频文件信息对应的音视频流,或与所述工程文件的数据结构信息对应的音视频流;将接收到的音视频流发送至视频播放器窗口的媒体播放器进行播放。Preferably, when the user operation request is a request to preview clipped audio and video files or engineering files, the step of invoking the play strategy to acquire and play the data requested by the user operation request from the server includes: sending a play request, wherein, the playback request carries the audio and video file information to be previewed, or the data structure information of the project file to be previewed; the data structure information of the project file includes multiple pieces of audio and video material information and the arrangement relationship of each piece of audio and video material information; receive the audio and video stream corresponding to the audio and video file information returned by the server, or the audio and video stream corresponding to the data structure information of the project file; send the received audio and video stream to the video player window media player to play.

优选地,在所述向服务器发送播放请求步骤之前,所述方法还包括:判断是否已连接所述服务器;若未连接所述服务器,则与所述服务器建立连接,并将已编辑的工程文件的数据结构信息同步至所述服务器。Preferably, before the step of sending a play request to the server, the method further includes: judging whether the server has been connected; if not, establishing a connection with the server, and saving the edited project file The data structure information of is synchronized to the server.

优选地,当所述用户操作请求为对剪辑的视频画面帧或工程画面帧进行预览的请求时,调用搜索策略从服务器获取所述用户操作请求所请求的数据并播放的步骤包括:向服务器发送搜索请求,其中,所述搜索请求中携带有待预览的所述视频画面帧的信息,或待浏览的所述工程画面帧的信息;接收所述服务器按照设定频率返回的与所述视频画面帧的信息,或所述工程画面帧的信息对应的视频流;将接收到的视频流发送至视频播放器窗口的媒体播放器进行播放,以实现对画面帧的预览。Preferably, when the user operation request is a request to preview clipped video frames or engineering frame frames, the step of invoking the search strategy to acquire and play the data requested by the user operation request from the server includes: sending A search request, wherein the search request carries the information of the video frame to be previewed, or the information of the engineering frame to be browsed; receiving the video frame returned by the server according to the set frequency information, or the video stream corresponding to the information of the project picture frame; the received video stream is sent to the media player in the video player window for playback, so as to realize the preview of the picture frame.

优选地,向所述服务器发送的播放请求、搜索请求以及接收到的所述服务器返回的音视频流、视频流均遵循设定格式的协议数据包在所述服务器与浏览器客户端之间进行传输;其中,所述协议数据包的设定格式为:第一字段为命令标识、第二字段为载荷数据长度、第三字段为载荷数据。Preferably, the playback request and search request sent to the server and the received audio and video streams and video streams returned by the server are all carried out between the server and the browser client in accordance with the protocol data packets of the set format. Transmission; wherein, the format of the protocol data packet is: the first field is the command identifier, the second field is the payload data length, and the third field is the payload data.

依据本发明的另一个方面,还提供了一种非线性编辑软件的调度装置,包括:接收模块,用于接收用户操作请求;其中,所述用户操作请求包括:对剪辑的音视频文件或工程文件进行预览的请求、对剪辑的视频画面帧或工程画面帧进行预览的请求;确定模块,用于确定所述用户操作请求的类型;调用模块,用于依据确定结果调用与所述类型相对应的调度策略从服务器获取所述用户操作请求所请求的数据并播放;其中,当所述用户操作请求为对剪辑的音视频文件或工程文件进行预览的请求时,调用播放策略;当所述用户操作请求为对剪辑视频画面帧或工程画面帧进行预览的请求时,调用搜索策略。According to another aspect of the present invention, a scheduling device for non-linear editing software is also provided, including: a receiving module, configured to receive user operation requests; wherein, the user operation requests include: editing audio and video files or projects A request for previewing a file, a request for previewing a clipped video frame or an engineering frame; a determination module, configured to determine the type of the user operation request; a calling module, configured to invoke the type corresponding to the type according to the determination result The scheduling strategy obtains the data requested by the user operation request from the server and plays it; wherein, when the user operation request is a request for previewing the clipped audio and video files or project files, the playback strategy is invoked; when the user When the operation request is a request for previewing the edited video frame or engineering frame, the search strategy is invoked.

优选地,当所述用户操作请求为对剪辑的音视频文件或工程文件进行预览的请求时,所述调用模块调用播放策略从服务器获取用户操作请求所请求的数据并播放时:向服务器发送播放请求,其中,所述播放请求中携带有待预览的音视频文件信息,或待预览的工程文件的数据结构信息;工程文件的数据结构信息包含多段音视频素材信息以及各段音视频素材的排列关系信息;接收所述服务器返回的与所述音视频文件信息对应的音视频流,或与所述工程文件的数据结构信息对应的音视频流;将接收到的音视频流发送至视频播放器窗口的媒体播放器进行播放。Preferably, when the user operation request is a request for previewing the clipped audio and video files or project files, the calling module invokes the play strategy to obtain and play the data requested by the user operation request from the server: send the play to the server request, wherein, the playback request carries the audio and video file information to be previewed, or the data structure information of the project file to be previewed; the data structure information of the project file includes multiple pieces of audio and video material information and the arrangement relationship of each piece of audio and video material information; receive the audio and video stream corresponding to the audio and video file information returned by the server, or the audio and video stream corresponding to the data structure information of the project file; send the received audio and video stream to the video player window media player to play.

优选地,所述非线性编辑软件的调度装置还包括:连接模块,用于在所述调用模块向服务器发送播放请求之前,判断是否已连接所述服务器;若未连接所述服务器,则与所述服务器建立连接,并将已编辑的工程文件的数据结构信息同步至所述服务器。Preferably, the scheduling device of the nonlinear editing software further includes: a connection module, used to determine whether the server has been connected before the calling module sends a playback request to the server; The server establishes a connection, and the data structure information of the edited project file is synchronized to the server.

优选地,当所述用户操作请求为对剪辑的视频画面帧或工程画面帧进行预览的请求时,所述调用模块调用搜索策略从服务器获取所述用户操作请求所请求的数据并播放时:向服务器发送搜索请求,其中,所述搜索请求中携带有待预览的所述视频画面帧的信息,或待浏览的所述工程画面帧的信息;接收所述服务器按照设定频率返回的与所述视频画面帧的信息,或所述工程画面帧的信息对应的视频流;将接收到的视频流发送至视频播放器窗口的媒体播放器进行播放,以实现对画面帧的预览。Preferably, when the user operation request is a request to preview clipped video frames or engineering frame frames, the calling module invokes the search strategy to obtain the requested data from the server and play it: to The server sends a search request, wherein the search request carries the information of the video picture frame to be previewed, or the information of the engineering picture frame to be browsed; and receives the information related to the video frame returned by the server according to the set frequency The information of the picture frame, or the video stream corresponding to the information of the project picture frame; the received video stream is sent to the media player in the video player window for playback, so as to realize the preview of the picture frame.

优选地,向所述服务器发送的播放请求、搜索请求以及接收到的所述服务器返回的音视频流、视频流均遵循设定格式的协议数据包在所述服务器与浏览器客户端之间进行传输;其中,所述协议数据包的设定格式为:第一字段为命令标识、第二字段为载荷数据长度、第三字段为载荷数据。Preferably, the playback request and search request sent to the server and the received audio and video streams and video streams returned by the server are all carried out between the server and the browser client in accordance with the protocol data packets of the set format. Transmission; wherein, the format of the protocol data packet is: the first field is the command identifier, the second field is the payload data length, and the third field is the payload data.

与现有技术相比,本发明具有以下优点:Compared with the prior art, the present invention has the following advantages:

本发明实施例提供的非线性编辑软件的调度方法和装置,浏览器客户端可以直接接收用户对服务器中存储的素材的选择,而无需将素材包下载到浏览器客户端侧,即可实现对音视频文件的编辑,因此,既节省制作人员的制作精力,又不会为浏览器客户端带来存储负担。不仅如此,用户还可以通过操作请求,请求浏览器客户端通过相应地调度策略从服务器侧将用户编辑的音视频文件、或视频画面帧直接下载到的浏览器客户端供用户预览,便于用户操作。由于仅是下载已编辑完成的音视频数据,因此,相较于现有的编辑方案需要下载大量的无用的素材包,能够有效减轻浏览器客户端与服务器端的数据传输负担。In the method and device for scheduling non-linear editing software provided by the embodiments of the present invention, the browser client can directly receive the user's selection of materials stored in the server without downloading the material package to the browser client side, which can realize the The editing of audio and video files, therefore, not only saves the production effort of the production staff, but also does not bring storage burden to the browser client. Not only that, the user can also request the browser client to directly download the audio and video files or video frame frames edited by the user from the server side to the browser client through the operation request through the corresponding scheduling strategy for the user to preview, which is convenient for the user to operate . Because only the edited audio and video data is downloaded, compared with the existing editing solutions that need to download a large number of useless material packages, it can effectively reduce the data transmission burden between the browser client and the server.

上述说明仅是本发明技术方案的概述,为了能够更清楚了解本发明的技术手段,而可依照说明书的内容予以实施,并且为了让本发明的上述和其它目的、特征和优点能够更明显易懂,以下特举本发明的具体实施方式。The above description is only an overview of the technical solution of the present invention. In order to better understand the technical means of the present invention, it can be implemented according to the contents of the description, and in order to make the above and other purposes, features and advantages of the present invention more obvious and understandable , the specific embodiments of the present invention are enumerated below.

附图说明Description of drawings

通过阅读下文优选实施方式的详细描述,各种其他的优点和益处对于本领域普通技术人员将变得清楚明了。附图仅用于示出优选实施方式的目的,而并不认为是对本发明的限制。而且在整个附图中,用相同的参考符号表示相同的部件。在附图中:Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiment. The drawings are only for the purpose of illustrating a preferred embodiment and are not to be considered as limiting the invention. Also throughout the drawings, the same reference numerals are used to designate the same components. In the attached picture:

图1是根据本发明实施例一的一种非线性编辑软件的调度方法的步骤流程图;FIG. 1 is a flow chart of steps of a scheduling method of nonlinear editing software according to Embodiment 1 of the present invention;

图2是根据本发明实施例二的一种非线性编辑软件的调度方法的步骤流程图;FIG. 2 is a flow chart of steps of a scheduling method of nonlinear editing software according to Embodiment 2 of the present invention;

图3是在实施例二中的播放策略下浏览器客户端与服务器的交互示意图;Fig. 3 is a schematic diagram of the interaction between the browser client and the server under the playing strategy in the second embodiment;

图4是在实施例二中的搜索策略下浏览器客户端与服务器的交互示意图;FIG. 4 is a schematic diagram of the interaction between the browser client and the server under the search strategy in Embodiment 2;

图5是根据本发明实施例三的一种非线性编辑软件的调度装置的结构框图;Fig. 5 is a structural block diagram of a scheduling device of nonlinear editing software according to Embodiment 3 of the present invention;

图6是根据本发明实施例四的一种非线性编辑软件的调度装置的结构框图。Fig. 6 is a structural block diagram of a scheduling device for nonlinear editing software according to Embodiment 4 of the present invention.

具体实施方式Detailed ways

下面将参照附图更详细地描述本公开的示例性实施例。虽然附图中显示了本公开的示例性实施例,然而应当理解,可以以各种形式实现本公开而不应被这里阐述的实施例所限制。相反,提供这些实施例是为了能够更透彻地理解本公开,并且能够将本公开的范围完整的传达给本领域的技术人员。Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

实施例一Embodiment one

参照图1,示出了本发明实施例一的一种非线性编辑软件的调度方法的步骤流程图。Referring to FIG. 1 , it shows a flow chart of steps of a scheduling method for nonlinear editing software according to Embodiment 1 of the present invention.

本发明实施例的非线性编辑软件的调度方法包括以下步骤:The scheduling method of the non-linear editing software of the embodiment of the present invention comprises the following steps:

步骤S102:接收用户操作请求。Step S102: Receive a user operation request.

用户即制作人员在对音视频文件或者工程文件进行剪辑的过程中,可以对已编辑的音视频文件或者工程文件进行预览。在预览时,可以是预览文件中的某一段视频,还可以是预览文件的某一画面帧。那么,用户则需要发出相应的操作请求,浏览器客户端才能够对请求进行处理,为用户提供相应的预览服务。The user, that is, the producer, can preview the edited audio and video files or project files during the editing process of the audio and video files or project files. When previewing, it may be a certain segment of video in the preview file, or a certain picture frame of the preview file. Then, the user needs to issue a corresponding operation request, so that the browser client can process the request and provide the user with a corresponding preview service.

用户操作请求可以是任意适当的操作,例如:点选某一剪辑的音视频文件、或者是,点选剪辑的音视频文件中的某一画面帧等。The user operation request may be any appropriate operation, for example, clicking a clipped audio and video file, or clicking a certain picture frame in a clipped audio and video file, and the like.

其中,用户操作请求包括:对剪辑的音视频文件或工程文件进行预览的请求、对剪辑的视频画面帧或工程画面帧进行预览的请求。Wherein, the user operation request includes: a request for previewing clipped audio and video files or project files, and a request for previewing clipped video frame frames or project frame frames.

步骤S104:确定用户操作请求的类型。Step S104: Determine the type of user operation request.

浏览器客户端在接收到用户的操作请求后,判断操作请求对应的类型,然后,依据类型调用相应的调度策略。After receiving the user's operation request, the browser client judges the type of the operation request, and then invokes the corresponding scheduling strategy according to the type.

步骤S106:依据确定结果调用与类型相对应的调度策略从服务器获取用户操作请求所请求的数据并播放。Step S106: According to the determination result, the scheduling strategy corresponding to the type is invoked to acquire the data requested by the user operation request from the server and play it.

其中,当用户操作请求为对剪辑的音视频文件或工程文件进行预览的请求时,调用播放策略;当用户操作请求为对剪辑视频画面帧或工程画面帧进行预览的请求时,调用搜索策略。Wherein, when the user operation request is a request for previewing edited audio and video files or project files, the play strategy is invoked; when the user operation request is a request for previewing edited video frame or engineering frame, the search strategy is invoked.

播放策略与搜索策略可以由本领域技术人员根据实际需求进行设置,本实施例对此不作具体限制。The playback strategy and the search strategy can be set by those skilled in the art according to actual needs, which is not specifically limited in this embodiment.

通过本实施例提供的非线性编辑软件的调度方法,浏览器客户端可以直接接收用户对服务器中存储的素材的选择,而无需将素材包下载到浏览器客户端侧,即可实现对音视频文件的编辑,因此,既节省制作人员的制作精力,又不会为浏览器客户端带来存储负担。不仅如此,用户还可以通过操作请求,请求浏览器客户端通过相应地调度策略从服务器侧将用户编辑的音视频文件、或视频画面帧直接下载到的浏览器客户端供用户预览,便于用户操作。由于仅是下载已编辑完成的音视频数据,因此,相较于现有的编辑方案需要下载大量的无用的素材包,能够有效减轻浏览器客户端与服务器端的数据传输负担。Through the scheduling method of the nonlinear editing software provided in this embodiment, the browser client can directly receive the user's selection of the material stored in the server, without downloading the material package to the browser client side, the audio and video can be edited. Therefore, it not only saves the production effort of the production staff, but also does not bring storage burden to the browser client. Not only that, the user can also request the browser client to directly download the audio and video files or video frame frames edited by the user from the server side to the browser client through the operation request through the corresponding scheduling strategy for the user to preview, which is convenient for the user to operate . Because only the edited audio and video data is downloaded, compared with the existing editing solutions that need to download a large number of useless material packages, it can effectively reduce the data transmission burden between the browser client and the server.

实施例二Embodiment two

参照图2,示出了本发明实施例二的一种非线性编辑软件的调度方法的步骤流程图。Referring to FIG. 2 , it shows a flow chart of steps of a scheduling method for nonlinear editing software according to Embodiment 2 of the present invention.

本发明实施例的非线性编辑软件的调度方法包括以下步骤:The scheduling method of the non-linear editing software of the embodiment of the present invention comprises the following steps:

步骤S202:浏览器客户端接收用户操作请求。Step S202: the browser client receives a user operation request.

其中,用户操作请求包括:对剪辑的音视频文件或工程文件进行预览的请求、对剪辑的视频画面帧或工程画面帧进行预览的请求。Wherein, the user operation request includes: a request for previewing clipped audio and video files or project files, and a request for previewing clipped video frame frames or project frame frames.

音视频文件为既包含音频又包含视频的文件。工程文件为由许多音视频文件按照设定排列顺序组成的文件。An audiovisual file is a file that contains both audio and video. A project file is a file composed of many audio and video files according to the set sequence.

需要说明的是,用户操作请求可以是任意适当的操作,例如:点选某一剪辑的音视频文件、或者是,点选剪辑的音视频文件中的某一画面帧,或者,点选某一剪辑的工程文件等操作。It should be noted that the user operation request can be any appropriate operation, for example: click on a clipped audio and video file, or click on a certain picture frame in the clipped audio and video file, or click on a certain Clipped project files and other operations.

本实施例中,浏览器客户端采用Silverlight(银光技术)进行设计布局,整个界面由视频播放窗口、时间线窗口和特技控制窗口组成,其中特技控制窗口上可以覆盖一个下拉窗口,用来对剪辑素材进行管理。服务器端的部署分为两部分,一部分是流控引擎服务(Streaming Server),一部分是打包服务(Compile Server)。其中Streaming Server是通信和播放的核心,文件的读取及解码、特技及字幕的渲染、实时性的处理及节拍的控制等工作都是在这个服务上实现的,服务器提供TCP(Transmission Control Protocol,传输控制协议)端口作为浏览器客户端的连接端口。Compile Server主要是用于提供在音视频文件或工程文件剪辑完成后打包输出的服务,同时,还提供了编码及写音视频文件或工程文件的能力。In this embodiment, the browser client adopts Silverlight (Silver Light Technology) to design the layout, and the whole interface is composed of a video playback window, a timeline window and a special effect control window, wherein a drop-down window can be covered on the special effect control window for Clip footage for management. The server-side deployment is divided into two parts, one is the flow control engine service (Streaming Server), and the other is the packaging service (Compile Server). Among them, Streaming Server is the core of communication and playback. The reading and decoding of files, rendering of special effects and subtitles, real-time processing and beat control are all realized on this service. The server provides TCP (Transmission Control Protocol, Transmission Control Protocol) port as the connection port of the browser client. Compile Server is mainly used to provide services for packaging and outputting audio and video files or project files after editing. At the same time, it also provides the ability to encode and write audio and video files or project files.

步骤S204:浏览器客户端判断用户操作请求的类型,以确定用户操作所请求的类型;当操作请求的类型为对剪辑的音视频文件或工程文件进行预览的请求时,则执行步骤S206,当户操作请求为对剪辑的视频画面帧或工程画面帧进行预览的请求时,执行步骤S208。Step S204: The browser client judges the type of user operation request to determine the type of user operation request; when the type of operation request is a request for previewing the clipped audio and video files or project files, then perform step S206, when When the user operation request is a request for previewing a clipped video frame or engineering frame, step S208 is executed.

在浏览器客户端侧,对于视频的显示,有两种机制,一种是播放机制,播放剪辑的视频文件或工程文件,即Play机制;一种是查看某一画面帧的机制,即Seek机制。其中,在Play机制下即调用播放策略,在Seek机制下即调用搜索策略。本发明实施例中的浏览器客户端之所以设置Seek机制,是为了要做到画面帧预览的精确性,而Silverlight自带的Media Element媒体播放器组件无法做到这一点。On the browser client side, there are two mechanisms for video display, one is the playback mechanism, which plays clipped video files or project files, that is, the Play mechanism; the other is the mechanism for viewing a certain frame, that is, the Seek mechanism . Among them, the play strategy is called under the Play mechanism, and the search strategy is called under the Seek mechanism. The reason why the browser client in the embodiment of the present invention sets the Seek mechanism is to achieve the accuracy of the picture frame preview, but the Media Element media player component that comes with Silverlight cannot do this.

步骤S206:当操作请求的类型为对剪辑的音视频文件或工程文件进行预览的请求时,浏览器客户端调用播放策略从服务器获取用户操作请求所请求的数据并播放。Step S206: When the type of the operation request is a request for previewing clipped audio and video files or project files, the browser client invokes the play strategy to obtain and play the data requested by the user operation request from the server.

一种优选的调用播放策略从服务器获取用户操作请求所请求的数据并播放的方式如下:A preferred method of invoking the playback strategy to obtain and play the data requested by the user operation request from the server is as follows:

S1:浏览器客户端向服务器发送播放请求,其中,播放请求中携带有待预览的音视频文件信息,或待预览的工程文件的数据结构信息;工程文件的数据结构信息包含多段音视频素材信息以及各段音视频素材的排列关系信息。S1: The browser client sends a play request to the server, wherein the play request carries the audio and video file information to be previewed, or the data structure information of the project file to be previewed; the data structure information of the project file includes multiple pieces of audio and video material information and Arrangement relationship information of each audio and video material.

服务器在接收到播放请求时,查找播放请求所请求的信息,并将其打包后返回至浏览器客户端。其中,返回的信息可以为AV Stream即AV流。When the server receives the playback request, it searches for the information requested by the playback request, packages it and returns it to the browser client. Wherein, the returned information may be an AV Stream, that is, an AV stream.

S2:浏览器客户端接收服务器返回的与音视频文件信息对应的音视频流,或与工程文件的数据结构信息对应的音视频流。S2: The browser client receives the audio and video stream corresponding to the audio and video file information or the audio and video stream corresponding to the data structure information of the project file returned by the server.

S3:浏览器客户端将接收到的音视频流发送至视频播放器窗口的媒体播放器进行播放。S3: The browser client sends the received audio and video streams to the media player in the video player window for playback.

需要说明的是,上述优选实现方式,是在客户端浏览器与服务器之间建立连接的基础上执行的,而如果不确定二者之间是否已建立连接关系,浏览器客户端则需执行下述步骤:It should be noted that the above-mentioned preferred implementation method is executed on the basis of establishing a connection between the client browser and the server, and if it is uncertain whether a connection relationship has been established between the two, the browser client needs to execute the following The above steps:

浏览器客户端在向服务器发送播放请求步骤之前,判断是否已连接服务器;若未连接服务器,则与服务器建立连接,并将已编辑的工程文件的数据结构信息同步至服务器。Before the browser client sends a playback request to the server, it judges whether it is connected to the server; if it is not connected to the server, it establishes a connection with the server, and synchronizes the data structure information of the edited project file to the server.

步骤S208:用户操作请求为对剪辑的视频画面帧或工程画面帧进行预览的请求时,浏览器客户端调用搜索策略从服务器获取用户操作请求所请求的数据并播放。Step S208: When the user operation request is a request to preview clipped video frames or engineering frame frames, the browser client invokes the search strategy to obtain and play the data requested by the user operation request from the server.

一种优选的调用搜索策略从服务器获取用户操作请求所请求的数据并播放的方式如下:A preferred method of invoking the search strategy to obtain and play the data requested by the user operation request from the server is as follows:

S1:浏览器客户端向服务器发送搜索请求,其中,搜索请求中携带有待预览的视频画面帧的信息,或待浏览的工程画面帧的信息。S1: The browser client sends a search request to the server, wherein the search request carries information about a video frame to be previewed, or information about an engineering frame to be browsed.

服务器在接收到播放请求后,查找播放请求所请求的信息,并将其解码打包后返回至浏览器客户端。其中,返回的信息可以为画面帧对应的视频数据,将接收到的视频流发送至视频播放器窗口的媒体播放器进行播放,以实现对画面帧的预览。After receiving the play request, the server searches for the information requested by the play request, decodes and packs it, and returns it to the browser client. Wherein, the returned information may be the video data corresponding to the picture frame, and the received video stream is sent to the media player in the video player window for playing, so as to realize the preview of the picture frame.

服务器接收到Seek请求后,对播放请求进行读取并解码,只对画面帧对应的视频数据进行Seek,不对画面帧对应的音频数据,将解码出来的数据用IP帧的形式不断重复P帧发送回浏览器客户端,这就制造了一个视频流VStream即虚拟数据流,保证了Media Element能够正常播放显示,并且能够精准的只Seek选中的画面帧。After the server receives the Seek request, it reads and decodes the play request, only performs Seek on the video data corresponding to the picture frame, and does not perform the Seek on the audio data corresponding to the picture frame, and repeats the P frame sending of the decoded data in the form of an IP frame. Back to the browser client, this creates a video stream VStream, which is a virtual data stream, which ensures that the Media Element can be played and displayed normally, and only the frame selected by Seek can be accurately displayed.

S2:浏览器客户端接收服务器按照设定频率返回的与视频画面帧的信息,或工程画面帧的信息对应的视频流。S2: The browser client receives the video stream corresponding to the information of the video picture frame or the information of the engineering picture frame returned by the server according to the set frequency.

其中,设定频率可以由本领域技术人员根据实际需求进行设置,本实施例中对此不作具体限制。Wherein, the set frequency can be set by those skilled in the art according to actual needs, and there is no specific limitation in this embodiment.

S3:浏览器客户端将接收到的视频流发送至视频播放器窗口的媒体播放器进行播放,以实现对画面帧的预览。S3: The browser client sends the received video stream to the media player in the video player window for playback, so as to realize the preview of the picture frame.

浏览器客户端收到VStream后,将其发送给视频播放器窗口的MediaElement组件进行播放,当然,由于收到的都是同一画面帧的数据,所以播放出来的效果就是静止的画面,达到了Seek这一画面帧的效果。After the browser client receives the VStream, it sends it to the MediaElement component of the video player window for playback. Of course, since the received data are all the data of the same picture frame, the effect of playing is a still picture, reaching the Seek level. The effect of this picture frame.

需要说明的是,对于快速Seek的情况,为了保证流畅度,在处理的过程中会根据收发数据的情况丢掉一些Seek出来的数据。It should be noted that in the case of fast Seek, in order to ensure fluency, some data from Seek will be discarded during the processing according to the situation of sending and receiving data.

对于剪辑界面的操作,浏览器客户端需要与服务器端进行工程的数据结构信息的同步,这个同步是单向的,只由浏览器客户端向服务器发送同步请求,为了防止用户误操作等问题,机制还提供了Undo/Redo流程,保证了剪辑的流畅度。其中,Undo/Redo流程即将已经剪辑的音视频文件、工程文件、或文件中的某画面帧的编辑撤销。For the operation of the editing interface, the browser client needs to synchronize the data structure information of the project with the server. This synchronization is one-way, and only the browser client sends a synchronization request to the server. In order to prevent problems such as user misoperation, The mechanism also provides an Undo/Redo process to ensure the smoothness of editing. Among them, the Undo/Redo process is about undoing the editing of the edited audio and video files, project files, or a certain picture frame in the file.

需要说明的是,为了实现浏览器客户端与服务器的通信,本实施例设计了一套协议,协议用XML(Extensive Markup Language,可扩展标记语言)格式定义,既简单又便于扩展和修改,浏览器和服务器都遵循这个协议进行通信。It should be noted that, in order to realize the communication between the browser client and the server, this embodiment designs a set of protocols, which are defined in XML (Extensive Markup Language) format, which is simple and convenient for expansion and modification. Servers and servers follow this protocol for communication.

也就说是,浏览器客户端向服务器发送的播放请求、搜索请求以及接收到的服务器返回的音视频流、视频流均遵循设定格式的协议数据包在服务器与浏览器客户端之间进行传输;其中,协议数据包的设定格式为:第一字段为命令标识、第二字段为载荷数据长度、第三字段为载荷数据。That is to say, the playback request and search request sent by the browser client to the server and the received audio and video streams and video streams returned by the server are all carried out between the server and the browser client in accordance with the protocol data packets of the set format. Transmission; wherein, the format of the protocol data packet is: the first field is the command identifier, the second field is the payload data length, and the third field is the payload data.

通过本实施例提供的非线性编辑软件的调度方法,浏览器客户端可以直接接收用户对服务器中存储的素材的选择,而无需将素材包下载到浏览器客户端侧,即可实现对音视频文件的编辑,因此,既节省制作人员的制作精力,又不会为浏览器客户端带来存储负担。不仅如此,用户还可以通过操作请求,请求浏览器客户端通过相应地调度策略从服务器侧将用户编辑的音视频文件、或视频画面帧直接下载到的浏览器客户端供用户预览,便于用户操作。由于仅是下载已编辑完成的音视频数据,因此,相较于现有的编辑方案需要下载大量的无用的素材包,能够有效减轻浏览器客户端与服务器端的数据传输负担。Through the scheduling method of the nonlinear editing software provided in this embodiment, the browser client can directly receive the user's selection of the material stored in the server, without downloading the material package to the browser client side, the audio and video can be edited. Therefore, it not only saves the production effort of the production staff, but also does not bring storage burden to the browser client. Not only that, the user can also request the browser client to directly download the audio and video files or video frame frames edited by the user from the server side to the browser client through the operation request through the corresponding scheduling strategy for the user to preview, which is convenient for the user to operate . Because only the edited audio and video data is downloaded, compared with the existing editing solutions that need to download a large number of useless material packages, it can effectively reduce the data transmission burden between the browser client and the server.

下面分别针对图3与图4对本实施例中的播放策略即Play机制、以及搜索策略即Seek机制进行说明。The playing strategy, ie, the Play mechanism, and the searching strategy, ie, the Seek mechanism, in this embodiment will be described below with reference to FIG. 3 and FIG. 4 .

如图3所示,为浏览器客户端通过Play机制与服务器端进行交互的交互示意图,具体交互流程如下:As shown in Figure 3, it is a schematic diagram of the interaction between the browser client and the server through the Play mechanism. The specific interaction process is as follows:

S1:浏览器客户端判断是否与服务器之间建立连接,如果没有连接服务器,则执行S2,若连接了服务器,则执行S3。S1: The browser client determines whether to establish a connection with the server, if not connected to the server, execute S2, and if connected to the server, execute S3.

S2:如果没有连接服务器,浏览器客户端连接服务器并向服务器同步工程的数据结构等信息,然后执行S3。S2: If the server is not connected, the browser client connects to the server and synchronizes the project data structure and other information with the server, and then executes S3.

S3:若连接了服务器,浏览器客户端向服务器发送Play请求。S3: If the server is connected, the browser client sends a Play request to the server.

其中,Play请求既可以Play文件,也可以Play时间线。Among them, the Play request can be either a Play file or a Play timeline.

S4:服务器接收到Play请求后,对文件进行读取并解码,将解码出来的视音频数据按照设定频率通过协议请求发送回浏览器客户端。S4: After receiving the Play request, the server reads and decodes the file, and sends the decoded video and audio data back to the browser client through the protocol request according to the set frequency.

其中,设定频率可以设定为按照40ms的节拍通过协议请求发送回浏览器客户端,这些发送给浏览器客户端的源源不断的视音频数据就形成了一个音视频流AVStream,直至文件播放完毕或者浏览器客户端发送停止的请求时,服务器便不再发送。Among them, the setting frequency can be set to send back to the browser client through the protocol request according to the beat of 40ms, and the continuous video and audio data sent to the browser client forms an audio and video stream AVStream until the file is played or When the browser client sends a stop request, the server doesn't send it anymore.

S5:浏览器客户端收到AVStream后,将其发送给视频播放器窗口的Media Element组件进行播放。S5: After the browser client receives the AVStream, it sends it to the Media Element component of the video player window for playback.

播放的同时,还需要对界面进行刷新,如时码和时码线的位置,时间线的显示区间,播放按钮等控件的状态。While playing, the interface also needs to be refreshed, such as the position of the time code and time code line, the display interval of the time line, the state of controls such as the play button.

S6:浏览器客户端向服务器发送停止请求,当播放停止时,一次播放的流程就结束了,用户可以继续执行下一次播放。S6: The browser client sends a stop request to the server. When the playback stops, the process of one playback ends, and the user can continue to perform the next playback.

如图4所示,为浏览器客户端通过Seek机制与服务器端进行交互的交互示意图,具体交互流程如下:As shown in Figure 4, it is a schematic diagram of the interaction between the browser client and the server through the Seek mechanism. The specific interaction process is as follows:

S1:浏览器客户端判断是否与服务器之间建立连接,如果没有连接服务器,则执行S2,若连接了服务器,则执行S3。S1: The browser client determines whether to establish a connection with the server, if not connected to the server, execute S2, and if connected to the server, execute S3.

S2:如果没有连接服务器,浏览器客户端连接服务器并同步工程文件的数据结构等信息,然后执行S3。S2: If the server is not connected, the browser client connects to the server and synchronizes information such as the data structure of the project file, and then executes S3.

S3:若连接了服务器,浏览器客户端向服务器发送Seek请求。S3: If the server is connected, the browser client sends a Seek request to the server.

其中,Seek请求既可以Seek文件即对音视频文件中的某一画面帧进行播放,也可以Seek时间线即对工程文件中的某一画面帧进行播放。Wherein, the Seek request can not only play a certain picture frame in an audio and video file as a Seek file, but also play a certain picture frame in a project file as a Seek timeline.

S4:服务器接收到Seek请求后,对文件进行读取并解码,将解码出来的视音频数据按照设定频率通过协议请求发送回浏览器客户端。S4: After receiving the Seek request, the server reads and decodes the file, and sends the decoded video and audio data back to the browser client through the protocol request according to the set frequency.

服务器在处理Seek请求时,只对视频进行Seek,不做音频,将解码出来的视频数据用IP帧的形式不断重复P帧发送回浏览器客户端,这就人为地制造了一个视频流VStream,保证了MediaElement能够正常播放显示。When the server processes the Seek request, it only performs Seek on the video, does not perform audio, and sends the decoded video data back to the browser client repeatedly in the form of IP frames with P frames, which artificially creates a video stream VStream. Ensure that the MediaElement can be played and displayed normally.

S5:浏览器客户端收到VStream后,将其发送给视频播放器窗口的MediaElement组件进行播放,当然,由于收到的都是同一画面帧的数据,所以播放出来的效果就是静止的画面,达到了Seek这一画面帧的效果。S5: After the browser client receives the VStream, it sends it to the MediaElement component of the video player window for playback. Of course, since the received data are all the data of the same picture frame, the effect of playing is a still picture, reaching The effect of the frame of the Seek frame.

对于快速Seek的情况,为了保证流畅度,在处理的过程中会根据收发数据的情况丢掉一些Seek出来的数据。In the case of fast Seek, in order to ensure fluency, some data from Seek will be discarded during the processing according to the situation of sending and receiving data.

对于剪辑界面的操作,浏览器客户端需要与服务器端进行工程文件的数据结构信息的同步,这个同步是单向的,只由客户端向服务端发送同步请求,为了防止用户误操作等问题,机制还提供了Undo/Redo流程,保证了剪辑的流畅度。For the operation of the editing interface, the browser client needs to synchronize the data structure information of the project file with the server. This synchronization is one-way, and only the client sends a synchronization request to the server. In order to prevent problems such as user misoperation, The mechanism also provides an Undo/Redo process to ensure the smoothness of editing.

实施例三Embodiment three

参照图5,示出了本发明实施例三的一种非线性编辑软件的调度装置的结构框图。Referring to FIG. 5 , it shows a structural block diagram of a scheduling device for nonlinear editing software according to Embodiment 3 of the present invention.

本实施例的非线性编辑软件的调度装置包括:接收模块502,用于接收用户操作请求;其中,用户操作请求包括:对剪辑的音视频文件或工程文件进行预览的请求、对剪辑的视频画面帧或工程画面帧进行预览的请求;确定模块504,用于确定用户操作请求的类型;调用模块506,用于依据确定结果调用与类型相对应的调度策略从服务器获取用户操作请求所请求的数据并播放;其中,当用户操作请求为对剪辑的音视频文件或工程文件进行预览的请求时,调用播放策略;当用户操作请求为对剪辑视频画面帧或工程画面帧进行预览的请求时,调用搜索策略。The scheduling device of the nonlinear editing software in this embodiment includes: a receiving module 502 for receiving user operation requests; wherein, the user operation requests include: a request for previewing clipped audio and video files or project files; Frame or engineering picture frame is previewed request; Determining module 504, is used for determining the type of user operation request; Calling module 506, is used for calling the dispatch strategy corresponding to type according to determining result and obtaining the requested data of user operation request from server And play; Wherein, when the user operation request is a request to preview the clipped audio and video files or project files, call the playback strategy; when the user operation request is a request to preview the clipped video frame or project frame, call search strategy.

通过本实施例提供的非线性编辑软件的调度装置,浏览器客户端可以直接接收用户对服务器中存储的素材的选择,而无需将素材包下载到浏览器客户端侧,即可实现对音视频文件的编辑,因此,既节省制作人员的制作精力,又不会为浏览器客户端带来存储负担。不仅如此,用户还可以通过操作请求,请求浏览器客户端通过相应地调度策略从服务器侧将用户编辑的音视频文件、或视频画面帧直接下载到的浏览器客户端供用户预览,便于用户操作。由于仅是下载已编辑完成的音视频数据,因此,相较于现有的编辑方案需要下载大量的无用的素材包,能够有效减轻浏览器客户端与服务器端的数据传输负担。Through the scheduling device of the non-linear editing software provided in this embodiment, the browser client can directly receive the user's selection of the material stored in the server, without downloading the material package to the browser client side, which can realize audio and video editing. Therefore, it not only saves the production effort of the production staff, but also does not bring storage burden to the browser client. Not only that, the user can also request the browser client to directly download the audio and video files or video frame frames edited by the user from the server side to the browser client through the operation request through the corresponding scheduling strategy for the user to preview, which is convenient for the user to operate . Because only the edited audio and video data is downloaded, compared with the existing editing solutions that need to download a large number of useless material packages, it can effectively reduce the data transmission burden between the browser client and the server.

实施例四Embodiment four

参照图6,示出了本发明实施例四的一种非线性编辑软件的调度装置的结构框图。Referring to FIG. 6 , it shows a structural block diagram of a scheduling device for nonlinear editing software according to Embodiment 4 of the present invention.

本实施例的非线性编辑软件的调度装置包括:接收模块602,用于接收用户操作请求;其中,用户操作请求包括:对剪辑的音视频文件或工程文件进行预览的请求、对剪辑的视频画面帧或工程画面帧进行预览的请求;确定模块604,用于确定用户操作请求的类型;调用模块606,用于依据确定结果调用与类型相对应的调度策略从服务器获取用户操作请求所请求的数据并播放;其中,当用户操作请求为对剪辑的音视频文件或工程文件进行预览的请求时,调用播放策略;当用户操作请求为对剪辑视频画面帧或工程画面帧进行预览的请求时,调用搜索策略。The scheduling device of the nonlinear editing software in this embodiment includes: a receiving module 602 for receiving user operation requests; wherein, the user operation requests include: a request for previewing clipped audio and video files or project files; Frame or project picture frame is previewed request; Determination module 604, is used for determining the type of user operation request; Calling module 606, is used for according to the dispatching strategy corresponding to type of calling and type according to determination result and obtains the requested data of user operation request from server And play; Wherein, when the user operation request is a request to preview the clipped audio and video files or project files, call the playback strategy; when the user operation request is a request to preview the clipped video frame or project frame, call search strategy.

优选地,当用户操作请求为对剪辑的音视频文件或工程文件进行预览的请求时,调用模块606调用播放策略从服务器获取用户操作请求所请求的数据并播放时:向服务器发送播放请求,其中,播放请求中携带有待预览的音视频文件信息,或待预览的工程文件的数据结构信息;工程文件的数据结构信息包含多段音视频素材信息以及各段音视频素材的排列关系信息;接收服务器返回的与音视频文件信息对应的音视频流,或与工程文件的数据结构信息对应的音视频流;将接收到的音视频流发送至视频播放器窗口的媒体播放器进行播放。Preferably, when the user operation request is a request for previewing the clipped audio and video files or project files, the calling module 606 invokes the play strategy to obtain and play the data requested by the user operation request from the server: send a play request to the server, wherein , the playback request carries the audio and video file information to be previewed, or the data structure information of the project file to be previewed; the data structure information of the project file includes information on multiple audio and video materials and the arrangement relationship information of each audio and video material; the receiving server returns The audio and video stream corresponding to the audio and video file information, or the audio and video stream corresponding to the data structure information of the project file; the received audio and video stream is sent to the media player in the video player window for playback.

优选地,本实施例的非线性编辑软件的调度装置还包括:连接模块608,用于在调用模块606向服务器发送播放请求之前,判断是否已连接所述服务器;若未连接服务器,则与服务器建立连接,并将已编辑的工程文件的数据结构信息同步至服务器。Preferably, the scheduling device of the non-linear editing software in this embodiment further includes: a connection module 608, which is used to determine whether the server has been connected to the server before the call module 606 sends a playback request to the server; Establish a connection and synchronize the data structure information of the edited project file to the server.

优选地,当用户操作请求为对剪辑的视频画面帧或工程画面帧进行预览的请求时,调用模块606调用搜索策略从服务器获取用户操作请求所请求的数据并播放时:向服务器发送搜索请求,其中,搜索请求中携带有待预览的视频画面帧的信息,或待浏览的工程画面帧的信息;接收服务器按照设定频率返回的与视频画面帧的信息,或工程画面帧的信息对应的视频流;将接收到的视频流发送至视频播放器窗口的媒体播放器进行播放,以实现对画面帧的预览。Preferably, when the user operation request is a request for previewing a clipped video frame or engineering frame, the calling module 606 invokes the search strategy to obtain and play the data requested by the user operation request from the server: send a search request to the server, Wherein, the search request carries the information of the video picture frame to be previewed, or the information of the engineering picture frame to be browsed; the video stream corresponding to the information of the video picture frame or the information of the engineering picture frame returned by the server according to the set frequency ;Send the received video stream to the media player in the video player window for playback, so as to realize the preview of the picture frame.

优选地,向服务器发送的播放请求、搜索请求以及接收到的服务器返回的音视频流、视频流均遵循设定格式的协议数据包在服务器与浏览器客户端之间进行传输;其中,协议数据包的设定格式为:第一字段为命令标识、第二字段为载荷数据长度、第三字段为载荷数据。Preferably, the playback request sent to the server, the search request, and the received audio and video streams and video streams returned by the server are transmitted between the server and the browser client in accordance with the protocol data packets of the set format; wherein, the protocol data The setting format of the packet is: the first field is the command identifier, the second field is the payload data length, and the third field is the payload data.

本实施例的非线性编辑软件的调度装置用于实现前述实施例一、实施例二中相应的调度方法,并且具有相应的方法实施例的有益效果,在此不再赘述。The scheduling device of the nonlinear editing software in this embodiment is used to implement the corresponding scheduling methods in the foregoing first and second embodiments, and has the beneficial effects of the corresponding method embodiments, which will not be repeated here.

在此提供的非线性编辑软件的调度方案不与任何特定计算机、虚拟系统或者其它设备固有相关。各种通用系统也可以与基于在此的示教一起使用。根据上面的描述,构造具有本发明方案的系统所要求的结构是显而易见的。此外,本发明也不针对任何特定编程语言。应当明白,可以利用各种编程语言实现在此描述的本发明的内容,并且上面对特定语言所做的描述是为了披露本发明的最佳实施方式。The scheduling scheme for the nonlinear editing software provided herein is not inherently related to any particular computer, virtual system, or other device. Various generic systems can also be used with the teachings based on this. The structure required to construct a system having the solution of the present invention is apparent from the above description. Furthermore, the present invention is not specific to any particular programming language. It should be understood that various programming languages can be used to implement the content of the present invention described herein, and the above description of specific languages is for disclosing the best mode of the present invention.

在此处所提供的说明书中,说明了大量具体细节。然而,能够理解,本发明的实施例可以在没有这些具体细节的情况下实践。在一些实例中,并未详细示出公知的方法、结构和技术,以便不模糊对本说明书的理解。In the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure the understanding of this description.

类似地,应当理解,为了精简本公开并帮助理解各个发明方面中的一个或多个,在上面对本发明的示例性实施例的描述中,本发明的各个特征有时被一起分组到单个实施例、图、或者对其的描述中。然而,并不应将该公开的方法解释成反映如下意图:即所要求保护的本发明要求比在每个权利要求中所明确记载的特征更多的特征。更确切地说,如权利要求书所反映的那样,发明方面在于少于前面公开的单个实施例的所有特征。因此,遵循具体实施方式的权利要求书由此明确地并入该具体实施方式,其中每个权利要求本身都作为本发明的单独实施例。Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, in order to streamline this disclosure and to facilitate an understanding of one or more of the various inventive aspects, various features of the invention are sometimes grouped together in a single embodiment, figure, or its description. This method of disclosure, however, is not to be interpreted as reflecting an intention that the claimed invention requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the Detailed Description are hereby expressly incorporated into this Detailed Description, with each claim standing on its own as a separate embodiment of this invention.

本领域那些技术人员可以理解,可以对实施例中的设备中的模块进行自适应性地改变并且把它们设置在与该实施例不同的一个或多个设备中。可以把实施例中的模块或单元或组件组合成一个模块或单元或组件,以及此外可以把它们分成多个子模块或子单元或子组件。除了这样的特征和/或过程或者单元中的至少一些是相互排斥之外,可以采用任何组合对本说明书(包括伴随的权利要求、摘要和附图)中公开的所有特征以及如此公开的任何方法或者设备的所有过程或单元进行组合。除非另外明确陈述,本说明书(包括伴随的权利要求、摘要和附图)中公开的每个特征可以由提供相同、等同或相似目的的替代特征来代替。Those skilled in the art can understand that the modules in the device in the embodiment can be adaptively changed and arranged in one or more devices different from the embodiment. Modules or units or components in the embodiments may be combined into one module or unit or component, and furthermore may be divided into a plurality of sub-modules or sub-units or sub-assemblies. All features disclosed in this specification (including accompanying claims, abstract and drawings) and any method or method so disclosed may be used in any combination, except that at least some of such features and/or processes or units are mutually exclusive. All processes or units of equipment are combined. Each feature disclosed in this specification (including accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.

此外,本领域的技术人员能够理解,尽管在此所述的一些实施例包括其它实施例中所包括的某些特征而不是其它特征,但是不同实施例的特征的组合意味着处于本发明的范围之内并且形成不同的实施例。例如,在权利要求书中,所要求保护的实施例的任意之一都可以以任意的组合方式来使用。Furthermore, those skilled in the art will understand that although some embodiments described herein include some features included in other embodiments but not others, combinations of features from different embodiments are meant to be within the scope of the invention. and form different embodiments. For example, in the claims, any one of the claimed embodiments can be used in any combination.

本发明的各个部件实施例可以以硬件实现,或者以在一个或者多个处理器上运行的软件模块实现,或者以它们的组合实现。本领域的技术人员应当理解,可以在实践中使用微处理器或者数字信号处理器(DSP)来实现根据本发明实施例的非线性编辑软件的调度方案中的一些或者全部部件的一些或者全部功能。本发明还可以实现为用于执行这里所描述的方法的一部分或者全部的设备或者装置程序(例如,计算机程序和计算机程序产品)。这样的实现本发明的程序可以存储在计算机可读介质上,或者可以具有一个或者多个信号的形式。这样的信号可以从因特网网站上下载得到,或者在载体信号上提供,或者以任何其他形式提供。The various component embodiments of the present invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art should understand that a microprocessor or a digital signal processor (DSP) can be used in practice to realize some or all functions of some or all components in the scheduling scheme of the nonlinear editing software according to the embodiment of the present invention . The present invention can also be implemented as an apparatus or an apparatus program (for example, a computer program and a computer program product) for performing a part or all of the methods described herein. Such a program for realizing the present invention may be stored on a computer-readable medium, or may be in the form of one or more signals. Such a signal may be downloaded from an Internet site, or provided on a carrier signal, or provided in any other form.

应该注意的是上述实施例对本发明进行说明而不是对本发明进行限制,并且本领域技术人员在不脱离所附权利要求的范围的情况下可设计出替换实施例。在权利要求中,不应将位于括号之间的任何参考符号构造成对权利要求的限制。单词“包含”不排除存在未列在权利要求中的元件或步骤。位于元件之前的单词“一”或“一个”不排除存在多个这样的元件。本发明可以借助于包括有若干不同元件的硬件以及借助于适当编程的计算机来实现。在列举了若干装置的单元权利要求中,这些装置中的若干个可以是通过同一个硬件项来具体体现。单词第一、第二、以及第三等的使用不表示任何顺序。可将这些单词解释为名称。It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention can be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means can be embodied by one and the same item of hardware. The use of the words first, second, and third, etc. does not indicate any order. These words can be interpreted as names.

Claims (10)

1. a dispatching method for non-linear editing software, is characterized in that, comprising:
Receive user operation request; Wherein, described user operation request comprises: the audio-video document of editing or project file are carried out to the request of preview, the video pictures frame of editing or engineering image frame carried out to the request of preview;
Determine the type of described user operation request;
Call the scheduling strategy corresponding with described type according to determination result obtain from server data that described user operation request asks and play;
Wherein, when described user operation request is, when carrying out the request of preview to the audio-video document of editing or project file, call broadcast strategy; When described user operation request is, when carrying out the request of preview to editing video pictures frame or engineering image frame, call search strategy.
2. method according to claim 1, it is characterized in that, when described user operation request is when carrying out the request of preview to the audio-video document of editing or project file, call broadcast strategy and obtain data that described user operation request asks and the step play comprises from server:
Send playing request to server, wherein, in described playing request, carry the audio-video document information of preview of needing, or treat the data structure information of project file of preview; The data structure information of project file comprises the Rankine-Hugoniot relations information of multistage audio frequency and video material information and each section of audio frequency and video material;
Receive the audio/video flow corresponding with described audio-video document information that described server returns, or the audio/video flow corresponding with the data structure information of described project file;
The media player that the audio/video flow received is sent to video player window is play.
3. method according to claim 2, is characterized in that, described before server transmission playing request step, described method also comprises:
Judge whether to connect described server;
If do not connect described server, then connect with described server, and the data structure information of the project file edited is synchronized to described server.
4. method according to claim 3, it is characterized in that, when described user operation request is when carrying out the request of preview to the video pictures frame of editing or engineering image frame, call search strategy and obtain data that described user operation request asks and the step play comprises from server:
Send searching request to server, wherein, in described searching request, carry the information of described video pictures frame of preview of needing, or the information of described engineering image frame to be browsed;
Receive that described server returns according to setpoint frequency with information that is described video pictures frame, or the video flowing that the information of described engineering image frame is corresponding;
The media player of the video stream received to video player window is play, to realize the preview to image frame.
5. method according to claim 4, it is characterized in that, the protocol data that the audio/video flow that the playing request sent to described server, searching request and the described server received return, video flowing all follow setting form wraps between described server and browser client and transmits;
Wherein, the setting form of described protocol data bag is: the first field is command id, the second field is load data length, the 3rd field is load data.
6. a dispatching device for non-linear editing software, is characterized in that, comprising:
Receiver module, for receiving user operation request; Wherein, described user operation request comprises: the audio-video document of editing or project file are carried out to the request of preview, the video pictures frame of editing or engineering image frame carried out to the request of preview;
Determination module, for determining the type of described user operation request;
Calling module, obtains from server data that described user operation request asks for calling the scheduling strategy corresponding with described type according to determination result and plays;
Wherein, when described user operation request is, when carrying out the request of preview to the audio-video document of editing or project file, call broadcast strategy; When described user operation request is, when carrying out the request of preview to editing video pictures frame or engineering image frame, call search strategy.
7. device according to claim 6, it is characterized in that, when described user operation request is when carrying out the request of preview to the audio-video document of editing or project file, described calling module calls broadcast strategy when obtaining data that user operation request asks from server and play:
Send playing request to server, wherein, in described playing request, carry the audio-video document information of preview of needing, or treat the data structure information of project file of preview; The data structure information of project file comprises the Rankine-Hugoniot relations information of multistage audio frequency and video material information and each section of audio frequency and video material;
Receive the audio/video flow corresponding with described audio-video document information that described server returns, or the audio/video flow corresponding with the data structure information of described project file;
The media player that the audio/video flow received is sent to video player window is play.
8. device according to claim 7, is characterized in that, the dispatching device of described non-linear editing software also comprises:
Link block, before sending playing request at described calling module to server, judges whether to connect described server; If do not connect described server, then connect with described server, and the data structure information of the project file edited is synchronized to described server.
9. device according to claim 8, it is characterized in that, when described user operation request is when carrying out the request of preview to the video pictures frame of editing or engineering image frame, described calling module calls search strategy when obtaining data that described user operation request asks from server and play:
Send searching request to server, wherein, in described searching request, carry the information of described video pictures frame of preview of needing, or the information of described engineering image frame to be browsed;
Receive that described server returns according to setpoint frequency with information that is described video pictures frame, or the video flowing that the information of described engineering image frame is corresponding;
The media player of the video stream received to video player window is play, to realize the preview to image frame.
10. device according to claim 9, it is characterized in that, the protocol data that the audio/video flow that the playing request sent to described server, searching request and the described server received return, video flowing all follow setting form wraps between described server and browser client and transmits;
Wherein, the setting form of described protocol data bag is: the first field is command id, the second field is load data length, the 3rd field is load data.
CN201510300770.2A 2015-06-03 2015-06-03 The dispatching method and device of non-linear editing software Active CN104954850B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510300770.2A CN104954850B (en) 2015-06-03 2015-06-03 The dispatching method and device of non-linear editing software

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510300770.2A CN104954850B (en) 2015-06-03 2015-06-03 The dispatching method and device of non-linear editing software

Publications (2)

Publication Number Publication Date
CN104954850A true CN104954850A (en) 2015-09-30
CN104954850B CN104954850B (en) 2019-08-06

Family

ID=54169137

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510300770.2A Active CN104954850B (en) 2015-06-03 2015-06-03 The dispatching method and device of non-linear editing software

Country Status (1)

Country Link
CN (1) CN104954850B (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105516257A (en) * 2015-11-27 2016-04-20 深圳市中博科创信息技术有限公司 Video file processing method and video file processing system
CN105635751A (en) * 2015-12-25 2016-06-01 北京大学第三医院 Video cloud platform video playing method and device
CN106060342A (en) * 2016-06-17 2016-10-26 深圳广播电影电视集团 Method and system for integration of on-line image-text editing system and non-linear editing system
CN112437342A (en) * 2020-05-14 2021-03-02 上海哔哩哔哩科技有限公司 Video editing method and device
CN115577684A (en) * 2022-12-07 2023-01-06 成都华栖云科技有限公司 Method, system and storage medium for connecting nonlinear editing system
CN118450198A (en) * 2024-06-26 2024-08-06 杭州海康威视数字技术股份有限公司 Video editing method and device, electronic equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030014758A1 (en) * 2001-07-13 2003-01-16 Samsung Electronics Co., Ltd. System and method for providing summary video information of video data
CN101740082A (en) * 2009-11-30 2010-06-16 孟智平 Method and system for clipping video based on browser
CN102081946A (en) * 2010-11-30 2011-06-01 上海交通大学 On-line collaborative nolinear editing system
CN104052935A (en) * 2014-06-18 2014-09-17 广东欧珀移动通信有限公司 A video editing method and device
CN104424242A (en) * 2013-08-27 2015-03-18 北大方正集团有限公司 Multi-media file processing method and system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030014758A1 (en) * 2001-07-13 2003-01-16 Samsung Electronics Co., Ltd. System and method for providing summary video information of video data
CN101740082A (en) * 2009-11-30 2010-06-16 孟智平 Method and system for clipping video based on browser
CN102081946A (en) * 2010-11-30 2011-06-01 上海交通大学 On-line collaborative nolinear editing system
CN104424242A (en) * 2013-08-27 2015-03-18 北大方正集团有限公司 Multi-media file processing method and system
CN104052935A (en) * 2014-06-18 2014-09-17 广东欧珀移动通信有限公司 A video editing method and device

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105516257A (en) * 2015-11-27 2016-04-20 深圳市中博科创信息技术有限公司 Video file processing method and video file processing system
CN105516257B (en) * 2015-11-27 2019-05-03 深圳市中博科创信息技术有限公司 A kind of processing method and video file processing system of video file
CN105635751A (en) * 2015-12-25 2016-06-01 北京大学第三医院 Video cloud platform video playing method and device
CN105635751B (en) * 2015-12-25 2019-01-04 北京大学第三医院 A kind of video cloud platform plays the method and device of video
CN106060342A (en) * 2016-06-17 2016-10-26 深圳广播电影电视集团 Method and system for integration of on-line image-text editing system and non-linear editing system
CN106060342B (en) * 2016-06-17 2019-07-09 深圳广播电影电视集团 A kind of integrated approach and system of online video text editing system and NLE system
CN112437342A (en) * 2020-05-14 2021-03-02 上海哔哩哔哩科技有限公司 Video editing method and device
CN115577684A (en) * 2022-12-07 2023-01-06 成都华栖云科技有限公司 Method, system and storage medium for connecting nonlinear editing system
CN115577684B (en) * 2022-12-07 2023-03-31 成都华栖云科技有限公司 Method, system and storage medium for connecting nonlinear editing system
CN118450198A (en) * 2024-06-26 2024-08-06 杭州海康威视数字技术股份有限公司 Video editing method and device, electronic equipment and storage medium
CN118450198B (en) * 2024-06-26 2024-08-30 杭州海康威视数字技术股份有限公司 Video editing method and device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN104954850B (en) 2019-08-06

Similar Documents

Publication Publication Date Title
CN104954850B (en) The dispatching method and device of non-linear editing software
US7900140B2 (en) Media processing methods, systems and application program interfaces
US7434154B2 (en) Systems and methods for synchronizing media rendering
US9264772B2 (en) Reception apparatus, reception method, and program
JP4865985B2 (en) Method and apparatus for processing media services from content aggregators
US7669206B2 (en) Dynamic redirection of streaming media between computing devices
US8265457B2 (en) Proxy editing and rendering for various delivery outlets
US7712108B2 (en) Media processing methods, systems and application program interfaces
CN113099258B (en) Cloud guide system, live broadcast processing method and device, and computer readable storage medium
CN104796796B (en) Improve the fault-tolerant method of the HLS streaming players of Android platform
WO2017063399A1 (en) Video playback method and device
CN109168031A (en) Streaming Media method for pushing and device, steaming media platform
CN105376590B (en) Multithreading whole process towards full media cooperates with high definition post-production system and its method
TW201202975A (en) Real-time or near real-time streaming
CN108810657B (en) A method and system for setting video cover
CN107197386A (en) A kind of cross-platform video playback implementation method without client
CN108881357A (en) A kind of method and apparatus that data are synchronous
CN107534793A (en) Receiving device, transmitting device and data processing method
CN103414959B (en) A kind of method and apparatus for accelerating Internet video broadcasting speed
US20060236219A1 (en) Media timeline processing infrastructure
CN108924630A (en) A kind of method and playback equipment of display caching progress
CN106231363A (en) A kind of barrage video stream transmission method and equipment thereof
CN108833968A (en) A kind of method and relevant device of buffered video
CN106537930A (en) Multi-media streaming service presentation method, relevant device and relevant system
CN205754690U (en) Instant news multi-screen interactive platform

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
PP01 Preservation of patent right

Effective date of registration: 20250928

Granted publication date: 20190806

PP01 Preservation of patent right