Embodiment
Below in conjunction with accompanying drawing, the present invention is described in further detail.
Fig. 1 illustrate according to one aspect of the invention for playing the equipment schematic diagram of the network multimedia file of multiple encapsulation format, wherein, built-in terminal 1 comprises acquisition device 11, checkout gear 12, the first conversion equipment 13 and the first playing device 14.At this, built-in terminal can be anyly can implant embedded system and can pass through keyboard with user, mouse, remote controller, the mode such as touch-screen or handwriting equipment is carried out the electronic product of man-machine interaction, include but not limited to mobile phone, electronic dictionary, video telephone, digital camera (DC), digital camera (DV), Set Top Box (Set Top Box), HDTV (High-Definition Television) (HDTV), game machine, intelligent toy, appliance control system etc., those skilled in the art will be understood that above-mentioned built-in terminal is only for giving an example, other built-in terminals existing or that may occur are from now on as applicable to the present invention, also should be included in protection range of the present invention, and with way of reference, be contained in this at this.
Acquisition device 11 is for having the multimedia file of the first encapsulation format by Network Capture.Particularly, acquisition device 11 is by network, and server or third-party server from content supplier, obtain the multimedia file with the first encapsulation format.At this, network includes but not limited to the Internet, wide area network, metropolitan area network, local area network (LAN), VPN network, wireless self-organization network (Ad Hoc network) etc.; The server of content supplier or third-party server include but not limited to web server, streaming media server etc.Those skilled in the art will be understood that above-mentioned network or server are only for giving an example, and other networks existing or that may occur from now on or server, as applicable to the present invention, also should be included in protection range of the present invention, and with way of reference, are contained in this at this.In addition, described in there is the multimedia file of the first encapsulation format obtain manner include but not limited to, HTTP mode, FTP mode, RTSP mode, MMS mode or P2P mode.For example, built-in terminal 1 not only can be browsed generic web page by browser, also can login video website or other websites, by http protocol access browsing video webpage, obtains hyperlink multimedia file pointed in this video webpage.And for example, acquisition device 11 in built-in terminal 1 is from Network Capture multichannel P2P video file, these multi-channel video files comprise the video file of separate sources, a plurality of fragments of a video file of separate sources (separate sources film for example, or a plurality of fragments of this film of composition of separate sources), then acquisition device 11 carries out ensuing operation by the fragment delivery of the video file of specific video file or special time to other devices of built-in terminal 1 again.At this; those skilled in the art will be understood that above-mentioned several obtain manner with the multimedia file of the first encapsulation format is only for example; the obtain manner of other existing or multimedia files with the first encapsulation format that may occur is from now on as applicable to the present invention; also should be included in protection range of the present invention, and with way of reference, be contained in this at this.At this, multimedia file includes but not limited to that audio file, video file, picture file etc. can be by the digital documents of player plays.Those skilled in the art will be understood that above-mentioned several multimedia file is only for giving an example, and other multimedia files existing or that may occur from now on, as applicable to the present invention, also should be included in protection range of the present invention, and with way of reference, are contained in this at this.
Whether checkout gear 12 matches with the support format list of built-in terminal for detection of described the first encapsulation format.Particularly, the multimedia file with the first encapsulation format that checkout gear 12 obtains according to acquisition device 11, detect the first encapsulation format of this multimedia file, for example, according to the extension name of this multimedia file, the characteristic information such as characteristic signature or metadata, determine the first encapsulation format of this multimedia file, after this, again the support format list of described the first encapsulation format and built-in terminal is compared, whether detect described the first encapsulation format matches with the support format list of built-in terminal, for example whether described the first encapsulation format is contained in this support format list.To expand example by name, the encapsulation format corresponding to multimedia file of expansion " flv " by name is " FLV "; But the encapsulation format that different extension name may be corresponding identical, the encapsulation format that for example " asf " and " wmv " is corresponding is " ASF ".At this; the extension name of multimedia file includes but not limited to " mp3 ", " mp4 ", " avi ", " flv ", " mov ", " rmvb ", " rm ", " asf ", " wmv " or " mkv " etc.; those skilled in the art will be understood that the extension name of above-mentioned several multimedia files is only for giving an example; the extension name of other multimedia files existing or that may occur is from now on as applicable to the present invention; also should be included in protection range of the present invention, and with way of reference, be contained in this at this.At this; the encapsulation format of multimedia file includes but not limited to " MP3 ", " MP4 ", " AVI ", " FLV ", " QuickTime ", " RMVB ", " RM ", " ASF " or " MKV "; those skilled in the art will be understood that the encapsulation format of above-mentioned several multimedia files is only for giving an example; the encapsulation format of other multimedia files existing or that may occur is from now on as applicable to the present invention; also should be included in protection range of the present invention, and with way of reference, be contained in this at this.Whether checkout gear 12, according to the first encapsulation format of described multimedia file, compares with the support format list of built-in terminal, detect described the first encapsulation format and match with the support format list of built-in terminal.At this, support to store the encapsulation format that described built-in terminal is supported in format list the encapsulation format of the multimedia file of the broadcasting that can directly be well on this built-in terminal; For not mating because of encapsulation format, do not cause the multimedia file that cannot play on this built-in terminal, its encapsulation format does not mate with this support format list.Those skilled in the art will be understood that mode that whether described the first encapsulation format of above-mentioned detection match with the support format list of built-in terminal is only for for example; the mode whether described the first encapsulation format of other detections existing or that may occur from now on matches with the support format list of built-in terminal is as applicable to the present invention; also should be included in protection range of the present invention, and with way of reference, be contained in this at this.Preferably, because browser execution is in application layer, its support be JS, HTML, the scripts such as XML, and the CPU of built-in terminal 1, decoding chips etc. are positioned at bottom, it supports the code speechs such as C language, cannot directly call above-mentioned script, therefore, acquisition device 11 can also call by one or many modes such as described application programming interfaces (API) or socket (Socket) interface, the obtained multimedia file with the first encapsulation format is passed to checkout gear 12, to detect described the first encapsulation format, whether match with the support format list of built-in terminal.
The first conversion equipment 13 is not for when described the first encapsulation format and described support format list match, according to format conversion storehouse, described multimedia file is carried out to format conversion processing, to obtain the multimedia file with the second encapsulation format, wherein, described the second encapsulation format and described support format list match.Particularly, when being detected described the first encapsulation format and described support format list by checkout gear 12 and not matching, the first conversion equipment 13 is according to format conversion storehouse, obtain the format conversion information of described the first encapsulation format, the packaging information of this first encapsulation format for example, decapsulation information etc., and according to described format conversion information, by modes such as decapsulation-encapsulation process, described multimedia file is carried out to format conversion processing, to obtain the multimedia file with the second encapsulation format, wherein, described the second encapsulation format and described support format list match, , described built-in terminal can be play-overed the multimedia file with described the second encapsulation format.For example, the first conversion equipment 13 is according to format conversion storehouse, by calling (as called or far call this locality) or loading and call corresponding decapsulation application, decapsulation multimedia file, thus obtain the one or more coding unit sequence flows after this multimedia file decapsulation.At this, coding unit sequence flows includes but not limited to audio coding unit sequence flows, video encoding unit sequence flows or both combinations.For example, suppose that checkout gear 12 is after the first encapsulation format that detects multimedia file is " MKV ", call the decapsulation application corresponding with " MKV " form, after this multimedia file of decapsulation, obtain an audio coding unit sequence flows and a video encoding unit sequence flows in this multimedia file.Those skilled in the art will be understood that above-mentioned several coding unit sequence flows is only for giving an example; other coding unit sequence flows existing or that may occur are from now on as applicable to the present invention; also should be included in protection range of the present invention, and with way of reference, be contained in this at this.After this, one or more coding unit sequence flows that the first conversion equipment 13 obtains according to decapsulation again, according to the second encapsulation format in described support format list, described one or more coding unit sequence flows are packaged into the multimedia file with the second encapsulation format, to complete the format conversion operation of described multimedia file.For example, suppose that multimedia file first encapsulation format is " FLV ", by after its decapsulation, obtain an audio coding unit sequence flows and a video encoding unit sequence flows, now, the second encapsulation format that built-in terminal 1 is supported is " AVI ", so, the first conversion equipment 13 encapsulates this audio coding unit sequence flows and video encoding unit sequence flows according to the form of " AVI ", thus the conversion of the encapsulation format that completes this multimedia file from " FLV " to " AVI ".Those skilled in the art will be understood that the above-mentioned mode that multimedia file is carried out to format conversion processing is only for giving an example; other existing or modes of multimedia file being carried out to format conversion processing that may occur are from now on as applicable to the present invention; also should be included in protection range of the present invention, and with way of reference, be contained in this at this.
The first playing device 14 is for having the multimedia file of the second encapsulation format described in the broadcasting of decoding.Particularly, the first playing device 14 carries out according to the first conversion equipment 13 multimedia file with the second encapsulation format obtaining after conversion process, by the coding unit sequence flows to wherein, decompress, then according to the temporal information in this coding unit sequence flows, synchronously play audio coding unit and the video encoding unit in this coding unit sequence flows.For example, the first playing device 14 its receive by after the first conversion equipment 13 conversion, obtain there is the multimedia file of the second encapsulation format time, for example, by the decoding chip in built-in terminal 1, to coding unit sequence flows decompression wherein, from the temporal information of coding unit sequence flows, obtain the timestamp of audio coding unit and video encoding unit, then according to this timestamp, realize the synchronous broadcasting of audio coding unit and video encoding unit.Those skilled in the art will be understood that the method for synchronization of above-mentioned audio coding unit and video encoding unit is only for giving an example; the method of synchronization of other audio coding units existing or that may occur from now on and video encoding unit is as applicable to the present invention; also should be included in protection range of the present invention, and with way of reference, be contained in this at this.Those skilled in the art will be understood that the mode of multimedia file that above-mentioned decoding has the second encapsulation format described in playing is only for for example; other decodings existing or that may occur from now on have the mode of multimedia file of the second encapsulation format described in playing as applicable to the present invention; also should be included in protection range of the present invention, and with way of reference, be contained in this at this.
Preferably, between each device of built-in terminal 1, be constant work.Particularly, acquisition device 11 has the multimedia file of the first encapsulation format by Network Capture; Whether checkout gear 12 detects described the first encapsulation format and matches with the support format list of built-in terminal; When described the first encapsulation format and described support format list do not match, the first conversion equipment 13 is according to format conversion storehouse, described multimedia file is carried out to format conversion processing, to obtain the multimedia file with the second encapsulation format, wherein, described the second encapsulation format and described support format list match; The multimedia file described in the first playing device 14 decoding broadcastings with the second encapsulation format.At this, it will be understood by those skilled in the art that each device that " continuing " refer to built-in terminal 1 requires to have the obtaining of multimedia file of the first encapsulation format according to the mode of operation of setting or adjust in real time respectively, detection and the conversion of the first encapsulation format, there is the decoding broadcasting of the multimedia file of the second encapsulation format, until acquisition device 11 stops having by Network Capture the multimedia file of the first encapsulation format in a long time.
Preferably, built-in terminal 1 can also comprise the second playing device (not shown).Described the second playing device is for when described the first encapsulation format and described support format list match, to the broadcasting of decoding of described multimedia file.Particularly, when checkout gear 12 detects described the first encapsulation format and described support format list and matches, the second playing device is by decompressing to the described coding unit sequence flows with the multimedia file of the first encapsulation format, then according to the temporal information in this coding unit sequence flows, synchronously play audio coding unit and the video encoding unit in this coding unit sequence flows, to the broadcasting of decoding of described multimedia file.For example, the second playing device decompresses the described coding unit sequence flows with the multimedia file of the first encapsulation format, from the temporal information of coding unit sequence flows, obtain the timestamp of audio coding unit and video encoding unit, then according to this timestamp, realize the synchronous broadcasting of audio coding unit and video encoding unit.Those skilled in the art will be understood that the method for synchronization of above-mentioned audio coding unit and video encoding unit is only for giving an example; the method of synchronization of other audio coding units existing or that may occur from now on and video encoding unit is as applicable to the present invention; also should be included in protection range of the present invention, and with way of reference, be contained in this at this.Those skilled in the art also will be understood that the mode of multimedia file that above-mentioned decoding has the first encapsulation format described in playing is only for for example; other decodings existing or that may occur from now on have the mode of multimedia file of the first encapsulation format described in playing as applicable to the present invention; also should be included in protection range of the present invention, and with way of reference, be contained in this at this.
Those skilled in the art will be understood that above-mentioned the first playing device and the second playing device are only example, and in practice, they can be two independently modules, also can all be integrated in a module.
Preferably, the first conversion equipment 13 also, for when described the first encapsulation format and described support format list do not match, according to described format conversion storehouse, carries out decapsulation processing to described multimedia file, to obtain the multimedia file without encapsulation; According to described support format list, select the second encapsulation format of described multimedia file, wherein, described the second encapsulation format and described support format list match; According to described the second encapsulation format, the described multimedia file without encapsulation is carried out to form encapsulation process, to obtain the multimedia file with the second encapsulation format.Particularly, when being detected described the first encapsulation format and described support format list by checkout gear 12 and not matching, the first conversion equipment 13 is according to described format conversion storehouse, obtain the format conversion information of described the first encapsulation format, the packaging information of this first encapsulation format for example, decapsulation information etc., and according to described format conversion information, by calling (as called or far call this locality) or loading and call corresponding decapsulation application, described multimedia file is carried out to decapsulation processing, to obtain the multimedia file without encapsulation, one or more coding unit sequence flows for example, after this, the second encapsulation format that the first conversion equipment 13 is supported according to the decoding chip of described built-in terminal again, such as the mode such as select from support format list, select the second encapsulation format of described multimedia file, wherein, described the second encapsulation format and described support format list match, then, described the first conversion equipment 13 is again according to described the second encapsulation format, the described multimedia file without encapsulation is carried out to form encapsulation process, to obtain the multimedia file with the second encapsulation format, for example, described one or more coding unit sequence flows are packaged into the multimedia file with the second encapsulation format.At this, coding unit sequence flows includes but not limited to audio coding unit sequence flows, video encoding unit sequence flows or both combinations.For example, suppose that checkout gear 12 is after the first encapsulation format that detects multimedia file is " MKV ", the first conversion equipment 13 calls the decapsulation application corresponding with " MKV " form, after this multimedia file of decapsulation, obtain an audio coding unit sequence flows and a video encoding unit sequence flows in this multimedia file.Those skilled in the art will be understood that above-mentioned several coding unit sequence flows is only for giving an example; other coding unit sequence flows existing or that may occur are from now on as applicable to the present invention; also should be included in protection range of the present invention, and with way of reference, be contained in this at this.For example, suppose that multimedia file first encapsulation format is " FLV ", by after its decapsulation, obtain an audio coding unit sequence flows and a video encoding unit sequence flows, now, the second encapsulation format that built-in terminal 1 is supported is " AVI ", so, the first conversion equipment 13 encapsulates this audio coding unit sequence flows and video encoding unit sequence flows according to the form of " AVI ", thus the conversion of the encapsulation format that completes this multimedia file from " FLV " to " AVI ".Those skilled in the art will be understood that the above-mentioned mode that multimedia file is carried out to format conversion processing is only for giving an example; other existing or modes of multimedia file being carried out to format conversion processing that may occur are from now on as applicable to the present invention; also should be included in protection range of the present invention, and with way of reference, be contained in this at this.
(with reference to Fig. 1) in a preferred embodiment, described format conversion storehouse comprises native format transformation warehouse; Wherein, described the first conversion equipment 13 is not also for when described the first encapsulation format and described support format list match, according to described native format transformation warehouse, described multimedia file is carried out to format conversion processing, to obtain the multimedia file with the second encapsulation format, wherein, described the second encapsulation format and described support format list match.Particularly, when described format conversion storehouse comprises native format transformation warehouse, described format conversion storehouse is kept at local side, and built-in terminal, wherein stores format conversion information, such as the packaging information of encapsulation format, decapsulation information etc.When checkout gear 12 detects described the first encapsulation format and described support format list and does not match, the first conversion equipment 13 is according to native format transformation warehouse, obtain the format conversion information of described the first encapsulation format, for example this first encapsulation format is stored in local packaging information, decapsulation information etc., and according to described format conversion information, by modes such as decapsulation-encapsulation process, described multimedia file is carried out to format conversion processing, to obtain the multimedia file with the second encapsulation format, wherein, described the second encapsulation format and described support format list match.Those skilled in the art will be understood that the above-mentioned mode that multimedia file is carried out to format conversion processing is only for giving an example; other existing or modes of multimedia file being carried out to format conversion processing that may occur are from now on as applicable to the present invention; also should be included in protection range of the present invention, and with way of reference, be contained in this at this.
Fig. 2 illustrate according to one aspect of the invention for playing the system topological figure of the network multimedia file of multiple encapsulation format; Comprising the network equipment 2 and a plurality of built-in terminal being connected via network with it 1.Wherein, the network equipment 2 can be connected via network with a plurality of built-in terminals 1, and be received from the format conversion request about described multimedia file that built-in terminal 1 sends, wherein, described format conversion request comprises the support format list of described built-in terminal; According to network format transformation warehouse, described multimedia file is carried out to format conversion processing, to obtain the multimedia file with the second encapsulation format, wherein, described the second encapsulation format and described support format list match; To described built-in terminal 1, send the multimedia file with the second encapsulation format obtaining based on described format conversion request.At this, network includes but not limited to the Internet, wide area network, metropolitan area network, local area network (LAN), VPN network, wireless self-organization network (Ad Hoc network) etc.
In addition, the network equipment 2 includes but not limited to the cloud that network host, single network server, a plurality of webserver collection or a plurality of server form.At this, cloud consists of a large amount of computers based on cloud computing (Cloud Computing) or the webserver, and wherein, cloud computing is a kind of of Distributed Calculation, the super virtual machine being comprised of the loosely-coupled computer collection of a group.And built-in terminal 1 includes but not limited to any electronic product that can implant embedded system and can carry out man-machine interaction by modes such as keyboard, mouse, remote controller, touch-screen or handwriting equipments with user, such as mobile phone, electronic dictionary, video telephone, digital camera (DC), digital camera (DV), Set Top Box (Set Top Box), HDTV (High-Definition Television) (HDTV), game machine, intelligent toy, appliance control system etc.Communicating by letter between the network equipment 2 and built-in terminal 1 is separate, includes but not limited to the packet data transmission based on such as ICP/IP protocol, udp protocol etc.
Those skilled in the art will be understood that the above-mentioned network equipment 2, built-in terminal 1 and connection network or communication mode is therebetween only for example; other network equipments existing or that may occur from now on, built-in terminal or network, communication mode are as applicable to the present invention; also should be included in protection range of the present invention, and with way of reference, be contained in this at this.
Those skilled in the art also will be understood that, the quantity of the disparate networks element only illustrating for simplicity's sake in Fig. 2 may be less than the quantity in real network, but this omission far and away with can not affect to the present invention carry out clear, be disclosed as prerequisite fully.
For simplicity's sake, take a built-in terminal 1 is below described as example.Those skilled in the art will be understood that, the network equipment 2 can be simultaneously mutual with a plurality of built-in terminals 1, and be received from the format conversion request about described multimedia file that different built-in terminals 1 send, wherein, described format conversion request comprises the support format list of described built-in terminal; According to network format transformation warehouse, described multimedia file is carried out to format conversion processing, to obtain the multimedia file with the second encapsulation format, wherein, described the second encapsulation format and described support format list match; To corresponding built-in terminal 1, send the multimedia file with the second encapsulation format obtaining based on described format conversion request.
Fig. 3 illustrate in accordance with a preferred embodiment of the present invention for playing the equipment schematic diagram of the network multimedia file of multiple encapsulation format.Built-in terminal 1 comprises acquisition device 11 ', checkout gear 12 ', the first conversion equipment 13 ' and the first playing device 14 '; The network equipment 2 comprises receiving system 21 ', the second conversion equipment 22 ' and the first dispensing device 23 '.Wherein, the acquisition device 11 ' in built-in terminal 1, checkout gear 12 ' and the first playing device 14 ' are identical with corresponding intrument shown in Fig. 1 respectively, so locate to repeat no more, and mode is by reference contained in this.
Between each device in built-in terminal 1 and the network equipment 2, work in coordination, to complete the network multimedia file of playing multiple encapsulation format.Particularly, when described format conversion storehouse comprises the network format transformation warehouse in the network equipment, and when described the first encapsulation format and described support format list do not match, the first conversion equipment 13 ' in built-in terminal 1 sends the format conversion request about described multimedia file to the described network equipment, and wherein said format conversion request comprises described support format list.Receiving system 21 ' in the network equipment 2 is received from the format conversion request about described multimedia file that built-in terminal sends, and wherein, described format conversion request comprises the support format list of described built-in terminal; The second conversion equipment 22 ', according to network format transformation warehouse, carries out format conversion processing by described multimedia file, and to obtain the multimedia file with the second encapsulation format, wherein, described the second encapsulation format and described support format list match; The first dispensing device 23 ' sends the multimedia file with the second encapsulation format obtaining based on described format conversion request to described built-in terminal.What the first conversion equipment 13 ' in built-in terminal 1 was received from that the described network equipment sends obtains the multimedia file with the second encapsulation format based on described format conversion request according to described network format transformation warehouse, wherein, described the second encapsulation format and described support format list match.Preferably, between above-mentioned each device, be constant work.At this, it will be understood by those skilled in the art that " continuing " refers to that above-mentioned each device requires to operate accordingly according to the mode of operation of setting or adjust in real time respectively.
More specifically, when described format conversion storehouse comprises the network format transformation warehouse in the network equipment, and when described the first encapsulation format and described support format list do not match; The first conversion equipment 13 ' in described built-in terminal 1 in real time or answer Event triggered ground, by one or many, call application programming interfaces (API) that the network equipment 2 provides or the communication mode of other agreements, the format conversion request sending about described multimedia file to the described network equipment 2, wherein said format conversion request comprises described support format list; After this, what be received from that the described network equipment 2 sends obtains the multimedia file with the second encapsulation format based on described format conversion request according to described network format transformation warehouse, for example receive by the multimedia file with the second encapsulation format of the communication mode transmission of the API described in precedent or other agreements, wherein, described the second encapsulation format and described support format list match.Those skilled in the art will be understood that the mode of above-mentioned transmission format conversion request is only for giving an example; the mode of other transmission format conversion existing or that may occur from now on requests is as applicable to the present invention; also should be included in protection range of the present invention, and with way of reference, be contained in this at this.Those skilled in the art also will be understood that the mode of multimedia file that above-mentioned reception has the second encapsulation format is only for for example; other receptions existing or that may occur from now on have the mode of multimedia file of the second encapsulation format as applicable to the present invention; also should be included in protection range of the present invention, and with way of reference, be contained in this at this.
Receiving system 21 ' in the network equipment 2 is received from the format conversion request about described multimedia file that built-in terminal sends, for example receive the format conversion request of the described multimedia file of the communication mode transmission of passing through the API described in precedent or other agreements, wherein, described format conversion request comprises the support format list of described built-in terminal.
The second conversion equipment 22 ' is according to network format transformation warehouse, obtain the format conversion information of described the first encapsulation format, for example be stored in the packaging information of this first encapsulation format of network terminal, decapsulation information etc., and according to described format conversion information, the support format list of included built-in terminal 1 in the format conversion request receiving in conjunction with receiving system 21 ', by modes such as decapsulation-encapsulation process, described multimedia file is carried out to format conversion processing, to obtain the multimedia file with the second encapsulation format, wherein, described the second encapsulation format and described support format list match.
The first dispensing device 23 ' in real time or answer Event triggered ground, by one or many, call application programming interfaces (API) that built-in terminal 1 provides or the communication mode of other agreements, to described built-in terminal, send the multimedia file with the second encapsulation format obtaining based on described format conversion request.
In a preferred embodiment, described the second conversion equipment 22 ', also for according to described network format transformation warehouse, carries out decapsulation processing to described multimedia file, to obtain the multimedia file without encapsulation; According to described support format list, select the second encapsulation format of described multimedia file, wherein, described the second encapsulation format and described support format list match; According to described the second encapsulation format, the described multimedia file without encapsulation is carried out to form encapsulation process, to obtain the multimedia file with the second encapsulation format.Particularly, the second conversion equipment 22 ' is according to described network format transformation warehouse, obtain the format conversion information of described the first encapsulation format, such as being stored in packaging information, decapsulation information of this first encapsulation format of network terminal etc., and according to described format conversion information, by calling or load and call corresponding decapsulation, apply, described multimedia file is carried out to decapsulation processing, for example, to obtain the multimedia file without encapsulation, one or more coding unit sequence flows; After this, the support format list of included built-in terminal 1 in the format conversion request that the second conversion equipment 22 ' receives according to receiving system 21 ' again, such as the mode such as select from support format list, select the second encapsulation format of described multimedia file, wherein, described the second encapsulation format and described support format list match; Then, described the second conversion equipment 22 ' is again according to described the second encapsulation format, the described multimedia file without encapsulation is carried out to form encapsulation process, to obtain the multimedia file with the second encapsulation format, for example, described one or more coding unit sequence flows are packaged into the multimedia file with the second encapsulation format.At this, coding unit sequence flows includes but not limited to audio coding unit sequence flows, video encoding unit sequence flows or both combinations.Those skilled in the art will be understood that the above-mentioned mode that multimedia file is carried out to format conversion processing is only for giving an example; other existing or modes of multimedia file being carried out to format conversion processing that may occur are from now on as applicable to the present invention; also should be included in protection range of the present invention, and with way of reference, be contained in this at this.
Preferably, the network equipment 2 can also comprise the second dispensing device (not shown), and built-in terminal 1 can also comprise updating device (not shown).Described the second dispensing device is for sending the format conversion information based on described network format transformation warehouse to described built-in terminal.Described updating device, for when described format conversion storehouse also comprises native format transformation warehouse, is received from the format conversion information based on described network format transformation warehouse that the described network equipment sends; According to described format conversion information, set up or upgrade described native format transformation warehouse.Particularly, the second dispensing device in the network equipment 2 in real time or answer Event triggered ground, by one or many, call application programming interfaces (API) that built-in terminal 1 provides or the communication mode of other agreements, to described built-in terminal, send the format conversion information based on described network format transformation warehouse.When described format conversion storehouse also comprises native format transformation warehouse, updating device in built-in terminal 1 is received from the format conversion information based on described network format transformation warehouse that the described network equipment sends, for example receive the format conversion information of the described network format transformation warehouse that the communication mode by the API described in precedent or other agreements transmits, such as encapsulation format, be stored in the packaging information, decapsulation information of network terminal etc.; After this, updating device is again according to described format conversion information, by modes such as database updates, sets up or upgrades described native format transformation warehouse.Those skilled in the art will be understood that the mode of above-mentioned renewal native format transformation warehouse is only for giving an example; the mode of other renewal native format transformation warehouses existing or that may occur is from now on as applicable to the present invention; also should be included in protection range of the present invention, and with way of reference, be contained in this at this.
Those skilled in the art will be understood that above-mentioned the first dispensing device and the second dispensing device are only example, and in practice, they can be two independently modules, also can all be integrated in a module.
Fig. 4 illustrate according to a further aspect of the present invention for playing the method flow diagram of the network multimedia file of multiple encapsulation format.
Wherein, in step S1, built-in terminal 1 has the multimedia file of the first encapsulation format by Network Capture.Particularly, in step S1, built-in terminal 1 is by network, and server or third-party server from content supplier, obtain the multimedia file with the first encapsulation format.At this, network includes but not limited to the Internet, wide area network, metropolitan area network, local area network (LAN), VPN network, wireless self-organization network (Ad Hoc network) etc.; The server of content supplier or third-party server include but not limited to web server, streaming media server etc.Those skilled in the art will be understood that above-mentioned network or server are only for giving an example, and other networks existing or that may occur from now on or server, as applicable to the present invention, also should be included in protection range of the present invention, and with way of reference, are contained in this at this.In addition, described in there is the multimedia file of the first encapsulation format obtain manner include but not limited to, HTTP mode, FTP mode, RTSP mode, MMS mode or P2P mode.For example, built-in terminal 1 not only can be browsed generic web page by browser, also can login video website or other websites, by http protocol access browsing video webpage, obtains hyperlink multimedia file pointed in this video webpage.And for example, built-in terminal 1 in step S1 from Network Capture multichannel P2P video file, these multi-channel video files comprise the video file of separate sources, a plurality of fragments of a video file of separate sources (separate sources film for example, or a plurality of fragments of this film of composition of separate sources), then built-in terminal 1 carries out following step to the fragment of the video file of specific video file or special time again.At this; those skilled in the art will be understood that above-mentioned several obtain manner with the multimedia file of the first encapsulation format is only for example; the obtain manner of other existing or multimedia files with the first encapsulation format that may occur is from now on as applicable to the present invention; also should be included in protection range of the present invention, and with way of reference, be contained in this at this.At this, multimedia file includes but not limited to that audio file, video file, picture file etc. can be by the digital documents of player plays.Those skilled in the art will be understood that above-mentioned several multimedia file is only for giving an example, and other multimedia files existing or that may occur from now on, as applicable to the present invention, also should be included in protection range of the present invention, and with way of reference, are contained in this at this.
In step S2, whether built-in terminal 1 detects described the first encapsulation format and matches with the support format list of built-in terminal.Particularly, in step S2, built-in terminal 1 is according to the multimedia file with the first encapsulation format obtaining in step S1, detect the first encapsulation format of this multimedia file, for example, according to the extension name of this multimedia file, the characteristic information such as characteristic signature or metadata, determine the first encapsulation format of this multimedia file, after this, again the support format list of described the first encapsulation format and built-in terminal is compared, whether detect described the first encapsulation format matches with the support format list of built-in terminal, for example whether described the first encapsulation format is contained in this support format list.To expand example by name, the encapsulation format corresponding to multimedia file of expansion " flv " by name is " FLV "; But the encapsulation format that different extension name may be corresponding identical, the encapsulation format that for example " asf " and " wmv " is corresponding is " ASF ".At this; the extension name of multimedia file includes but not limited to " mp3 ", " mp4 ", " avi ", " flv ", " mov ", " rmvb ", " rm ", " asf ", " wmv " or " mkv " etc.; those skilled in the art will be understood that the extension name of above-mentioned several multimedia files is only for giving an example; the extension name of other multimedia files existing or that may occur is from now on as applicable to the present invention; also should be included in protection range of the present invention, and with way of reference, be contained in this at this.At this; the encapsulation format of multimedia file includes but not limited to " MP3 ", " MP4 ", " AVI ", " FLV ", " QuickTime ", " RMVB ", " RM ", " ASF " or " MKV "; those skilled in the art will be understood that the encapsulation format of above-mentioned several multimedia files is only for giving an example; the encapsulation format of other multimedia files existing or that may occur is from now on as applicable to the present invention; also should be included in protection range of the present invention, and with way of reference, be contained in this at this.Whether, in step S2, built-in terminal 1, according to the first encapsulation format of described multimedia file, compares with the support format list of built-in terminal, detect described the first encapsulation format and match with the support format list of built-in terminal.At this, support to store the encapsulation format that described built-in terminal is supported in format list the encapsulation format of the multimedia file of the broadcasting that can directly be well on this built-in terminal; For not mating because of encapsulation format, do not cause the multimedia file that cannot play on this built-in terminal, its encapsulation format does not mate with this support format list.Those skilled in the art will be understood that mode that whether described the first encapsulation format of above-mentioned detection match with the support format list of built-in terminal is only for for example; the mode whether described the first encapsulation format of other detections existing or that may occur from now on matches with the support format list of built-in terminal is as applicable to the present invention; also should be included in protection range of the present invention, and with way of reference, be contained in this at this.Preferably, because browser execution is in application layer, its support be JS, HTML, the scripts such as XML, and the CPU of built-in terminal 1, decoding chips etc. are positioned at bottom, it supports the code speechs such as C language, cannot directly call above-mentioned script, therefore, in step S1, built-in terminal 1 can also call by one or many modes such as described application programming interfaces (API) or socket (Socket) interface, the obtained multimedia file with the first encapsulation format is passed to bottom, to detect described the first encapsulation format, whether match with the support format list of built-in terminal.
In step S3, when described the first encapsulation format and described support format list do not match, built-in terminal 1 is according to format conversion storehouse, described multimedia file is carried out to format conversion processing, to obtain the multimedia file with the second encapsulation format, wherein, described the second encapsulation format and described support format list match.Particularly, when in step S2, when built-in terminal 1 detects described the first encapsulation format and described support format list and does not match, in step S3, built-in terminal 1 is according to format conversion storehouse, obtain the format conversion information of described the first encapsulation format, the packaging information of this first encapsulation format for example, decapsulation information etc., and according to described format conversion information, by modes such as decapsulation-encapsulation process, described multimedia file is carried out to format conversion processing, to obtain the multimedia file with the second encapsulation format, wherein, described the second encapsulation format and described support format list match, , described built-in terminal can be play-overed the multimedia file with described the second encapsulation format.For example, in step S3, built-in terminal 1 is according to format conversion storehouse, by calling (as called or far call this locality) or loading and call corresponding decapsulation application, decapsulation multimedia file, thus the one or more coding unit sequence flows after this multimedia file decapsulation obtained.At this, coding unit sequence flows includes but not limited to audio coding unit sequence flows, video encoding unit sequence flows or both combinations.For example, suppose in step S2, the first encapsulation format that built-in terminal 1 detects multimedia file for " MKV " after, call the decapsulation application corresponding with " MKV " form, after this multimedia file of decapsulation, obtain an audio coding unit sequence flows and a video encoding unit sequence flows in this multimedia file.Those skilled in the art will be understood that above-mentioned several coding unit sequence flows is only for giving an example; other coding unit sequence flows existing or that may occur are from now on as applicable to the present invention; also should be included in protection range of the present invention, and with way of reference, be contained in this at this.After this, in step S3, one or more coding unit sequence flows that built-in terminal 1 obtains according to decapsulation again, according to the second encapsulation format in described support format list, described one or more coding unit sequence flows are packaged into the multimedia file with the second encapsulation format, to complete the format conversion operation of described multimedia file.For example, suppose that multimedia file first encapsulation format is " FLV ", by after its decapsulation, obtain an audio coding unit sequence flows and a video encoding unit sequence flows, now, the second encapsulation format that built-in terminal 1 is supported is " AVI ", so, in step S3, built-in terminal 1 encapsulates this audio coding unit sequence flows and video encoding unit sequence flows according to the form of " AVI ", thus the conversion of the encapsulation format that completes this multimedia file from " FLV " to " AVI ".Those skilled in the art will be understood that the above-mentioned mode that multimedia file is carried out to format conversion processing is only for giving an example; other existing or modes of multimedia file being carried out to format conversion processing that may occur are from now on as applicable to the present invention; also should be included in protection range of the present invention, and with way of reference, be contained in this at this.
In step S4, built-in terminal 1 decoding has the multimedia file of the second encapsulation format described in playing.Particularly, in step S4, built-in terminal 1 is according to the multimedia file with the second encapsulation format that carries out obtaining after conversion process in step S3, by the coding unit sequence flows to wherein, decompress, then according to the temporal information in this coding unit sequence flows, synchronously play audio coding unit and the video encoding unit in this coding unit sequence flows.For example, in step S4, built-in terminal 1 obtains after it receives in step S3 conversion while having the multimedia file of the second encapsulation format, for example, by the decoding chip in built-in terminal 1, to coding unit sequence flows decompression wherein, from the temporal information of coding unit sequence flows, obtain the timestamp of audio coding unit and video encoding unit, then according to this timestamp, realize the synchronous broadcasting of audio coding unit and video encoding unit.Those skilled in the art will be understood that the method for synchronization of above-mentioned audio coding unit and video encoding unit is only for giving an example; the method of synchronization of other audio coding units existing or that may occur from now on and video encoding unit is as applicable to the present invention; also should be included in protection range of the present invention, and with way of reference, be contained in this at this.Those skilled in the art will be understood that the mode of multimedia file that above-mentioned decoding has the second encapsulation format described in playing is only for for example; other decodings existing or that may occur from now on have the mode of multimedia file of the second encapsulation format described in playing as applicable to the present invention; also should be included in protection range of the present invention, and with way of reference, be contained in this at this.
Preferably, between above-mentioned each step, be constant work.Particularly, in step S1, built-in terminal 1 has the multimedia file of the first encapsulation format by Network Capture; In step S2, whether built-in terminal 1 detects described the first encapsulation format and matches with the support format list of built-in terminal; When described the first encapsulation format and described support format list do not match, in step S3, built-in terminal 1 is according to format conversion storehouse, described multimedia file is carried out to format conversion processing, to obtain the multimedia file with the second encapsulation format, wherein, described the second encapsulation format and described support format list match; In step S4, built-in terminal 1 decoding has the multimedia file of the second encapsulation format described in playing.At this, it will be understood by those skilled in the art that " continuing " refers to that above steps requires to have the obtaining of multimedia file of the first encapsulation format according to the mode of operation of setting or adjust in real time respectively, detection and the conversion of the first encapsulation format, have the decoding broadcasting of the multimedia file of the second encapsulation format, until built-in terminal 1 stops having by Network Capture the multimedia file of the first encapsulation format in a long time.
Preferably, in step S6 (not shown), when described the first encapsulation format and described support format list match, built-in terminal 1 can also be to the broadcasting of decoding of described multimedia file.Particularly, when in step S2, when built-in terminal 1 detects described the first encapsulation format and described support format list and matches, in step S6, built-in terminal 1 is by decompressing to the described coding unit sequence flows with the multimedia file of the first encapsulation format, then according to the temporal information in this coding unit sequence flows, synchronously play audio coding unit and the video encoding unit in this coding unit sequence flows, to the broadcasting of decoding of described multimedia file.For example, in step S6, built-in terminal 1 decompresses the described coding unit sequence flows with the multimedia file of the first encapsulation format, from the temporal information of coding unit sequence flows, obtain the timestamp of audio coding unit and video encoding unit, then according to this timestamp, realize the synchronous broadcasting of audio coding unit and video encoding unit.Those skilled in the art will be understood that the method for synchronization of above-mentioned audio coding unit and video encoding unit is only for giving an example; the method of synchronization of other audio coding units existing or that may occur from now on and video encoding unit is as applicable to the present invention; also should be included in protection range of the present invention, and with way of reference, be contained in this at this.Those skilled in the art also will be understood that the mode of multimedia file that above-mentioned decoding has the first encapsulation format described in playing is only for for example; other decodings existing or that may occur from now on have the mode of multimedia file of the first encapsulation format described in playing as applicable to the present invention; also should be included in protection range of the present invention, and with way of reference, be contained in this at this.
Preferably, in step S3, when described the first encapsulation format and described support format list do not match, built-in terminal 1 can also carry out decapsulation processing to described multimedia file according to described format conversion storehouse, to obtain the multimedia file without encapsulation; According to described support format list, select the second encapsulation format of described multimedia file, wherein, described the second encapsulation format and described support format list match; According to described the second encapsulation format, the described multimedia file without encapsulation is carried out to form encapsulation process, to obtain the multimedia file with the second encapsulation format.Particularly, when in step S2, when built-in terminal 1 detects described the first encapsulation format and described support format list and does not match, in step S3, built-in terminal 1 is according to described format conversion storehouse, obtain the format conversion information of described the first encapsulation format, the packaging information of this first encapsulation format for example, decapsulation information etc., and according to described format conversion information, by calling (as called or far call this locality) or loading and call corresponding decapsulation application, described multimedia file is carried out to decapsulation processing, to obtain the multimedia file without encapsulation, one or more coding unit sequence flows for example, after this, the second encapsulation format that built-in terminal 1 is supported according to the decoding chip of described built-in terminal again, such as the mode such as select from support format list, selects the second encapsulation format of described multimedia file, wherein, described the second encapsulation format and described support format list match, then, built-in terminal 1 is again according to described the second encapsulation format, the described multimedia file without encapsulation is carried out to form encapsulation process, to obtain the multimedia file with the second encapsulation format, for example, described one or more coding unit sequence flows are packaged into the multimedia file with the second encapsulation format.At this, coding unit sequence flows includes but not limited to audio coding unit sequence flows, video encoding unit sequence flows or both combinations.For example, suppose in step S2, the first encapsulation format that built-in terminal 1 detects multimedia file for " MKV " after, in step S3, built-in terminal 1 calls the decapsulation application corresponding with " MKV " form, after this multimedia file of decapsulation, obtain an audio coding unit sequence flows and a video encoding unit sequence flows in this multimedia file.Those skilled in the art will be understood that above-mentioned several coding unit sequence flows is only for giving an example; other coding unit sequence flows existing or that may occur are from now on as applicable to the present invention; also should be included in protection range of the present invention, and with way of reference, be contained in this at this.For example, suppose that multimedia file first encapsulation format is " FLV ", by after its decapsulation, obtain an audio coding unit sequence flows and a video encoding unit sequence flows, now, the second encapsulation format that built-in terminal 1 is supported is " AVI ", so, in step S3, built-in terminal 1 encapsulates this audio coding unit sequence flows and video encoding unit sequence flows according to the form of " AVI ", thus the conversion of the encapsulation format that completes this multimedia file from " FLV " to " AVI ".Those skilled in the art will be understood that the above-mentioned mode that multimedia file is carried out to format conversion processing is only for giving an example; other existing or modes of multimedia file being carried out to format conversion processing that may occur are from now on as applicable to the present invention; also should be included in protection range of the present invention, and with way of reference, be contained in this at this.
(with reference to Fig. 4) in a preferred embodiment, described format conversion storehouse comprises native format transformation warehouse; Wherein, in step S3, when described the first encapsulation format and described support format list do not match, built-in terminal 1 can also be according to described native format transformation warehouse, described multimedia file is carried out to format conversion processing, to obtain the multimedia file with the second encapsulation format, wherein, described the second encapsulation format and described support format list match.Particularly, when described format conversion storehouse comprises native format transformation warehouse, described format conversion storehouse is kept at local side, and built-in terminal, wherein stores format conversion information, such as the packaging information of encapsulation format, decapsulation information etc.When in step S2, when built-in terminal 1 detects described the first encapsulation format and described support format list and does not match, in step S3, built-in terminal 1 is according to native format transformation warehouse, obtain the format conversion information of described the first encapsulation format, for example this first encapsulation format is stored in local packaging information, decapsulation information etc., and according to described format conversion information, by modes such as decapsulation-encapsulation process, described multimedia file is carried out to format conversion processing, to obtain the multimedia file with the second encapsulation format, wherein, described the second encapsulation format and described support format list match.Those skilled in the art will be understood that the above-mentioned mode that multimedia file is carried out to format conversion processing is only for giving an example; other existing or modes of multimedia file being carried out to format conversion processing that may occur are from now on as applicable to the present invention; also should be included in protection range of the present invention, and with way of reference, be contained in this at this.
Fig. 5 illustrate in accordance with a preferred embodiment of the present invention for playing the method flow diagram of the network multimedia file of multiple encapsulation format.
Between each step in built-in terminal 1 and the network equipment 2, work in coordination, to complete the network multimedia file of playing multiple encapsulation format.Particularly, when described format conversion storehouse comprises the network format transformation warehouse in the network equipment, and when described the first encapsulation format and described support format list do not match, in step S31 ', built-in terminal 1 sends the format conversion request about described multimedia file to the described network equipment, and wherein said format conversion request comprises described support format list.The network equipment 2 is received from the format conversion request about described multimedia file that built-in terminal sends, and wherein, described format conversion request comprises the support format list of described built-in terminal; In step S5 ', the network equipment 2, according to network format transformation warehouse, carries out format conversion processing by described multimedia file, and to obtain the multimedia file with the second encapsulation format, wherein, described the second encapsulation format and described support format list match; In step S32 ', the network equipment 2 sends the multimedia file with the second encapsulation format obtaining based on described format conversion request to described built-in terminal.What built-in terminal 1 was received from that the described network equipment sends obtains the multimedia file with the second encapsulation format based on described format conversion request according to described network format transformation warehouse, wherein, described the second encapsulation format and described support format list match.Preferably, between above-mentioned each step, be constant work.At this, it will be understood by those skilled in the art that " continuing " refers to that above steps requires to operate accordingly according to the mode of operation of setting or adjust in real time respectively.
More specifically, when described format conversion storehouse comprises the network format transformation warehouse in the network equipment, and when described the first encapsulation format and described support format list do not match; In step S31 ', described built-in terminal 1 in real time or answer Event triggered ground, by one or many, call application programming interfaces (API) that the network equipment 2 provides or the communication mode of other agreements, the format conversion request sending about described multimedia file to the described network equipment 2, wherein said format conversion request comprises described support format list; After this, what be received from that the described network equipment 2 sends obtains the multimedia file with the second encapsulation format based on described format conversion request according to described network format transformation warehouse, for example receive by the multimedia file with the second encapsulation format of the communication mode transmission of the API described in precedent or other agreements, wherein, described the second encapsulation format and described support format list match.Those skilled in the art will be understood that the mode of above-mentioned transmission format conversion request is only for giving an example; the mode of other transmission format conversion existing or that may occur from now on requests is as applicable to the present invention; also should be included in protection range of the present invention, and with way of reference, be contained in this at this.Those skilled in the art also will be understood that the mode of multimedia file that above-mentioned reception has the second encapsulation format is only for for example; other receptions existing or that may occur from now on have the mode of multimedia file of the second encapsulation format as applicable to the present invention; also should be included in protection range of the present invention, and with way of reference, be contained in this at this.
The network equipment 2 is received from the format conversion request about described multimedia file that built-in terminal sends, for example receive the format conversion request of the described multimedia file of the communication mode transmission of passing through the API described in precedent or other agreements, wherein, described format conversion request comprises the support format list of described built-in terminal.
In step S5 ', the network equipment 2 is according to network format transformation warehouse, obtain the format conversion information of described the first encapsulation format, for example be stored in the packaging information of this first encapsulation format of network terminal, decapsulation information etc., and according to described format conversion information, be combined in the support format list of built-in terminal 1 included in the format conversion request receiving in step S31 ', by modes such as decapsulation-encapsulation process, described multimedia file is carried out to format conversion processing, to obtain the multimedia file with the second encapsulation format, wherein, described the second encapsulation format and described support format list match.
In step S32 ', the network equipment 2 in real time or answer Event triggered ground, by one or many, call application programming interfaces (API) that built-in terminal 1 provides or the communication mode of other agreements, to described built-in terminal, send the multimedia file with the second encapsulation format obtaining based on described format conversion request.
In a preferred embodiment, in step S5 ', the network equipment 2 can also carry out decapsulation processing to described multimedia file according to described network format transformation warehouse, to obtain the multimedia file without encapsulation; According to described support format list, select the second encapsulation format of described multimedia file, wherein, described the second encapsulation format and described support format list match; According to described the second encapsulation format, the described multimedia file without encapsulation is carried out to form encapsulation process, to obtain the multimedia file with the second encapsulation format.Particularly, in step S5 ', the network equipment 2 is according to described network format transformation warehouse, obtain the format conversion information of described the first encapsulation format, such as being stored in packaging information, decapsulation information of this first encapsulation format of network terminal etc., and according to described format conversion information, by calling or load and call corresponding decapsulation, apply, described multimedia file is carried out to decapsulation processing, for example, to obtain the multimedia file without encapsulation, one or more coding unit sequence flows; After this, the network equipment 2 is again according to the support format list of built-in terminal 1 included in the format conversion request receiving in step S31 ', such as the mode such as select from support format list, select the second encapsulation format of described multimedia file, wherein, described the second encapsulation format and described support format list match; Then, the network equipment 2 is again according to described the second encapsulation format, the described multimedia file without encapsulation is carried out to form encapsulation process, to obtain the multimedia file with the second encapsulation format, for example, described one or more coding unit sequence flows are packaged into the multimedia file with the second encapsulation format.At this, coding unit sequence flows includes but not limited to audio coding unit sequence flows, video encoding unit sequence flows or both combinations.Those skilled in the art will be understood that the above-mentioned mode that multimedia file is carried out to format conversion processing is only for giving an example; other existing or modes of multimedia file being carried out to format conversion processing that may occur are from now on as applicable to the present invention; also should be included in protection range of the present invention, and with way of reference, be contained in this at this.
Preferably, in step S7 ' (not shown), the network equipment 2 can also send the format conversion information based on described network format transformation warehouse to described built-in terminal.In step S8 ' (not shown), when described format conversion storehouse also comprises native format transformation warehouse, built-in terminal 1 can also be received from the format conversion information based on described network format transformation warehouse that the described network equipment sends; According to described format conversion information, set up or upgrade described native format transformation warehouse.Particularly, in step S7 ', the network equipment 2 in real time or answer Event triggered ground, by one or many, call application programming interfaces (API) that built-in terminal 1 provides or the communication mode of other agreements, to described built-in terminal, send the format conversion information based on described network format transformation warehouse.When described format conversion storehouse also comprises native format transformation warehouse, in step S8 ', built-in terminal 1 is received from the format conversion information based on described network format transformation warehouse that the described network equipment sends, for example receive the format conversion information of the described network format transformation warehouse that the communication mode by the API described in precedent or other agreements transmits, such as encapsulation format, be stored in the packaging information, decapsulation information of network terminal etc.; After this, built-in terminal 1 is again according to described format conversion information, by modes such as database updates, sets up or upgrades described native format transformation warehouse.Those skilled in the art will be understood that the mode of above-mentioned renewal native format transformation warehouse is only for giving an example; the mode of other renewal native format transformation warehouses existing or that may occur is from now on as applicable to the present invention; also should be included in protection range of the present invention, and with way of reference, be contained in this at this.
To those skilled in the art, obviously the invention is not restricted to the details of above-mentioned one exemplary embodiment, and in the situation that not deviating from spirit of the present invention or essential characteristic, can realize the present invention with other concrete form.Therefore, no matter from which point, all should regard embodiment as exemplary, and be nonrestrictive, scope of the present invention is limited by claims rather than above-mentioned explanation, is therefore intended to be included in the present invention dropping on the implication that is equal to important document of claim and all changes in scope.Any Reference numeral in claim should be considered as limiting related claim.In addition, obviously other unit or step do not got rid of in " comprising " word, and odd number is not got rid of plural number.A plurality of unit of stating in device claim or device also can be realized by software or hardware by a unit or device.The first, the second word such as grade is used for representing title, and does not represent any specific order.