JP6249749B2 - Information processing apparatus, control method thereof, and program - Google Patents

Description

  The present invention relates to a moving image recording apparatus that records moving image data and moving image management information for the moving image data, a network system in which the information processing apparatus communicates, an information processing apparatus used therefor, a control method thereof, and a program.

Some digital video cameras or the like write moving image management information for moving image data on a recording medium when recording moving image data.
As this kind of technology, Patent Document 1 discloses a digital video recording apparatus that includes a non-volatile memory as a countermeasure against a power failure during recording and saves information necessary for constructing moving image management information in the non-volatile memory. Is disclosed. In this method, the moving image management information is reconstructed using the information stored in the nonvolatile memory when the power failure occurs.
Patent Document 2 discloses an information recording / reproducing apparatus that multiplexes information necessary for generating moving image management information into moving image data and restores the information using the multiplexed information.

JP 2002-084498 A JP 2001-266696 A

However, in Patent Document 1, a non-volatile memory is required, which causes an increase in cost. In addition, a device that uses a disk as a recording medium that cannot be exchanged during a power failure, or a device that incorporates an HDD may be a non-volatile memory. Since devices that can be used are common, the same SD card is not always installed when power is restored.
In Patent Document 2, it is necessary to read moving image data from a recording medium in order to restore moving image management information. Therefore, a relatively long time is required to restore the moving image management information, and the user is kept waiting during this time.

  The present invention has been made in view of the above points, and does not require a non-volatile memory as a countermeasure against a power failure during recording, and can restore video management information in a short time. Objective.

The information processing apparatus of the present invention, video data and an information processing apparatus for communicating with moving picture recording apparatus for recording moving image management information about said video data, the video data transferred from the moving picture recording apparatus first transmitting a recording means for recording on a recording medium, a generation unit configured to generate moving image management information about the moving image data recorded on the first recording medium, the moving image management information generated by said generating means to said video recording device A transmission unit, and the generation unit performs the first recording when the initial communication process is executed without notification of the transfer end after the transfer of the moving image data from the moving image recording device is started. Moving image management information related to moving image data recorded on a medium is generated .

  According to the present invention, since the information processing apparatus can generate moving picture management information as needed and transmit it to the moving picture recording apparatus, a non-volatile memory is not required for power failure countermeasures during recording, and a short time is required. This makes it possible to complete the restoration of the video management information.

It is a figure which shows the structure of the network system which concerns on 1st Embodiment. It is a figure explaining the structure of the digital video camera which concerns on 1st Embodiment. It is a figure explaining the structure of the server which concerns on 1st Embodiment. It is a figure for demonstrating compressed video data. It is a figure for demonstrating compressed video management data. It is a figure which shows the file structure recorded on a memory card. It is a sequence chart which shows communication with the digital video camera and server in 1st Embodiment. It is a sequence chart which shows communication with the digital video camera and server in 1st Embodiment. It is a sequence chart which shows communication with the digital video camera and server in 2nd Embodiment.

Preferred embodiments of the present invention will be described below with reference to the accompanying drawings.
(First embodiment)
<Network system configuration>
FIG. 1 is a diagram illustrating a configuration of a network system according to the first embodiment.
Reference numeral 100 denotes a digital video camera which is a moving image recording apparatus, and has a wireless communication function. A wireless base station 51 connects a wireless terminal to a network communication. 52 is a network. Reference numeral 200 denotes a server which is an information processing apparatus, which can store a function of performing user authentication for a device to be connected via the network 52, a function of transmitting / receiving data to / from the device, and data transferred from the device. With good storage.
The digital video camera 100 records compressed video data that is moving image data, and compressed video management data that is moving image management information for the compressed video data. Further, the digital video camera 100 is connected to the network 52 via the base station 51 and performs a user authentication procedure with the server 200. Thereafter, a data storage request is issued to the server 200 as necessary, and the compressed video data is transferred to the server 200.
The server 200 has a function of analyzing the compressed video data transferred from the digital video camera 100 and storing it, generating compressed video management data as necessary, and transmitting it to the digital video camera 100.

<Configuration of digital video camera>
FIG. 2 is a block diagram showing the configuration of the digital video camera 100 according to the first embodiment.
Reference numeral 101 denotes a lens unit, which is a correction unit that has a function of correcting an imaging position moved by movement of a fixed lens group for focusing, a variable power lens group, a diaphragm, and a variable power lens group, and a function of performing focus adjustment. Consists of a lens group. An image sensor 102 converts an optical image into an electrical signal. A camera signal processing circuit 103 performs image processing such as predetermined color conversion processing and reduction processing on the electrical signal generated by the image sensor 102 and outputs image data. A video signal processing circuit 105 receives image data from the camera signal processing circuit 103 and the compression / decompression circuit 106, performs image processing suitable for each block, and outputs it. In addition, the video signal processing circuit 105 can superimpose a bitmap, thereby displaying a device status, a warning, various setting screens, and the like.

Reference numeral 106 denotes a compression / decompression circuit, which performs video compression processing for compressing image data by the MPEG2 (Moving Picture Experts Group phase 2) system and writing the compressed video data to the memory 114 via the bus 121. Further, the compression / decompression circuit 106 reads the compressed video data stored in the memory 114, reproduces it as image data, and performs a video expansion process that is output to the video signal processing circuit 105.
In the MPEG2 video compression technique (moving image compression method), there are an I frame that is intra-frame coding, a P (forward prediction) frame that is inter-frame coding, and a B (bidirectional prediction) frame. Of these, the I picture can be reproduced by itself. In addition, each predetermined number of frames is managed in a unit called GOP (Group Of Pictures). In the present embodiment, it is composed of 15 frames like IBBPBBPBBPBBPBB, and an I frame is arranged at the head of each GOP in the compressed video data.
Also, in the MPEG2 system, there is a PTS (Presentation Time Stamp: Reproduction Time Information) indicating the reproduction time, and it is possible to control the time at which each frame should be reproduced at the time of reproduction by giving it to each frame.
The compression / decompression circuit 106 generates information about the GOP size, the size from the beginning of the GOP to the end of the I frame, and the PTS of the I frame each time a GOP is generated during the compression operation so that the microcomputer 111 can read the information. It has a function. By accumulating and recording this information, the position of an arbitrary I picture can be searched and reproduced.

  A microcomputer 111 controls the entire system. Reference numeral 113 denotes a flash ROM, which is a rewritable nonvolatile memory in which programs executed by the microcomputer 111, various parameters, and the like are stored. Reference numeral 114 denotes a memory which is used as a work area by the microcomputer 111, the compression / decompression circuit 106, and the like. 121 is a bus. Reference numeral 115 denotes a memory card interface (card I / F), and 116 denotes a memory card. The card I / F 115 stores the memory card 116 and transmits / receives commands and data. The memory card 116 is a memory card such as an SD card, for example, and is a recording medium for recording the compressed video data generated by the compression / decompression circuit 106 according to a predetermined format that can be used by a computer such as a FAT file system. .

A liquid crystal panel 107 receives image data from the video signal processing circuit 105 and displays it. Although not specifically shown, a microphone unit, a speaker, and an external output path are also provided for audio, and the audio is compressed and multiplexed by the compression / decompression circuit 106 together with the image. Reference numeral 112 denotes a group of operation switches for the user to input operations. The operation switch group 112 is also provided with a switch for selecting a camera mode mainly for photographing with a camera, a reproduction mode for mainly reproducing, and a power-off mode for turning off the power.
Reference numeral 130 denotes a wireless communication circuit, which can perform data transfer by performing communication control with a wirelessly connectable device, the server 200, in accordance with instructions from the microcomputer 111. As a result, the compressed video data can be recorded on the memory card 116 and transferred to the server 200 for storage.

<Server configuration>
FIG. 3 is a block diagram illustrating a configuration of the server 200 according to the first embodiment.
201 is a CPU, 202 is a ROM, 203 is a RAM, and 204 is a network interface controller (NIC) for connection to a network. The CPU 201 generally controls each unit of the server 200 by executing software stored in the ROM 202, for example. The RAM 203 functions as a main memory or work area for the CPU 201.

<Compressed video data and compressed video management data>
The compressed video data generated by the compression / decompression circuit 106 of the digital video camera 100 will be described with reference to FIG.
Reference numeral 401 denotes compressed video data, which includes a plurality of GOPs. 402 is the GOP size. Since each GOP size 402 is not constant, it is necessary to record the distance (size) from the head of the compressed video data 401 to each GOP head position in order to search an arbitrary GOP head position at high speed. The size of 403 is an example, and this is I_OFFSET. I_OFFSET can be generated by adding each GOP size generated by the compression / decompression circuit 106.
In the GOP, reference numeral 405 denotes a size from the GOP head to the end of the I frame arranged at the GOP head, and is I_SIZE. Further, by combining the PTSs of each I frame, it is possible to search I_OFFSET and I_SIZE from the PTS at high speed, and functions such as fast forward and resume playback can be realized.

The compressed video management data will be described with reference to FIG.
In this embodiment, compressed video management data including PTS, I_OFFSET, and I_SIZE of each I frame is recorded.
Reference numeral 501 denotes compressed video management data, which is recorded for each compressed video data. Reference numeral 502 denotes compressed video data attribute information indicating the attributes of the compressed video data 401. The attributes are, for example, a compressed video data size, information about a recording device, recording date / time, frame rate, resolution, and the like. In the present embodiment, since the compressed video data size is used, other elements are omitted. Reference numeral 503 denotes an I picture search table. ID is a GOP number from the beginning, and records each PTS, I_OFFSET, and I_SIZE. ID_Num records the number of IDs.

<File structure>
With reference to FIG. 6, the structure of a file recorded on the memory card 116 will be described.
Reference numeral 601 denotes a root directory, which is the highest directory recorded on the memory card 116.
Reference numeral 602 denotes a VIDEO directory arranged under the root whose directory name is “VIDEO”, and records a file group of a recording format.
Reference numeral 603 denotes a directory having a directory name “PLYLIST”, which is arranged under the VIDEO directory 602, and records a playlist. Reference numeral 604 denotes a file recorded under the PLAYLIST directory 603, and the file name is “00000.PL”. This file is called a PL file.
Reference numeral 605 denotes a directory having a directory name “STREAM”, which is arranged under the VIDEO directory 602, and records a compressed video data file. Reference numeral 606 denotes a compressed video data file group, each of which is a 5-digit number + “. MTS” file. This file is referred to as an MTS file.
Reference numeral 607 denotes a directory having a directory name “INFO”, which is arranged under the VIDEO directory 602, and records a compressed video management data file. Reference numeral 608 denotes a compressed video management data file group, each of which is a 5-digit number + “. INF” file. This file is called an INF file.
The MTS file and INF file with the same number are a set. For example, information regarding the 00000.MTS file is recorded in the 00000.INF file. In the INF file, information for reproducing the corresponding MTS file is stored. The playback order of the MTS file is recorded in the PL file 604.

<Communication between digital video camera and server>
FIG. 7 is a sequence chart showing communication between the digital video camera 100 and the server 200. FIG. 7 is a sequence in a case where compressed video data is normally transferred. FIG. 7 is a time axis from the top to the bottom.
Reference numeral 701 denotes initial communication processing such as user authentication and transfer speed between the digital video camera 100 and the server 200.

  Reference numeral 702 denotes a memory card ID which is individual identification information allocated to each memory card 116 and transmitted from the digital video camera 100 to the server 200. A memory card ID reception confirmation signal 703 is transmitted from the server 200 to the digital video camera 100 to confirm that the memory card ID has been received.

  A compressed data file creation signal 704 is issued when a shooting request is generated in the digital video camera 100 by a user operation. At this time, the file name is also determined. Reference numeral 705 denotes a data accumulation start confirmation signal that informs the digital video camera 100 that the server 200 has received the compressed data file creation signal 704. When the digital video camera 100 receives the data accumulation start confirmation signal, the digital video camera 100 starts to transfer the compressed video data. In FIG. 7, reference numeral 706 denotes compressed video data transfer processing. Note that a data reception confirmation signal may be issued to the digital video camera 100 every time the server 200 receives a predetermined amount of compressed video data.

Reference numeral 707 denotes processing for stopping recording in the digital video camera 100 and recording compressed video management data for the compressed video data after the recording of the compressed video data is completed.
A transfer end notification 708 is transmitted from the digital video camera 100 to the server 200. Upon receiving the transfer end notification, the server 200 closes the file and ends the recording. Reference numeral 709 denotes a signal for transmitting that the server 200 has received the transfer end notification transmitted to the digital video camera 100.

Next, a case where the wireless connection is disconnected during the compressed video data transfer process 706 will be described with reference to FIG. In FIG. 8, the time axis from the top to the bottom and the same reference numerals as those in FIG. Further, FIG. 8 illustrates from the time point when shooting is already started and the transfer process 706 of compressed video data is performed.
As the next step, the server 200 expects a transfer end notification 708. However, there are cases where the digital video camera 100 does not transmit the transfer end notification 708 due to a power failure or the like. In this case, the sequence is resumed from the sequence after the initial communication processing 701, and the server 200 determines that this is an abnormal sequence. In the abnormal sequence, there is a high possibility that the digital video camera 100 has not completed the compressed video management data recording process 707. Therefore, the server 200 generates compressed video management data from the received compressed video data. If the end of the compressed video data is not a GOP boundary, the compressed video management data is generated after the last GOP boundary is deleted.

  Reference numeral 801 denotes compressed video management data transmitted from the server 200 to the digital video camera 100. The server 200 executes transmission processing of the compressed video management data 801 when the received memory card ID 702 is the same as when the abnormal sequence occurs. Reference numeral 802 denotes a compressed video management data reception completion signal for notifying the server 200 of completion after recording the compressed video management data 801 received by the digital video camera 100 on the memory card 116. The server 200 receives the compressed video management data reception completion signal 802 and determines that the abnormal sequence has been repaired.

As described above, the digital video camera 100 records the compressed video management data received from the server 200 in the memory card 116. At this time, it is more preferable that the compressed video data size recorded in the compressed video management data is compared with the file size of the compressed video data recorded in the memory card 116 to ensure consistency.
Recording to the PL file 604 may be performed by the digital video camera 100 at an arbitrary timing after the reception of the compressed video management data 801.
Further, although the memory card 116 that can be attached to and detached from the main body has been described as an example of the recording medium on the digital video camera 100 side, a recording medium that is not attachable / detachable such as an HDD or an embedded flash memory may be provided. At this time, for the confirmation of the restoration target, information that can specify the restoration target, such as the model ID and serial ID of the digital video camera, may be used instead of the memory card ID.
In addition, the digital video camera having a wireless communication function has been described. However, a memory card having a wireless communication function may be mounted on the digital video camera.

  As described above, a non-volatile memory is provided as a countermeasure against a power failure during recording, and there is no need to save information necessary for constructing compressed video management data in the non-volatile memory. Further, it is not necessary to execute a relatively time-consuming process such as reading compressed video data. Therefore, it is possible to eliminate the cost increase for power failure countermeasures and the stress on the user during the repair process, and the user can immediately perform the next recording even after the power failure occurs.

(Second Embodiment)
In the first embodiment, an example has been described in which compressed video data is recorded on the memory card 116 at the time of shooting and the compressed video management data is restored using the transfer of the compressed video data to the server 200.
In the second embodiment, an example will be described in which data of the server 200 is also used to restore compressed video data. Note that the configurations and basic processing operations of the digital video camera 100 and the server 200 are the same as those in the first embodiment, and the differences from the first embodiment will be mainly described below.

With reference to FIG. 9, a case where the wireless connection is disconnected in the middle of the transfer process 706 of compressed video data will be described. In FIG. 9, the time axis from the top to the bottom and the same reference numerals as those in FIGS. 7 and 8 are the same processing. Further, FIG. 9 illustrates from the time point when shooting is already started and the transfer process 706 of compressed video data is performed.
As the next step, the server 200 expects a transfer end notification 708. However, there are cases where the digital video camera 100 does not transmit the transfer end notification 708 due to a power failure or the like. In this case, the sequence is resumed from the sequence after the initial communication processing 701, and the server 200 determines that this is an abnormal sequence. In the abnormal sequence, there is a high possibility that the digital video camera 100 has not completed the compressed video management data recording process 707. Therefore, the server 200 generates compressed video management data from the received compressed video data. If the end of the compressed video data is not a GOP boundary, the compressed video management data is generated after the last GOP boundary is deleted.

The server 200 executes the following sequence when the received memory card ID 702 is the same as when the abnormal sequence occurred.
Reference numeral 901 denotes a compressed video data file size request command for requesting the size of a compressed video data file to be restored, which is transmitted from the server 200 to the digital video camera 100. Reference numeral 902 denotes a response to the compressed video data file size request command 901 transmitted from the digital video camera 100 to the server 200, and notifies the server of the size of the compressed video data file. The size of this compressed video data file can be obtained from the file system information.

Next, the server 200 compares the size of the compressed video data file stored in the server 200 with the compressed video data file size notification 902. Process 903 is executed. In the file difference data notification processing 903, the difference data, size, and connection position information between the compressed video data file stored in the memory card 116 of the digital video camera 100 and the compressed video data file stored in the server 200 are stored. The connection position information is an offset from the beginning of the compressed video data file to the position to be connected. Upon receiving the file difference data notification, the digital video camera 100 concatenates the differences between the compressed video data files. As a result, data that cannot be saved by the digital video camera 100 alone can be restored.
The compressed video management data 801 and the compressed video management data reception completion signal 802 are as described in the first embodiment.

  As described above, in addition to the effects of the first embodiment, it is possible to restore a compressed video data area that could not be recorded on the memory card 116 of the digital video camera 100.

(Other embodiments)
The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, etc.) of the system or apparatus reads the program. It is a process to be executed.

  100: digital video camera, 106: compression / decompression circuit, 111: microcomputer, 116: memory card, 130: wireless communication circuit, 200: server, 201: CPU, 202: ROM, 203: RAM, 204 is a network interface controller

Claims (9)

An information processing apparatus for communicating with moving picture recording apparatus for recording moving image management information about the moving image data and the moving image data,
Recording means for recording the moving image data transferred from the moving image recording apparatus on a first recording medium ;
Generating means for generating a moving image management information about the moving image data recorded on the first recording medium,
Transmission means for transmitting the moving picture management information generated by the generating means to the moving picture recording apparatus ,
The generation means relates to the moving image data recorded on the first recording medium when the initial communication process is executed without notifying the transfer end notification after starting the transfer of the moving image data from the moving image recording apparatus. An information processing apparatus that generates moving image management information . The second recording medium on which the moving image recording device records the moving image data and the moving image management information is detachable from the moving image recording device, and has identification information for identifying an individual,
After the initial communication processing, the information processing apparatus according to claim 1, further comprising a receiving means for receiving the identification information from the moving picture recording apparatus. When the transmission means matches the identification information received at the start of the transfer of moving image data from the moving image recording device and the identification information received after the initial communication process has been executed without being notified of the transfer end notification the information processing apparatus according to claim 2, characterized in that to transmit the moving image management information generated by said generating means to said video recording device. From the video recording device, further comprising an acquisition means for acquiring the size of the video data recorded by the video recording device,
And size acquired by the acquisition unit, the first by comparing the size of the recorded video data to the recording medium, when towards the size of the moving image data recorded on said first recording medium is large, the transmission unit the information processing apparatus according to any one of claims 1 to 3, characterized in that sending the difference data of the video data to the video recording apparatus. The generation means generates the moving image management information based on moving image data before a last GOP (Group Of Picture) boundary among moving image data already recorded on the first recording medium. Item 5. The information processing apparatus according to any one of Items 1 to 4. The information processing apparatus according to claim 1, wherein the moving image recording apparatus is a video camera. The information processing apparatus according to claim 1, wherein the moving image management information is generated as a file. A method for controlling an information processing apparatus for communicating with moving picture recording apparatus for recording moving image management information about the moving image data and the moving image data,
And recording the moving image data to be transferred from said moving picture recording apparatus in a first recording medium,
Generating a moving image management information about the moving image data recorded on the first recording medium,
It possesses and transmitting moving image management information the product to the moving picture recording apparatus,
In the step of generating the moving image management information, after the start of transfer of moving image data from the moving image recording device, when initial communication processing is executed without notification of transfer end notification, the first recording medium A method for controlling an information processing apparatus, comprising: generating moving image management information relating to recorded moving image data . The program for functioning a computer as each means of the information processing apparatus of any one of Claim 1 thru | or 7 .

Images