CN100585721C - Image sensing device, image editing method - Google Patents

Abstract

An image sensing device capable of shooting and playing back moving images that simplifies and performs editing operations for forming one moving image by inserting another image in the middle of a specified moving image. A kind of equipment comprises the flash memory (38) of recording moving picture data; The key input unit (36) of designating arbitrary time position in the moving picture data recorded in flash memory (38); And control unit (32), at the designated time Based on the position, shooting of an image is started, image data obtained by shooting is inserted into moving image data according to the specified time position, and the obtained moving image data is played back.

Description

Image sensing device, image editing method

technical field

The present invention relates to an image sensing device capable of recording and reproducing moving images, an image editing method, and a storage medium recording the image editing method.

Background technique

In recent years, digital cameras capable of recording image data obtained by photography in a semiconductor memory (hereinafter, simply referred to as "digital cameras") have been widely used over conventional cameras that record images on silver halide films.

Most models of such digital cameras can capture not only still images but also time-series images such as continuous shooting images, moving images, etc., although they cannot perform long-term recordings compared to video recorders with integrated cameras, depending on the capacity of the recording medium. Time record.

When a moving picture is shot by such a digital camera, individual moving picture data recorded on a memory card or the like are independent of each other. Therefore, with a digital camera, it is difficult to perform an operation such as combining two moving images into one moving image. In this case, editing software on a personal computer is required.

Under these circumstances, a digital camera has been devised which allows simple editing operations on moving images, such as partial erasing, dividing, joining, etc., by itself. (For example, see Patent Document 1).

[Patent Document 1]

Japanese Patent Application, KOKAI Publication No. 11-275512

As described above, the digital camera of Patent Document 1 allows the user to designate editing points in a moving image, and perform editing operations for partial erasing, dividing, and combining moving images based on the designated editing points.

In inserting another moving picture B into the middle pair of designated moving pictures A already identically recorded by this code, the following operations are required:

(1) Designate an edit point in the moving image A;

(2) According to the editing mode "cutting", the moving image A is divided into A1 and A2;

(3) Press the edit mode "paste" to combine the moving images A1 and B; and

(4) Press the edit mode "paste" to combine the moving image "A1+B" and A2.

In addition, edited moving images are immediately stored in flash memory as a recording medium by overwriting after each editing operation, such as dividing, combining, and the like. Therefore, when the user confirms the edited moving picture "A1+B+A2" by selecting the playback mode, and is not satisfied with the content, he or she must redo the moving picture from the one used to combine the combined motion by designating two editing points. The operation of dividing the image "A1+B+A2" into three moving images.

In this way, by combining basic editing operations, it is necessary to issue instructions for a plurality of moving images. Therefore, cumbersome operations are required as a whole, and similar labor is required for redoing.

Contents of the invention

According to the present invention, an image sensing apparatus is characterized by comprising: a recording unit for recording moving image data obtained by shooting; a specifying unit for specifying an arbitrary time position in the moving image data recorded in the recording unit; shooting control A unit for starting image capturing according to a time position specified by the specifying unit; and an inserting unit for inserting image data obtained by shooting by the shooting control unit into the moving image data according to the specified time position, and storing the obtained moving image data.

Description of drawings

1A and 1B show perspective views representing the appearance of a digital camera according to a first embodiment of the present invention;

FIG. 2 is a block diagram showing a circuit arrangement according to the first embodiment;

FIG. 3 mainly shows a flow chart of processing contents in a moving picture insertion mode according to the first embodiment;

4A to 4E show examples of edited content of moving picture data to be processed in moving picture insertion mode according to the first embodiment;

5 mainly shows a flow chart of processing contents in a moving image insertion mode according to a second embodiment of the present invention;

6A to 6G show examples of edited content of moving picture data to be processed in moving picture insertion mode according to the second embodiment;

7 mainly shows a flow chart of processing contents in a moving image insertion mode according to a third embodiment of the present invention;

8A to 8G show examples of edited content of moving picture data to be processed in moving picture insertion mode according to the third embodiment;

9 mainly shows a flow chart of processing contents in a moving image insertion mode according to a fourth embodiment of the present invention;

FIG. 10 shows a display example when moving picture data is played back in the moving picture insertion mode according to the first embodiment of the present invention; and

Fig. 11 shows a display example at the time of switching the playback mode to the recording mode in the moving image insertion mode according to the first embodiment.

Detailed ways

(first embodiment)

Hereinafter, a first embodiment when the present invention is applied to a digital camera will be described with reference to the drawings.

1A and 1B show the appearance of a digital camera. FIG. 1A is a perspective view mainly showing the front side of the digital camera, and FIG. 1B is a perspective view mainly showing the rear side thereof.

This digital camera 1 has a photographing lens 2, a self-timer lamp 3, an optical viewfinder window 4, a microphone 5, a flash light emitting unit 6, and a rubber grip 7, which are arranged on the front of a substantially rectangular thin profile body. . On the right end side of the top surface (with respect to the user), a power key 8 and a shutter key 9 are provided.

The rubber handle 7 is a strip-shaped protrusion of rubber, which is set so that when he or she holds the digital camera 1 from the right side of the housing with the right hand, the user's second finger, third finger and Small fingers can hold the case tightly.

Operate the power key 8 to turn on/off the power. The shutter key 9 is used to control shooting in the shooting mode. The shutter key 9 is also used as an execution key for controlling setting/execution in menu selection, for example.

On the rear of the digital camera 1 , a mode switch (SW) 10 , a speaker 11 , a menu key 12 , a cross key 13 , an optical viewfinder 14 , a flash charging lamp 15 and a display unit 16 are provided.

The mode switch 10 includes, for example, a slide switch and is used to switch between a recording mode "R" and a playback mode "P" as basic modes.

When selecting various menu items and the like, the menu key 12 is operated.

By including cursor keys in up, down, right and left directions, a cross key 13 is formed.

The display unit 16 includes a color liquid crystal panel with a backlight. In the recording mode, the display unit 16 displays the entire monitored through image as an electronic viewfinder. At the same time, the display unit 16 displays the selection image played back in the play mode.

It is assumed that a memory card slot for detachably accommodating a memory card used as a recording medium, a USB (Universal Serial Bus) connection as an example of a serial interface connector for connecting an external personal computer are provided on the bottom surface of the digital camera 1 devices, etc. (although none of them are shown).

Next, the digital circuit configuration of the digital camera 1 will be described using FIG. 2 .

In the monitoring state in the image capturing mode, the focus position and the aperture position are moved by driving the motor (M) 21 . The CCD 23 is an image sensor element, and is provided behind the imaging optical axis of the lens optical system 22 including the imaging lens 2 . The CCD 23 is scanned and driven by a timing generator (TG) 24 and a vertical driver 25, and at a predetermined period, outputs a photoelectric conversion output corresponding to a shaped optical image for one frame.

This photoelectric conversion output is appropriately subjected to gain adjustment for each basic color component (RGB) as an analog value signal, and then sampled/held by a sample/hold circuit (S/H) 26 . The output from the sample/hold circuit 26 is converted into digital data by the A/D converter 27 . The digital data is subjected to color processing, including pixel interpolation processing and gamma correction processing, by the color processing circuit 28, generating digital-valued luminance signal Y and color difference signals Cb and Cr. These signals are then output to a DMA (Direct Memory Access) controller 29 .

The DMA controller 29 temporarily writes the luminance signal Y and the color difference signals Cb and Cr output from the color processing circuit 29 into its internal memory using the synthesized sync signal, memory write enable signal, and clock signal also output from the color processing circuit 28 . Then, the DMA controller 29 DMAs these signals to the DRAM 31 serving as a buffer memory via the DRAM interface (I/F) 30.

The control unit 32 includes a CPU 32A, a ROM 32B that permanently stores an operation program, a RAM 32C used as a work memory, a shooting control section 32D that starts image shooting, and an insertion section 32E that inserts moving image data into another moving image data and stores them . The control unit 32 controls the operation of the entire digital camera 1 . After the luminance and color difference signals are transmitted to DRAM 31 in DMA transfer mode, control unit 32 reads these luminance and color difference signals from DRAM 31 through DRAM interface 30, and writes them into VRAM 34 through VRAM controller 33.

The digital video encoder 35 periodically reads out luminance and color difference signals from the VRAM 34 via the VRAM controller 33 , generates a video signal based on these data, and outputs the video signal to the display unit 16 .

The display unit 16 functions as a monitor display unit (electronic viewfinder) in the image capturing mode, as described above. The display unit 16 performs display based on the video signal from the digital video encoder 35 , thereby displaying an image in real time based on the image information captured from the VRAM controller 33 at this time.

When the user wants to take a still image, he or she operates the shutter key 9 forming the key input unit 36 (specifying unit), and in this way, the image at that time is displayed in real time on the display unit 16 as a monitor image, generating trigger signal.

In response to this trigger signal, the control unit 32 closes the path from the CCD 23 to the DRAM 31 immediately after completing the DMA transfer of the luminance and color difference signals for one frame captured from the CCD 23 at this time to the DRAM 31, and transitions to the record/save state.

In the record/save state, the control unit 32 reads out the basic block (8 pixels (vertical direction)×8 pixels (horizontal direction)) written in the DARM 31 for each of called Y, Cb, and Cr component data. Luminance and color difference signals for one frame of each unit, and the read-out signals are written in a JPEG (Joint Photographic Experts Group) circuit 37 . The JPEG circuit 37 compresses data by processing such as ADCT (Adaptive Discrete Cosine Transform), Huffman encoding as entropy encoding, and the like.

The control unit 32 reads out the obtained encoded data as a data file of one image from the JPEG circuit 37, and writes it into the flash memory 38 (recording unit) as a nonvolatile memory. A flash memory 38 is sealed in a detachably attached memory card as a recording medium of this digital camera 1 .

In addition, this flash memory 38 may be included in the digital camera 1 in addition to a detachable memory card, and the memory card and the internal memory may be used together.

After completing the compression processing of the luminance and color difference signals for one frame, and the writing processing of all compressed data in the flash memory 38, the control unit 32 opens the path from the CCD 32 to the DRAM 31 again.

The control unit 32 is further connected with an audio processor 39 and a USB interface (I/F) 40 .

The audio processor 39 includes a sound source circuit such as a PCM sound source or the like. In the audio recording mode, the audio processor 39 converts an audio signal input from a microphone (MIC) 5 into digital data. The audio processor 9 compresses this data to generate an audio data file according to a predetermined data file format such as MP3 (MPEG-1 Audio Layer 3), and sends this file to the control unit 32 . On the other hand, in the audio playback mode, the audio processor 39 decompresses the received audio data file, and converts the decompressed data into an analog signal. Then, the audio processor 39 drives the speaker (SP) 11 so as to produce loud sound.

The USB interface 40 performs communication control when exchanging image data and the like with an external device (for example, a personal computer) connected by wire via the USB connector 40 .

Note that the key input unit 36 includes, in addition to the shutter key 9, a power key 8, a mode switch 10, a menu key 12, a cross key 13, and the like. Signals generated when these keys are operated are directly output to the control unit 32 .

When shooting a moving image instead of a still image, the still image data file obtained by compressing the still image data by the JPEG circuit 37 is temporarily continuously recorded while continuing to maintain the operation of the shutter key 9 of the key input unit 36 . When the operation of the shutter key 9 is completed, or after a predetermined limited time (for example, 30 seconds) elapses, a series of still image data files are reset to motion JPEG data files.

In the playback mode, the control unit 32 selectively reads out image data recorded in the flash memory 38 . The JPEG circuit 37 expands the compressed image data in the reverse order of the data compression sequence in the shooting mode. After the expanded image data is stored in the DRAM 31 via the DRAM interface 30 , the stored content of the DRAM 31 is stored in the VRAM 34 via the VRAM controller 33 . Then, image data is periodically read out from the VRAM 34 to generate a video signal, which is reproduced and output on the display unit 16 .

When the selected image data is not a still image but a moving image, the respective still images forming the selected moving image are played back temporarily in succession. After the playback of all still image data is completed, only the still image data located at the head of the moving image file is played back and displayed until the next playback instruction is issued.

The operation of this embodiment will be described below.

3 shows a series of processing contents mainly performed by the control unit 32 until the moving picture data recorded in the flash memory 38 is selected, another moving picture data is inserted into the selected moving picture data, and the obtained data is recorded so that Updating the old data, until the playback mode is selected by the mode switch 10 simultaneously.

When this process is started, after selecting the moving image data to be displayed (step A01), by repeatedly checking whether the user has performed a key operation instructing playback start by directly operating the shutter key 9 (step A02), or by repeatedly checking After operating the menu key 12 and the cross key 13, the shutter key 9 is operated, whether the user has specified the moving image insertion mode (step A03) for inserting another moving image in the middle of the selected moving image, the control waits for the following key operations one of.

When the user has performed a key operation related to the specified moving picture insertion mode, this operation is detected in step A03, and the moving picture insertion mode is set (A04). Then, the flow returns to the process from step A01.

If it is determined in step A02 that the user has performed a key operation for starting playback, it is determined whether the moving image insertion mode has been set at this time (step A05).

If the moving picture insertion mode is not set, it is determined that the normal moving picture playback process will be performed, and its description will be omitted below.

If it is determined in step A05 that the moving picture insertion mode is set, the moving picture data selected in step A01 starts playback (step A06). After that, the control repeatedly checks whether the user has given an insertion mark (step A07) indicating the insertion time in the middle of the moving image being played back and displayed by operating such as the shutter key 9, and whether the motion of the initial selection has been completed. The playback process of the image (step A08) waits for one of the following states. FIG. 10 shows display examples on the display unit 16 in steps A06 and A07 in which the user has given an insertion mark M designating an insertion time during playback and display of the moving image data selected in step A01. The bar BAR displayed below the moving picture represents the entire moving picture data being played back and displayed, and the data ratio of the entire data played back so far is represented by BAR1.

If it is determined in step A08 that the playback process of the moving image is completed, it is determined that the insertion flag M is not given, and therefore, the initially selected moving image has no time position to be edited (inserted), thereby ending a series of processes.

If it is determined in step A07 that the insertion flag has been given, the control immediately changes from the insertion mode as the basic mode to the recording mode (step A09), and waits for a key operation indicating to start recording a new moving image to be inserted (more specifically , operation of the shutter key 9) (step A10).

In this case, the display unit 16 can also display the guide message as a characteristic string:

"Press the shutter button to start shooting the motion picture that will be inserted"

11 shows a display example of a guide message superimposed on the through image displayed on the display unit 16 after the control has entered the recording mode in step A09.

When the user has issued a recording start instruction of a moving image by operating the shutter key 9, this operation is detected in step A10. Then, the moving image to be inserted is recorded (step A11), while repeating the process for determining the end of recording the moving image by checking whether the shutter key 9 is released or a predetermined limited time (for example, 30 seconds) for continuous recording of the moving image has passed (step A11). A12).

At this time, the obtained moving image data is sequentially recorded in the flash memory 38 as new moving image data.

If it is determined in step A12 that the recording of the moving image is ended, it is determined that the moving image data to be inserted has been obtained. Therefore, the recording mode is switched to the playback mode again (step A13), so that the playback and display are obtained from the beginning to the end on the display unit 16 by inserting new moving image data obtained by recording in the middle of the moving image data selected in step A01. moving image data (step A14).

After the insertion process is completed, it is checked whether the played content is recorded and saved as a new moving image data file (step A15).

By displaying the guide message on the display unit 16 as a character string:

"You want to record what is replayed now as a new file?

whether",

And this verification process is performed by determining whether the user directly operates the shutter key 9 while highlighting the character string "Yes" by the cursor, or he or she moves the highlighted cursor to the character string by operating the right key of the cross key 13. Sequential "No", operate the shutter key 9.

If it is determined in step A15 that the obtained data is recorded and stored as a new file, using the two moving picture data recorded in the flash memory 38, an editing process is performed so as to obtain the above-mentioned playback order, and the edited moving picture data Newly recorded as a moving picture data (step A16), thereby ending a series of processes.

On the other hand, if it is determined in step A15 that the obtained data will not be recorded and saved as a new file, by deleting it from the flash memory 38, the moving image data obtained by shooting and to be inserted is deleted (step A17), thereby ending a series process.

4A to 4E show examples of moving image data to be edited based on the series of processes described above. Assume that the moving image A shown in FIG. 4A is initially selected in step A01.

Meanwhile, it is assumed that this moving picture A is played back while setting the moving picture insertion mode, and an insertion flag IM is given at playback time, as shown in FIG. 4B. Assume that A1 is the first half of the moving image A that has been played back, and A2 is the second half of the moving image A to be played back.

The recording mode starts automatically, and through the processing in steps A10 to A12, the moving image B to be inserted is newly recorded, as shown in FIG. 4C. The playback mode is automatically started in step A13, and in step A14, the display unit 16 plays back and displays a series of moving images "A1+B+A2" obtained by inserting the moving image B into the position specified by the insertion mark IM of the moving image A , as shown in Figure 4D.

When the user has performed a key operation indicating to record and save a new moving picture as a playing moving picture A, wherein a moving picture B is inserted at an arbitrary time position, in step A16, the new moving picture A' is recorded in the flash memory 38, so that Update old data, as shown in Figure 4E. At the same time, the data files of the old moving images A and B are deleted from the flash memory 38 for arrangement purposes.

In this way, by the minimum required key operation without any change operation of the basic mode, it is possible to perform a series of editing processing which is when an arbitrary time position is specified in the initially selected moving image (A), shooting A new moving picture (B) to be inserted, and required for playing back and displaying a moving picture (A1+B+A2) obtained by inserting the moving picture (B) into the selected moving picture (A). Therefore, operations required for editing data by the user of the digital camera 1 can be greatly simplified.

Also, after the user tentatively confirms the content obtained by inserting the moving image (B) to be inserted obtained by shooting (A1+B+A2), the obtained content is recorded in the flash memory 38 as a recording medium. Therefore, when the user is dissatisfied with the edited content, the edited content is not recorded, and moving images to be taken in the future are automatically deleted from the flash memory 38 (B). Therefore, the processing required until the user can redo similar editing operations can be greatly reduced.

(second embodiment)

A second embodiment when the present invention is applied to a digital camera will be described below with reference to the drawings.

Note that the appearance and digital circuit layout of the digital camera are basically the same as those shown in FIGS. 1A , 1B and 2 . Therefore, in this embodiment, the same symbols denote the same components as those of the first embodiment, and illustration and description will be omitted.

Next, the operation of this embodiment will be described.

5 shows until the moving picture data recorded in the flash memory 38 is selected, another moving picture data is inserted into the selected moving picture data, and the obtained data is recorded so as to update the old data, while the playback mode is selected by the mode switch 10, the main A series of processing contents executed by the control unit 32 .

At the beginning of this process, after selecting the moving image data to be displayed (step B01), the control repeatedly checks whether the user has performed a key operation indicating the start of playback by directly operating the shutter key 9 (step B02), or the user Whether have waited for one of the following key operations by operating the shutter key 9 after operating the menu key 12 and the cross key 13, inserting another moving image in the middle of the selected moving image, specifying the moving image insertion mode (step B03) .

When the user has performed a key operation related to specifying the moving picture insertion mode, this operation is detected in step B03, and the moving picture insertion mode is set (step B04). The flow then returns to the process from step B01.

If it is determined in step B02 that the user has performed a key operation for starting playback, it is determined whether the moving image insertion mode is set at this time (step B05).

If the moving picture insertion mode is not set, it is determined that the normal moving picture playback process will be performed, and its description will be omitted.

If it is determined in step B05 that the moving picture insertion mode is set, playback of the moving picture data selected in step B01 is started (step B06). After that, whether the playback process (step B07) of selecting moving images is completed by repeating checks, whether the user has specified the insertion mark of the insertion time in the middle of the moving images being played back and displayed (step B07) by operating, for example, the shutter key 9 (step B07). B08), and whether the user has finished the designation operation of the insertion mark (step B09) by operating, for example, the right key of the cross key 13, the control waits for one of the following states.

If it is determined in step B08 that the user has designated the insertion mark, it is determined that according to that time position, the insertion mark will be given, and the control unit 32 internally stores the setting for specifying the insertion mark (step B10). Then, the flow returns to the process from step B09.

If it is determined in step B07 to end the playback process of the selected moving image, or if it is determined in step B09 that the designation operation of the insertion flag will be terminated, it is determined that the selection motion will be inserted by checking whether the control unit 32 internally stores the setting of the designation insertion flag. Whether the moving image in the image still exists (step B11).

If it is determined that the moving picture to be inserted still exists, the control immediately changes from the playback mode as the basic mode to the recording mode (step B12), and waits for a key operation (more specifically, a shutter button) indicating to start recording a new moving picture to be inserted. key 9) (step B13).

In this case, the display unit 16 may also display the guide message as the character string "Press the shutter to start shooting the moving image to be inserted".

When the user has issued a recording start instruction of a moving image by operating the shutter key 9, this operation is detected in step B13. Then, the moving image to be inserted is recorded (step B14), while repeating the process for determining the end of recording the moving image by checking whether the shutter key 9 is released or a predetermined limit time (for example, 30 seconds) for continuous recording of the moving image has passed ( Step B15).

At this time, the obtained moving image data is sequentially recorded in the flash memory 38 as new moving image data.

If it is determined in step B15 that the recording of the moving picture is terminated, the setting of the specified insertion flag internally stored in the control unit 32 is checked by adding flag information indicating that the corresponding moving picture has been recorded (step B16). The flow then returns to step B11 to check whether other moving pictures to be inserted still exist.

When a plurality of insertion marks are designated and set in step B10 and the moving image is to be inserted at a plurality of positions of the initially selected moving image, according to the number of insertion marks, the processing in steps B11 to B16 is repeated, and the positions to be inserted are sequentially recorded. moving image.

After finishing shooting and recording all the moving pictures to be inserted, it is determined in step B11 that there is no moving picture to be inserted, and the recording mode is switched to the playback mode again (step B17). Then, the display unit 16 plays back and displays the moving picture data with a plurality of new moving picture data obtained by recording inserted in the middle of the moving picture data selected in step B01 recorded from the beginning to the end (step B18).

After the playback processing is completed, it is checked whether the played content is recorded and saved as a new moving picture data file (step B19).

This verification process is performed by displaying the guidance message on the display unit 16 as a string:

"You want to record what is replayed now as a new file?

whether",

And by determining whether the user directly operates the shutter key 9 while highlighting the character string part "Yes" with the cursor, or after he or she moves the highlighted cursor to the character string part "No" by operating the right key of the cross key 13, Operate the shutter key 9.

If it is determined in step B19 that the obtained data is recorded and saved as a new file, using the respective moving image data recorded in the flash memory 38, an editing process is performed so as to obtain the above-mentioned playback order, and the edited moving image data is newly recorded. is one moving image data (step B20), thus ending a series of processes.

On the other hand, if it is determined in step B19 that the obtained data is not to be recorded and saved as a new file, by deleting them from the flash memory 38 at the same time, each moving image data obtained by shooting and to be inserted is deleted (step B21), thereby ending series of treatments.

6A to 6G show examples of moving image data to be edited based on the above-described series of processing. Assume that the moving image A shown in FIG. 6A is initially selected in step B01.

Meanwhile, it is assumed that this moving picture A is played back while setting the moving picture insertion mode, and insertion flags IM1 to IM3 are designated at respective playback times, as shown in FIG. 6B. Then, at the positions of the insertion marks IM1 to IM3 specified in this way, this moving image A is divided into partial images A1 to A4.

The recording mode starts automatically, and through the processing in steps B13 to B16, the moving images B to D to be inserted are newly recorded sequentially, as shown in FIGS. 6C to 6E. Then, after the recording process of the desired moving image to be inserted is assumed to be completed in step B11, the playback mode is automatically started in step B17.

In step B18, the display unit 16 plays back and displays a series of moving images "A1+B+A2+C+ A3+D+A4", as shown in Figure 6F.

When the user has performed a key operation instructing to record and save the played moving picture A as a new moving picture, wherein moving pictures B to D are inserted at arbitrary time positions, in step B20, the new moving picture A' is recorded in In the flash memory 38 in order to update the old data, as shown in Figure 6G. At the same time, the data files of the old moving image A and the moving images B to D to be inserted obtained by shooting are deleted from the flash memory 38 for arrangement purposes.

In this way, by the minimum required key operations without any change operation to the basic mode, it is possible to perform sequential shooting of a new moving image to be inserted when specifying a plurality of arbitrary time positions in the initially selected moving image (A) (B) to D), and a series of editing processes required for playback and display of moving images (A1+B+A2+C+A3+D+A4) obtained by inserting these moving images into the selected moving image (A). Therefore, operations required for editing data by the user of the digital camera 1 can be greatly simplified.

In addition, since a plurality of moving images are inserted into an initially selected moving image, for example, a flashback-like video effect can be easily set and executed, thereby widening the range of representation.

(third embodiment)

Hereinafter, a third embodiment in which the present invention is applied to a digital camera will be described with reference to the drawings.

Note that the appearance and digital circuit layout of the digital camera are basically the same as those shown in FIGS. 1A , 1B and 2 . Therefore, the same symbols in this embodiment denote the same components as those in the first embodiment, and illustration and description thereof will be omitted.

The operation of this embodiment will be described below.

7 shows until the moving picture data recorded in the flash memory 38 is selected, another moving picture data is inserted into the selected moving picture data, and the obtained data is recorded so as to update the old data, and the playback mode is selected by the mode switch 10 at the same time. A series of processing contents executed by the control unit 32 .

At the beginning of this process, after selecting the moving image data to be displayed (step C01), by repeatedly checking whether the user has performed by directly operating the shutter key 9, instructing the playback start key operation (step C02), or by After operating the menu key 12 and the cross key 13, operate the shutter key 9, whether the user indicates that another moving image is inserted into the moving image insertion mode (step C03) in the middle of the selected moving image, the control waits for the subsequent key operation one.

When the user has performed a key operation related to the specified moving image insertion mode, this operation is detected in step C03, and the moving image insertion mode is set (step C04). Then, the flow returns to the process from step C01.

If it is determined in step C02 that the user has performed a key operation for starting playback, it is determined whether the moving image insertion mode is set at this time (step C05).

If the moving picture insertion mode is not set, it is determined that the normal moving picture playback process will be performed, and its description will be omitted.

If it is determined in step C05 that the moving picture insertion mode is set, the moving picture data selected in step C01 starts playback (step C06). After that, whether the playback process (step C07) of selecting the motion picture is completed by repeating the check, whether the user has specified the insertion mark of the insertion time in the middle of the motion picture being played back and displayed (step C07) by operating, for example, the shutter key 9 (step C07). C08), and whether the user has completed the designation operation of the insertion mark by operating, for example, the right key of the cross key 13 (step C09), the control waits for one of the following states.

If it is determined in step C08 that the insertion mark has been specified by the user, it is determined that the insertion mark will be given according to the time position, and the control unit 32 internally stores the setting for specifying the insertion mark (step C10). At the same time, the control unit 32 stores the setting of the shooting order of this insertion mark (step C11). Then, the flow returns to the process from step C09.

If it is determined in step C07 to end the playback process of the selected moving image, or if it is determined in step C09 that the specifying operation of the insertion flag will be terminated, it is determined that the selection motion will be inserted by checking whether the control unit 32 internally stores the setting of the specified insertion flag. Whether the moving image in the image still exists (step C12).

If it is determined that the moving picture to be inserted still exists, the control immediately shifts from the playback mode as the basic mode to the recording mode (step C13). After designating the first positions of those moving images inserted in the shooting order (step C14), the control waits for a key operation (more specifically, an operation of the shutter key 9) to instruct to start recording a new moving image to be inserted (step C15 ).

In this case, the display unit 16 can also display the guide message as a characteristic string:

"Press the shutter to start shooting the motion picture that will be inserted".

When the user has issued a recording start instruction of a moving image by operating the shutter key 9, this operation is detected in step C15. Then, the moving image to be inserted is recorded (step C16), while repeating the process for determining the end of recording the moving image by checking whether the shutter key 9 is released or a predetermined limit time (for example, 30 seconds) for continuous recording of the moving image has passed ( Step C17).

At this time, the obtained moving image data is sequentially recorded in the flash memory 38 as new moving image data.

If it is determined in step C17 that the recording of the moving picture is terminated, the setting of the specified insertion flag internally stored in the control unit 32 is checked by adding flag information indicating that the corresponding moving picture has been recorded (step C18). The flow then returns to step C12 to check whether other moving pictures to be inserted still exist.

When a plurality of insertion marks are specified and set in steps C10 and C11 and the moving image is to be inserted at a plurality of positions of the initially selected moving image, the processes in steps C12 to B18 are repeated according to the number of insertion marks, and the processing in steps C12 to B18 is repeated according to the specified Shooting order, which records the motion picture to be inserted in sequence.

After finishing shooting and recording all the moving pictures to be recorded, it is determined in step C12 that there is no moving picture to be inserted, and the recording mode is switched to the playback mode again (step C19). Then, the display unit 16 plays back and displays the moving image data in which a plurality of new moving image data obtained by recording in the specified shooting order is inserted in the middle of the moving image data selected in step C01 recorded from the beginning to the end (step C20) .

After the playback processing is completed, it is checked whether the played content is recorded and saved as a new moving picture data file (step C21).

This verification process is performed by displaying the guidance message on the display unit 16 as a string of characters:

"You want to record what is replayed now as a new file?

whether"

And by determining whether the user directly operates the shutter key 9 while highlighting the character string part "Yes" with the cursor, or after he or she moves the highlighted cursor to the character string part "No" by operating the right key of the cross key 13, Operate the shutter key 9.

If it is determined in step C21 that the obtained data is recorded and saved as a new file, using the respective moving image data recorded in the flash memory 38, an editing process is performed so as to obtain the above-mentioned playback order, and the edited moving image data is newly recorded. to one moving image data (step C22), thus ending a series of processes.

On the other hand, if it is determined in step C21 that the obtained data are not to be recorded and saved as a new file, by deleting them from the flash memory 38 at the same time, each moving image data obtained by shooting and to be inserted is deleted (step C23), thereby ending series of treatments.

8A to 8G show examples of moving image data to be edited based on the above-described series of processing. Assume that the moving image A shown in FIG. 8A is initially selected in step C01.

Meanwhile, it is assumed that this moving picture A is played back while setting the moving picture insertion mode, and insertion marks IM1 to IM3 are designated at a total of 3 positions at the playback time, as shown in FIG. 8B. In this case, the shooting order of moving pictures to be inserted is also specified. Then, at the positions of the insertion marks IM1 to IM3 specified in this way, this moving image A is divided into partial images A1 to A4.

The recording mode starts automatically, and through the processing in steps C15 to C18, the moving images B to D to be inserted are newly recorded sequentially, as shown in FIGS. 8C to 8E. Then, after the recording process of the desired moving image to be inserted is assumed to be completed in step C12, the playback mode is automatically started in step C19.

In step C20, the display unit 16 plays back and displays a series of moving images "A1" obtained by inserting the moving images B, C, and D into the designated positions of the insertion marks IM1 to IM3 in the moving image A according to the designated shooting order. +C+A2+D+A3+B+A4", as shown in Figure 8F.

When the user has performed a key operation instructing to record and save the played moving image A as a new moving image, in which moving images B to D are inserted at arbitrary time positions according to the specified shooting order, in step C22, the new The moving image A' is recorded in the flash memory 38 so as to update the old data, as shown in FIG. 8G. At the same time, the data files of the old moving image A and the moving images B to D to be inserted obtained by shooting are deleted from the flash memory 38 for arrangement purposes.

In this way, with the minimum required key operations, without any change operation to the basic mode, it is possible to perform when a plurality of arbitrary time positions are designated in the initially selected moving image (A), sequentially shooting according to the designated order will be inserted A series of new moving pictures (B to D) and a moving picture (A1+C+A2+D+A3+B+A4) obtained by inserting these moving pictures into the selected moving picture (A) to play back and display Edit processing. Therefore, operations required for editing data by the user of the digital camera 1 can be greatly simplified.

In addition, since a plurality of moving images are inserted into an initially selected moving image, for example, a flashback-like video effect can be easily set and executed, thereby expanding the range of representation.

Furthermore, since the shooting order of each individual moving picture to be inserted between specified moving pictures can be specified, labor required for shooting and editing images can be reduced according to user's flexibility, thereby easily creating expressive moving pictures.

(fourth embodiment)

Hereinafter, a fourth embodiment in which the present invention is applied to a digital camera will be described with reference to the drawings.

Note that the appearance and digital circuit layout of the digital camera are basically the same as those shown in FIGS. 1A , 1B and 2 . Therefore, the same symbols in this embodiment denote the same components as in the first embodiment, and illustration and description thereof will be omitted.

The operation of this embodiment will be described below.

9 shows until the moving picture data recorded in the flash memory 38 is selected, another moving picture data is inserted into the selected moving picture data, and the obtained data is recorded so as to update the old data, and the playback mode is selected by the mode switch 10 at the same time. A series of processing contents executed by the control unit 32 .

At the beginning of this process, after selecting the moving image data to be displayed (step D01), the circuit repeatedly checks whether the user has performed the operation of the playback start key (step D02) by directly operating the shutter key 9, or by After operating the menu key 12 and the cross key 13, operate the shutter key 9, whether the user specifies a moving image insertion mode for inserting another moving image into the middle of the selected moving image (step D03), wait for one of the following key operations .

When the user has performed a key operation related to the designated moving picture insertion mode, this operation is detected in step D03, and the moving picture insertion mode is set (D04). Then, the flow returns to the process from step D01.

If it is determined in step D02 that the user has performed a key operation for starting playback, it is determined whether the moving image insertion mode is set at this time (step D05).

If the moving picture insertion mode is not set, it is determined that the normal moving picture playback process will be performed, and its description will be omitted.

If it is determined in step D05 that the moving picture insertion mode is set, the moving picture data selected in step D01 starts playback (step D06). After that, by repeatedly checking whether the user has indicated the insertion mark (step D07) of the insertion time in the middle of the moving image being played back and displayed by operating, for example, the shutter key 9, and whether the playback of the initially selected moving image is ended process (step D08), the control waits for one of the following states.

If it is determined in step D08 that the playback processing of the moving image is completed, it is determined that the insertion flag is not provided, and therefore, the initially selected moving image has no time position to be edited (inserted), thereby ending a series of processing.

If it is determined in step D07 that the user has given an insert flag, the control immediately shifts from the playback mode as the basic mode to the recording mode (step D09). In addition, display unit 16 plays back the moving image for a predetermined period of time (for example, 5 seconds) by tracking from the temporal position of the moving image for which the insertion flag is provided and set (step D10). Then, the control waits for a key operation (more specifically, an operation of the shutter key 9 ) instructing to start recording a new moving image to be inserted (step D11 ).

In this case, the display unit 16 can also display the guide message as a characteristic string:

"Press the shutter to start shooting the motion picture that will be inserted".

When the user has issued a recording start instruction of a moving image by operating the shutter key 9, this operation is detected in step D11. Then, the moving image to be inserted is recorded (step D12), while repeating the process for determining the end of recording the moving image by checking whether the shutter key 9 is released or a predetermined limit time (for example, 30 seconds) for continuous recording of the moving image has passed ( Step D13).

At this time, the obtained moving image data is sequentially recorded in the flash memory 38 as new moving image data.

If it is determined in step D13 that the recording of the moving image is ended, it is determined that the moving image data to be inserted has been obtained. Therefore, the recording mode is switched to the playback mode again (step D14), so that the new moving image data obtained by recording is inserted in the middle of the moving image data selected in step D01 to play and display on the display unit 16 from the beginning to the end. Moving picture data (step D15).

After finishing the playback process, it is checked whether the played content is recorded and saved as a new moving picture data file (step D16).

This verification process is performed by displaying the guidance message on the display unit 16 as a character string:

"You want to record what is replayed now as a new file?

whether",

And by determining whether the user directly operates the shutter key 9 while highlighting the character string part "Yes" by the cursor, or he or she operates the shutter by operating the right key of the cross key 13, moving the highlighted cursor to the character string part "No" key9.

If it is determined in step D16 that the obtained data is recorded and stored as a new file, using the two moving picture data recorded in the flash memory 39, an editing process is performed so as to obtain the above-mentioned playback order, and the edited moving picture data is newly created. It is recorded as a moving picture data (step D17), thereby ending a series of operations.

On the other hand, if it is determined in step D16 that the obtained data will not be recorded and saved as a new file, by deleting it from the flash memory 38, the moving image data obtained by shooting and to be inserted is deleted (step D18), thereby ending a series of operations.

4D to 4E show examples of moving image data to be edited based on the above-described series of operations. Assume that the moving image A shown in FIG. 4D is initially selected in step D01.

Meanwhile, it is assumed that this moving picture A is played back while setting the moving picture insertion mode, and an insertion flag IM is given at playback time, as shown in FIG. 4B. Assume that A1 is the first half of the moving image A that has been played back, and A2 is the second half of the moving image A to be played back.

The recording mode starts automatically, and the image is played back and displayed again for a predetermined period of time from the time the insertion mark IM is given in step D10, so that the user can well recognize the image of the moving image to be inserted. After that, through the processing in steps D11 to A13, the moving image B to be inserted is newly recorded, as shown in FIG. 4C. The play mode starts automatically in step D14, and in step D15, display unit 16 plays back and displays a series of moving images "A1+B+A2" obtained by inserting moving image B into the position specified by the insertion mark IM of moving image A , as shown in Figure 4D.

When the user has performed a key operation instructing to record and save a new moving picture as a playback moving picture A in which the moving picture B is inserted at an arbitrary time position, in step D17, the new moving picture A' is recorded in the flash memory 38 so that Update old data, as shown in Figure 4E. At the same time, the data files of the old moving images A and B are deleted from the flash memory 38 for arrangement purposes.

In this way, by the minimum required key operations, without any change operation to the basic mode, it is possible to perform shooting of a new moving image (B) to be inserted when specifying an arbitrary time position in the initially selected moving image (A), And a series of editing processes required for playing back and displaying the moving image (A1+B+A2) obtained by inserting the moving image (B) into the selected moving image (A). Therefore, operations required for editing data by the user of the digital camera 1 can be greatly simplified.

Also, after the user visually and stably recognizes the scene to be inserted immediately after the new moving image, shooting of this image starts. Therefore, after the user is sufficiently aware of his or her intention, the user can start shooting a moving image to be inserted, thereby alleviating shooting failure.

Note that the fourth embodiment has been described in conjunction with the operation of the first embodiment, in step D10, a playback process of a moving image for a predetermined period of time. However, this process can also be performed in combination with the operations of the second or third embodiment in addition to the first embodiment.

In this case, before starting shooting of a new moving image to be shot and recorded, the scene immediately before the inserted moving image is played back in consideration of the shooting order, and the user can visually confirm the content.

Furthermore, in the first to fourth embodiments, when the moving image A' is recorded in the flash memory 38 as the recording medium, the data files of the old moving images A and B are deleted from the flash memory 38 at the same time. Alternatively, the old data files may not be deleted, or the user may choose whether to delete the old moving pictures A and B. When the old moving images A and B remain unchanged, the use range of the user's image data can be widened.

In the first to fourth embodiments, image data to be inserted into a moving image is a moving image. However, image data to be inserted is not limited to moving images, but may be still images. In this case, with the same data format as the moving image A, the still image is converted into a still image of a predetermined time period (for example, 2 seconds), and the converted still image is inserted in the same manner as in the case of inserting the moving image B. image. Then, the obtained data is recorded in the flash memory 38 in the same manner as the moving image A'. It is assumed that the user can arbitrarily set the predetermined time period. Of course, the user can select whether to delete old moving pictures and still pictures. In this way, image editing operations desired by the user can be performed.

In the first to fourth embodiments, the present invention is applied to a digital camera. However, the present invention is not limited thereto, and can be applied to various other image sensing devices using random access semiconductor memories, hard disk devices, etc. as recording media, such as camera-integrated video recorders, and portable telephone terminals compatible with moving images And PDA (Personal Digital Assistant) and so on.

The present invention is not limited to the above-mentioned embodiment, and when it is carried out, various modifications can be made without departing from the scope of the present invention.

Furthermore, these embodiments include inventions at various stages, and various inventions can be extracted by appropriately combining a plurality of disclosed required constituent elements. For example, even when some required constituent elements are omitted from all the required constituent elements described in the embodiments, the means of omitting the required constituent elements can be extracted as an invention as long as it solves the problems already in the paragraphs to be solved by the present invention Discussed problems, and the effects that have been explained in the paragraph of the effects of the present invention can be obtained.

Claims (10)

1. An image sensing device, comprising: A recording unit (38), recording moving image data obtained by shooting; specifying unit (36) for specifying at least one arbitrary time position in said moving image data recorded in said recording unit; A shooting control unit (32D) that implements switching to a recording mode when said specifying unit specifies said at least one arbitrary time position; and an inserting unit (32E) for inserting at least one newly photographed image data respectively at said at least one designated arbitrary time position in said moving image data, wherein in said recording mode set by said photographing control unit The at least one newly photographed image data is obtained through at least one photographing operation as at least one image data respectively corresponding to the at least one specified arbitrary time position. 2. The image sensing device according to claim 1, wherein the specifying unit specifies a plurality of arbitrary time positions and photographing sequences in the moving image data, and The inserting unit inserts each of a plurality of newly captured image data at a corresponding specified time position in the moving image data according to the shooting order specified by the specifying unit. 3. The image sensing apparatus according to claim 1, wherein the image data obtained in the recording mode set by the shooting control unit is one of moving image data and still image data. 4. The image sensing apparatus according to claim 1, wherein the insertion unit inserts newly captured moving image data. 5. The image sensing apparatus according to claim 1, wherein the insertion unit inserts newly captured still image data. 6. The image sensing device of claim 1, further comprising: a playback control unit that plays back and controls the moving image data recorded in the recording unit; and Wherein, the specifying unit specifies the at least one arbitrary time position with respect to the moving image data played back and controlled by the playback control unit. 7. The image sensing apparatus according to claim 6, wherein said playback control unit stops playback control of said moving image data when each of said at least one specified arbitrary time position is reached. 8. The image sensing device of claim 1, further comprising: A display control unit for displaying the at least one arbitrary time position designated by the designating unit corresponding to the bar BAR of the moving image data. 9. A method of image editing comprising: specifying at least one arbitrary time position in the moving image data recorded in the recording medium recording the moving image data obtained by shooting; enabling switching to recording mode when said at least one arbitrary time position is specified; and inserting at least one newly captured image data at the at least one designated arbitrary time position in the moving image data, wherein the at least one newly captured image is obtained by at least one shooting operation in the recording mode data as at least one piece of image data respectively corresponding to the at least one specified arbitrary time position. 10. The image editing method according to claim 9, wherein the step of specifying at least one arbitrary time position includes specifying a plurality of arbitrary time positions and shooting sequences in the moving image data, and The step of inserting at least one newly captured image data includes inserting each of a plurality of newly captured image data at a corresponding specified time position in the moving image data according to the specified shooting order.

Images