JP4857358B2 - Sound processing apparatus, imaging apparatus, sound processing method, computer program, and computer-readable storage medium - Google Patents

Description

  The present invention relates to an imaging apparatus, a sound processing apparatus, a sound processing method, a computer program, and a computer-readable storage medium used for the imaging apparatus.

  Conventionally, electronic cameras for recording and reproducing still images and moving images using a memory card having a solid-state memory element as a recording medium are already on the market, and electronic cameras equipped with an electronic viewfinder such as a color liquid crystal panel are also on the market. According to these electronic cameras, it is possible to continuously display images before photographing and to determine the composition by the user of the electronic camera, or to reproduce and display the photographed images for confirmation. In particular, the function of reproducing a photographed image immediately after photographing is highly convenient and is a useful function for the user of the electronic camera.

  In addition, in digital cameras, products having a function of capturing not only still images but also moving images are increasing, and moving image recording time, image size, and the like are also improved. Some digital cameras are equipped with a microphone and a speaker and have a sound recording / playback function using the microphone and the speaker, and some have a function such as post-recording or voice memo.

  On the other hand, not only electronic sounds but also various types of sound effects from a speaker have come out for digital camera startup sounds and operation sounds. With these models, it is possible to shoot using sound effects such as “yes, cheese” and “pasha” when pressing the shutter with the self-timer.

  Using the microphone and speaker functions of the digital camera, the recorded voice can be used as the operation sound or startup sound of the digital camera. However, in this case, since the reproduction time is extremely short, there is a problem that it is difficult to record well. It is conceivable to cut out and use the voice recorded by the after-recording method, but in this case, the operation becomes complicated and the function is difficult for the user to understand.

  The present invention has been made in view of the above problems, and an object of the present invention is to enable recording with a simple operation, for example, when recording a sound as an operation sound or an activation sound of an imaging apparatus such as a digital camera.

The image pickup apparatus of the present invention is recorded by a recording means, a setting means for setting a recording time when recording by the recording means, a selection means for selecting an arbitrary function from a plurality of different functions, and a recording means Reproducing means for reproducing the sound as an operation sound corresponding to the function, and the plurality of functions have at least a recording time of the operation sound corresponding to a part of the operation sound corresponding to the other function. Different from the recording time, the recording time of the operation sound corresponding to each function is predetermined, and the setting means corresponds to the selected function by selecting the function by the selection means. The recording time of the operation sound is set.

  As described above, according to the present invention, for example, when recording a sound to be used as an operation sound such as an operation sound or a start-up sound of an imaging apparatus such as a digital camera, the sound can be recorded with a simple operation.

It is a figure which shows the structure of imaging devices 100, such as a digital camera containing the audio processing apparatus of this embodiment. FIG. 10 is a diagram for describing an operation member of the imaging apparatus 100. It is a flowchart which shows the flow of an audio | voice processing operation. It is a figure which shows an example of the screen display in the case of registering an audio | voice. It is a figure which shows an example of the screen display in the case of recording a start-up sound. It is a figure which shows an example of the screen display in the case of recording an operation sound.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a diagram illustrating a configuration of an imaging apparatus 100 such as a digital camera including the sound processing apparatus of the present embodiment. In the figure, 10 is a photographing lens, 12 is a shutter having a diaphragm function, 14 is an image sensor that converts an optical image into an electrical signal, and 16 is an A / D converter that converts an analog signal output of the image sensor 14 into a digital signal. It is.

  A timing generation circuit 18 supplies a clock signal and a control signal to the image sensor 14, the A / D converter 16, and the D / A converter 26, and is controlled by the memory control circuit 22 and the system control circuit 50.

  An image processing circuit 20 performs predetermined pixel interpolation processing and color conversion processing on the data from the A / D converter 16 or the data from the memory control circuit 22. The image processing circuit 20 performs predetermined calculation processing using the captured image data, and the system control circuit 50 controls the exposure control unit 40 and the distance measurement control unit 42 based on the obtained calculation result. TTL (through-the-lens) AF (autofocus) processing, AE (automatic exposure) processing, and EF (flash pre-emission) processing are performed. Further, the image processing circuit 20 performs predetermined arithmetic processing using captured image data, and also performs TTL AWB (auto white balance) processing based on the obtained arithmetic result.

  A memory control circuit 22 controls the A / D converter 16, the timing generation circuit 18, the image processing circuit 20, the image display memory 24, the D / A converter 26, the memory 30, and the compression / decompression circuit 32. The data of the A / D converter 16 is written into the image display memory 24 or the memory 30 via the image processing circuit 20 and the memory control circuit 22 or the data of the A / D converter 16 is directly passed through the memory control circuit 22. It is.

  Reference numeral 24 denotes an image display memory, 26 denotes a D / A converter, 28 denotes an image display unit including a TFT LCD, and the image data for display written in the image display memory 24 passes through the D / A converter 26. Displayed by the image display unit 28. If the image data captured using the image display unit 28 is sequentially displayed, the electronic viewfinder function can be realized. Further, the image display unit 28 can arbitrarily turn on / off the display according to an instruction from the system control circuit 50. When the display is turned off, the power consumption can be greatly reduced.

  Reference numeral 30 denotes a memory for storing captured still images and moving images, and has a sufficient storage capacity to store a predetermined number of still images and a predetermined time of moving images. Thereby, even in the case of continuous shooting or panoramic shooting in which a plurality of still images are continuously shot, it is possible to write a large amount of images to the memory 30 at high speed. The memory 30 can also be used as a work area for the system control circuit 50.

  Reference numeral 32 denotes a compression / decompression circuit that compresses and decompresses image data by adaptive discrete cosine transform (ADCT) or the like, reads an image stored in the memory 30, performs compression processing or decompression processing, and stores the processed data in the memory 30. Write to.

  Reference numeral 40 denotes an exposure control unit that controls the shutter 12 having an aperture function, and has a flash light control function in cooperation with the flash 48. Reference numeral 42 denotes a distance measurement control unit that controls focusing of the photographing lens 10, reference numeral 44 denotes a zoom control unit that controls zooming of the photographing lens 10, and reference numeral 46 denotes a barrier control unit that controls the operation of the protection unit 102 serving as a barrier.

  A flash 48 has an AF auxiliary light projecting function and a flash light control function. The exposure control unit 40 and the distance measurement control unit 42 are controlled using the TTL method. Based on the calculation result obtained by calculating the captured image data by the image processing circuit 20, the system control circuit 50 performs the exposure control unit 40 and the distance measurement. The controller 42 is controlled.

  A system control circuit 50 controls the entire system. In this embodiment, the system control circuit 50 serves as a main component, and functions as recording time setting means, recording start reception means, and recording means in the present invention. A memory 52 stores constants, variables, programs, and the like for operating the system control circuit 50.

  Reference numeral 54 denotes a display unit such as a liquid crystal display device or a speaker that displays an operation state or a message using characters, images, sounds, and the like in accordance with execution of a program in the system control circuit 50. One or a plurality of positions are easily installed, and are configured by a combination of, for example, an LCD, an LED, and a sounding element. The display unit 54 has a part of its function installed in the optical viewfinder 104.

  Among the display contents of the display unit 54, what is displayed on the LCD or the like includes single shot / continuous shooting display, self-timer display, compression rate display, number of recorded pixels, number of recorded pixels, number of remaining images that can be captured, shutter Speed display, Aperture value display, Exposure compensation display, Flash display, Red-eye reduction display, Macro shooting display, Buzzer setting display, Clock battery level display, Battery level display, Error display, Multi-digit number information display and recording There are a display state of the media 200 and 210, a communication I / F operation display, a date / time display, and the like.

  Among the display contents of the display unit 54, what is displayed in the optical viewfinder 104 includes in-focus display, camera shake warning display, flash charge display, shutter speed display, aperture value display, exposure correction display, and the like.

  Reference numeral 56 denotes an electrically erasable / recordable nonvolatile memory such as an EEPROM.

  Reference numerals 60, 62, 64, 66, 68, and 70 denote operation units for inputting various operation instructions of the system control circuit 50. A single unit such as a switch, a dial, a touch panel, a pointing by gaze detection, a voice recognition device, or the like Consists of multiple combinations.

  Here, a specific description of these operation units will be given. Reference numeral 60 denotes a mode dial switch, which can switch and set various function modes such as power-off, automatic shooting mode, shooting mode, panoramic shooting mode, playback mode, multi-screen playback / erase mode, and PC connection mode.

  Reference numeral 62 denotes a shutter switch SW1, which is turned ON during the operation of a shutter button (not shown), and performs AF (auto focus) processing, AE (auto exposure) processing, AWB (auto white balance) processing, EF (flash pre-flash) processing, and the like. Instruct to start operation.

  Reference numeral 64 denotes a shutter switch SW2, which is turned on when the operation of a shutter button (not shown) is completed, and an exposure process for writing a signal read from the image sensor 12 to the memory 30 via the A / D converter 16 and the memory control circuit 22. Development processing using operations in the image processing circuit 20 and the memory control circuit 22, recording processing for reading image data from the memory 30, compression in the compression / decompression circuit 32, and writing the image data to the recording medium 200 or 210. Instructs the start of a series of processing operations.

  Reference numeral 66 denotes an image display ON / OFF switch which can set ON / OFF of the image display unit 28. With this function, when photographing using the optical viewfinder 104, it is possible to save power by cutting off the current supply to the image display unit including a TFT LCD or the like.

  Reference numeral 68 denotes a quick review ON / OFF switch, which sets a quick review function for automatically reproducing image data taken immediately after photographing. In this embodiment, it is assumed that a function for setting the quick review function when the image display unit 28 is turned off is provided.

  Reference numeral 70 denotes an operation unit composed of various buttons, a touch panel, and the like. A menu button, a set button, a macro button, a multi-screen playback page break button, a flash setting button, a single shooting / continuous shooting / self-timer switching button, menu movement + (plus) Button, menu shift- (minus) button, playback image shift + (plus) button, playback image- (minus) button, shooting image quality selection button, exposure correction button, date / time setting button, and the like.

  Reference numeral 72 is a microphone, and 74 is a speaker. A power control unit 80 includes a battery detection circuit, a DC-DC converter, a switch circuit that switches a block to be energized, and the like. In addition, the DC-DC converter is controlled based on an instruction from the system control circuit 50, and a necessary voltage is supplied to each unit including the recording medium for a necessary period.

  Reference numeral 82 denotes a connector, 84 denotes a connector, and 86 denotes a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery, NiMH battery, or Li battery, an AC adapter, or the like.

  90 and 94 are interfaces with a recording medium such as a memory card or a hard disk, 92 and 96 are connectors for connecting to a recording medium such as a memory card or a hard disk, and 98 is a recording medium 200 or 210 attached to the connector 92 or 96. It is a recording medium attachment / detachment detection unit that detects whether or not the recording medium is present. Although the present embodiment has been described as having two systems of interfaces and connectors for attaching a recording medium, these interfaces and connectors may have a single or a plurality of systems. Moreover, it is good also as a structure provided with combining the interface and connector of a different standard. The interface and connector may be configured using a PCMCIA card, CF (Compact Flash (R)) card, or the like that conforms to the standard. Further, when the interfaces 90 and 94 and the connectors 92 and 96 are configured using a PCMCIA card, a CF (Compact Flash (R)) card, or the like, a LAN card, a modem card, a USB card, an IEEE 1394 card. By connecting various communication cards such as P1284 card, SCSI card, PHS and other communication cards, image data and management information attached to the image data can be transferred to and from peripheral devices such as other computers and printers. Can fit.

  Reference numeral 102 denotes a protective unit that is a barrier that covers the imaging unit including the lens 10 to prevent the imaging unit from being dirty or damaged.

  Reference numeral 104 denotes an optical viewfinder, which can take an image using only the optical viewfinder without using the electronic viewfinder function of the image display unit 28. In the optical viewfinder 104, some functions of the display unit 54, for example, a focus display, a camera shake warning display, a flash charge display, a shutter speed display, an aperture value display, an exposure correction display, and the like are installed.

  A communication unit 110 has various communication functions such as RS232C, USB, IEEE1394, P1284, SCSI, modem, LAN, and wireless communication.

  Reference numeral 112 denotes a connector connected to another device by the communication unit 110 or an antenna in the case of wireless communication.

  Reference numeral 200 denotes a recording medium such as a memory card or a hard disk. The recording medium 200 includes a recording unit 202 composed of a semiconductor memory, a magnetic disk, and the like, an interface 204 with the imaging device 100, and a connector 206 that connects to the imaging device 100.

  Reference numeral 210 denotes a recording medium such as a memory card or a hard disk. The recording medium 210 includes a recording unit 212 composed of a semiconductor memory, a magnetic disk, and the like, an interface 214 with the imaging device 100, and a connector 216 that connects to the imaging device 100.

  FIG. 2 is a diagram for explaining an operation member of the imaging apparatus 100. A power button 301 is used to start and end the digital camera. A menu button 302 is used to enter a menu for changing a shooting mode, setting a date, protecting or deleting an image. Also used to end various setting modes. A determination button 303 is used to determine a selection item.

  A display button 304 switches display / non-display of shooting information related to an image. The left button 305 is used to move the selection item to the left or to advance the image. The right button 306 is used for moving the selection item to the right or for image forwarding. The up button 307 is used to move the selection item up. The down button 308 is used to move the selection item downward.

  The shutter button 310 is a button used when shooting in the shooting mode. A mode switch 311 switches between a recording mode and a playback mode. The liquid crystal screen 312 is used when photographing while confirming an image, and is also used for confirming the photographed image.

  FIG. 3 is a flowchart showing the flow of the voice processing operation of the present embodiment. When recording, first, the recording time of the voice to be recorded is set (step S301). This recording time does not change depending on the free space of the recording medium, and is a fixed value determined by the sound to be used because an area on the RAM is used. As will be described later, startup sound, operation sound, shutter sound, self-timer sound are set as the usage of the sound to be recorded, and each recording time is preset, and the recording time is set by selecting the desired usage To do.

  After setting the recording time, the user starts recording at an arbitrary timing (step S302).

  When the start of recording is started by the user's intention, the sound is recorded for the time set in step S301 (step S303). In the meantime, other operations such as recording stop cannot be performed, and recording is performed until the set recording time elapses.

  Thereafter, the user determines whether or not to record the recorded voice (step S304), and if so, registers it as one of the sound effects in the digital camera (step S305).

  FIG. 4 shows a display example of the liquid crystal screen 401 (liquid crystal screen 312 in FIG. 2) when registering voice. As items for registering sound (use of sound), start sound 402, operation sound 403, shutter sound 404, and self-timer sound 405 are set. From these items, the up button 307 and down button 308 are used to move the item to the item to be registered, and then the enter button 303 is used to move to the recording screen.

  FIG. 5 shows a display example of the liquid crystal screen 501 (the liquid crystal screen 312 in FIG. 2) when recording the start-up sound. In the panel shown at the bottom of the screen, a recording button 502, a registration button 503, and a counter 504 for displaying the recording time are displayed. The focus of the button is moved with the left button 305 and the right button 306, and the determination is performed with the decision button 303. The registration button can no longer be selected before recording.

  FIG. 6 shows a display example of a liquid crystal screen 601 (liquid crystal screen 312 in FIG. 2) when recording an operation sound. In the case of the operation sound, the recording time is set to be as short as 0.3 seconds compared to the case of the start-up sound described in FIG. 5 and the recording time is displayed on the counter 602.

  In the recording screen shown in FIGS. 5 and 6, an example in which only the recording start and registration functions are provided has been described. However, on this screen, functions such as sound reproduction and volume adjustment are provided. You may make it let. In that case, it is possible to confirm whether or not to record by playing back and determine whether or not to register.

(Other embodiments)
In order to operate various devices to realize the functions of the above-described embodiment, software program codes for realizing the functions of the above-described embodiments are provided to an apparatus or a computer in the system connected to the various devices What is implemented by operating the various devices according to a program supplied and stored in a computer (CPU or MPU) of the system or apparatus is also included in the scope of the present invention.

  In this case, the program code of the software itself realizes the functions of the above-described embodiments, and the program code itself constitutes the present invention. As a transmission medium for the program code, a communication medium (wired line or wireless line such as an optical fiber) in a computer network (LAN, WAN such as the Internet, wireless communication network, etc.) system for propagating and supplying program information as a carrier wave Etc.) can be used.

  Further, means for supplying the program code to the computer, for example, a recording medium storing the program code constitutes the present invention. As a recording medium for storing the program code, for example, a flexible disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a magnetic tape, a nonvolatile memory card, a ROM, or the like can be used.

  Further, by executing the program code supplied by the computer, not only the functions of the above-described embodiments are realized, but also the OS (Operating System) or other application software in which the program code is running on the computer, etc. It goes without saying that the program code is also included in the embodiment of the present invention even when the functions of the above-described embodiment are realized in cooperation with the embodiment.

  Further, after the supplied program code is stored in the memory provided in the function expansion board of the computer or the function expansion unit connected to the computer, the CPU provided in the function expansion board or function expansion unit based on the instruction of the program code Needless to say, the present invention includes the case where the functions of the above-described embodiment are realized by performing part or all of the actual processing.

  It should be noted that the shapes and structures of the respective parts shown in the above embodiments are merely examples of implementation in carrying out the present invention, and the technical scope of the present invention is limitedly interpreted by these. It must not be done. That is, the present invention can be implemented in various forms without departing from the spirit or main features thereof. For example, the recording media 200 and 210 include not only a memory card such as a PCMCIA card or a compact flash (R), a hard disk, but also a micro DAT, a magneto-optical disk, an optical disk such as a CD-R or a CD-WR, and a DVD. Of course, there is no problem even if it is composed of a changeable optical disk or the like. Of course, there is no problem even if the recording media 200 and 210 are composite media in which a memory card and a hard disk are integrated. Further, there is no problem even if a part of the composite medium is detachable. Further, the recording media 200 and 210 have been described as being separated from the image capturing apparatus 100 and can be arbitrarily connected, but it is of course no problem if any or all of the recording media remain fixed to the image capturing apparatus 100. .

14 Image sensor 24 Image display memory 28 Image display unit 30 Memory 50 System control circuit 54 Display unit 72 Microphone 74 Speaker 200 Recording medium 201 Recording medium

Claims (12)

Recording means;
Setting means for setting a recording time when recording by the recording means;
A selection means for selecting an arbitrary function from a plurality of different functions;
Reproducing means for reproducing the sound recorded by the recording means as an operation sound corresponding to the function,
The plurality of functions have a predetermined operation sound recording time for each function so that the operation sound recording time corresponding to at least some functions is different from the operation sound recording time corresponding to other functions. And
The setting unit sets an operation sound recording time corresponding to the selected function when a function is selected by the selection unit.   The imaging apparatus according to claim 1, wherein the reproduction unit reproduces the operation sound when a corresponding function is executed.   The plurality of functions include an activation function that activates the imaging device, an operation function that operates the imaging device based on an input to an operation unit, a photographing function that performs photographing using the imaging device, and photographing after a predetermined time from a photographing instruction. The imaging apparatus according to claim 1, comprising at least two of self-timer functions to be started.   2. The recording apparatus according to claim 1, further comprising a registration unit configured to record a recorded sound with a recording time set corresponding to the selected function and register the recorded sound as an operation sound corresponding to the selected function. 4. The imaging device according to any one of 3. Display means for displaying information indicating each of the plurality of functions;
The selection unit is configured to select a function indicated by the selected information by selecting arbitrary information from information indicating each of the plurality of functions displayed on the display unit. The imaging device according to any one of claims 1 to 4.   The imaging device according to claim 5, wherein the display unit displays items of operation sounds corresponding to the plurality of functions as information indicating the plurality of functions, respectively.   The imaging device according to claim 6, wherein the operation sound item includes at least two of a start-up sound, an operation sound, a shutter sound, and a self-timer sound.   The said display means displays the recording time set corresponding to the function which this selected information shows with the said selected information, The any one of Claim 5 thru | or 7 characterized by the above-mentioned. Imaging device. Recording means;
Setting means for setting a recording time when recording by the recording means;
A selection means for selecting an arbitrary function from a plurality of different functions;
Reproducing means for reproducing the sound recorded by the recording means as operation sounds corresponding to the plurality of functions,
The plurality of functions have a predetermined operation sound recording time for each function so that the operation sound recording time corresponding to at least some functions is different from the operation sound recording time corresponding to other functions. And
The sound processing apparatus, wherein the setting means sets a recording time of an operation sound corresponding to the selected function when the function is selected by the selection means. Recording step,
A setting step for setting a recording time when recording in the recording step;
A selection step of selecting an arbitrary function from a plurality of different functions;
A playback step for playing back the sound recorded in the recording step as the operation sound corresponding to the plurality of functions;
The plurality of functions have a predetermined operation sound recording time for each function so that the operation sound recording time corresponding to at least some functions is different from the operation sound recording time corresponding to other functions. And
In the sound processing method, the setting step sets a recording time of an operation sound corresponding to the selected function by selecting a function in the selection step. Recording step,
A setting step for setting a recording time when recording in the recording step;
A selection step of selecting an arbitrary function from a plurality of different functions;
A playback step for playing back the sound recorded in the recording step as the operation sound corresponding to the plurality of functions;
The plurality of functions have a predetermined operation sound recording time for each function so that the operation sound recording time corresponding to at least some functions is different from the operation sound recording time corresponding to other functions. And
The setting step causes a computer to execute a sound processing method characterized in that, when a function is selected in the selection step, a recording time of an operation sound corresponding to the selected function is set. Computer program.   A computer-readable storage medium storing the computer program according to claim 11.

Images