JP4666204B2 - Playback apparatus and method, and program - Google Patents

Description

  The present invention relates to a reproduction apparatus, method, and program, and is particularly suitable for application to a reproduction apparatus that reproduces audio information in which an image is associated with one or a plurality of audio positions.

  Conventionally, there is an IC recorder as a portable sound storage device. The IC recorder collects external sound with a built-in microphone, and compresses and encodes the obtained sound data into a built-in semiconductor memory or a loaded external memory.

  Such an IC recorder has a small size and light weight and is excellent in portability. Therefore, in recent years, the IC recorder is widely used as a personal use voice memo device while being used in a business scene such as a meeting or a meeting.

Further, in recent years, a CCD (Charge Coupled Device) camera is mounted, and image information of an image captured by the CCD camera during recording can be stored in association with the sound position at that time, and then the desired sound position can be obtained using the image as a clue. An IC recorder with a camera that can be easily accessed is proposed by the present applicant.
Japanese Patent Application No. 2004-256199

  By the way, in recent IC recorders, a CD-ROM (Compact Disc-) in which application software having a function of reproducing or editing a sound file of recorded sound stored in the IC recorder on a personal computer is recorded. Read Only Memory) is included as an accessory.

  Then, the user installs the application software in his / her personal computer and starts it to display a predetermined graphical user interface (hereinafter simply referred to as GUI (Graphical User Interface)) on the display of the personal computer. The GUI can be used to reproduce or edit a voice file of recorded voice stored in an IC recorder connected to the personal computer via a cable.

  However, when a recorded audio file stored in the IC recorder is reproduced or edited on a personal computer in this way, it is complicated to find a desired audio portion from a series of audio. It is desired to provide application software that can easily recognize the contents of voice and can easily search for a desired voice portion.

  The present invention has been made in consideration of the above points, and an object of the present invention is to propose a playback apparatus, method, and program capable of facilitating the recognition of voice content and the search for a desired voice portion.

This onset bright order to solve such problems, a playback device, among the audio information in units of time to record the end of the recording start time, to one or more sound position in the audio information for the selected object an image presentation means for displaying a list of communication Tagged image Seki, among the reproduction time axis, a mark presenting means for a mark to a portion corresponding to one or more sound position in the audio information of the selected target, voice selection Reproduction position changing means for changing the position of the slider that can move the reproduction time axis corresponding to the reproduction position in the information to the audio position of the mark that is attached before and after the current position, and the marked part When the slider passes, the highlighting means for highlighting the mark and the image associated with the sound position of the mark is included.

  As a result, in this playback apparatus, the images associated with the playback position are displayed while being sequentially switched so as to supplement the content of the playback audio, so that the user can intuitively recognize the audio content based on the image.

This onset Ming also provides a playback method, image presentation means, of the voice information in units of time to record the end of the recording start time, to one or more sound position in the audio information for the selected object a first step of displaying a list of communication Tagged image Seki, mark presenting means, among the reproduction time axis, the second of a mark in one or more portions corresponding to the sound position in the audio information for the selected object The step and the playback position changing means change the position of the slider that can move the playback time axis according to the playback position in the audio information to be selected to the audio position of the mark that is attached before and after the current position. And a third step of highlighting, when the slider has passed through the marked part, a fourth step of highlighting the mark and an image associated with the audio position of the mark. And a step.

  As a result, according to this playback method, the images associated with the playback position are displayed while being sequentially switched so as to supplement the content of the playback audio, so that the user can intuitively recognize the audio content based on the image. .

The present onset Ming is a program, for the computer, of the audio information in units of time to record the end of the recording start time, related to one or more sound position in the audio information for the selected object Displaying a list of linked images, marking a portion corresponding to one or more audio positions in the audio information to be selected on the reproduction time axis, and corresponding to a reproduction position in the audio information to be selected Change the position of the slider that can move the playback time axis to the audio position of the mark attached to the front and back with respect to the current position, when the slider passes the marked part, Ru is performed to highlight the image associated with the sound position of the mark.

  As a result, according to this program, the images associated with the reproduction position are displayed while being sequentially switched so as to supplement the content of the reproduced audio, so that the user can intuitively recognize the audio content based on the image.

  According to the present invention, in a playback apparatus, method, and program for playing back sound information in which image information is associated with one or a plurality of sound positions, the sound information is responsive to a playback command input using a graphical user interface. In this case, the image associated with the sound position is displayed while sequentially switching at the timing of reproducing the sound position associated with any image of the sound information. Based on the above, it is possible to make it possible for the user to intuitively recognize the audio content, and thus to realize a playback apparatus, method, and program that can facilitate the recognition of the audio content and the search for a desired audio portion.

  Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.

(1) External appearance configuration of camera-equipped IC recorder 1 according to this embodiment (1-1) External appearance configuration of camera-equipped IC recorder 1 In FIG. 1 to FIG. 3, reference numeral 1 denotes an IC recorder 1 with a camera according to the present embodiment as a whole. An LCD cover 4 to which a CCD (Charge Coupled Device) camera 3 is attached is slidably disposed upward (in the direction of the arrow z) on an upper portion of a vertically long main body 2 that is round as a whole. Yes.

  In the main body 2, sound collecting holes 5A and 5B are formed on the left and right sides of the upper part of the back surface 2A, and microphones 20A and 20B (FIG. 5) are accommodated in the sound collecting holes, respectively. Thus, the microphones 20A and 20B can collect external sound through the corresponding sound collecting holes 5A and 5B.

  In addition, a recording button 6A is provided at the middle position of the front surface 2B of the main body 2. By pressing this recording button 6A, the recording operation of the external sound collected by the microphones 20A and 20B is started. It is made to be able to let you.

  Further, an LCD 7 composed of a high-resolution color liquid crystal display is disposed at the upper position of the front surface 2B of the main body 2 as shown in FIG. 3, and the LCD cover 4 is drawn upward as shown in FIG. In a state where the camera cover 8 of the LCD cover 4 is rotated so that the CCD camera 3 is exposed as will be described later, the live view button 6B disposed on the lower side of the LCD 7 is pressed to operate the CCD. A moving image photographed by the camera 3 can be displayed on the LCD 7.

  Further, a camera shutter button 6C is disposed on the left side of the live view button 6B of the main unit 2 and is displayed on the LCD 7 by pressing the camera shutter button 6C while a moving image is displayed on the LCD 7. Of the moving images, a still image for one frame at the moment of pressing the camera shutter button 6C can be captured and stored.

  On the other hand, a menu button 6D is disposed on the right side surface 2C of the main body 2, and a predetermined menu screen can be displayed on the LCD 7 by pressing the menu button 6D. Further, a jog lever 6E is disposed below the menu button 6D on the right side surface 2C of the main body 2. The jog lever 6E is displayed in the menu screen by operating the jog lever 6E in the vertical and horizontal directions. A desired option can be selected from the various options that have been selected, or the option can be determined as a selection target.

  Further, a stop button 6F is disposed below the jog lever 6E on the right side surface 2C of the main body 2, and a volume button 6G is disposed below the stop button 6F. The stop button 6F The recording operation and the playback operation can be stopped by pressing the button, and the speaker 31 (located on the back side of the LCD 7 at this time can be pressed by pressing the upper or lower side of the volume button 6G during the playback operation. The volume of the reproduced sound output from FIG. 5) can be increased or decreased.

  Further, a USB (Universal Serial Bus) connector 10 is disposed below the power supply connector 9 on the left side surface 2D of the main body 2, and is connected to an external device such as a personal computer via the USB connector 10. It has been made so that it can. As a result, the camera-equipped IC recorder 1 outputs the audio data of the recorded audio and the image data of the recorded image stored in the IC recorder 1 with the camera to the external device connected to the USB. In addition, audio data and image data given from the external device can be captured.

  On the other hand, a cylindrical camera cover 8 is rotatably disposed on the upper portion of the LCD cover unit 4, and the above-described CCD camera 3 has its optical axis at a predetermined position of the camera cover 8. The camera cover 8 is attached in a direction perpendicular to the central axis.

  Thus, in this IC recorder with camera 1, the camera cover 8 is positioned at the origin position where the CCD camera 3 faces downward to protect the CCD camera 3 when not in use. By rotating the camera in the direction and positioning the CCD camera 3 at the front position on the back surface 2A side of the main body 2, a desired image can be taken while viewing the moving image displayed on the LCD 7. Yes.

(1-2) Internal Configuration of IC Recorder 1 with Camera FIG. 4 shows the internal configuration of the IC recorder 1 with camera.

  In the camera-equipped IC recorder 1, when the power is turned on, external sound is collected by the microphones 20 </ b> A and 20 </ b> B, and the obtained sound signal S <b> 1 is passed through an amplifier 21 to AD (Analog / Digital) / DA (Digital / Analog) Input to the converter 22. Further, the AD / DA converter 22 sequentially converts the supplied audio signal S1 into digital conversion processing, and sequentially transmits the obtained audio data D1 to the data processing and control unit 23.

  The data processing and control unit 23 includes a CPU (Central Processing Unit) 24 that controls the entire IC recorder 1 with camera, a ROM (Read Only Memory) 25 that stores various programs, and a RAM (Work Memory of the CPU 24). A control unit 27 having a microcomputer configuration including a Random Access Memory) 26, and a DSP (Digital Signal Processor) 28 having a data compression / decompression function for audio data D1 and image data D3 described later.

  The control unit 27 of the data processing and control unit 23 includes the recording button 6A, live view button 6B, camera shutter button 6C, menu button 6D, jog lever 6E, stop button 6F, and volume switch 6G that constitute the operation unit. When any one of these is operated, an operation input signal S2 corresponding thereto is given from the operation unit 6 (6A to 6G).

  Further, the control unit 27 receives a first sensor (not shown) provided in the LCD cover unit 4 in a closed state in which the LCD cover unit 4 is closed as shown in FIG. 1 and an open state in which the LCD cover unit 4 is opened as shown in FIG. An LCD cover state signal S3 indicating which state is present is given, and the rotation state of the camera cover 8 is exposed from the second sensor (not shown) provided in the LCD cover unit 4 so that the CCD camera 3 is exposed. A camera cover state signal S4 indicating whether the closed state or the open state where the CCD camera 3 is exposed is provided.

  Thus, the CPU 24 of the control unit 27 recognizes the contents of the user's operation based on the operation input signal S2, and the current LCD cover unit 4 and camera cover 8 based on the LCD camera cover state signal S3 and the camera cover state signal S4. A state is detected, and a corresponding control process is executed based on these recognitions and detection results.

  In practice, when the CPU 24 detects that at least one of the LCD cover unit 4 and the camera cover 8 is in a closed state, the CPU 24 recognizes that the recording button 6A has been pressed, and changes the operation mode. By changing to the recording mode and controlling the DSP 28, the audio data D1 output from the AD / DA converter 22 is subjected to audio compression processing conforming to a predetermined audio compression method such as LPEC (registered trademark of Sony Corporation). The compressed audio data D2 obtained is sequentially stored in the built-in flash memory 29.

  Further, when the CPU 24 recognizes that the stop button 6F has been pressed thereafter, the CPU 24 controls the DSP 28 to stop the audio compression processing for the audio data D1 given from the AD / DA converter 22, while at that time by the user. A new message folder (“03072400” to “03072408” in FIG. 6) is generated in the selected folder (“FOLDER1” to “FOLDER3” in FIG. 6) to be described later, and the compressed audio data D2 is converted into a file. The obtained audio file (“03072400.MSV” in FIG. 6) is stored in the business folder. Further, the CPU stores the management information of the business folder in a management file MSF (FIG. 7) described later.

  On the other hand, when the CPU 24 detects that both the LCD cover unit 4 and the camera cover 8 are in the open state, the CPU 24 shifts the operation mode to the camera mode and controls the CCD camera 3 to activate the CCD camera 3. . As a result, the image signal S5 about the scene photographed by the CCD camera 3 at that time is sequentially output from the CCD camera 3 and is supplied to the data processing and control unit 23.

  When the CPU 24 recognizes that the live view button 6B has been pressed in this state, the CPU 24 controls the DSP 28 accordingly. Thus, at this time, the DSP 28 sequentially converts the image signal S5 supplied from the CCD camera 3 and sends the obtained image data D3 to the LCD 7. As a result, based on the image data D3, the moving image of the scene being shot by the CCD camera 3 at that time is displayed on the LCD 7 in real time.

  Further, when the CPU 24 subsequently recognizes that the camera shutter button 6C has been pressed in this state, it controls the DSP 28 accordingly. Thus, at this time, the DSP 28 captures the image data D3 of the still image for one frame at the moment when the camera shutter button 6C obtained based on the image data D3 is pressed, and for example, JPEG ( Image compression processing conforming to a predetermined image compression method such as Joint Photographic Experts Group) is performed, and the obtained compressed image data D4 is stored in the flash memory 29.

  Thereafter, the CPU 24 generates a new business folder in the folder selected by the user at that time, and the image file (“P0000000.JPG” to “P0000003.JPG” in FIG. 6) including the compressed image data D4. ) Is stored in the business folder, and the management information of the business folder is stored in the management file MSF.

  On the other hand, when the CPU 24 detects that both the LCD cover unit 4 and the camera cover 8 are in the open state, when the CPU 24 recognizes that the recording button 6A has been pressed, the operation mode is changed to the recording / recording mode. The DSP 28 is controlled in response to the transition.

  At this time, the DSP 28 sequentially performs predetermined audio compression processing on the audio data D1 supplied from the AD / DA converter 22 in the same manner as in the recording mode described above, and stores the obtained compressed audio data D2 in the flash memory 29. . At this time, the DSP 28 sequentially digitally converts the image signal S5 given from the CCD camera 3 and sends the obtained image data D3 to the LCD 7, as in the camera mode described above. As a result, on the LCD 7, a moving image of the scene taken by the CCD camera 3 at that time based on the image data D3 is displayed in real time.

  Further, when the CPU 24 subsequently recognizes that the camera shutter button 6C has been pressed in this state, it controls the DSP 28 accordingly. At this time, as in the camera mode, the DSP 28 takes in the image data D3 of the still image for one frame at the moment when the camera shutter button 6C obtained based on the image signal S5 given from the CCD camera 3 is pressed. Image compression processing is performed on the captured image data D3.

  Further, the DSP 28 uses the compressed image data D4 obtained by the image compression processing thereafter as an image (hereinafter referred to as a bookmark image) as a mark when searching the moment when the camera shutter button 6C is pressed. ) Of the compressed audio data D4 stored in the flash memory 29 at that time in association with the corresponding positions of the compressed audio data D2 and stored in the flash memory 29.

  Then, when the CPU 24 recognizes that the stop button 6F has been pressed, a new business folder is generated in the folder selected by the user at that time, and an audio file composed of the compressed audio data D2 and Each image file composed of the above-described compressed image data D4 associated with the audio file is stored in the business folder, and management information of the business folder is stored in the management file MSF.

  In this manner, the camera-equipped IC recorder 1 can record not only voice and still images independently, but also can record still images as bookmark images in association with the voice being recorded. .

  The IC recorder with camera 1 can search for a desired message folder and a desired voice position in the message folder based on the bookmark image recorded in association with the voice in this way.

  In practice, the CPU 24 presses the jog lever 6E to select a desired message folder in the desired folder (hereinafter referred to as a message folder selection window) or its message folder. When it is recognized that a display command for selecting a desired bookmark image in the image (hereinafter referred to as a bookmark image selection screen) is input, the corresponding image data D3 is read from the ROM 25 and sent to the LCD 7. As a result, a message folder selection screen 32 as shown in FIG. 5 and a bookmark image selection screen 33 (FIG. 5) having the same configuration as the message folder selection screen 32 are displayed on the LCD 7.

In this case, when displaying the message folder selection screen 32 on the LCD 7, the CPU 24 displays a typical bookmark image (hereinafter referred to as “this”) for each message folder in the folder. reading the image file of the representative image hereinafter) (the compressed image data D4) from the flash memory 29, and which was processed decoded DSP 28, the thumbnail images P ₁ to P ₆ of a predetermined based on the image data D3 obtained size create.

Then, as shown in FIG. 5, the CPU 24 displays a list of thumbnail images P _{1 to} P ₆ for each message folder thus obtained in the message folder selection screen 32. At this time, a predetermined icon is displayed instead of the thumbnail image for a business folder that does not include a still image of only sound.

Further, when the jog lever 6E is subsequently operated to select one thumbnail image P _{1 to} P ₆ in the message folder selection screen 32, the CPU 24 responds based on the management file MSF (FIG. 7) described above. The audio file (compressed audio data D2) in the message folder to be read is read from the flash memory 29, and is decoded by the DSP.

  As a result, the audio data D1 obtained by the decoding process is output from the DSP 28, converted into an analog signal by the AD / DA converter 22, and the obtained audio signal S6 is supplied to the speaker 31 via the amplifier 30. Thereby, the sound based on this sound signal S6 is output from the speaker 31 at this time.

Similarly, when displaying the bookmark image selection screen 33 (FIG. 5) on the LCD 7, the CPU 24 selects an image file (compressed image) of each bookmark image in the corresponding business folder based on the management file MSF. It reads data D4) from the flash memory 29, if these were processed decoded DSP 28, create respective thumbnail images _P 1 to P ₆ of a predetermined size based on each image data D3 obtained. Then, the CPU 24 displays a list of the thumbnail images P _{1 to} P ₆ for each bookmark image obtained in this way in the bookmark image selection screen 33.

The CPU24 is thereafter jog lever 6E is operated and one of the thumbnail images _P 1 to P ₆ in the bookmark image selection screen 33 is selected, the thumbnail image _P 1 ~ in the corresponding audio file from the flash memory 29 reads the compressed audio data D2 of the audio portion after that is associated with the original bookmark image of P _6, is decoding it to DSP 28.

  As a result, the audio data D1 obtained by the decoding process is output from the DSP 28, converted into an analog signal by the AD / DA converter 22, and the obtained audio signal S6 is supplied to the speaker 31 via the amplifier 30. Thereby, based on this audio signal S6, the audio after the audio position associated with the bookmark image selected by the user in the selected business folder is output from the speaker 31.

  In this way, in this IC recorder with camera 1, based on the representative image of the business folder and each bookmark image in the business folder, the desired business folder and the desired audio position in the business folder can be quickly displayed. It is designed to be easily accessible.

(1-3) Directory Structure of Data Management Format in IC Recorder 1 with Camera Next, the voice cape format, which is a data management format for compressed audio data D2 and compressed video data D4, employed in the IC recorder 1 with camera The directory structure of (Voiscape Format) will be described.

  FIG. 6 shows the directory structure of such a voice cape format. As shown in FIG. 6, an audio file of recorded audio (“03072400.MSV”) and an image file of bookmark images (“P0000000.JPG” to “P0000003.JPG”) recorded in association therewith are “MSSONY”. Is stored in a folder called “VOISCAPE” created in a folder called “.”

  The folders ("FOLDER1" to "FOLDER3") that store the business folders exist in this "VOISCAPE", and the user selects the desired folder as the storage location for the recorded audio files from these folders. Or create a new folder.

  “VOISCAPE” also stores the management file MSF (“MSGLIST.MSF”) for managing the created business folder. As shown in FIG. 7, this management file MSF has a 32 [Byte] header (“Header”) in which the date, hour, minute, second and day of the week when the management file MSF was last edited are described. Folder entry ("Folder Entry") describing the folder name etc. of each folder ("FOLDER1" to "FOLDER3"), and the folder name of each business folder created in that folder and the creation of that business folder A message entry (“Message Entry”) in which the date and time are described has a data structure in which each folder is sequentially described.

  In this voice cape format, when a new folder or a new business folder is created, a folder entry or message entry in which various management information as described above is described is always registered in the management file MSF. As a result, in this voice cape format, it is possible to reliably and quickly search in which folder the desired business folder is based on the management file MSF.

  Furthermore, in each folder (“FOLDER1” to “FOLDER3”), one or more business folders (“03072400” to “03072408”) are created according to the usage status of each user. In addition, an audio file ("03072400.MSV") of compressed audio data D2 obtained by recording and an image file ("P0000000.JPG" to "P0000003" of compressed image data D4 of each bookmark image taken during the recording. .JPG ") and an image management file PIN (" 03072400.PIN ") for managing each image file. Such an audio file has the same file format as the audio file format adopted in the existing IC recorder.

  As shown in FIG. 8, the image management file PIN includes a plurality of picture entries after a header (“Header”) describing the date, hour, minute, second and day of the week when the image management file PIN was last edited. (“Picture Entry”).

  In this case, in the first picture entry, when a representative image is set, the file name of the image file of the bookmark image and the corresponding position (hour / minute / second) with respect to the audio file (audio data D1) of the bookmark image ) Etc. are described. If a representative image is not set, zero data is stored in all parts of the first picture entry other than the picture ID indicating that the area described at the head of each picture entry is a picture entry. Stored.

  In the second and subsequent picture entries, the file name of the image file of each bookmark image taken during recording of the corresponding sound and the corresponding position (hour, minute and second) of the bookmark image with respect to the sound are described. The In this case, since the second and subsequent picture entries are sequentially added after each new bookmark image file is recorded, the arrangement order of the second and subsequent picture entries in the image management file PIN is changed. The order of the position where the image file is associated from the head of the corresponding sound as it is is represented.

  In this way, in this voice cape format, it is possible to search for the corresponding position of the representative image of each business folder and the sound of each bookmark image based on the image management file PIN. In addition, when the audio file and the image file of each bookmark image associated therewith are stored in the same folder (business folder), the data is taken into an external personal computer and viewed with Explorer. In addition, it is easy to recognize the relationship between the audio file and the image file, and as a result, the user can be prevented from deleting the audio file and the image file by mistake.

(2) Configuration of the message folder editing system 40 according to the present embodiment (2-1) Configuration of the message folder editing system 40 FIG. 9 shows various settings for the IC recorder 1 with a camera, and messages. 1 shows a business folder editing system 40 configured to allow a personal computer 1 to add or copy a folder or view or edit a business folder stored in the IC recorder with camera 1. The business folder editing system 40 is configured by connecting the IC recorder with camera 1 and the personal computer 41 via a USB cable.

  The personal computer 41 is a general-purpose computer installed in a general home. As shown in FIG. 10, the CPU 50, a ROM 51 storing various programs, a RAM 52 as a work memory of the CPU 50, and a hard disk storing various application software. The apparatus 53, an image processing unit 54 that performs predetermined signal processing on image data, an audio processing unit 55 that performs predetermined signal processing such as digital / analog conversion processing on audio data, an interface 56, and a USB connector 57 are buses. A main body 59 is configured by being connected to each other via 58. A keyboard 60 and a mouse 61 are connected to the interface 56, a display 62 is connected to the image processing unit 54, and a speaker 63 is connected to the audio processing unit 55.

  Further, the hard disk device 53 is installed with what is recorded on a CD-ROM from the manufacturer of the IC recorder 1 with camera, or is downloaded from the homepage of the manufacturer through a network such as the Internet as described above. Application software having a function of viewing or editing a business folder (hereinafter referred to as a business folder editing application) is stored.

  When the activation command for the application for editing the business folder is input by operating the keyboard 60 or the mouse 61, the CPU 50 reads the business folder editing application from the hard disk device 53 and expands it in the RAM 52.

  Further, the CPU 50 thereafter controls the image processing unit 54 as necessary based on the application for editing the business folder and the user's operation, so that various GUIs (Graphical) such as a main window 70 (FIG. 11) as described later are used. User Interface) is displayed on the display 62, and if necessary, communication with the IC recorder 1 with camera connected via the USB connector 57 is performed, so that the message folder with the camera IC recorder 1 is communicated. The file data and the file data of the management file MSF described above with reference to FIG. 7 are read and written, and various settings are made for the camera-equipped IC recorder 1 according to the user operation.

  Further, when the CPU 50 reads the file data of the business folder or the file data of the management file MSF from the IC recorder 1 with camera, if necessary, the image file data of the corresponding bookmark image in the business folder (hereinafter referred to as “file data”). This is referred to as image file data), or given management data based on the file data of the management file is provided to the image processing unit 54, whereby the image and management information based on the image file data and management data are displayed on the display 62. Displayed at the corresponding position in the GUI. Further, the CPU 50 gives the audio processing unit 55 the file data (hereinafter referred to as audio file data) of the audio file in the business folder read from the IC recorder 1 with the camera as necessary, and thereby the audio file. A sound based on the data is output from the speaker 31.

(2-2) Configuration of Main Window 70 Here, the CPU 50 communicates with the IC recorder 1 with the camera via the USB cable 42 when starting the application for editing the business folder, thereby managing the file MSF (FIG. 7). 11 is read from the camera-equipped IC recorder 1 and thereafter the image processing unit 54 is controlled based on the file data of the management file MSF, so that the main window 70 as shown in FIG. Display.

  The main window 70 includes a toolbar 71, an IC recorder information display unit 72, a personal computer information display unit 73, a thumbnail display unit 74, and a player unit 75. The toolbar 71 includes "file" and "edit". And the item name of the content that can be performed by this application for editing the business folder such as “display” and the icon of the content are displayed.

  Then, the user can display a predetermined setting window (not shown) on the main window 70 by clicking on the icon 71A associated with the IC recorder setting function displayed on the toolbar 71, Various settings of the camera-equipped IC recorder 1 can be performed using this setting window.

  The IC recorder information display unit 72 includes a device selection combo box 80, a remaining amount display field 81, a folder information display field 82, and a requirement folder display field 83, and the IC recorder 1 with camera read from the IC recorder 1 with camera. And the model name of the IC recorder 1 with camera are displayed at the top, and the remaining recordable time of the IC recorder 1 with camera is displayed in the remaining amount display field 81.

  Further, in the IC recorder information display section 72, each folder ("FOLDER1" in FIG. 6) set in the camera-equipped IC recorder 1 based on the file data of the management foil MSF (FIG. 7) read from the IC recorder 1 with camera. ”To“ FOLDER 4 ”) and the number of business folders stored in the folder are listed in the folder information display field 82.

  In the IC recorder information display section 72, by selecting a desired folder from the folders displayed in the folder information display field 82 by operating the mouse, each message folder stored in the folder is selected. Predetermined information such as the folder name, recording date and time, and recording time can be displayed in a list in the message folder display field 83 in text format.

In the IC recorder information display section 72, the setting at this time is changed, so that the list is displayed in the folder information display field 82 of the IC recorder information display section 72 as shown in FIG. It is also possible to display thumbnail images P _{10 to} P ₁₂ of representative images of the respective business folders registered in the processed folder in the business folder display field 83 as a list.

The user can select one desired message folder by operating the mouse from the message folders whose text information or thumbnail images P _{10 to} P ₁₂ are displayed in the message folder display field 83. . When one message folder is selected, the thumbnail images P _{20 to} P ₂₃ of each bookmark image in the message folder are displayed in the thumbnail display portion 74 together with the time code of the recorded sound associated with the bookmark image. Listed.

  At this time, in the upper part of the player section 75, the user name set in the business folder, the file name of the business folder selected as described above, the recording date and time of the business folder, and the usage The current playback time of all the recording times in the subject folder is displayed.

  Further, when one message folder is selected as described above, a basic operation button group 90 including a plurality of buttons 90A to 90J for performing various basic operations provided in the lower part of the player unit 75 is displayed in an active manner. Is done. Thus, the user clicks the play button 90A, the stop button 90B, the fast forward play button 90C, or the fast reverse play button 90D in the basic operation button group 90 that is actively displayed, so that the message folder is displayed on the personal computer 41. , Stop the playback, execute fast forward playback that repeats playback for 3 seconds, for example, 20 seconds fast forward, or fast reverse playback that repeats playback for 3 seconds, for example, 20 seconds fast backward Can be executed.

  The basic operation button group 90 is provided with other easy search buttons 90E and 90F, bookmark jump buttons 90G and 90H, and item switching buttons 90I and 90J. Of these, the easy search buttons 90E and 90F are clicked. Thus, with respect to the message folder being played on the personal computer 41 at that time, a fast-forward easy search for fast-forwarding by 10 seconds and returning to the playback operation or a fast-rewinding easy search for returning by 3 seconds and returning to the playback operation can be executed. it can.

  By clicking the bookmark jump buttons 90G and 90H, the playback position of the message folder being played on the personal computer 41 can be jumped to the time code position associated with the previous or next bookmark image, By clicking the message switching buttons 90I and 90J, the message folder to be reproduced can be switched to the previous or next message folder displayed in the message folder display field 83 of the IC recorder information display section 72.

Note that in the main window 70, by double-clicking the desired thumbnail image _P 20 _{to P 22} from the thumbnail images _P 20 _{to P 22} that is displayed in the thumbnail display section 74, a corresponding message folder personal computer 41, the thumbnail images P _{20 to} P ₂₂ can be reproduced from the associated audio position. Thus, the user can quickly access a desired position of the corresponding business folder based on the thumbnail images P _{20 to} P ₂₂ displayed in the thumbnail display unit 74.

  On the other hand, a playback slider bar 91 is provided on the right side of the basic operation button group 90. When one message folder is selected as described above, the first, center of the audio file included in the message folder is selected. The last time code is displayed along the playback slider bar 91 on the lower side. When the message folder is being reproduced on the personal computer 41, the slider 91A is displayed so as to sequentially move rightward in accordance with the current reproduction position.

  Further, a bookmark-shaped mark (hereinafter referred to as a bookmark) 92 is displayed on the upper side of the playback slider bar 91 so as to correspond to the time code position associated with each bookmark image in the message folder. .

When the message folder is played, when the slider 91 has passed the time code position associated with any bookmark 92 (that is, the playback position of the audio folder has passed the time code position associated with any bookmark image). The bookmark 92 is highlighted in red, for example, and the bookmark 92 (the bookmark image associated with the time code) of the thumbnail images P _{20 to} P ₂₂ displayed on the thumbnail display unit 74 is displayed. ) And the corresponding thumbnail images P _{20 to} P ₂₂ are highlighted so as to be surrounded by a red frame, and the time code displayed below the thumbnail images P _{20 to} P ₂₂ is highlighted, for example, in red. Thus, the user can easily recognize the current playback position as viewed from the whole based on the highlighting.

Further, at this time, a picture window 93 provided on the right side of the reproduction slider bar 91 has a thumbnail associated with the highlighted bookmark 92 among the thumbnail images P _{20 to} P ₂₂ displayed on the thumbnail display unit 74. The original bookmark image of the images P _{20 to} P ₂₂ (that is, the bookmark image associated with the time code of the audio folder) is displayed.

  In this case, the picture window 93 can be enlarged and displayed in a state separated from the main window 70 as shown in FIG. 13 by clicking the enlargement button 93A displayed at the upper right of the picture window 93. Can be visually confirmed in more detail. The enlarged picture window 94 can be reduced and displayed at the original position as shown in FIG. 11 by clicking the close button 94A displayed at the upper right of the picture window 94.

  Further, in the middle part of the player unit 75, there are provided a mute button 95 for turning on / off the volume during the playback of the message folder, various operation buttons such as a volume setting slider bar 96, and several slider bars. By clicking and dropping and dragging these, corresponding functions can be exhibited.

  Further, an edit button 97 is provided on the rightmost side of the middle part of the player unit 75, and by clicking this edit button 97, a predetermined edit window (not shown) can be displayed on the main window 70 in an overlapping manner. it can. Thus, the user can use this editing window to perform editing operations such as changing the position where each bookmark image is associated with the recorded audio based on the audio file in the currently selected business folder. it can.

  On the other hand, the personal computer information display unit 73 includes a folder information display field 100 and a file information display field 101. In the folder information display column 100, the folder structure of each folder in the personal computer 41 is hierarchically displayed. One folder designated by a user operation from each folder displayed in the folder information display column 100 is displayed. Of each file stored in the folder, information such as the file name and creation date and time of a sound file in a predetermined format that can be handled by the application for editing the business folder is displayed in the file information display column 101.

  In the main window 70, one business folder is selected from each business folder displayed in the business folder information display field 83 of the IC recorder information display section 72, and the folder of the personal computer information display section 73 is selected. By selecting one folder from each of the folders displayed in the information display field 100 and then clicking the save button 102 displayed between the IC recorder information display unit 72 and the personal computer information display unit 73, the camera The file data of the business folder selected in the IC recorder information display unit 72 is read from the attached IC recorder 1 and a copy thereof is stored in the folder in the personal computer 41 selected in the personal computer information display unit 73. it can.

  On the contrary, in the main window 70, one audio file is selected from each audio file displayed in the file information display field 101 of the personal computer information display unit 73, and the folder of the IC recorder information display unit 72 is selected. By selecting one folder from each folder displayed in the information display field 82 and then clicking the add button 103 displayed between the IC recorder information display section 72 and the personal computer information display section 73, the personal information is displayed. The file data of the audio file selected in the computer information display unit 73 can be transferred to the IC recorder 1 with camera and stored in the flash memory 29 (FIG. 4) in the IC recorder 1 with camera. At this time, in the IC recorder 1 with the camera, the file data of the audio file is stored in a state stored in a newly created business folder in the folder selected in the IC recorder information display unit 72, and the management file is accordingly The file data of the MSF (FIG. 7) is updated.

  On the other hand, when the user clicks the simple player button 71B displayed on the toolbar 71 of the main window 70, a simple player window 110 as shown in FIG. 14 is displayed instead of the main window 70 displayed at that time. 62 can be displayed.

  The simple player window 110 includes a player unit 111 and an image display unit 112. A message folder information display unit 120 is provided on the upper left side of the player unit 111, and the message folder information display unit 120 The user name of the message folder selected at that time, the folder name of the message folder, and the time code of the current playback time are displayed.

  Further, on the right side of the message folder information display unit 120 in the player unit 111, corresponding operation buttons among various operation buttons such as a mute button 95 displayed in the middle of the player unit 75 of the main window 70 (FIG. 11). In addition, various operation buttons each having the same function as a corresponding slider bar among a number of slider bars such as a slider bar 96 for setting a volume, an operation button including a slider bar, and a slider bar group 121 are provided.

  Further, a play button having the same function as the corresponding button in the basic operation button group 90 displayed at the lower right of the player unit 75 of the main window 70 is provided below the message folder information display unit 120 in the player unit 111. A basic operation button group 122 including 122A, a stop button 122B, easy search buttons 122C and 122D, bookmark jump buttons 122E and 122F, and item switching buttons 122G and 122H is displayed. As a result, in the simple player window 110, by clicking a button in the basic operation button group 122, the message folder selected at that time can be reproduced on the personal computer 41.

  Further, a playback slider bar 123 having the same function as the playback slider bar 91 of the player unit 75 of the main window 70 is displayed on the right side of the basic operation button group 90 in the player unit 111. On the upper side of the playback slider bar 123, bookmarks 124 are displayed at the time code positions associated with the respective bookmark images in the currently selected business folder. When the message folder is played back, when the slider 123A has passed the time code position associated with one of the bookmarks 124, the bookmark 124 is highlighted in red, for example.

  At this time, the image display unit 112 displays a bookmark image associated with the highlighted bookmark 124 in the message folder. The image display unit 112 can be displayed or not displayed by clicking the image display switching button 125 displayed on the upper right of the simple player window 110.

  Further, the simple player window 110 can always be displayed in front or released by clicking the display switching button 126 displayed on the upper right of the simple player window 110.

  In this way, in the requirement folder editing system 40, the requirement file stored in the IC recorder with camera 1 can be freely reproduced not only by the main window 70 but also by the simple player window 110. Has been made.

(2-3) Message folder playback processing procedure RT
Here, the CPU 50 (FIG. 10) of the personal computer 41 executes the process for reproducing the message folder selected in the main window 70 (FIG. 11) as described above according to the message folder reproduction process procedure RT shown in FIG. .

  That is, the CPU 50 selects one business folder in the business folder display field 83 of the IC recorder information display section 72 of the main window 70 or switches the business folder in the basic operation button group 90 of the player section 75 of the main window 70 thereafter. When the buttons 90I and 90J are clicked, this message folder reproduction processing procedure RT is started in step SP0, and in the subsequent step SP1, the camera-equipped IC recorder 1 connected at that time is accessed and the corresponding use is made. The file data of all image files in the file folder and the file data of the image management file PIN (FIG. 8) and the message entry of the message folder in the management file MSF (FIG. 7) (“Message Entry” in FIG. 7) Read the data.

Subsequently, the CPU 50 proceeds to step SP2 to generate image data of thumbnail images of each bookmark image based on the file data of each image file in the message folder acquired in step SP1, and this is generated as an image processing unit. 54 (FIG. 10), the thumbnail images P _{20 to} P ₂₂ are displayed in the thumbnail display portion 74 of the main window 70. At this time, based on the image management file PIN in the business folder acquired in step SP1, the CPU 50 records the time of the recorded sound in which the bookmark image is associated with the thumbnail images P _{20 to} P _22. Display the code.

Further, in this step SP2, the CPU 50 displays predetermined information on the message file on the upper part of the player section 75 of the main window 70 based on the message entry data of the message file acquired in step SP1. At the same time, the CPU 50 sets a time code below the playback slider bar 91 of the player unit 75 based on the message entry data of the message file acquired in step SP1 and the file data of the image management file PIN. At the same time, the bookmark 92 is displayed at the corresponding position on the upper side of the reproduction slider bar 91 so as to correspond to the bookmark images P _{20 to} P ₂₂ .

Then CPU50 proceeds to step SP3, any of the thumbnail images _P 20 _{to P 22} that is displayed in the thumbnail display section 74 of the main window 70 is double-clicked, the bookmark jump button Basic operation button group 90 of the player section 75 It waits for 90G and 90H to be clicked or for the playback button 90A of the basic operation button group 90 to be clicked.

  Then, when such an operation is input, the CPU 50 proceeds to step SP4, accesses the IC recorder 1 with camera connected via USB, and stores the file data of the audio file in the currently selected business file. Read one or more frames from the corresponding audio position.

Note that the appropriate sound position in this case, the thumbnail images P ₂₀ to P which is the double-click when one of the thumbnail images P ₂₀ to P ₂₂ that is displayed in the thumbnail display section 74 of the main window 70 is double clicked _When the bookmark jump buttons 90G and 90H of the basic operation button group 90 of the player unit 75 are clicked, the bookmark immediately before or after the bookmark image currently displayed in the picture window is clicked. When the playback button 90A of the basic operation button group 90 is clicked, the voice position to which the slider 91A of the playback slider bar 91 is pointing is referred to.

  Then, the CPU 50 gives the audio processing unit 55 (FIG. 10) the file data of the audio file for one or a plurality of frames starting from the corresponding audio position read from the IC recorder 1 with the camera as described above. Let the playback process. As a result, sound based on the file data of this sound file is output from the speaker 63.

  Then, the CPU 50 proceeds to step SP5, determines whether or not the current reproduction position matches the time code associated with any bookmark image, and proceeds to step SP8 when a negative result is obtained.

  On the other hand, when the CPU 50 obtains a positive result in step SP5, the CPU 50 proceeds to step SP6, and provides the image processing unit 54 with image data based on the file data of the corresponding image file acquired in step SP1, thereby causing the picture window. The bookmark image displayed in 93 is switched to the corresponding bookmark image.

The CPU50 proceeds to the following step SP7, the thumbnail images _{P 20} and corresponding switching bookmark image in step SP6 of the thumbnail images _P 20 _{to P 22} that is displayed in the thumbnail display section 74 of the main window 70 and the time code displayed in to P ₂₂ and the lower thereof with the bookmark image and corresponding bookmark 92 of each bookmark 92 is displayed above the playback slider bar 91 of the player unit 75 of the main window 70 The image processing unit 54 is controlled to highlight each of them.

  Thereafter, the CPU 50 proceeds to step SP8, where the stop button 90B of the basic operation button group 90 displayed on the player unit 75 of the main window 70 is clicked, or finishes reproducing the audio file being reproduced at the end. It is determined whether or not.

  If the CPU 50 obtains a negative result in step SP8, it returns to step SP4, and thereafter repeats the loop of step SP4 to step SP8-step SP4 until it obtains a positive result in step SP8.

  If the CPU 50 eventually obtains an affirmative result in step SP8, it proceeds to step SP9 to control the audio processing unit 55 (FIG. 10) to end the reproduction process, and then returns to step SP4 and thereafter the same. Repeat the process.

  In this way, the CPU 50 reproduces the message file selected by the user operation among the message files stored in the camera-equipped IC recorder 1.

  Even when the simple player window 110 is used, the CPU 50 performs a reproduction process on the message file selected by the user operation from the message files saved in the camera-equipped IC recorder 1 in the same manner. To do.

(3) Operation and effect of the present embodiment In the above configuration, in the business folder editing system 40, any one of the audio files included in the business folder when the business folder selected by the user is played back. While the sound position associated with the bookmark image is sequentially switched at the timing of reproduction, the bookmark image associated with the sound position (time code) is the picture of the picture window 93 in the main window 70 or the image of the simple player window 110. It is displayed on the display unit 112.

  Therefore, in the message folder editing system 40, the user can intuitively understand the content of the current playback sound based on the bookmark image displayed on the picture window 93 in the main window 70 or the image display unit 112 of the simple player window 110. Therefore, by using the bookmark image displayed on the picture window 93 in the main window 70 or the image display unit 112 of the simple player window 110, it is possible to easily search for a desired audio part. .

  In the business folder editing system 40, the thumbnail image of each bookmark image included in the business folder selected as the reproduction target and the time code associated with the bookmark image are displayed in the thumbnail display section 74 of the main window 70. Since it is displayed in a list, it is possible to intuitively recognize the overall flow of audio content based on these thumbnail images and time codes, and the search operation for a desired audio portion can be further facilitated. it can.

  According to the above configuration, when playing the business folder, the bookmark image corresponding to the current playback position of the audio file is displayed while being sequentially switched, so that the content of the current playback audio is based on the bookmark image. Can be intuitively recognized by the user, thus realizing a business folder editing system that can facilitate the recognition of the audio content and the search for the desired audio portion.

(4) Other Embodiments In the above-described embodiment, the case where the present invention is applied to the personal computer 41 constituting the business folder editing system 40 has been described. However, the present invention is not limited to this. The present invention can be widely applied to playback apparatuses that play back sound information in which image information is associated with one or more sound positions.

  In the above-described embodiment, the personal computer 41 and the camera-equipped IC recorder 1 are connected via the USB cable 42 so that the personal computer 41 and the camera-equipped IC recorder 1 are stored in the camera-equipped IC recorder 1 as described above. However, the present invention is not limited to this. For example, the flash memory 29 of the camera-equipped IC recorder 1 can be freely attached and attached to the personal computer 41, so that The business file stored in the flash memory 29 may be played back.

  Further, in the above-described embodiment, the case where the main window 70 as a GUI for inputting various commands is configured as shown in FIG. 11 is described, but the present invention is not limited to this, and various other types are also provided. The configuration of can be widely applied.

  Further, in the above-described embodiment, a case has been described in which bookmarks displayed on the upper side of the playback slider bar 91 are each formed in a bookmark shape corresponding to the audio position associated with each bookmark image. The mark form can be widely applied.

Further, in the above-described embodiment, when the message 91 is played back, when the slider 91 of the playback slider bar 91 passes the time code position associated with any bookmark 92, the bookmark 92 is displayed in red. while, enclose the thumbnail images _P 20 _{to P 22} corresponding to the bookmark 92 of the thumbnail images _P 20 _{to P 22} that is displayed in the thumbnail display section 74 with a red frame, under the thumbnail images _P 20 _{to P 22} In the above description, the time codes displayed on the side are displayed in red so that they are highlighted. However, the present invention is not limited to this, and various other display methods can be used as the highlighting method. Can be widely applied.

  INDUSTRIAL APPLICABILITY The present invention can be widely applied to a reproduction apparatus that reproduces audio information in which an image is associated with one or a plurality of audio positions, in addition to a business folder editing system corresponding to an IC recorder with camera.

It is a perspective view which shows the external appearance structure of the IC recorder with a camera by this Embodiment. It is a perspective view which shows the external appearance structure of the IC recorder with a camera by this Embodiment. It is a perspective view which shows the external appearance structure of the IC recorder with a camera by this Embodiment. It is a block diagram which shows the internal structure of the IC recorder with a camera by this Embodiment. It is a top view which shows the structure of a message folder selection screen. It is a conceptual diagram which shows the directory structure of a voice cape format. It is a conceptual diagram which shows the data structure of a business folder management file. It is a conceptual diagram which shows the data structure of an image management file. It is a basic diagram which shows the structure of the business file editing system by this Embodiment. It is a block diagram which shows the structure of a personal computer. It is a top view which shows the structure of a main window. It is a top view which shows the other structure of an IC recorder information display part. It is a top view which shows a mode that the picture window was expanded and displayed. It is a top view which shows the structure of a simple player window. It is a flowchart which shows a message file reproduction | regeneration processing procedure.

Explanation of symbols

1 ... IC recorder with camera, 24, 50 ... CPU, 29 ... Flash memory, 40 ... Message file editing system, 41 ... Personal computer, 60 ... Keyboard, 61 ... Mouse, 62 ... Display 63 63 Speaker 70 Main window 74 Thumbnail display 90 90 122 Basic operation button group 90A 122A Play button 91 123 Play slider bar 92 124 ... Bookmark, 93, 94... Picture window, 110... Simple player, 112... Image display unit, P _{20 to} P ₂₂ .. Thumbnail image, RT.

Claims (3)

Of the audio information in units of time to record the end of the recording start point, the image presentation means for displaying a list of related Tagged images on one or more sound position in the audio information of the selected object,
Mark presenting means for marking a portion corresponding to one or a plurality of audio positions in the audio information to be selected in the reproduction time axis,
Reproduction position changing means for changing the position of the slider that can move the reproduction time axis corresponding to the reproduction position in the audio information to be selected to the audio position of the mark attached to the front and rear with reference to the current position;
Highlighting means for highlighting the mark and the image associated with the audio position of the mark when the slider passes through the marked part;
A reproducing apparatus. Image presentation means, of the voice information in units of time to record the end of the recording start point, first to list the related Tagged images on one or more sound position in the audio information for the selected object Steps,
A second step in which the mark presenting means puts a mark on a portion of the reproduction time axis corresponding to one or more audio positions in the audio information to be selected ;
The reproduction position changing means changes the position of the slider that can move the reproduction time axis corresponding to the reproduction position in the audio information to be selected to the audio position of the mark that is attached before and after the current position as a reference. 3 steps,
A fourth step in which highlighting means highlights the mark and the image associated with the audio position of the mark when the slider has passed the portion marked with the mark;
A reproduction method comprising: For the computer,
Of the audio information in units of time to record the end of the recording start time, it displays a list of the related Tagged images on one or more sound position in the audio information of the selected object,
Marking a portion corresponding to one or a plurality of audio positions in the audio information to be selected on the reproduction time axis,
Changing the position of the slider that can move the reproduction time axis corresponding to the reproduction position in the audio information to be selected to the audio position of the mark attached to the front and rear with reference to the current position;
A program for executing highlighting of the mark and an image associated with the sound position of the mark when the slider passes through the portion with the mark .

Images