JP4876736B2 - Document camera device - Google Patents

Description

  The present invention relates to a document camera apparatus that includes a camera that captures a document such as an original or a document and displays an image captured by the camera on a display device.

  A camera device that captures a document printed on paper, a document such as a drawing or a photograph, or a three-dimensional object, and displays the captured image on a screen or display is called a document camera (document camera).

  A document camera device generally includes a camera for photographing a document, a stand that supports the camera and is movable up and down and left and right so that a subject can be photographed from a suitable angle, and a projector that captures image data obtained by photographing. And an interface for sending to the display. For example, even if the document is not read in advance on a PC or the like before the meeting, it is possible to project the image on the screen by photographing with a document camera device and taking it in.

  There has also been proposed a document camera device having a function of storing an image once captured by a camera and stored in a computer (see, for example, Patent Document 1).

JP 2005-79727 A

However, since voice data such as a speaker's speech made while an image was displayed could not be stored in association with the image, even a document camera having a function that can store image data is displayed. There is a problem that it is impossible to reproduce and listen to the explanation sound corresponding to the image data.
Further, even a document camera that can store captured image data has a problem of wastefully consuming the capacity of the storage device unless only the necessary image data is stored by detecting a change in the image. ing.

  The present invention has been made in view of the above circumstances, and an object thereof is to provide a document camera device that faithfully reproduces the state of a conference and facilitates understanding of the content of the conference.

In order to achieve such an object, a document camera device of the present invention is a document camera device that captures image data for projection projected on a screen, and sequentially inputs the image data to be captured, and the image data that is sequentially input The image data having a change in the image is detected by comparing the two images, and the timing at which the image data is detected is detected as the switching timing at which the projection image data projected on the screen is switched, and the image a detecting means for storing the image data in the storage means in the change, an audio input means for capturing the voice of the speaker as a voice data, the divided speech data in accordance with the detected switching timing of said detection means, and division dividing means for storing the audio data in the storage means, and image data with a change in the image, the divided An audio data divided by the stage, the association means image data having the change in the image is stored in the storage means to create a file which associates the voice data inputted while it is projected on the screen And the detection means extracts the image feature quantity of the image data, and compares the image feature quantity with the image feature quantity of the immediately preceding image data, thereby obtaining the image data having a change in the image. And detecting means extracts at least one of an image color histogram, a color distribution, a uniform number of image patterns, a number of pixels, a pixel array, and an edge number of the image as the image feature amount. characterized in that it.
As described above, according to the present invention, since the captured image data and the utterance to the image data are associated with each other and stored in the storage unit, the sound data can be reproduced while displaying the image data. Accordingly, the state of the meeting can be faithfully reproduced, and the contents of the meeting can be easily understood.
Further, the detection means extracts at least one of an image color histogram, a color distribution, the number of image patterns with uniform density, the number of pixels, the pixel array, and the number of edges of the image as the image feature amount. Therefore, it is possible to accurately detect a change in the image.

The document camera device of the present invention is a document camera device that captures image data for projection projected on a screen, and sequentially inputs the image data to be captured, and compares the images of the sequentially input image data. The image data having a change is detected, the timing at which the image data is detected is detected as a switching timing at which the projection image data projected on the screen is switched, and the image data having a change in the image is detected. Detection means to be stored in the storage means, voice input means for capturing the voice of the speaker as voice data, and the voice data is divided according to the switching timing detected by the detection means, and the divided voice data is stored in the storage means. Dividing means for storing, image data having a change in the image, and audio data divided by the dividing means And an association unit that creates a file associated with the audio data input while the image data having a change in the image is projected on the screen and stores the file in the storage unit, and the detection unit Is characterized in that the text information extracted from the image data is compared with the text information extracted from the immediately preceding image data to detect image data having a change in the image.
  As described above, according to the present invention, since the captured image data and the utterance to the image data are associated with each other and stored in the storage unit, the sound data can be reproduced while displaying the image data. Accordingly, the state of the meeting can be faithfully reproduced, and the contents of the meeting can be easily understood.
In addition, the detecting means compares the text information extracted from the image data with the text information extracted from the immediately preceding image data, and detects the image data having a change in the image, thereby accurately detecting the change in the image. can do.

The document camera device further includes first photographing means for photographing the projection image data, and the detection means detects an operation input from an operation means that instructs the first photographing means to perform photographing, and performs the switching. It is good to detect timing.
Therefore, since the image switching timing is detected by the input from the operating means, it is possible to accurately associate the audio data with the image data.

The document camera apparatus further includes a first photographing unit that photographs the projection image data, and the detection unit detects whether or not a material is arranged at a photographing position of the first photographing unit. The switching timing may be detected by inputting a signal from the means.
Accordingly, it is possible to accurately detect a change in the image.

The document camera device may include a reproduction control unit that reads out the image data having a change in the image and the divided audio data associated with the image data from the storage unit and reproduces the data. .
Accordingly, it is possible to reproduce the state of the conference by reproducing the image data and the audio data associated with the image data.

The document camera apparatus includes a second photographing unit that photographs a state of a speaker or a meeting room and stores the photographed image data, and the association unit includes image data photographed by the second photographing unit; A file in which the image data having a change in the image is associated with the audio data divided by the dividing unit may be created and stored in the storage unit.
Accordingly, it is possible to reproduce the material used in the conference and the speech of the speaker with respect to the material, and to allow the user to recognize the speaker or the conference room during the conference.

The document camera device includes a thumbnail creating unit that creates a thumbnail image of the captured image data and stores the created thumbnail image in the storage unit, and the association unit changes the thumbnail image and the image It is preferable to create a file in which the image data that is the image data that is the source of the thumbnail image and the audio data divided by the dividing unit are associated with each other and stored in the storage unit.
Therefore, it is possible to display thumbnail images and reproduce image data and audio data associated with the selected thumbnail image.

In the document camera device, character recognition means for extracting text information from captured image data, and storing each morpheme of the text information obtained by performing morphological analysis on the text information in the storage means; and the voice input Speech recognition means for performing speech recognition processing on the speech data input by the means to extract text information, and storing each morpheme of the text information obtained by performing morpheme analysis on the text information in the storage means; The association means includes search means for storing the morpheme in the storage means in association with the image data or voice data in which the morpheme is detected, and searching the storage means for image data or voice data including a search word. Good.
Therefore, it is possible to detect desired image data and audio data by inputting a search term.

  According to the present invention, it is possible to provide a document camera device that faithfully reproduces the state of a conference and facilitates understanding of the content of the conference.

  Preferred embodiments of the present invention will be described with reference to the accompanying drawings.

First, the configuration of the document camera 1 of this embodiment will be described with reference to FIG.
As shown in FIG. 1, the document camera 1 according to the present embodiment supports a first image input unit (first photographing unit) 2 such as a camera and the first image input unit 2, and allows a document serving as a subject to be viewed from a suitable position. It has a flexible arm 3 that operates in the XYZ directions so that it can shoot, and a stand 4 on which a document that is a subject is placed. Further, the document camera 1 includes a microphone terminal 8 to which a microphone 9 can be connected. Further, a projector device 10 that displays an image photographed by the first image input unit 2 on a screen or the like can be connected to the document camera 1.

Next, a more detailed configuration of the document camera 1 will be described with reference to FIG.
As shown in FIG. 2, the document camera 1 includes a first image input unit 2, an image processing unit 21, a recording start / end operation unit 22, an audio input unit 9, a reproduction control information input unit 23, and registration data. A display unit 24, a shooting instruction operation unit 25, and an image / audio recording / reproducing unit 30 are provided.

  The first image input unit 2 includes, for example, an image sensor such as a CCD, and a lens mechanism that forms an image of the material on the stand 4 on the image sensor. The lens mechanism includes a zoom lens mechanism that includes a plurality of lenses and has a variable imaging magnification. The image data captured by the image sensor is sent to the image processing unit 21.

  The image processing unit 21 converts the format of the image data (analog data) captured by the first image input unit 2 into digital data. In addition, the image processing unit 21 performs image processing such as distortion correction and tilt correction as necessary, and transfers the processed image data to the projector device 10 connected to the document camera 1. The projector device 10 projects the image data supplied from the document camera 1 onto a screen (not shown).

An imaging instruction operation unit (corresponding to the operation means of the present invention) 25 is an operation unit that instructs the first image input unit 2 to capture an image. When the photographing instruction operation unit 25 is operated, an operation signal is input from the photographing instruction operation unit 25 to an image acquisition unit 31 described later. The image acquisition unit 31 recognizes the shooting timing of the image data based on the operation signal from the shooting instruction operation unit 25.
The recording start / end operation unit 22 is an operation unit for instructing the image / sound recording / reproducing unit 30 to start and end the capturing of images and sounds. The reproduction control information input unit 23 is an operation unit for performing a reproduction operation of images and sounds recorded in the image / sound recording / reproducing unit 30. The recording start / end operation unit 22, the reproduction control information input unit 23, and the shooting instruction operation unit 25 are configured by a control panel 7 provided on the stand 4 of the document camera body.
FIG. 3 shows an example of the control panel. The control panel 7 of this embodiment has an image / audio recording button 71 for instructing the image / audio recording / reproducing unit 30 to capture image data and audio data, and an image for instructing the first image input unit 2 to shoot an image. A button 72 and a playback button 73 that functions as the playback control information input unit 23, buttons for rewind 76, fast forward 77, pause 75, and stop 74 are provided. In addition, a menu display button 78, a zoom setting button 79, and the like are provided.

  The voice input unit 9 is a microphone that inputs the voice of the speaker. The voice input unit 9 may be built in the main body of the document camera 1 or may be connected to the main body of the document camera 1 via the microphone terminal 8 as shown in FIG.

  The registered data display unit 24 is for displaying data recorded in the image / sound recording / reproducing unit 30. The registered data display unit 24 includes a liquid crystal display 6 installed on the stand 4 of the document camera body, and displays thumbnail images of images registered in the image / audio recording / reproducing unit 30 (see FIG. 3). .

  Next, details of the image / sound recording / reproducing unit 30 will be described. As shown in FIG. 2, an image / audio recording / reproducing unit 30 includes an image acquisition unit (corresponding to detection means and thumbnail creation means of the present invention) 31, an audio acquisition unit 32, and an association processing unit (of the present invention). 33 (corresponding to association processing means), a reproduction control unit 34, a data storage unit 35, and an image / sound reproduction unit 36 are provided.

  The image acquisition unit 31 receives the image data and the shooting time information of the image data from the image processing unit 21, and detects the switching timing at which the image data projected on the screen is switched. In addition, it is also possible to input an operation signal instructing shooting from the shooting instruction operation unit 25, and the image acquisition unit 31 can detect the switching timing of the image data. When the image acquisition unit 31 detects the switching timing of the image data to be projected on the screen, the image acquisition unit 31 outputs a timing signal to the sound acquisition unit 32 to notify the image acquisition.

  Further, the image acquisition unit 31 generates a thumbnail image of the acquired image data. The image acquisition unit 31 assigns an identifier to the generated thumbnail image and image data, and stores the identifier in the data storage unit 35. The image data is compressed and stored in the data storage unit 35. When the data acquisition unit 31 stores data in the data storage unit 35, the generated identifier (an identifier given to the thumbnail image and the image data), the address of the data storage unit 35, and the image data acquired from the image processing unit 21 are stored. The shooting time information is output to the association processing unit 33.

  The audio acquisition unit 32 inputs audio data from the audio input unit 9 and divides the audio data according to a timing signal indicating the switching timing of the image data. An identifier (referred to as an audio data identifier) is assigned to the divided audio data and stored in the data storage unit 35. Furthermore, the voice acquisition unit 32 outputs the address of the data storage unit 35 that stores the voice data to the association processing unit 33.

  The association processing unit 33 generates an index file for associating image data, thumbnail images, and audio data stored in the data storage unit 35. Hereinafter, the associated image data, thumbnail image, and audio data are referred to as a data set. As shown in FIG. 4, the index file includes a data identifier assigned to each data set, a time (year / month / day) when the data set was generated, a time (hour / minute / second), and a data set obtained in one presentation. A presentation identifier, an image data identifier for identifying image data, an audio data identifier for identifying audio data, a thumbnail identifier for identifying thumbnail images, and the like. In addition, the address of the data storage unit 35 storing image data, the address of the data storage unit 35 storing audio data, and the address of the data storage unit 35 storing thumbnail images are stored.

The association processing unit 33 stores the shooting time information (year / month / day, hour / minute / second) of the image data acquired from the image acquisition unit 31 when storing the identifiers assigned to the image data, thumbnail image, and audio data in the index file. Is also stored in the index file.
In addition, the association processing unit 33 gives a presentation identifier so that a data set obtained in one presentation can be identified. A data set obtained at the beginning of a presentation is given a presentation identifier common to the presentation and Start information indicating the start point of the presentation. In addition, a presentation identifier and End information indicating the end point of the presentation are given to the data set finally obtained in one presentation.

  The reproduction control unit 34 controls reproduction of images and sounds, and executes processing according to instructions input from the reproduction control information input unit 23. Specifically, the instructed identifier (data identifier, presentation identifier, image data identifier, audio data identifier, etc.) is notified to the image / sound playback unit 36, and the image / sound playback unit 36 plays back the image or sound. .

  The image / sound reproduction unit 36 reads out the image data and sound data instructed by the reproduction control unit 34 from the data storage unit 35 and performs expansion processing, and outputs the image data to the projector device 10 and the sound data to the sound output unit 11. To do.

  The document camera 1 according to the present embodiment associates and saves image data obtained by photographing presentation materials and audio data in which a speech at a meeting when the image data is displayed on the screen by the projector device 10 is recorded. Then, when referring to the image data, the associated audio data can be heard.

Therefore, the image acquisition unit 31 inputs image data from the image processing unit 21 and outputs a timing signal to the audio acquisition unit 32 at a predetermined timing (the predetermined timing will be described later). The sound acquisition unit 32 divides the sound data input from the sound input unit 9 in accordance with the timing signal output from the image acquisition unit 31. The divided audio data is not the image data projected on the screen, but the audio data in which the utterances discussed about the image data projected on the screen before that image are input, so the image data being projected Is recorded in association with the image data taken immediately before.
The image data identifier is assigned to the image data by the image acquisition unit 31, and the audio data identifier is assigned to the audio data by the audio acquisition unit 32. The image acquisition unit 31 outputs the generated image data identifier to the association processing unit 33 in the order of generation. Similarly, the voice acquisition unit 32 outputs the generated voice data identifier to the association processing unit 33 in the order of generation. The association processing unit 33 creates an index file by associating the image data identifier input from the image acquisition unit 31 with the audio data identifier input from the audio acquisition unit 32.

  In addition, the speaker of the presentation often adjusts the position or direction of the material on the stand 4 or focuses it so that the material can be easily viewed. Furthermore, marking or writing may be performed on the material with a pen, or a certain part on the material may be pointed. By such an operation, a large number of unnecessary images may be extracted as “change images”. In order to exclude such an image, the image acquisition unit 31 extracts an image that has changed with respect to the immediately preceding image from the image data sequentially input from the image processing unit 21. Alternatively, a temporal threshold value may be set so that only images that have not changed for a certain period of time may be extracted. At this time, the image acquisition unit 31 outputs a timing signal indicating that a changed image has been input to the sound acquisition unit 32. When receiving the timing signal from the image acquisition unit 31, the audio acquisition unit 32 delimits the audio data input from the audio input unit 9.

Next, the processing procedure of the image acquisition unit 31 will be described with reference to the flowchart shown in FIG.
When the image processing unit 21 outputs the image data (presentation is started and the first input image data is hereinafter referred to as reference image data) and the shooting time information of the image data to the image acquisition unit 31 ( In step S1), the image acquisition unit 31 outputs a timing signal to the audio acquisition unit 32 to notify the acquisition of image data (step S2). The image acquisition unit 31 extracts the feature amount of the acquired image data (step S3). The extracted feature quantity includes a color histogram, a color distribution, a uniformity pattern, the number of pixels and their arrangement, the number of edges, and the like. Further, the image acquisition unit 31 generates a thumbnail image of the acquired image data (step S4).

  Next, the image acquisition unit 31 assigns identifiers to the acquired image data and the generated thumbnail image, and stores the image data and the thumbnail image in the data storage unit 35 (step S5).

  Next, the image acquisition unit 31 outputs the shooting time information of the reference image data, the identifier of the image data and the thumbnail image, and the address of the data storage unit 35 storing these data to the association processing unit 33 ( Step S6).

  When the next image data (hereinafter, this image data is referred to as comparison target image data) is input (step S7 / YES), the image acquisition unit 31 extracts the feature amount of the acquired comparison target image data (step S7). S8). Then, the feature amount extracted from the reference image data is compared with the feature amount extracted from the comparison target image data (step S9). If there is a difference greater than a preset allowable range between the two (step S9 / NO), the image acquisition unit 31 determines that the comparison target image data is a changed image candidate (hereinafter referred to as a changed image candidate). . When the change image candidate is detected, the image acquisition unit 31 starts comparison between the change image candidate and the comparison target image data sequentially input from the image processing unit 21 (step S11).

  In order to prevent operations such as position adjustment and focusing from being detected as a change image, only images that have not changed for a predetermined time (for example, 4 seconds) are detected from the images extracted as “change image candidates” ( Step S12). When image data that has not changed for a predetermined time or longer is detected, the image acquisition unit 31 outputs a timing signal to the audio acquisition unit 32 (step S13). Further, this image data is set to “change image” (an image in which the image has changed), and the image acquisition unit 31 creates a thumbnail of the change image (step S14). Then, the image acquisition unit 31 assigns an identifier to the change image data and the thumbnail image of the change image data, and compresses the change image data. The image acquisition unit 31 stores the compressed change image data and thumbnails in the data storage unit 35 (step S15). Further, the image data detected as the change image, the identifier of the thumbnail image, the shooting time information, and the address of the data storage unit 35 storing the data are output to the association processing unit 33 (step S16). Further, the detected change image is compared with the image data input from the image processing unit 21 as the next reference image data (step S17).

  In step S12, if comparison target image data having a feature amount difference equal to or greater than a threshold value is detected within a predetermined time (step S12 / NO), the change image candidate image data is discarded and the reference image is discarded. The comparison between the data and the comparison target image data is resumed (step S18). In step S7, if the comparison target image data is not input even after a predetermined time has elapsed (step S19 / YES), it is determined that one presentation has been completed, and the process is terminated.

  In this way, by capturing only the image data in which the feature amount of the data has changed, unnecessary image data need not be stored, and the capacity of the data storage unit 35 is not wasted.

Note that there are various methods other than those described above as the method for extracting the change image.
First, text information can be extracted from image data by OCR (Optical Character Reader), and a change image can be extracted by determining the number of characters, character size, and character matching.
Second, a photo sensor (corresponding to the second detection means of the present invention) may be provided in the document placement area 5 on the stand 4 to record the switching of materials and the timing thereof.
Thirdly, the immediately following image can be extracted as a change image based on an operation signal input by zooming or marker display performed by the user.
Fourthly, when the user gives an instruction to shoot a material by operating the shooting instruction operation unit 25, the image acquired by the first image input unit 2 may be acquired by the image acquisition unit 31.
Moreover, you may use combining the method described above.

  The association processing unit 33 rewrites the index file stored in the data storage unit 35 based on the information acquired from the image acquisition unit 31 and the sound acquisition unit 32. The association processing unit 33 performs a process of adding a new entry table to the index file read from the data storage unit 35 and writing necessary data as shown in FIG. The rewritten index file is stored in the data storage unit 35.

Next, reproduction of the acquired image data and audio data will be described.
In the document camera of this embodiment, thumbnail display of image data stored in the data storage unit 35 is possible. By selecting a thumbnail image from the control panel 7, full screen display of corresponding image data, audio reproduction, Is possible.
Operations such as playback start, playback end, pause, rewind, and fast forward can be performed by operating buttons on the control panel 7. The thumbnails and images are displayed on the liquid crystal display 6 above the main unit stand 4, but can be displayed on these display devices if the projector or display is connected to the document camera 1.

Next, display of thumbnail images will be described. When the user selects a predetermined button on the control panel 7 or a predetermined button displayed on the liquid crystal display 6, the reproduction control unit 34 reads the index file from the data storage unit 35. Then, by referring to the time (year / month / day) of the index file, the latest material stored in the data storage unit 35 is detected. The reproduction control unit 34 reads out the thumbnail image of the latest material from the data storage unit 35 and causes the registered data display unit 24 to display the thumbnail image.
In the example of the liquid crystal display 6 shown in FIG. 3, the upper left thumbnail is in a selectable state. The user operates the control panel 7 to enable selection of a thumbnail for which an image is to be displayed. In addition, even when the display of the thumbnails registered with the same presentation identifier is completed, if no image data is selected, the reproduction control unit 34 next selects a new material and displays this thumbnail image.

  When a predetermined button is operated while the thumbnail image is in a selected state, the reproduction control unit 34 reads out the identifier of the image data and audio data corresponding to the selected thumbnail from the index file. The playback control unit 34 notifies the identifier information to the image / sound playback unit 36. The image / sound reproduction unit 36 reads out the image data and the sound data of the identifier notified from the reproduction control unit 34 from the data storage unit 35, develops them, outputs the image data to the display device 10, and outputs the sound data to the sound. To the unit 11. When the reproduction of one set of image data and audio data is completed, image data and audio data that are registered with the same presentation identifier and are one time newer than the reproduced image data and audio data are read. The read image data is output to the display device 10, and the audio data is output to the audio output unit 11.

In the first embodiment described above, the image of the presentation material placed on the stand 4 and the voice of the corresponding speaker are recorded and reproduced.
However, this information alone does not tell who the speaker is, who was participating in the conference at that time, and in which conference room the conference was held.
Therefore, in this embodiment, in addition to image data and audio data, a photograph of a face of a speaker or a participant in a conference, a state of a meeting room is captured, and the captured image is associated with a document image or audio data to store data 35. Then, the face images of the speaker and the conference participant can be displayed together when reproducing the document image and the sound.

The configuration of this embodiment is shown in FIG. As shown in FIG. 6, in the present embodiment, in addition to the first image input unit 2 that photographs the material placed on the stand 4, a second image that photographs a speaker, a conference participant, a conference room, and the like. An input unit 40 is provided.
A plurality of second image input units 40 may be installed to shoot different subjects (speaker and venue), or a tripod may be used without fixing the camera to the arm. In addition, the conference participant may take a picture with a camera as the second image input unit 40.

Further, in this embodiment, a photographing timing control unit 37 is newly provided as shown in FIG. The shooting timing control unit 37 manages the shooting timing of the second image input unit 40. The shooting timing of the shooting timing control unit 37 may be at regular time intervals as shown in FIG. 8, or a time schedule is set in the shooting timing control unit 37, and shooting is performed according to this time schedule. Also good.
Further, the image may be taken after a certain time after the change image is extracted from the photographed image of the first image input unit 2, or may be photographed when a change appears in the sensor value using various sensors. . For example, a sound volume sensor can be provided to take a picture when a sound volume above a certain level is detected. The image data photographed by the camera of the second image input unit 40 and the photographing time information may be stored in a storage area inside the second image input unit 40 and may be taken into the document camera 1 later. It is also possible to transfer and save the document camera 1 in real time using radio.

  FIG. 9 shows an index file created by the association processing unit 33. A data set indicated by diagonal lines in FIG. 9 indicates image data captured by the second image input unit 25. The same presentation identifier as that of the data set of the image data taken by the first image input unit 2 and its thumbnail image and the audio data input by the audio input unit 9 is given and registered in the index file.

  In this embodiment, the data set generated by the document camera 1 can be distributed to the user terminal 70 at a remote location via the network. The configuration of this embodiment is shown in FIG. This embodiment further includes a URL (Uniform Resource Locator) allocation unit 38, a data acquisition unit 39, a data distribution unit 50, and a network IF unit 51, as shown in FIG.

  The URL assignment unit 38 assigns a URL (server name, port number, folder name, file name, etc.) to the image data acquired by the image acquisition unit 31. The assigned URL information is stored in the index file by the association processing unit 33.

  The data distribution unit 50 is connected to the user terminal 70 via the network interface unit 51, and outputs a data acquisition request input from the user terminal 70 to the data acquisition unit 39. The data acquisition unit 39 reads the instructed image data, audio data, and index data from the data storage unit 35 in accordance with a request from the data distribution unit 50, and outputs it to the data distribution unit 50. The data distribution unit 50 collects the acquired image data, audio data, and index data into one distribution data file and distributes it to the requesting user terminal 70.

  When the user terminal 70 acquires the distribution data file from the document camera 1, the user terminal 70 activates an application program to display an image and reproduce sound.

  In this embodiment, the document camera 1 is equipped with a Web server function. The user accesses the document camera 1 by specifying a URL from an Internet browser installed on the user terminal 70.

When the document camera 1 accepts access from the user terminal 70, the document camera 1 returns the HTML top screen designated by the data distribution unit 50 to the browser and displays it.
On the HTML top screen displayed on the user terminal 70, thumbnails of stored images are displayed. When the user selects a desired thumbnail from the displayed thumbnails, selection information is sent from the data distribution unit 50 to the data acquisition unit 39. The data acquisition unit 39 accesses the data storage unit 35 and extracts image data, audio data, and index data paired with the selected thumbnail. Desired image data, audio data, and index data are transferred to the data distribution unit 50, collected into one distribution data file, and transferred to the client terminal. The processing in the data acquisition unit 39 can be realized by a CGI (Common Gateway Interface) program.

  When a large number of image data and audio data are stored in the data storage unit 35, it may be difficult to find data to be viewed simply by displaying a list of thumbnails and files. Therefore, in this embodiment, desired image data and audio data can be efficiently found by keyword search.

  The configuration of this embodiment is shown in FIG. As shown in FIG. 11, in this embodiment, the character recognition unit 60 performs character recognition processing on the image data acquired by the image acquisition unit 31 and extracts text information. Further, morphological analysis is performed on the extracted text information to separate the text information into morphemes.

  The voice recognition unit 61 performs voice recognition processing on the voice data acquired by the voice acquisition unit 32, and extracts text information. Further, morphological analysis is performed on the extracted text information to separate the text information into morphemes.

  The association processing unit 33 registers morphemes of image data and audio data in the index file. Note that the morpheme extracted from the image and the morpheme extracted from the sound may be distinguished and registered in the index file. This makes it possible to perform a keyword search that distinguishes between image and audio information sources.

  FIG. 12 shows an interface screen displayed on the user terminal 70 by keyword search. The interface screen shown in FIG. 12 includes an input field for inputting a keyword, a check box for selecting whether the search target data is an image only, an audio only, or both an image and an audio, and a search Results and are displayed. When image data including a keyword is detected as a result of the search, a thumbnail image of the image data is displayed as the search result. When only audio data is searched, data such as conference ID, recording date and time, and recording location may be displayed. In addition, the type of detected data may be displayed. That is, it is displayed whether both image data and audio data have been detected, whether only image data has been detected, or only audio data has been detected.

  The embodiment described above is a preferred embodiment of the present invention. However, the present invention is not limited to this, and various modifications can be made without departing from the scope of the present invention.

1 is a diagram illustrating an external appearance of a document camera according to Embodiment 1. FIG. FIG. 3 is a functional block diagram illustrating a detailed configuration of the document camera according to the first exemplary embodiment. It is a figure which shows the structure of a control panel and a liquid crystal display. It is a figure which shows the structure of the index file of Example 1. FIG. 4 is a flowchart illustrating a processing procedure of an image acquisition unit 31. 6 is a diagram illustrating an appearance of a document camera according to Embodiment 2. FIG. 6 is a diagram illustrating a detailed configuration of a document camera according to Embodiment 2. FIG. It is a figure which shows the image recording timing of a 1st image input part and a 2nd image input part. It is a figure which shows the structure of the index file of Example 2. FIG. FIG. 10 is a diagram illustrating a detailed configuration of a document camera according to a third embodiment. FIG. 10 is a diagram illustrating a detailed configuration of a document camera according to a fourth embodiment. It is a figure which shows an example of the interface screen displayed on a user terminal.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Document camera 2 Image input part 3 Flexible arm 4 Stand 5 Original installation area 6 Liquid crystal display 7 Control panel 8 Microphone terminal 9 Microphone 10 Display apparatus 21 Image processing part 22 Recording start / end operation part 23 Playback control information input part 24 Registration data Display unit 25 Shooting instruction operation unit 31 Image acquisition unit 32 Audio acquisition unit 33 Association processing unit 34 Playback control unit 35 Data storage unit 36 Image / audio playback unit 37 Shooting timing control unit 38 URL assignment unit 39 Data acquisition unit 40 Second image Input section

Claims (8)

A document camera device for photographing image data for projection projected on a screen,
The image data to be photographed are sequentially input, the images of the sequentially input image data are compared to detect image data having a change in the image, and the timing at which the image data is detected is determined for the projection projected on the screen. Detecting means for detecting the switching timing when the image data is switched, and storing the image data having a change in the image in a storage means ;
Voice input means for capturing the voice of the speaker as voice data;
Dividing means for dividing the audio data according to the switching timing detected by the detection means, and storing the divided audio data in the storage means ;
And image data with a change in the image, an audio data divided by said dividing means, the file in which the image data having the change in the image associated with the audio data inputted while it is projected on the screen And an associating means for creating and storing in the storage means ,
The detection means detects image data having a change in the image by extracting an image feature amount of the image data and comparing the image feature amount with an image feature amount of the immediately preceding image data,
The detecting means extracts at least one of an image color histogram, a color distribution, the number of image patterns with uniform density, the number of pixels, a pixel array, and the number of edges of the image as the image feature amount. A document camera device. A document camera device for photographing image data for projection projected on a screen,
The image data to be photographed are sequentially input, the images of the sequentially input image data are compared to detect image data having a change in the image, and the timing at which the image data is detected is determined for the projection projected on the screen. Detecting means for detecting the switching timing when the image data is switched, and storing the image data having a change in the image in a storage means ;
Voice input means for capturing the voice of the speaker as voice data;
Dividing means for dividing the audio data according to the switching timing detected by the detection means, and storing the divided audio data in the storage means ;
And image data with a change in the image, an audio data divided by said dividing means, the file in which the image data having the change in the image associated with the audio data inputted while it is projected on the screen And an associating means for creating and storing in the storage means ,
The document camera apparatus characterized in that the detecting means compares text information extracted from image data with text information extracted from the immediately preceding image data, and detects image data having a change in the image . First imaging means for imaging the projection image data;
3. The document camera device according to claim 1, wherein the detection unit detects an operation input from an operation unit that instructs the first photographing unit to perform photographing, and detects the switching timing. First imaging means for imaging the projection image data;
The detection means detects the switching timing by inputting a signal from a second detection means for detecting whether or not a material is arranged at the photographing position of the first photographing means. 3. The document camera device according to 1 or 2 . And image data having the change in the image, associated with the image data, divided and audio data read out from said memory means, from claim 1, characterized in that it comprises a reproduction control means for reproducing 4 The document camera device according to claim 1. The second photographing means for photographing the state of the speaker and the conference room and storing the photographed image data ,
The associating means creates a file in which the image data photographed by the second photographing means, the image data having a change in the image, and the audio data divided by the dividing means are associated with each other in the storage means. 6. The document camera device according to claim 1, wherein the document camera device stores the document camera. A thumbnail creating unit for creating a thumbnail image of the captured image data and storing the created thumbnail image in the storage unit ;
The associating means creates a file associating the thumbnail image, the image data having a change in the image, the image data from which the thumbnail image is created, and the audio data divided by the dividing means. document camera apparatus according to any one claim of 6 claim 1, characterized in that to be stored in the storage means Te. Character recognition means for extracting text information from the captured image data and storing each morpheme of the text information obtained by performing morphological analysis on the text information in the storage means;
Speech recognition means for performing speech recognition processing on speech data input by the speech input means to extract text information , and storing each morpheme of the text information obtained by performing morpheme analysis on the text information in the storage means; Have
The association means stores the morpheme in the storage means in association with image data or audio data in which the morpheme is detected,
Search word document camera apparatus of claims 1, wherein 7 to any one claim of having a search unit image data or the sound data retrieved from said storage means comprises a.

Images