JP4183231B2 - Image processing server, control method therefor, program, image processing system, and terminal - Google Patents

Description

BACKGROUND OF THE INVENTION
The present invention relates to an image processing server connected to a terminal via a communication line, a control method thereof, a program, a storage medium, and an image processing system.
[0001]
[Prior art]
Systems that distribute video by operating a video camera via the Internet are known. In addition, a mechanism for displaying a moving image in an MPEG format or the like distributed via the Internet on a personal computer and cutting out a still image from the displayed moving image is also known. In the capture of still images, taking into account the time lag of pressing the capture designation button (shutter button), a technology that displays several image frames before the time when the shutter is pressed and selects the desired frame from them Is also known.
[0002]
[Problems to be solved by the invention]
In the MPEG format, since the difference information of the moving part is distributed, it is extremely difficult to capture a still image therefrom. In addition, Motion JPEG includes a complete compressed frame, but the file size is larger than MPEG.
[0003]
For this reason, high-resolution video, for example, about 2000 × 1200 to 4000 × 2400 and high-resolution video (for example, high-definition video) of about 30 frames per second, even if the video is compressed, has a bandwidth even on a line of about 100 Mbps. Run short. For example, high-definition IP transmission requires a bandwidth of 1.5 Gbps when uncompressed (2001/10/29, NTT announcement). For this reason, for example, a low-resolution video of about 160 × 100 to 720 × 480 dots can only be distributed, and when enjoying the video as it is, the still image itself can withstand viewing even if the still image is cut out from the video. I didn't get it.
[0004]
In particular, for example, there was no mechanism suitable for an application such as cutting out a bromide of a favorite musician from a live image of a concert or the like and capturing a still image on his own PC (personal computer). For use in such bromides, printing output on paper of A4 or A3 or higher is expected, and a high-resolution digital camera (2800 × 2200, about 6 million pixels) or higher resolution (for example, This is because a still image having the same quality as that of a case of shooting at about 5000 × 3600, about 18 million pixels approaching a silver halide film is required.
[0005]
Also, for example, if you do not need a resolution similar to bromide, for example, if you want to take a small size photo for use in a sports highlight scene to be put on a newspaper or an in-house newsletter or a tourist brochure There was a problem that the cost increased because it was necessary to send a specialized photographer to take a picture.
[0006]
Still cameras have certain restrictions on the shooting interval, so shooting with the optimum shutter timing is not always possible. For this reason, if the editor who uses the photo does not like the image taken by the photographer, even if he tries to dispatch again at a tourist spot, the season may change and it will not be possible to shoot until next year. There was a problem that re-shooting was not possible.
[0007]
  The present invention has been made in view of the above-described problems, and distributes a low-resolution moving image to a terminal, specifies an extraction timing, and transmits timing information to the image processing server side. To cut out a still image from a high-resolution video, send the high-resolution still image to the terminal without imposing a burden on the communication line,In particular, the bookmark part is specified on the terminal side, the low resolution image of the bookmark part is extracted and transmitted in response to the playback request of the bookmark part on the image processing server side, and the video is played back on the terminal side while playing the video of the bookmark part. It is possible to cut out a desired still image efficientlyThe first object is to provide an image processing server.
[0008]
In addition, by distributing a medium resolution moving image to a terminal via a high-speed line, specifying a cutout timing, and transmitting timing information to the image processing server, the image processing server cuts out a still image from the medium resolution moving image, A second object of the present invention is to provide an image processing server capable of efficiently creating a printed matter combining an image and text in cooperation with a print layout creation system.
[0009]
[Means for Solving the Problems]
  Image processing according to the present invention to achieve the above objectsystemHas the following configuration. That is,
  An image processing system in which a terminal and an image processing server are connected via a communication line,
  The image processing server
    A first video storage means for storing the first video;
    Second video storage means for storing a second video that is lower in resolution than the first video and created based on the first video;
    Distribution means for distributing the second video stored in the second video storage means to the terminal based on a request from the terminal;
    In response to the first timing information indicating the extraction timing of the moving image of the bookmark designated portion received from the terminal and the reproduction request for the moving image of the bookmark designated portion received from the terminal, the second moving image storage means From the stored second moving image, a moving image of the bookmark specified portion starting from a timing that is a predetermined time later than the first timing information is extracted, and the extracted moving image of the bookmark specified portion is extracted to the terminal. Bookmark moving image transmitting means for transmitting an image;
    Received from the terminal, Second timing indicating the extraction timing of the still image cut out from the bookmark moving image of the specified portionAccording to the timing information, the first moving image storage meansFrom the first video stored inStill imageimageStill imageimageExtraction means and
  With
  The terminal
    Playback means for playing back the second moving image received from the image processing server;
    First timing designating means for designating first timing information indicating a timing for extracting a moving image of a bookmark designated portion during reproduction of the second video;
    Request means for transmitting a moving image reproduction request of the bookmark specified portion to the image processing server;
    A second timing indicating a timing for cutting out a still image from the moving image of the bookmark specified portion transmitted from the image processing server in response to the reproduction request;timinginformationSpecifysecondTiming designation means,
    SaidsecondSpecified by timing specification meansSecondTransmitting means for transmitting timing information to the image processing server;
  Is provided.
[0010]
  Also preferably,The image processing server
    In accordance with the timing information received from the terminal, further comprising a second distribution means for cutting out a screen display still image from the second video distributed by the distribution means and distributing it to the terminal,
    When the information indicating that the specific still image for screen display is selected from the terminal among the still images for screen display distributed from the second distribution means, the still image extracting means A still image is cut out from the first moving image stored in the first moving image storage means based on the timing information corresponding to the still image for screen display.
[0011]
  Also preferably,The image processing server
    The apparatus further includes moving image conversion means for converting the first moving image stored in the first moving image storage means into the second moving image.
  Also preferably,The moving image conversion means converts the first moving image stored in the first moving image storage means into the second moving image based on a request from the terminal.
[0012]
  In order to achieve the above object, an image processing server according to the present invention comprises the following arrangement. That is,
  An image processing server connected to a terminal via a communication line,
  A first video storage means for storing the first video;
  Second video storage means for storing a second video that is lower in resolution than the first video and created based on the first video;
  Distribution means for distributing the second video stored in the second video storage means to the terminal based on a request from the terminal;
  In response to the first timing information indicating the extraction timing of the moving image of the bookmark designated portion received from the terminal and the reproduction request for the moving image of the bookmark designated portion received from the terminal, the second moving image storage means From the stored second moving image, a moving image of the bookmark specified portion starting from a timing that is a predetermined time later than the first timing information is extracted, and the extracted moving image of the bookmark specified portion is extracted to the terminal. Bookmark moving image transmitting means for transmitting an image;
  Received from the terminal, Second timing indicating the extraction timing of the still image cut out from the bookmark moving image of the specified portionAccording to the timing information, the first moving image storage meansFrom the first video stored inStill imageimageStill imageimageExtraction means and
  Is provided.
[0013]
  In order to achieve the above object, a method for controlling an image processing server according to the present invention comprises the following arrangement. That is,
  A method of controlling an image processing server connected to a terminal via a communication line,
  A first moving image storing step of storing the first moving image in a first storage medium;
  A second moving image storing step of storing a second moving image having a lower resolution than the resolution of the first moving image and created based on the first moving image in a second storage medium;
  A distribution step of distributing the second moving image stored in the second storage medium to the terminal based on a request from the terminal;
  Stored in the second storage medium in response to the first timing information indicating the extraction timing of the moving image of the bookmark designated portion received from the terminal and the reproduction request for the moving image of the bookmark designated portion received from the terminal. The moving image of the specified bookmark portion is extracted from the second moving image extracted from the first timing information at a timing that is a predetermined time earlier, and the extracted moving image of the specified bookmark portion on the terminal. A bookmark moving image transmission process for transmitting
  Received from the terminal, Second timing indicating the extraction timing of the still image cut out from the bookmark moving image of the specified portionAccording to timing information, the first storage mediumFrom the first video stored inStill imageimageStill imageimageExtraction process
  Is provided.
[0014]
  In order to achieve the above object, a terminal according to the present invention comprises the following arrangement. That is,
  A terminal connected to an image processing server via a communication line,
  Playback means for playing back a moving image received from the image processing server;
  First timing designating means for designating first timing information indicating the extraction timing of a moving image of a bookmark designated portion during reproduction of the video;
  Request means for transmitting a moving image reproduction request of the bookmark specified portion to the image processing server;
  A second timing indicating a timing for cutting out a still image from the moving image of the bookmark specified portion transmitted from the image processing server in response to the reproduction request;timinginformationSpecifysecondTiming designation means,
  SaidsecondSpecified by timing specification meansSecondTransmitting means for transmitting timing information to the image processing server;
  Is provided.
[0015]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, a first embodiment of the present invention will be described in detail with reference to the drawings.
In each of the following drawings, a push button for screen transition or the like may be omitted for easy explanation.
First, FIG. 1 is a diagram showing a system configuration in an embodiment of the present invention.
[0016]
The image processing server 100, the client A 110, the client B 120, and the printing apparatus 130 are connected to each other via a communication line 150. The image processing server 100 is a so-called PC server or Unix server, and may be a high-performance personal computer (for example, a 64-bit PCI bus, a high-speed SCSI disk, a high-clock dual CPU, etc.) with a built-in large-capacity hard disk. good.
[0017]
The client A 110 and the client B 120 are terminals such as personal computers, PDAs, and mobile phones. The client A 110 is used for inputting moving images and image search information. The client B 120 is used for inputting a moving image search condition, specifying a still image cut-out timing, and the like.
[0018]
The printing apparatus 130 is typically a color laser beam printer or an ink jet printer, and may be a color printer of any kind, and may be a color digital printing machine.
[0019]
The communication line 150 is a so-called communication network realized by any one of the Internet, an intranet, a dedicated digital line, an ADSL line using a telephone line, a satellite line, a cable TV line, a data broadcasting wireless line, or a combination thereof. . The communication line 150 only needs to be able to transmit and receive data, and the communication means from the client 110 to the image processing server 100 and the communication means from the image processing server 100 to the printing apparatus 130 may be different.
[0020]
FIG. 2 is a diagram illustrating a hardware configuration of the image processing server 100 according to the embodiment of the present invention.
[0021]
In FIG. 2, a CPU 21, a RAM 22, a ROM 23, a LAN adapter 24, a video adapter 25, a keyboard 26, a mouse 27, a hard disk 28 and a CD-ROM drive 29 are connected to each other via a system bus 20. The system bus 20 means, for example, a PCI bus, an AGP bus, a memory bus, and the like.
Further, in FIG. 2, a chip for connecting between buses, a keyboard interface, and an input / output interface such as a so-called SCSI or ATAPI are omitted.
[0022]
The CPU 21 performs various operations such as four arithmetic operations and comparison operations and hardware control based on an operation system program and an application program. The RAM 22 stores an operation system program, an application program, and the like read from a storage medium such as a CD-ROM or CD-R mounted in the hard disk 28 or the CD-ROM drive 29, and these are controlled by the CPU 21. Performed originally.
[0023]
The ROM 23 stores a so-called BIOS that manages input / output to / from a hard disk or the like in cooperation with the operation system. The LAN adapter 24 communicates with the outside through a network in cooperation with an operation system communication program controlled by the CPU. The video adapter 25 generates an image signal to be output to the display device, and the keyboard 26 and the mouse 27 are used for inputting an instruction to the image processing server.
[0024]
The hard disk 28 stores various data such as operation system, application program, timing information received from the client 110, high-resolution video data and low-resolution video data, temporary files used when executing the application program, and client application programs. ing.
[0025]
The CD-ROM drive 29 is used for installing a storage medium such as a CD-ROM, CD-R, or CD-R / W and installing an application program on the hard disk 28. Needless to say, a CD-R drive, CD-R / W drive, DVD-RAM drive, DVD-RW drive, MO drive, or the like may be used instead of the CD-ROM drive.
[0026]
FIG. 3 is a diagram illustrating a hardware configuration of the client A 110 and the client B 120 according to the embodiment of this invention.
A so-called browser program is installed in the client A 110 and the client B 120. 3 is different only in reference numerals for distinction from the image processing server 100 (for example, the CPU 21 in FIG. 2 corresponds to the CPU 31 in FIG. 3), and detailed description thereof is omitted.
[0027]
Next, FIG. 4 is a flowchart showing image search information and moving image registration processing according to the embodiment of the present invention.
[0028]
At the start of the flowchart of FIG. 4, the session between the client A 110 and the image processing server 100 has been established, and the authentication with the user ID and password has been completed, and the display screen of the client A 110 is transmitted from the image processing server 100. It is assumed that the image search information registration screen shown in FIG. 9 is displayed based on the image display information.
It is assumed that a moving image file to be transmitted to the image processing server 100 is stored in the hard disk 38.
[0029]
In the flowchart of FIG. 4, steps S401 to S408 are executed under the control of the CPU 31 of the client A110. Steps S421 to S434 are executed under the control of the CPU 21 of the image processing server 100.
[0030]
First, in step S401, the image genre, sub-genre, performer, nationality of performer, shooting location (country), shooting location (place name), and free keyword are registered on the image search information registration screen shown in FIG. Technical data such as the shooting date, shooting time, resolution, image format, and frame rate of the moving image is included in the moving image data itself at the time of shooting and does not normally need to be corrected.
[0031]
However, it may be possible to make corrections manually, and when the resolution is changed, a moving image resolution changing function for changing the moving image to a designated resolution may be further provided. In this case, when the resolution is specified to be higher than the resolution of the original image, the resolution may be increased by complementary processing (such as smoothing) by software after transmission to the image processing server 100.
[0032]
When the change of the image format is designated, the image format is changed after transmission to the image processing server 100. When an image format that cannot be converted is designated, a message such as “cannot be converted to the designated format” is transmitted from the image processing server 100 to the client A 110.
[0033]
When the “Register” button at the lower left of the screen is pressed on the screen of FIG. 9, the process proceeds to step S <b> 402, and the input image search information is transmitted to the image processing server 100 via the communication line 150.
[0034]
Next, in step S <b> 421, the image processing server 100 receives the image search information and stores it in the RAM 22 and also stores it in the work file on the hard disk 28.
[0035]
In step S422, the received image search information is registered in the hard disk 28. The hard disk 28 further stores a parameter conversion check table. Before the registration of the image search information, the presence / absence of the change specification of the image format and the change specification of the resolution and the contents thereof are checked. In the next step S423, a warning message is transmitted to the client A110 instead of the completion message.
[0036]
For example, if the resolution is specified to be twice or more of the original video, or an image format that cannot be converted is specified, for example, "The resolution of the original image is 720 x 480. Please change to a specification that is twice or less." Or a warning message such as “Cannot be converted to an image file of this format” is transmitted to the client A 110.
[0037]
In step S423, the image processing server 100 sends to the client A 110 a message indicating that the registration of the image search information has been completed. Then, please send the image. Display information is sent.
[0038]
In step S403, the client A 110 receives screen display information including a completion message. In step S404, a moving image file name is designated, and the moving image file stored in the hard disk 38 is transmitted to the image processing server 100 via the communication line 150.
In step S424, the image processing server 100 receives the moving image file and stores it in the primary file of the hard disk 28.
[0039]
In step S425, it is determined whether there is a resolution conversion designation based on the image search information stored in the RAM 22. If there is a resolution conversion designation (Yes in step S425), the process proceeds to step S426, the resolution of the transmitted moving image is converted and stored in a temporary file on the hard disk 28, and the process proceeds to step S427.
[0040]
If there is no resolution conversion designation (No in step S425), the process immediately proceeds to step S427, and it is determined whether there is an image format conversion designation based on the image search information stored in the RAM 22. If there is an image format conversion designation (Yes in step S427), the process proceeds to step S428, the image format of the transmitted moving image is converted and stored in a temporary file on the hard disk 28, and the process proceeds to step S429. .
[0041]
If there is no image format conversion designation (No in step S427), the process immediately proceeds to step S429, and the moving image file stored in the temporary file on the hard disk 28 is associated with the registered image search information. It is registered in a moving image file on the hard disk 28. At this time, an index of image search information is also created.
[0042]
Next, in step S430, a low-resolution moving image (moving image of approximately 160 × 100 to 720 × 480 dots) to be distributed to the client B 120 is generated based on the registered moving image file.
[0043]
Next, in step S431, it is determined whether the registration processing from step S421 to step S430 has been completed normally.
[0044]
If the registration is normally completed (Yes in step S431), the process proceeds to step S432, and display information for causing the client A110 to display a screen including a message indicating that the registration is normally completed is transmitted. In step S405, a screen including a message indicating that registration has been normally completed is displayed on the display unit of the client A110, and the process ends.
[0045]
If the registration has not ended normally (No in step S431), the process proceeds to step S433, and display information for displaying on the client A110 a screen including a warning message indicating that the registration has not been completed normally. Sent. In step S406, a warning message indicating that the registration has not been completed normally, a message indicating whether or not to retransmit, a screen including a retransmit button and an end button are displayed on the display unit of the client A110.
[0046]
In step S407, it is determined that the retransmit button has been pressed. If the button has been pressed (Yes in step S407), the process returns to step S404, and the moving image is transmitted again.
[0047]
If it has not been pressed (No in step S407), the process proceeds to step S408, and cancel information for canceling the registration of the moving image is transmitted to the image processing server 100. In step S434, the image search information corresponding to the received cancellation information is deleted, and the process ends.
[0048]
FIG. 5 is a flowchart illustrating an entire process of distributing a moving image and cutting out a still image while exchanging data via the communication line 150 between the client B 120 and the image processing server 100 according to the embodiment of the present invention.
[0049]
At the start of the flowchart of FIG. 5, the session between the client B 120 and the image processing server 100 has been established, the authentication with the user ID and password has been completed, and the display screen of the client B 120 is transmitted from the image processing server 100. It is assumed that the image search condition input screen shown in FIG. 10 is displayed based on the image display information.
[0050]
In the flowchart of FIG. 5, steps S501 to S515 are executed under the control of the CPU 31 of the client B 120. Steps S521 to S531 are executed under the control of the CPU 21 of the image processing server 100.
[0051]
First, in step S501, when a search condition is input based on the screen display of the client B 120 shown in FIG. 10 and the “search” button at the lower left of the screen is pressed, the input search condition is transmitted via the communication line 150. It is transmitted to the image processing server 100.
[0052]
Next, in step S521, the image processing server 100 performs an index search based on the received image search condition, and display information for displaying the matching image search information and the first frame image of the moving image is the client B120. Sent to. When the client B 120 displays matching image search information and the first frame image of the moving image, and a specific moving image is selected, information for identifying the selected moving image is transmitted from the client B 120 to the image processing server 100. Sent.
[0053]
Next, in step S522, it is determined whether there is an image that matches the image search condition and a specific image file has been selected. If there is an image that matches the image search condition and information for specifying the selected moving image is received (Yes in step S522), the process proceeds to step S524.
[0054]
When a matching image exists and information for specifying the selected moving image has not been received, the image processing server 100 enters a reception waiting state for information for specifying the selected moving image.
[0055]
On the other hand, if there is no image that matches the image search condition (No in step S522), the process proceeds to step S523, and a warning message indicating that there is no image that matches the image search condition is transmitted to the client B120.
[0056]
In step S503, the client B 120 receives this warning message and displays it on the display unit, and the process proceeds to step S502. If there is an input to change the search condition (Yes in step S502), the process returns to step S501, and the image search condition is input again.
[0057]
If there is an input to end the search (No in step S502), the process ends.
[0058]
Step S524 and subsequent steps will be described again. A corresponding low-resolution moving image is selected based on information for specifying a moving image. Note that the low-resolution moving image has already been generated in step S430 described above. However, the present invention is not limited to this, and a low-resolution moving image may be generated on demand in step S524. As a result, a low-resolution moving image is generated only for the requested moving image, and the storage capacity of the hard disk 28 can be saved somewhat.
[0059]
In step S525, the client application program for cutting out the still image stored in the hard disk 28, the program for installing the client application program, and the selected low-resolution moving image are transmitted to the client B 120. The The client application program for extracting a still image may be an independent client program, a so-called browser plug-in, Java, Java script, or the like.
[0060]
In step S504, the client B 120 receives the client application program for extracting a still image, the installation program, and the selected low-resolution moving image.
[0061]
In step S505, an installation program is activated by input to the browser, and it is determined whether a client application program for extracting a still image is already installed in the client B120. For example, it is determined whether or not a low-resolution moving image file is already associated with a client application for extracting a still image that also serves as a moving image reproduction program.
[0062]
If it has already been installed (Yes in step S505), the process proceeds to step S507, where the client application having a screen as shown in FIG. 11 is activated, and the low-resolution moving image is reproduced while receiving the moving image. In FIG. 11, there is a moving image display section at the center of the screen, which includes a moving image playback button, a playback stop button, a bookmark start button, a bookmark end button, and the like. The bookmark start button may also serve as the bookmark end button. The bookmark button will be described later.
[0063]
If it has not been installed (No in step S505), the process proceeds to step S506, and a client application for extracting a still image that also serves as a moving image playback program is installed in the client B120 and associated with a low-resolution moving image file. The process proceeds to step S507.
[0064]
Next, when the “shutter” button at the lower right of the screen as shown in FIG. 11 is pressed during reproduction of a low-resolution moving image (Yes in step S508), the process proceeds to step S509. The timing data for extracting a still image is transmitted to the image processing server 100 based on the timing at which the “” button is pressed.
[0065]
The image processing server 100 receives the timing data in step S526 and stores it in the hard disk 28. In step S527, a thumbnail image corresponding to the timing data is extracted and stored in a temporary file on the hard disk 28.
[0066]
As shown in FIG. 11, a still image may be immediately cut out from a low-resolution moving image and displayed on a plurality of still image display units based on the timing when the “shutter” button is pressed. In this case, steps S527 and S528 are not executed on the image processing server 100 side, and steps S510 and S511 are not executed on the client B 120 side.
[0067]
Restore the description. Next, the process proceeds to step S510, where it is determined whether the “STOP” button has been pressed at a certain time interval, or the reproduction of the moving image has been completed due to the reproduction to the end.
[0068]
If the reproduction of the moving image has not ended (No in step S510), the process returns to step S507, and the reproduction is continued. Since the application has already been started, it will not be started again.
[0069]
When the reproduction of the moving image is completed (Yes in step S510), the process proceeds to step S511, and information indicating that a still image corresponding to the timing information specified during the reproduction is requested is transmitted to the image processing server 100.
[0070]
In the image processing server 100, the thumbnail image already extracted in step S527 and stored in the hard disk 28 is transmitted to the client B 120 in step S528. Note that the thumbnail image may be extracted after receiving information requesting a still image.
[0071]
In step S512, thumbnail images as shown in FIG. 12 are displayed on the screen of the display unit of the client B 120. Each thumbnail image is a still image cut out when the shutter button is pressed. For example, after positioning the cursor on the thumbnail image part you want to select, click the left mouse button, and then click the “Select” button at the lower left of the screen. When pressed, a specific thumbnail can be selected.
[0072]
In addition, although not displayed on the screen of FIG. 12, for example, a tick box may be displayed beside each thumbnail image so that a plurality of thumbnails to be selected can be selected. An input field for inputting a number such as 13 or 18 may be displayed there.
[0073]
In step S513, selection information of the selected thumbnail is transmitted to the image processing server 100. In step S529, a still image is cut out from the high-resolution moving image stored in the hard disk 28 based on the received selection information.
[0074]
In step S530, a high-resolution still image is transmitted from the image processing server 100 to the client B 120. In step S531, billing processing is executed based on the resolution of the transmitted high-resolution still image and the number of images.
[0075]
In step S514, the client B 120 receives the transmitted still image. In step S515, a high-resolution still image is displayed on the screen of the display unit as shown in FIG. A so-called scroll bar may be displayed on the right end and the lower end of the high-resolution still image display unit.
[0076]
When the “Save to file” button is pressed on the screen of FIG. 13, a high-resolution still image is stored as a file on the hard disk 38. The case where the “print” button is pressed will be described later.
[0077]
In this embodiment, the still image extraction is executed after receiving the selection information transmitted from the client B 120. However, the present invention is not limited to this, and after the thumbnail image is transmitted in step S528, the selection information Still image extraction may be performed immediately without waiting for reception and stored in a temporary file on the hard disk 28. By processing at such timing, the interval from the selection information reception to the still image transmission can be shortened.
[0078]
This is the end of the description of the flowchart of FIG.
Next, bookmark setting and bookmark portion reproduction processing in the first embodiment of the present invention will be described with reference to FIGS. In the following description, the same parts as those in the flowchart of FIG. 5 are omitted.
[0079]
At the start of the flowchart of FIG. 6, the session between the client B 120 and the image processing server 100 has been established, and the authentication with the user ID and password has been completed. The display screen of the client B 120 is transmitted from the image processing server 100. It is assumed that the image search condition input screen shown in FIG. 10 is displayed based on the image display information.
[0080]
In the flowchart of FIG. 6, steps S601 to S614 are executed under the control of the CPU 31 of the client B 120. Steps S621 to S630 are executed under the control of the CPU 21 of the image processing server 100.
[0081]
Steps S601 to S602 in FIG. 6 correspond to steps S501 to S507 in FIG. Similarly, steps S621 to S622 correspond to steps S521 to S525 in FIG.
[0082]
Similarly, steps S603 to S604 correspond to step S504 in FIG. Steps S605 to S606 correspond to steps S508 to S509 in FIG. Steps S623 to S624 correspond to step S526 in FIG.
[0083]
Further, step S613 to step S614 correspond to step S511 to step S515 in FIG. Steps S629 to S630 correspond to steps S529 to S530 in FIG.
[0084]
The correspondence between the common parts is as described above, and steps S607 to S611 and steps S625 to S628 will be described below.
[0085]
At the time of step S604, a screen as shown in FIG. 14 is reproduced on the display unit of the client B 120, and a low-resolution moving image is reproduced. In FIG. 14, a “bookmark” button for instructing the start time of the bookmark and a “bookmark end” button for instructing the end time of the bookmark are displayed. In step S607, it is determined whether the “bookmark” button or the “bookmark end” button is pressed at regular intervals.
[0086]
When the “bookmark” button or the “bookmark end” button is pressed (Yes in step S607), the process proceeds to step S608, and bookmark data including timing data when the button is pressed is transmitted to the image processing server 100. Is done.
[0087]
In step S625, the image processing server 100 receives the bookmark data. In step S626, the bookmark data is stored in the hard disk 28.
[0088]
Next, when it is determined in step S609 that the reproduction of the moving image has ended (in the case of Yes in step S609), the process proceeds to step S610, and it is determined whether the “bookmark designation portion reproduction” button has been pressed.
[0089]
When the “bookmark designation part reproduction” button is pressed (Yes in step S610), the process proceeds to step S611, and a reproduction request for the bookmark designation part is transmitted to the image processing server 100.
[0090]
On the other hand, if it is not determined in step S609 that the reproduction of the moving image has ended (No in step S609), the process returns to step S604, and the moving image is continuously reproduced.
[0091]
It should be noted that the “bookmark” button and the “bookmark end” button can be combined. In this case, when the “bookmark” button is pressed once, the start time of the bookmark is instructed, and when the “bookmark” button is pressed, the end time of the bookmark is instructed. At this time, as shown in the lower part of FIG. 14, the start time and end time of the bookmark designation may be displayed in the sub-window.
[0092]
Further, when the bookmark button is pressed once, about 5 seconds before and after the bookmark is pressed may be indicated as the start and end of the bookmark, and the time before and after the bookmark may not be the same (for example, the button is pressed). 7 seconds before pressing and 3 seconds after pressing are designated as the start and end of the bookmark.
[0093]
Next, in step S627, the image processing server 100 receives a bookmark specified portion reproduction request, extracts a moving image of the bookmark specified portion based on the corresponding timing data, and moves from the connection point A in step S628 to step S622. Returning, the moving image of the bookmark specified portion is transmitted to the client B 120 and reproduced on the client B 120 side. In the image processing server 100, the moving image of the bookmark designated portion is deleted after transmission, and the timing data is continuously stored.
[0094]
This is the end of the description of FIG. According to this embodiment, if there is a scene suitable for cutting out a still image during playback of a moving image, if the “bookmark” button is pressed at an approximate timing, the moving image of the bookmark specified portion will be collected later. Since an image can be reproduced and a still image can be cut out, viewing through a moving image is only required once, and a still image can be cut out efficiently.
[0095]
Next, the print request process after the still image cutout process according to the first embodiment of the present invention will be described with reference to FIGS.
[0096]
In the flowchart of FIG. 7, steps S701 to S710 are executed under the control of the CPU 31 of the client B120. Steps S721 to S728 are executed under the control of the CPU 21 of the image processing server 100.
[0097]
Steps S701 to S706 in FIG. 7 correspond to steps S601 to S606 in FIG. Steps S707 to S708 correspond to steps S609 and S612 to S613 in FIG. Step S709 corresponds to step S614 in FIG.
[0098]
Steps S721 to S724 in FIG. 7 correspond to steps S621 to S624 in FIG. Steps S725 to S726 correspond to steps S629 and S630 in FIG.
[0099]
In step S710, a screen as shown in FIG. 15 is displayed on the display unit of the client B 120, and a high-resolution still image is displayed on the high-resolution still image display unit at the center of the screen. When a “print” button at the bottom of the screen is pressed, a print request is transmitted to the image processing server 100.
[0100]
Note that the high-resolution still image display unit may display a scroll bar at the left end or the lower end of the screen, or may display a reduced image in which the entire high-resolution image can be seen at once.
[0101]
In step S727, the image processing server 100 receives the print request and generates print information. In step S728, the printing information is transmitted to the printing apparatus 130. The print information includes a print command and print image data.
[0102]
In step S729, after receiving information indicating that the printing has been normally completed from the printing apparatus 130, a charging process is performed based on the print request.
[0103]
The printing apparatus 130 may be in the vicinity of the image processing server 100 or in the vicinity of the client B 120. Further, the print information may be transmitted to the client B 120 and printed from the local printer of the client B 120. In this case, the accounting process is executed at the timing when the message indicating that the print information has been normally transmitted is sent from the client B 120 to the image processing server 100.
[0104]
This is the end of the description of FIG. According to the present embodiment, since printing with charging processing can be performed by a printer in a suitable place, it becomes possible for a production or the like having a copyright of a video such as a concert to sell a still image. .
[0105]
This is the end of the description of the first embodiment of the present invention.
Next, in the second embodiment, an example will be described in which a still image is cut out based on a moving image stored in the image processing server 100 and printed matter data is efficiently created in cooperation with a layout application.
[0106]
The printed matter creation process after the still image cutout process according to the second embodiment of the present invention will be described with reference to FIGS. 8, 15, and 16, focusing on differences from FIG. 7.
[0107]
In the flowchart of FIG. 8, steps S801 to S814 are executed under the control of the CPU 31 of the client B120. Steps S821 to S731 are executed under the control of the CPU 21 of the image processing server 100.
[0108]
Steps S801 to S809 in FIG. 8 correspond to steps S701 to S709 in FIG. Steps S821 to S826 correspond to steps S721 to S726 in FIG. Step S814 corresponds to step S710 in FIG. Step S831 corresponds to steps S727 to S728 in FIG.
[0109]
In step S809 of FIG. 8, the screen shown in FIG. 15 is displayed on the display unit of the client B 120. When the “layout” button at the lower right of the screen in FIG. 15 is pressed, the process proceeds to step S810. In step S810, a small screen for selecting a layout is displayed (not shown). When a layout is selected, information for requesting layout extraction is transmitted to the image processing server 100.
[0110]
In step S827, the image processing server 100 receives information requesting layout extraction, and the layout is extracted. In step S828, the layout application is activated, and display information for displaying the layout on the screen of the client B 120 is transmitted from the image processing server 100 to the client B 120. Next, in step S811, the selected layout is displayed on the screen of the client B 120 as shown in FIG.
[0111]
In step S812, editing operations such as calling and pasting various texts and still images, calling and pasting clips, and the like are performed on the displayed template, and editing information corresponding to the editing operation is transmitted to the image processing server 100. .
[0112]
In step S829, the image processing server 100 creates a temporary file separately from the template in the RAM 22 based on the received editing information, and reflects the editing information in the temporary file. In step S829, the created temporary file is stored in the hard disk 28. Remember.
[0113]
When the “Save” button is pressed on the screen of FIG. 16, a small screen for requesting the name of the created printed matter data is displayed, and information on the name designated by the client B 120 is transmitted to the image processing server 100. The names of 100 temporary files are updated.
[0114]
When the “print” button is pressed on the screen of FIG. 16 (Yes in step S813), the process proceeds to step S814, and a message requesting printing of the generated printed matter data is transmitted to the image processing server 100. In step S831, print information is transmitted to the printing apparatus 130 based on the received print request. This is the end of the process.
[0115]
In this embodiment, the layout application is activated on the image processing server 100 side. However, the present invention is not limited to this, and the layout application may be activated on the client B 120 side to perform layout of the printed matter.
[0116]
Furthermore, it goes without saying that the printed matter includes electronic data as well as physical media such as paper. “Printing” in the case of electronic data corresponds to, for example, output as a PDF file made by Adobe or HTML. The created electronic data may be attached to an e-mail or transmitted as an HTML mail.
[0117]
In the embodiment of the present invention, the image processing server 100 is described on the premise that the image processing server 100 is configured by a single piece of hardware. However, the present invention is not limited to this. Even in the case where the server A that performs the conversion, the server B that performs the search based on the image search information transmitted from the client, and the server C that distributes the low-resolution moving image based on the search result may be configured. Needless to say, it is included in the present invention.
[0118]
By configuring in this way, it is possible to reduce the load per server by distributing the processing and improve the system throughput.
[0119]
An object of the present invention is to supply a storage medium (or recording medium) in which a program code of software that realizes the functions of the above-described embodiments is recorded to a system or apparatus, and the computer (or CPU or CPU) of the system or apparatus. Needless to say, this can also be achieved by the MPU) reading and executing the program code stored in the storage medium.
[0120]
In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the storage medium storing the program code constitutes the present invention.
[0121]
Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an operating system (OS) running on the computer based on the instruction of the program code. It goes without saying that a case where the function of the above-described embodiment is realized by performing part or all of the actual processing and the processing is included.
[0122]
Furthermore, after the program code read from the storage medium is written to the storage medium provided in the function expansion card inserted into the computer or the function expansion unit connected to the computer, the program code is read based on the instruction of the program code. It goes without saying that the CPU of the function expansion card or the function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.
[0123]
Another object of the present invention is to distribute software program codes for realizing the functions of the above-described embodiments via a network, so that a storage means such as a hard disk or a memory of a system or apparatus, a CD-RW or a CD- Needless to say, this can also be achieved by a computer (or CPU or MPU) stored in a storage medium such as R reading and executing the program code stored in the storage means or the storage medium. .
[0124]
【The invention's effect】
According to the first embodiment of the present invention described above, a low-resolution video is distributed to a terminal, a cut-out timing is specified, timing information is transmitted to the image processing server, and a high-resolution video is transmitted on the image processing server side. Therefore, a high-resolution still image can be cut out and sent to a terminal without burdening the communication line, or can be sent to a remote printer for printing. As a result, it is possible to cut out a desired still image from the moving image and obtain an original print of your own.
[0125]
In addition, while playing a video with the bookmark function, it is possible to easily specify a candidate for cropping a still image, so it is possible to efficiently extract still images after playback while enjoying watching a video. Therefore, it is not necessary to reproduce the entire moving image again for the still image cutting operation.
[0126]
Furthermore, according to the second embodiment of the present invention, an image processing server is provided by distributing a medium-resolution moving image to a terminal via a high-speed line, specifying a cut-out timing, and transmitting timing information to the image processing server. A still image can be cut out from a medium-resolution moving image on the side, and a printed matter combining an image and text can be efficiently created in cooperation with a print layout creation system.
[0127]
In the same manner, a still image is cut out from a medium-resolution video, and electronic data having the same layout as a printed matter combining images and text is efficiently created in cooperation with the print layout creation system. It can also be distributed.
[0128]
Further, in the present invention, it is not necessary to store a moving image and a still image separately as images, and the moving image and moving image cut-out timing information can be managed as one, so that the storage device capacity such as a hard disk for storing images and the image Management man-hours can be saved.
[Brief description of the drawings]
FIG. 1 is a diagram showing a system configuration of an image processing system in first and second embodiments of the present invention.
FIG. 2 is a diagram showing a hardware configuration of a server 100 in the first and second embodiments of the present invention.
FIG. 3 is a diagram showing a hardware configuration of a client A 110 and a client B 120 in the first and second embodiments of the present invention.
FIG. 4 is a flowchart showing image search information and moving image registration processing in the first and second embodiments of the present invention.
FIG. 5 is a flowchart showing moving image reproduction and still image extraction processing in the first and second embodiments of the present invention.
FIG. 6 is a flowchart including bookmark setting and bookmark portion reproduction processing according to the first embodiment of the present invention;
FIG. 7 is a flowchart showing a print request process after a still image cutout process according to the first embodiment of the present invention.
FIG. 8 is a flowchart showing printed matter creation processing after still image cutout processing according to the second embodiment of the present invention.
FIG. 9 is a diagram showing a client input screen when registering image search information according to the first and second embodiments of the present invention.
FIG. 10 is a diagram showing a client search condition input screen during image information search processing in the first and second embodiments of the present invention.
FIG. 11 is a diagram showing a display screen of a client at the time of moving image reproduction in the first and second embodiments of the present invention.
FIG. 12 is a diagram showing a display screen of a client when displaying thumbnails in the first and second embodiments of the present invention.
FIG. 13 is a diagram showing a display screen of a client when a still image is displayed in the first and second embodiments of the present invention.
FIG. 14 is a diagram showing a display screen of the client when the bookmark button is pressed in the first embodiment of the present invention.
FIG. 15 is a diagram showing a display screen of a client provided with a layout application cooperation button according to the second embodiment of the present invention.
FIG. 16 is a diagram showing a display screen when editing a printed material layout according to the second embodiment of the present invention.
[Explanation of symbols]
20 System bus
21 CPU
22 RAM
23 ROM
24 LAN adapter
25 Video adapter
26 keyboard
27 mouse
28 hard disk
29 CD-ROM drive
30 System bus
31 CPU
32 RAM
33 ROM
34 LAN adapter
35 Video adapter
36 keyboard
37 mice
38 hard disk
39 CD-ROM drive
100 servers
110 Client A
120 Client B
130 Printing device
150 communication line

Claims (11)

An image processing system in which a terminal and an image processing server are connected via a communication line,
The image processing server
A first video storage means for storing the first video;
Second video storage means for storing a second video that is lower in resolution than the first video and created based on the first video;
Distribution means for distributing the second video stored in the second video storage means to the terminal based on a request from the terminal;
In response to the first timing information indicating the extraction timing of the moving image of the bookmark designated portion received from the terminal and the reproduction request for the moving image of the bookmark designated portion received from the terminal, the second moving image storage means From the stored second moving image, a moving image of the bookmark specified portion starting from a timing that is a predetermined time later than the first timing information is extracted, and the extracted moving image of the bookmark specified portion is extracted to the terminal. Bookmark moving image transmitting means for transmitting an image;
According to the second timing information indicating the extraction timing of the still image cut out from the bookmark moving image of the designated portion received from the terminal, the first moving image stored in the first moving image storage means is stopped. and a still picture image extracting unit for cutting out images,
The terminal
Playback means for playing back the second moving image received from the image processing server;
First timing designating means for designating first timing information indicating a timing for extracting a moving image of a bookmark designated portion during reproduction of the second video;
Request means for transmitting a moving image reproduction request of the bookmark specified portion to the image processing server;
Second timing designating means for designating second timing information indicating a timing for cutting out a still image from a moving image of the bookmark designated portion transmitted from the image processing server in response to the reproduction request ;
Transmitting means for transmitting the second timing information specified by the second timing specifying means to the image processing server;
An image processing system comprising: The image processing server
In accordance with the timing information received from the terminal, further comprising a second distribution means for cutting out a screen display still image from the second video distributed by the distribution means and distributing it to the terminal,
When the information indicating that the specific still image for screen display is selected from the terminal among the still images for screen display distributed from the second distribution means, the still image extracting means A still image is cut out from the first moving image stored in the first moving image storage means based on the timing information corresponding to the still image for screen display
The image processing system according to claim 1. The image processing server
A moving image conversion unit that converts the first moving image stored in the first moving image storage unit into the second moving image;
The image processing system according to claim 1, wherein the image processing system is an image processing system. The moving image conversion means of claim 3, wherein converting the first video stored in the first video storage means based on a request from the terminal to the second video Image processing system. An image processing server connected to a terminal via a communication line,
A first video storage means for storing the first video;
Second video storage means for storing a second video that is lower in resolution than the first video and created based on the first video;
Distribution means for distributing the second video stored in the second video storage means to the terminal based on a request from the terminal;
In response to the first timing information indicating the extraction timing of the moving image of the bookmark designated portion received from the terminal and the reproduction request for the moving image of the bookmark designated portion received from the terminal, the second moving image storage means From the stored second moving image, a moving image of the bookmark specified portion starting from a timing that is a predetermined time later than the first timing information is extracted, and the extracted moving image of the bookmark specified portion is extracted to the terminal. Bookmark moving image transmitting means for transmitting an image;
According to the second timing information indicating the extraction timing of the still image cut out from the bookmark moving image of the designated portion received from the terminal, the first moving image stored in the first moving image storage means is stopped. image processing server, characterized in that it comprises a still picture image extracting unit for cutting out images. In accordance with the timing information received from the terminal, further comprising a second distribution means for cutting out a screen display still image from the second video distributed by the distribution means and distributing it to the terminal,
When the information indicating that the specific still image for screen display is selected from the terminal among the still images for screen display distributed from the second distribution means, the still image extracting means based on the timing information corresponding to the still image of the screen display, the image processing according to claim 5, wherein the cut out still image picture from the first video stored in the first video storage means server. The image processing server according to claim 5 , further comprising a moving image conversion unit that converts the first moving image stored in the first moving image storage unit into the second moving image. The said moving image conversion means converts said 1st moving image memorize | stored in said 1st moving image storage means into said 2nd moving image based on the request | requirement from the said terminal. Image processing server. A method of controlling an image processing server connected to a terminal via a communication line,
A first moving image storing step of storing the first moving image in a first storage medium;
A second moving image storing step of storing a second moving image having a lower resolution than the resolution of the first moving image and created based on the first moving image in a second storage medium;
A distribution step of distributing the second moving image stored in the second storage medium to the terminal based on a request from the terminal;
Stored in the second storage medium in response to the first timing information indicating the extraction timing of the moving image of the bookmark designated portion received from the terminal and the reproduction request for the moving image of the bookmark designated portion received from the terminal. The moving image of the specified bookmark portion is extracted from the second moving image extracted from the first timing information at a timing that is a predetermined time earlier, and the extracted moving image of the specified bookmark portion on the terminal. A bookmark moving image transmission process for transmitting
Received from the terminal, in response to said second timing information indicating an extraction timing of the still image to be cut out from the bookmark moving image designated portion, a still image from said first of said first moving image stored in a storage medium method of controlling an image processing server, characterized in that it comprises a still picture image extraction step of cutting an image. A program for an image processing server connected to a terminal via a communication line,
The image processing server;
A first video storage means for storing the first video;
Second video storage means for storing a second video that is lower in resolution than the first video and created based on the first video;
Distribution means for distributing the second video stored in the second video storage means to the terminal based on a request from the terminal;
In response to the first timing information indicating the extraction timing of the moving image of the bookmark designated portion received from the terminal and the reproduction request for the moving image of the bookmark designated portion received from the terminal, the second moving image storage means From the stored second moving image, a moving image of the bookmark specified portion starting from a timing that is a predetermined time later than the first timing information is extracted, and the extracted moving image of the bookmark specified portion is extracted to the terminal. Bookmark moving image transmitting means for transmitting an image;
According to the second timing information indicating the extraction timing of the still image cut out from the bookmark moving image of the designated portion received from the terminal, the first moving image stored in the first moving image storage means is stopped. program for operating as a still picture image extracting unit for cutting out images. A terminal connected to an image processing server via a communication line,
Playback means for playing back a moving image received from the image processing server;
First timing designating means for designating first timing information indicating the extraction timing of a moving image of a bookmark designated portion during reproduction of the video;
Request means for transmitting a moving image reproduction request of the bookmark specified portion to the image processing server;
Second timing designating means for designating second timing information indicating a timing for cutting out a still image from a moving image of the bookmark designated portion transmitted from the image processing server in response to the reproduction request ;
Transmitting means for transmitting the second timing information specified by the second timing specifying means to the image processing server;
A terminal comprising:

Images