JP2002116996A - Cooperative work supporting method and system, client terminal equipment for cooperative work, cooperative work coordinator and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a cooperative work supporting method and system for simultaneously handling moving images at plural spots by real time responses and to provide a client terminal equipment for cooperative work, a cooperative work coordinator and a recording medium. SOLUTION: The plural pieces of the client terminal equipment 30 and the cooperative work coordinator 20 are connected to a network 1 and a moving image file to be used in the cooperative work is prepared in the respective pieces of the client terminal equipment 30. The moving image file is opened in the respective pieces of the client terminal equipment 30, event information generated in each client terminal equipment 30 is transmitted through the cooperative work coordinator to the other client terminal equipment 30 and picture including the moving image is updated in the respective pieces of the client terminal equipment 30.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a cooperative work support method and system for supporting cooperative work performed by workers at a plurality of points using a network, a cooperative work client terminal device, a cooperative work coordinator, and a recording medium. For example, the present invention can be used when two or more computers are connected to a network and two-way cooperative work is performed between multiple points using multimedia files such as moving image files and still image files.

[0002]

2. Description of the Related Art Hitherto, cooperative work by workers at a plurality of points has been performed by various methods. For example, in a video conferencing system, between two points or between multiple points using a multipoint connection device, a moving image, audio,
By transmitting and receiving still images and the like, cooperative work on a network is realized.

Further, in the pathological remote image diagnostic system described in Japanese Patent Application Laid-Open No. 9-117417, a moving image, a medium-quality still image, and a high-quality still image required for examination and diagnosis are transmitted from a hospital on the transmitting side. A system has been realized in which the data is transmitted to a hospital on the receiving side where a pathological diagnosis specialist is located, and the pathological diagnosis specialist performs diagnosis while interacting between two points.

In this system, first, a moving image is transmitted from a hospital on the transmitting side to an expert on pathological diagnosis on the receiving side, and then the expert on pathological diagnosis on the receiving side considers the received moving image as a lesion site. It specifies the frame to be transmitted and requests the transmitting hospital to transmit a medium-quality or high-quality still image of the frame. Subsequently, the transmitting hospital sends a still image in response to a request from a pathological diagnosis specialist on the receiving side, and views the same still image at both the transmitting hospital and the pathological diagnosis specialist on the receiving side. While talking, try to identify the lesion site with a mark or the like. Then, such operations are repeated until a lesion site is specified.

Further, as a system for performing two-way cooperative work between multiple points using a network, Japanese Patent Laid-Open No.
A cooperative work system described in JP-A-1112862 has been proposed. In this system, when a plurality of browsers operating on a plurality of client terminal devices and a WWW server that returns a corresponding page in response to a request from these browsers are connected to a network to perform cooperative work, An awareness server and a collaboration server are provided separately from the WWW server.

Specifically, when a client inputs a uniform resource locator (hereinafter, referred to as a URL) for cooperation, the URL is transmitted to an awareness server, and the awareness server transmits the URL to all client terminal devices. Deliver to. Then, each client makes a request to the WWW server based on the URL received from the awareness server, and the WWW server responds to the request with the page corresponding to the URL in the H.
Reply to each client in TML document. Each client receives this reply and displays the shared content (cooperation content) on each shared window.

In this system, a cooperative application (an applet described in the Java language) is executed on a shared window of a browser of each client as follows.
For cooperative business processing. That is, when a client inputs a URL for cooperative work, the URL is distributed to all clients via the awareness server in the same manner as described above, and based on that, each client makes a page request to the WWW server,
As a result, in each client terminal device, a WWW page and a cooperative application for cooperative work downloaded from the WWW server are displayed. Thereafter, when a certain client gives an operation instruction to the collaborative application, the operation information of this operation instruction is transmitted to the collaboration server, and further distributed from the collaboration server to all clients. Then, each client terminal device starts the operation processing of the cooperative application based on the operation information received from the collaboration server.

[0008]

However, in the above-described cooperative work by the conventional video conference system, the time delay accompanying transmission and reception of real-time moving images and still images is not negligible, and the time delay is as short as possible. In order to do so, communication costs are high because a wide bandwidth line is required, especially in the case of moving images, there is a problem with the image quality,
There are problems that it is difficult to reproduce a moving image that has been seen once, and that a multipoint connection device is required in addition to the video conference system terminal to connect between the multipoints.

In the pathological remote image diagnostic system described in the above-mentioned Japanese Patent Application Laid-Open No. Hei 9-117417, when performing the operation of specifying a lesion site, first, a specialist in pathological diagnosis on the receiving side is sent from the hospital on the transmitting side to the specialist on the pathological diagnosis on the receiving side. The moving image is sent, and then the pathological diagnosis specialist on the receiving side advances the identification of the lesion site. Images are transmitted one by one. Therefore, it is necessary to transfer images in order to proceed with the work, so it is difficult to perform work using high-definition moving images, and even if it is performed, transfer time is required. At the same time, there is a problem that work cannot be performed with real-time response.

[0010] Further, the aforementioned Japanese Patent Laid-Open No. 2000-1128
In the cooperative work system described in JP-A-62-62, an awareness server and a collaboration server are provided to collect and distribute information, so that each client downloads a Java applet from a WWW server and performs cooperative work. ing. In other words, cooperative work is realized by repeatedly accessing the WWW server and downloading data from the WWW server in real time. Therefore, it is difficult to work on high-definition moving image data that is not suitable for real-time downloading, and even if performed, there is a problem that real-time performance is lost,
Furthermore, there is a problem that a moving image having a size of several megabytes to several tens of megabytes is not usually handled in a WWW page. Also, a plurality of clients simultaneously handle a plurality of moving images and simultaneously reproduce the images, or capture a still image from a moving image file (cut out and save each frame of the moving image as one still image). In addition, there is a problem that cooperative work cannot be performed in a form in which a moving image and a still image are mixed.

An object of the present invention is to provide a cooperative work support method and system capable of handling moving images at a plurality of points simultaneously in real time response, a cooperative work client terminal device, a cooperative work coordinator, and a recording medium. is there.

[0012]

SUMMARY OF THE INVENTION The present invention relates to a cooperative work support method for supporting cooperative work performed by workers at a plurality of locations using a network, and is operated by a worker participating in the cooperative work. A plurality of client terminal devices are connected to the network, and a coordination work coordinator that transmits and receives event information for cooperative work with each client terminal device is connected to the network, and all of the plurality of client terminal devices are common. A moving image file is prepared in advance in each client terminal device as information to be held in each client terminal device. First, each moving image file is opened on each client terminal device to display a moving image screen, and then, Event information on events that occurred at each client terminal device by input operation And sends it to the over data, was collected by the cooperative work coordinator the transmitted event information,
The collected event information is distributed from the collaborative work coordinator to all of the plurality of client terminal devices or to client terminal devices other than the transmitting client terminal device among the plurality of client terminal devices. It is characterized in that a screen including a moving image displayed on a client terminal device other than the source client terminal device among all or a plurality of client terminal devices is updated.

Here, the network includes various forms such as a local area network (LAN), a metropolitan area network (MAN), a wide area network (WAN), the Internet, or a combination thereof. Is included, regardless of whether it is wired or wireless, or even a mixed type of wired and wireless, as long as it can transmit information between multiple points at a certain speed Good.

The "plural points" include two points and multiple points (three or more points), and the distance between the points does not matter. The “cooperative work” includes group education using moving images and still images performed by educational institutions such as universities, distance education and telemedicine, and work to determine movement-related during certification work for long-term care health. For example, all operations using moving images performed by a plurality of workers at a plurality of points are included. For this reason, the moving images handled in the present invention include various moving images such as an ultrasonic moving image, an endoscope moving image, a moving image of a speed skate while sliding, and a moving image of an old man standing up.

Furthermore, the client terminal device and the coordinating work coordinator are mainly realized by a computer, but are not limited to this.
Mobile phones, electronic organizers, game consoles, wristwatches, digital televisions, etc., are adopted as long as the performance of the central processing unit (CPU), the screen resolution, the capacity of the storage means, etc. are suitable for the present invention. be able to.

The client terminal device and the coordinating work coordinator need not be realized by separate computers or the like, but perform multitask processing by one computer or the like and realize the functions of both by time sharing. You may do so. Therefore, transmission / reception of event information between the client terminal device and the coordinating work coordinator includes not only a case where the event information is transmitted and received through a network but also a case where the information is transmitted within a single computer or the like. .

Further, it is not always necessary for a certain computer or the like to be a dedicated device for exhibiting the function of either the client terminal device or the coordinating work coordinator. In some cases, the coordinating work coordinator may be used. In addition, the coordinating work coordinator may be a device that simultaneously performs the functions of both the client terminal device and the coordinating work coordinator.

A method of preparing a moving image file in advance in each client terminal device as information to be held in common by all of the plurality of client terminal devices includes, for example, an analog video camera, a digital video camera,
A moving image captured by a camera such as a digital camera or a medical modality such as an ultrasonic diagnostic apparatus (echo) or an endoscope is stored in a computer or the like as a moving image file using a capturing device such as a capture board. A magneto-optical disk (MO) or a compact disk can be used not only when sending it to a client terminal device at a plurality of points through a network (for example, when using the FTP or SMB protocol) but also when urgency is low. Read-only memory used (CD-RO
M) and the like.

Further, "event information for cooperative work" refers to information on an input operation performed by a worker who performs cooperative work by handling a moving image, and includes at least one of the following various types of information. That is, [play], [stop], [pause / resume], [frame advance], [frame rewind], move to the first frame [first], Go to last frame [Last], repeat playback automatically [Repeat],
Simultaneously operate a plurality of moving images displayed on the screen simultaneously on the display means [synchronization], cut out and save each frame of the moving image displayed on the display means as one still image [capture], draw [Delete all], Cancel previous drawing [Undo], Save drawing history to another file [Save], Specify start frame of playback [Start frame], End playback Information on each operation (operation on these various buttons and various boxes, etc.) such as [End frame] to specify the frame, [Frame advance step] to set the moving frame interval at the time of frame advance and frame return, slide bar Operation of the slide bar to directly specify the frame number and display the screen by the operation of the moving image in the playback stopped state (any frame that constitutes the moving image) Information on each drawing operation such as [Mark], [Line], [Circle], [Free curve], [Text], etc. for the still image or text, information on the text entered in the chat and the name of the client who entered it, The information includes at least one of display / non-display of the whiteboard, information on each operation on the whiteboard, and information when a new file is opened in each client terminal device or when an already opened file is closed.

The event information distributed from the coordinating work coordinator is distributed to all of the plurality of client terminal devices, and is distributed to client terminal devices other than the source client terminal device among the plurality of client terminal devices. May be done. In the former case, all of the plurality of client terminal devices receive the distribution of the event information from the coordinating work coordinator and update the screen including the moving image based on the distribution of the event information. On the other hand, in the latter case, the client terminal device that transmitted the generated event information to the coordinating work coordinator uses the moving image based on the event information generated by its own input means without passing through the coordinating work coordinator. The client terminal device other than the transmission source client terminal device receives the distribution of the event information from the coordinating work coordinator and updates the screen including the moving image based on the distribution of the event information as in the former case. .

According to the present invention, a moving image file is prepared in advance in each client terminal device as information to be commonly held by a plurality of client terminal devices, and this moving image file is stored in each client terminal device. Open their own and work together. In other words, it is assumed that so-called storage transmission (however, transmission and reception by recording media such as MO and CD-ROM is included).

On the premise of such storage transmission, the event information generated in one client terminal device is transmitted to other client terminal devices via the coordination work coordinator, so that the same work is performed in all client terminal devices. (Update of a screen including a moving image), and a two-way cooperative operation for handling the moving image is realized.

Therefore, a moving image can be handled at a plurality of points simultaneously with a real-time response. For this reason, the inconvenience that a moving image viewed at the same time on the transmitting side and the receiving side is shifted, which has conventionally occurred, is resolved, and accurate information transmission between a plurality of workers becomes possible.

In the prior art, transmission / reception of high-quality moving images requires a line with a wide band, which has the disadvantage of increasing communication costs. Therefore, such inconvenience is solved, and the communication cost can be reduced, thereby achieving the above object.

Further, as a system for realizing the above-described cooperative work support method of the present invention, there is the following cooperative work support system of the present invention. That is, the present invention
A cooperative work support system for supporting cooperative work performed by workers at a plurality of points using a network, comprising: a plurality of client terminal devices connected to a network and operated by workers participating in the cooperative work; A coordinating work coordinator connected to the client terminal device for transmitting and receiving event information for cooperative work with each client terminal device, wherein each client terminal device has information that all of a plurality of client terminal devices should have in advance in common. Moving image file storage means for storing a moving image file prepared as a display, display means for displaying various information including a moving image on a screen, input means for inputting an operation of a worker on the moving image, and input by the input means Transmitting means for transmitting event information corresponding to the operation to the coordinating work coordinator; Receiving means for receiving the event information distributed from the coordinator, and opening the moving image file to display the moving image on the display means and to input the event information generated by the input means or received by the receiving means. Image processing means for updating a screen including a moving image displayed on the display means based on the information. The coordinating work coordinator collects the event information transmitted from each client terminal device, and the collecting means. Distributing means for distributing the event information collected in (1) to all of the plurality of client terminal devices or to client terminal devices other than the source client terminal device among the plurality of client terminal devices. It is.

Here, input means include a mouse, a keyboard, a trackball, a light pen, a trackpad, a trackpoint, a tablet and a stylus,
Various things such as a joystick and a voice recognition device can be adopted.

As the display means, a liquid crystal display, a CRT display, a projector, a screen and the like can be adopted.

Further, the moving image file storage means includes a hard disk, a read only memory (ROM),
Random access memory (RAM), magneto-optical disk (MO), read-only memory using compact disk (CD) (CD-ROM), CD recordable (CD-R), CD rewritable (CD-RW), Adopt read-only memory (DVD-ROM) using digital versatile disk (DVD), random access memory (DVD-RAM) using DVD, floppy (registered trademark) disk (FD), magnetic tape, etc. can do.

In the present invention, first, in each client terminal device, the moving image file stored in the moving image file storage means is opened by the image processing means and the screen of the moving image is displayed on the display means. The operator performs an input operation on the moving image using the input means. Then, event information relating to an event generated by the input operation of the worker is transmitted to the coordinating work coordinator by the transmission means.

Next, in the coordination work coordinator,
After the event information transmitted from each client terminal device is collected by the collecting means, the event information is distributed by the distribution means to all of the plurality of client terminal devices or client terminals other than the source client terminal device among the plurality of client terminal devices. Deliver to device.

Subsequently, in each client terminal device, after receiving the event information distributed from the coordinating work coordinator by the receiving means, the image processing means
The screen including the moving image displayed on the display means is updated based on the received event information. At this time, for the client terminal device of the transmission source among the plurality of client terminal devices, the screen including the moving image is updated by the image processing means based on the event information returned to the self terminal device via the coordinating work coordinator. Alternatively, the screen including the moving image may be updated by the image processing unit based on the event information generated by the input operation by the own input unit without the intervention of the cooperative work coordinator.

Therefore, the above-described cooperative work support method is realized by the cooperative work support system of the present invention.
The operation and effect of the above-described cooperative work support method can be obtained as it is, thereby achieving the above object.

As described above, the event information according to the present invention includes various types of information. In particular, it is preferable that the following information is included and that the corresponding image processing can be performed. . That is, in the above-described cooperative work support system, the event information includes information of a synchronous operation for simultaneously operating a plurality of moving images simultaneously displayed on the screen on the display unit, and the image processing unit includes a plurality of moving image files. It is desirable to have a function of opening the image and displaying the screen simultaneously on the display means, and simultaneously updating the screens of the plurality of moving images based on the event information.

When such a synchronization function is provided, the labor for input operation and the labor for monitoring by the operator are saved, and the work efficiency of the cooperative work is improved.

Further, in the above-mentioned collaborative work support system, the event information includes information of a capture operation for cutting out and saving each frame of the moving image displayed on the display means as one still image, It is preferable that each client terminal device includes a still image file storage unit that saves the cut out still image as a file.

When such a capture function is provided, for example, when it is necessary to save a frame considered to be important in performing a work such as a diagnosis among frames constituting a moving image, Can immediately save this, and can perform cooperative work in a state where moving images and still images are mixed.

As a component of the cooperative work support system described above, the following cooperative work client terminal device of the present invention is required. That is, the present invention provides a cooperative work support system that supports cooperative work performed by workers at a plurality of locations using a network. A client terminal device for cooperative work to be operated, wherein all of a plurality of client terminal devices for cooperative work including other client terminal devices for cooperative work participating in cooperative work are prepared in advance as information to be held in common. A moving image file storage unit for storing a moving image file, a display unit for displaying various kinds of information including a moving image on a screen, an input unit for inputting an operation performed by a worker on the moving image, and an input operation performed by the input unit A transmitting means for transmitting the event information to the coordinating work coordinator; Receives event information distributed in common to all of the plurality of cooperative work client terminal devices or cooperative work client terminal devices other than the source cooperative work client terminal device among the plurality of cooperative work client terminal devices Receiving means for opening a moving image file and displaying a moving image on the display means and displaying the moving image displayed on the display means based on event information generated by input operation by the input means or received by the receiving means And an image processing means for updating the screen including the following.

The following cooperative work coordinator of the present invention is required as a component of the above-mentioned cooperative work support system. That is, the present invention is connected to a network together with a plurality of client terminal devices to configure a cooperative work support system for supporting a cooperative work performed by workers at a plurality of points using a network, and each client terminal device A coordinating work coordinator for transmitting and receiving event information for cooperative work between the client terminal devices; a collecting unit for collecting event information transmitted from each client terminal device; And distribution means for distributing to all or a plurality of client terminal devices to client terminal devices other than the client terminal device of the transmission source. Actions prepared as information that should be held in common An image file,
The event information to be distributed by the distribution means is information of an operator's input operation on a moving image which is opened and displayed on the screen by each client terminal device. The information is used for updating a screen including a moving image performed by a client terminal device other than the transmission source client terminal device.

Further, the present invention is a computer-readable recording medium storing a program for causing a computer to execute a cooperative work support method for supporting cooperative work performed by workers at a plurality of points using a network. In addition, a plurality of client terminal devices operated by workers participating in the cooperative work are connected to the network, and a cooperative work coordinator for transmitting and receiving event information for cooperative work with each client terminal device is provided on the network. At the same time as connecting, a moving image file is prepared in advance in each client terminal device as information to be held in common by all of the plurality of client terminal devices. The image is displayed on the screen, and then input by the operator After transmitting the event information related to the event that has occurred in the client terminal device to the coordinating work coordinator, and collecting the transmitted event information by the coordinating work coordinator, the collected event information is transmitted from the cooperative work coordinator to all of the plurality of client terminal devices. Alternatively, the client terminal device is distributed to client terminal devices other than the client terminal device of the transmission source among the plurality of client terminal devices, and the client of the transmission source among all of the plurality of client terminal devices or the plurality of client terminal devices based on the distributed event information. A program for causing a computer to execute a collaborative work support method characterized by updating a screen including a moving image displayed on a client terminal device other than the terminal device is recorded.

Further, the present invention is connected to a network together with a coordinating work coordinator to participate in the cooperative work together with a coordinating work coordinator in order to constitute a cooperative work support system for supporting a cooperative work performed by workers at a plurality of points using a network. A computer-readable recording medium storing a program for causing a computer to function as a cooperative work client terminal device operated by an operator, including a plurality of cooperative work client terminal devices participating in cooperative work. A moving image file storage unit that stores a moving image file prepared as information to be held in common by all of the cooperative work client terminal devices, and a display unit that displays various information including moving images on a screen,
Input means for inputting an operation of a worker on a moving image, transmission means for transmitting event information corresponding to the input operation by the input means to the coordinating work coordinator, and all of a plurality of client terminal devices for cooperative work from the coordinating work coordinator Or, a receiving means for receiving event information distributed in common to the cooperative work client terminals other than the source cooperative work client terminal among the plurality of cooperative work client terminals, and opening the moving image file Image processing means for displaying a moving image on the display means and updating a screen including the moving image displayed on the display means based on event information generated by input operation by the input means or received by the receiving means And a client terminal device for cooperative work characterized by comprising: As it is obtained by recording a program for causing a computer to function.

According to the present invention, each client terminal is connected to a network together with a plurality of client terminal devices so as to constitute a cooperative work support system for supporting a cooperative operation performed by workers at a plurality of points using a network. A computer-readable recording medium that records a program for causing a computer to function as a cooperative work coordinator that transmits and receives event information for cooperative work to and from the device, the event information transmitted from each client terminal device And a distribution unit that distributes the event information collected by the collection unit to all of the plurality of client terminal devices or to client terminal devices other than the source client terminal device among the plurality of client terminal devices. Configured by the collection means The event information to be collected is input by a worker with respect to a moving image displayed on the screen by opening a moving image file prepared as information to be commonly held in advance by all of the plurality of client terminal devices. Event information to be distributed by the distribution means, which is operation information, includes a screen including a moving image performed by all of the plurality of client terminal devices or a client terminal device other than the transmission source client terminal device among the plurality of client terminal devices. A program for causing a computer to function as a cooperative work coordinator characterized in that the information is used for updating.

The program recorded on each recording medium described above may be a part of another program, or may be recorded on a recording medium together with a separate program. In addition, the programs recorded on each recording medium described above or a part of the programs are LAN, MAN,
Transmission is possible using a transmission medium such as a wired network such as a WAN or the Internet, or a wireless communication network, or a combination thereof, and it is also possible to carry the data on a carrier wave.

[0043]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS One embodiment of the present invention will be described below with reference to the drawings. FIG. 1 shows the overall configuration of a cooperative work support system 10 of the present embodiment. FIG. 2 shows a detailed configuration of the cooperative work support system 10 including a flow of cooperative work event information. The cooperative work support system 10 is a system that supports cooperative work performed by workers at a plurality of locations using the network 1.

In FIG. 1, a cooperative work support system 10
Is configured to include a coordination work coordinator 20 connected to the network 1 and a plurality of client terminal devices 30 connected to the network 1. Network 1 includes LAN, MAN, WAN, Internet,
A wireless communication network, or a combination thereof. The coordinating work coordinator 20 and each client terminal device 30 are each configured by a computer (including a main body, attached devices, and peripheral devices). In FIG. 2, a plurality of client terminal devices 30
Of these, only two client terminal devices 30A and 30B are shown as representatives, and the other client terminal devices 30 have the same configuration and function.
The illustration is omitted.

In FIG. 2, cooperative work coordinator 2
0 is a collection unit 21 for collecting event information transmitted from each client terminal device 30;
A distribution unit 22 for distributing the event information collected by the collection unit 21 to all of the plurality of client terminal devices 30; an event information storage unit 23 for storing all the event information collected by the collection unit 21 as an operation history; And a connection processing means 24 for receiving a connection request from the server.

Each client terminal device 30 includes a moving image file storage unit 41 for storing a moving image file and a still image file storage unit 42 for storing a still image file.
And a drawing history storage means 43 for storing a drawing history and the like.

Each client terminal device 30 includes a display means 51 for displaying various information including a moving image on a screen, an input means 52 for inputting an operation of an operator on the moving image,
Transmission means 5 for transmitting event information corresponding to the input operation by the input means 52 to the coordinating work coordinator 20
3, a receiving means 54 for receiving the event information distributed from the coordinating work coordinator 20, a moving image file is opened to display the moving image on the display means 51, and based on the event information received by the receiving means 54. An image processing unit 55 for updating a screen including a moving image displayed on the display unit 51;
Connection processing means 70 for performing a connection process to the server.
Each of the means 4 constituting the client terminal device 30A
Subscripts A are attached to 1 to 43, 51 to 55, and 70, and each means 41 to 43,
The subscript B is added to 51 to 55, 70.

The event information storage unit 23 of the coordinating work coordinator 20, the moving image file storage unit 41 of each client terminal device 30, and the still image file storage unit 4
2. The storage unit 43 for drawing history etc. includes a hard disk, ROM, RAM, MO, CD-ROM, CD-R,
CD-RW, DVD-ROM, DVD-RAM, FD,
It is composed of a magnetic tape or a combination thereof.

For example, after a moving image file used in a cooperative operation is transmitted through the network 1 and once stored in the hard disk of each client terminal device 30,
When all or a part of the cooperative work is read into the main memory when the cooperative work is performed, the hard disk or the RAM constituting the main memory corresponds to the moving image file storage unit 41. In addition, moving image files used for cooperative work are MO
When all or a part of the moving image file is directly read from these portable media into the main memory when the cooperative work is performed, , A portable medium such as an MO or a CD-ROM or a RAM constituting a main memory corresponds to the moving image file storage means 41. Further, the moving image file used in the cooperative work is delivered to each client terminal device 30 by a portable medium such as an MO or a CD-ROM, and is temporarily stored in the hard disk of each client terminal device 30. If all or part of the data is read into the main memory at the time of execution, the hard disk or the RAM constituting the main memory corresponds to the moving image file storage unit 41.

It is preferable that the capacity of the moving image file storage means 41 is sufficient to store a high-definition moving image. For example, a plurality of moving image files of several megabytes to several tens of megabytes are stored. It is preferable to set the capacity so that it can be used.

The format of each image file is AV
An I file (moving image), a BMP, a JPEG file (still image) and the like can be used, but the present invention is not limited to this. A file such as a drawing history stored in the drawing history storage unit 43 can be saved in an XML format or the like.

Collection means 2 of cooperative work coordinator 20
1. Distribution means 22, connected processing means 24, and transmission means 53, reception means 54, image processing means 55, and connection processing means 70 of client terminal device 30 operate on a central processing unit (CPU) and this CPU, respectively. This is realized by one or more programs. As an operating system (OS), Windows 9
5/98 / NT / 2000 (registered trademark) can be preferably used, but is not limited thereto. In addition, the present invention is described in Java language, and Windows,
QuickTime may be used on a platform such as MacOS or Linux (registered trademark). It should be noted that a program for realizing the present invention fits into about two floppy disks (FD).

The performance of the CPU of each client terminal device 30 needs to be able to reproduce a moving image file. For example, Pentium MMX (registered trademark)
Preferably, the performance is 233 MHz or higher. Considering that a plurality of moving image files can be reproduced simultaneously, for example, Pentium II (registered trademark) 40
More preferably, the performance is 0 MHz or more. Also,
For the same reason, the capacity of the main memory is preferably, for example, 96 megabytes or more, more preferably, 12 megabytes or more.
8 megabytes or more.

The image processing means 55 includes a graphical user interface (GUI). The functions of the image processing unit 55 include a reproduction function of opening a moving image file and reproducing the moving image on the screen of the display unit 51 (including initial display and updating), each frame constituting the moving image, and a still image. A drawing function for drawing on an image, an extraction function for capturing each frame constituting a moving image as one still image (capture function), a meeting function for holding a meeting between workers at a plurality of locations, and a moving image. There is a recording function for recording information such as basic information and drawing history in the drawing history storage means 43.

Each of these functions is realized by a process based on the event information distributed from the coordinating work coordinator 20 and received by the receiving means 54, and the input means 5
2 may be directly realized by a process based on an input operation performed by an operator using the second operation. The latter case is a case of a unique process performed by each client terminal device 30, for example, when there is an input operation that is not transmitted as event information to the cooperative work coordinator 20, such as selection of a color.

The playback function includes continuous playback, stop, pause / resume, frame advance,
This function is for performing frame rewind, moving to the first or last frame, seeking a frame, setting a start frame and an end frame in continuous playback, and setting a moving frame interval in frame advance / frame rewind. In addition, the playback function has a function to open multiple movie files at the same time.
A synchronization function for simultaneously performing the same operation on those moving image files is included. Furthermore, a function of continuous repetition reproduction and a function of scaling up and down the frame size are also included.

The drawing function is a function for drawing each frame constituting a moving image and a still image (including those cut out from the moving image by the extracting function).
This function is for marking, drawing straight lines, drawing circles, drawing free curves, drawing text, undoing, selecting colors, and selecting size / line thickness. When the mouse constituting the input means 52 is moved during reproduction, information on the movement is transmitted to the other client terminal devices 30, and a marker moving according to the movement of the mouse is displayed on the screen of the display means 51 of each client terminal device 30. Is displayed, so that the point of interest can be shared by all workers participating in the cooperative work.

The extraction function performs a capture operation to cut out each frame constituting a moving image as one still image, and, if necessary, converts the cut out still image as a still image file separate from the moving image file. This is a function of recording in the image file storage unit 42.

The conference function is a function for chatting by character input and drawing on a window (called a whiteboard) capable of drawing white. It should be noted that such a conferencing function is used for real-time voice transmission (for example, Voice over Internet Protocol (VOI)).
P) or the like, or character input (text transmission) and voice transmission may be used together. Furthermore, if the cooperative work is performed by a relatively small number of people, such as between two points, it is effective to combine it with a telephone or a video conference system.

The recording function records the basic information for the moving image and the history information such as the drawing generated by the drawing function, the extracting function, and the conference function in the drawing history storage means 43 as a file separate from the moving image file. Function.

As the display means 51, a liquid crystal display, a CRT display, or the like can be used, and the resolution is preferably 800 × 600 pixels or more, more preferably 1024 × 768 pixels or more.

As the input means 52, a mouse, a keyboard, a track ball, a light pen, a track pad, a track point, a tablet and a stylus, a joystick, a voice recognition device, and the like can be used, or a plurality of these can be combined. .

The connection processing means 70 of each client terminal device 30 includes a port number setting means for setting a port number, a client name setting means for setting a client name, and a socket for requesting a cooperative work coordinator 20 to perform a socket connection. Connection requesting means, notification receiving means for receiving connection client information notified from the coordinating work coordinator 20, and connection client window updating for updating the screen of the connection client window 102 (see FIG. 5 and the like) based on the received connection client information. Means.

The connected processing means 24 of the coordinating work coordinator 20 comprises: a port number setting means for setting a port number; a socket connection waiting means for waiting for a socket connection request from each client terminal device 30; Notifying means for notifying all of the devices 30 of the connected client information is provided.

An unillustrated photographing means for photographing a moving image handled in the cooperative work is connected to one of the client terminal devices 30 or at least one of the computers constituting the cooperative work coordinator 20.
The photographing means includes, for example, cameras such as an analog video camera, a digital video camera, and a digital camera, or various photographing devices such as an ultrasonic diagnostic apparatus (echo) and a medical modality such as an endoscope, and these photographing devices. It comprises a capture board for capturing a captured moving image into a computer, a capture device such as a universal serial bus (USB), and an input / output interface. The moving images photographed by these photographing means are transmitted to all the client terminal devices 30 through the network 1 and stored in the moving image file storage means 41. It should be noted that the photographing means does not necessarily need to be provided in the cooperative work support system 10 itself as described above, and the moving image is photographed using a separate photographing means separated from the cooperative work support system 10, and A portable medium such as an MO or a CD-ROM may be used to transfer the data to all the client terminal devices 30. In short, when the cooperative work starts, the same moving image file is stored in all the client terminal devices 30. What is necessary is just to be in the state prepared beforehand.

The computers constituting the client terminal devices 30 and the coordinating work coordinator 20 include:
An output unit such as a printer or a plotter that outputs the result of the cooperative work or the like may be appropriately connected.

In this embodiment, cooperative work is performed by workers at a plurality of points as follows.

FIG. 3 is an explanatory diagram showing a detailed flow of the connection operation of each client terminal device 30 operated by workers at a plurality of points. Here, for convenience of explanation, only the connection operation of the two client terminal devices 30A and 30B will be described, and the connection operation of the other client terminal devices 30 will be omitted because they are completely the same.

First, each client terminal device 30A, 3
0B and the coordinating work coordinator 20 are activated and put into operation (steps S1A, S1B, S
2). At this time, the client terminal devices 30A, 30B
Then, a program (subroutine) for realizing the connection processing means 70A, 70B is started, and a program (subroutine) for realizing the connected processing means 24 is started in the cooperative work coordinator 20 (Ne in FIG. 12).
work menu 252).

Next, it is determined by the port number setting means of the connection processing means 70A, 70B and the connected processing means 24 whether or not to change the port number used for connection from the default value (steps S3A, S3B, S4). ), When changing, a new port number is set (steps S5A, S5).
5B, S6). Here, the default value of the port number is, for example, 9001 or the like. In the case where the Internet is used as the network 1, depending on the setting of the firewall, if the port number is 9001, TCP / IP is used.
In such a case, the port number is changed to, for example, 110 used in the e-mail POP service or 25 used in the e-mail SMTP service.

Subsequently, each client terminal device 30A,
In 30B, the client name setting means of the connection processing means 70A, 70B determines whether or not to change the client name for distinguishing the connected client terminal devices 30A, 30B from a default value (step S7).
A, S7B), when changing, a new client name is set (steps S8A, S8B). Here, the default value of the client name given to each client terminal device 30A, 30B is, for example, the name given to the computer constituting each client terminal device 30A, 30B. When the attached computer participates in the cooperative work, the client name is changed.

Thereafter, each client terminal device 30A,
At 30B, the socket connection request means of the connection processing means 70A, 70B transmits a socket connection request to the coordinating work coordinator 20 via the network 1 (steps S9A, S9B).

On the other hand, the coordinating work coordinator 20
After completing the port number setting process (steps S4 and S6),
The socket connection standby unit of the connection processing unit 24 enters a standby state of a socket connection request from each of the client terminal devices 30A and 30B (step S10).
It is determined whether a socket connection request has been received from each of the client terminal devices 30A and 30B (step S1).
1). Here, when the socket connection request has not been received, the socket connection request is again in a standby state (step S10), and thereafter, the socket connection requests from all the client terminal devices 30 participating in the cooperative work are received. Until the above, the loop processing of steps S10 and S11 is repeated. On the other hand, when a socket connection request is received, the notifying means of the connected processing means 24 notifies the newly connected client terminal device 30 of the client name of the already connected client terminal device 30 and its client terminal. The information (file connection client information) of the file name opened by the device 30 is transmitted and notified, and the already connected client terminal device 3
0, the newly connected client terminal device 30
Client name and its client terminal device 30
Then, the information (connection client information) of the file name opened in step (1) is transmitted and notified (step S12).

Then, each client terminal device 30A,
In 30B, the connection client information transmitted from the coordinating work coordinator 20 is received by the respective notification receiving units of the connection processing units 70A and 70B.
The connected client window updating means A and 70B update the screen of the connected client window 102 (see FIG. 5 and the like) based on the received connected client information (steps S13A and S13B).

FIG. 4 is an explanatory diagram showing a detailed flow of the operation of the cooperative work after all the client terminal devices 30 participating in the cooperative work are connected to the cooperative work coordinator 20. Here, for convenience of explanation, only the operation of the cooperative operation of the two client terminal devices 30A and 30B will be described, and the operation of the cooperative operation of the other client terminal devices 30 is completely the same, and will not be described.

First, each client terminal device 30A, 3
In a situation in which the connection between the coordinator 20 and the coordinating work coordinator 20 has been completed in the procedure of FIG.
Assuming that an event has occurred by receiving the input operation of the worker using 2A through the GUI of the image processing unit 55A (step S21), the event information relating to this event is transmitted to the coordinating work coordinator 20 by the transmission unit 53A. It transmits (step S22). At this time, the image processing unit 55A only creates the event information and sends it to the transmission unit 53A, and does not update the screen of the display unit 51A.

On the other hand, the coordinating work coordinator 20
The collection unit 21 starts receiving event information from each client terminal device 30 (step S2).
3), always wait for the arrival of the event information (step S24). If it is determined that the event information has been received from the client terminal device 30A, a process according to the type of the event is performed, and then the distribution unit 22 outputs all the client terminal devices 30, in this case, two client terminals. Event information is distributed to both the devices 30A and 30B (step S25), and the process returns to a state of waiting for reception of event information from each client terminal device 30 (step S23). The event information received and collected from each client terminal device 30 is stored in the event information unit 23 as an operation history.

Next, each client terminal 30A, 3
In 0B, the receiving means 54A and 54B receive the event information from the coordinating work coordinator 20 (steps S26A and S26B), and based on the received event information, the image processing means 55A and 55B execute an action corresponding to the event. Execute (Steps S27A, S2
7B) Finally, the screen of the window targeted for the action is updated (steps S28A and S28).
B).

Further, a plurality of client terminal devices 30
(Here, two client terminal devices 30A, 30A
If the operations are performed simultaneously in B), for example, while a certain client terminal device 30A is performing a drawing operation or the like, the drawing operation or the like is performed on another client terminal device 30B and an event occurs. Even so, a process that ignores it may be performed. As a processing method to ignore, a processing method to ignore at the client terminal device 30B or a processing method to ignore at the cooperative work coordinator 20 can be adopted. The former client terminal device 30
The processing method to be ignored by B means that the client terminal device 30
Event information generated in A is the coordination work coordinator 2
0, and while the client terminal device 30B receives it and performs drawing based on the event information, even if an event is generated by the input means 52B such as a mouse on the client terminal device 30B, This is a processing method in which event information is not transmitted to the coordinating work coordinator 20. The latter coordinating work coordinator 20
Is a processing method to be ignored by a client terminal device 3
While the event information is transmitted from 0A and is being processed, even if the event information is transmitted from another client terminal device 30B, the event information is simply discarded.

Instead of such an ignoring processing method, a client terminal device 30 capable of performing a drawing operation or the like is determined, and only the event information corresponding to the drawing operation or the like from the client terminal device 30 is transmitted to the coordinating work coordinator 2.
A processing method accepted by 0 may be adopted. At this time, when changing the client terminal device 30 capable of performing a drawing operation or the like, the client terminal device 30 capable of performing a drawing operation or the like specifies the client terminal device 30 capable of performing the next drawing operation or the like. What should I do?

Hereinafter, the screen during the cooperative work displayed on the display means 51 of each client terminal device 30 will be described.

FIG. 5 shows an example in which two moving image windows 100 and 101 are displayed in a work window 107 as a screen display example on the display means 51. The work window 107 is arranged in the lower part of the screen of the display means 51.
One or more moving image windows, still image windows, and whiteboards are displayed simultaneously.

Further, a connected client window 102 is displayed in the upper left portion of the screen of the display means 51. In this connection client window 102, the client names of all the client terminal devices 30 participating in the cooperative work and the names of the files opened for performing the cooperative work on the respective client terminal devices 30 are displayed. You. Each client terminal device 3
0, a new file is opened, or an already opened file is closed, an event occurs. The image processing unit 55 connects all the client terminals 30 by the image processing unit 55 in accordance with the procedure of FIG. Window 102 is updated.

Further, a chat window 103 is displayed in the upper right part of the screen of the display means 51. The chat window 103 is a window for inputting and displaying a real-time character conversation between all the client terminal devices 30 participating in the cooperative work. When text is input to the chat input box 104 of the chat window 103, an event occurs, and the text is distributed as event information to all the client terminal devices 30 via the collaborative work coordinator 20 according to the procedure of FIG. By the image processing means 55, the name of the client who input the text (the left position of>) and the text (the right position of>) are added to the end of the chat output box 105 of the chat window 103.

At the lower position of the connection client window 102 and the chat window 103 on the screen of the display means 51, a drawing tool window 106 for displaying a drawing tool is displayed. The drawing tool window 106 is a window for specifying a drawing type, a color, a line thickness, or a font size.

FIG. 6 shows details of the buttons displayed side by side in the drawing tool window 106. 6, in the drawing tool window 106, from the left side to the right side in the figure, a [none] button 110, a [mark] button 111, a [straight line] button 112, a [circle] button 113, and a [free curve] button 114, [text]
Button 115, [text input] box 116,
[Red] button 120, [Green] button 121, [Blue] button 122, [Yellow] button 123, [Pink] button 12
4, [light blue] button 125, [white] button 126,
[Black] button 127, [Small / Fine] button 130, [Medium]
A button 131 and a [large / thick] button 132 are provided.

Each button 110-115 and box 1
Reference numeral 16 denotes buttons and boxes for performing various types of drawing. When performing text input, a “text” button 115 is pressed to input text to a “text input” box 116. Each of these buttons 110-115
When the box 116 is operated, an event occurs, and each operation is distributed as event information to all the client terminal devices 30 via the coordinating work coordinator 20 according to the procedure of FIG.
Thus, drawing is performed.

Each of the buttons 120 to 127 is a button to be pressed when selecting a color usable for drawing, and each of the buttons 130 to 132 is a button to be pressed when setting the thickness and the size of a line. The selection of these colors and the setting of the line thickness and the size of the line are unique to each client terminal device 30.
Even if the user operates 0 to 127 and 130 to 132, the event information is not transmitted to the cooperative work coordinator 20.

FIG. 7 shows, as an example of a screen display on the display means 51, an example in which a moving image window 140 and a still image window 141 are displayed one by one in the work window 107. In FIG. 7, a still image window 141 includes a moving image window 14.
A still image obtained by cutting out any one frame of the moving image displayed at 0 is displayed.

As shown in FIGS. 5 and 7, when a plurality of moving image windows, still image windows, and whiteboards are displayed in the work window 107 irrespective of the type, a mouse or keyboard is used. An active window for receiving an input from the input means 52 such as
When a change is made in a certain client terminal device 30, an event occurs, and the change operation is distributed as event information to all the client terminal devices 30 via the cooperative work coordinator 20 according to the procedure of FIG. The means 55 updates the active window. However, there is a case where a file for displaying the active window is not opened in a certain client terminal device 30, and in this case, a message prompting to open is displayed. Note that whether or not the connection has been opened can be confirmed in the connection client window 102.

FIG. 8 shows details of an operation unit such as a button of a moving image window. Video window 150
A moving image is displayed in a central display window 151, and a title bar 152 provided at the top of the moving image window 150 has a name of the moving image file which is opened and displayed in the display window 151. Is displayed. On the lower side of the display window 151, from the left side to the right side in the figure, a [play] button 160, a [stop] button 161, a [pause] button 162, [frame advance]
Button 163, [frame return] button 164, [first]
Button 165, [End] button 166, [Repeat]
Button 167, [Sync] button 168, [Capture]
Button 169, [Erase All] button 170, [Undo]
A button 171 and a [Save] button 172 are provided.

At the lower positions of these buttons 160 to 172, a slide bar 180, a [start frame] box 190, an [end frame] box 191 and a [frame feed Step] box 192 is provided. Further, a status bar 200 provided at the bottom of the moving image window 150 is provided.
Displays information on the number of the frame currently displayed in the display window 151 (left side of /) and the total number of frames (right side of /).

When the "play" button 160 is pressed, the moving image file is played. The start frame and the end frame at the time of this reproduction are designated in a [start frame] box 190 and an [end frame] box 191 respectively. Pressing the [Stop] button 161 during playback stops playback, and pressing the [Pause] button 162 during playback causes
Playback is temporarily stopped, and [Pause] button 1
Pressing 62 resumes playback. Further, if the [Repeat] button 167 is pressed, the reproduction is automatically repeated.

[Frame Forward] button 163, [Frame Back]
When the button 164 is pressed, the frame is advanced or returned from the current frame by the number of frames set in the [frame advance step] box 192. Also,
When the “first” button 165 and the “last” button 166 are pressed, the image moves to the first frame and the last frame of the moving image, respectively.

The slide bar 180 has a left end position corresponding to the first frame of the moving image and a right end position corresponding to the last frame. The slide bar 180 is horizontally moved left and right by a drag operation of a mouse constituting the input means 52. When,
A frame corresponding to the position is displayed in the display window 151.

[Synchronization] button 168 is a button for realizing a synchronization function of simultaneously operating a plurality of moving images (see FIG. 5) displayed in work window 107. When the button is pressed, [Play] is performed for all the moving images in the work window 107.
Button 160, [Stop] button 161, [Pause] button 162, [Frame Forward] button 163, [Frame Back]
The operation of the button 164, the [first] button 165, the [last] button 166, and the operation by the slide bar 180 are performed at the same time.

When the [Capture] button 169 is pressed, the current frame is cut out as a still image, and a new still image window appears in the work window 107 (see FIG. 7).

The [Erase All] button 170 is a button for erasing all the drawing history, and the [Restore] button 171
Is a button for canceling the previous drawing. When the [Save] button 172 is pressed, the drawing history is recorded in the drawing history storage unit 43 as a separate file.

Then, in a state where the reproduction of the moving image is stopped (a state in which a certain frame is displayed), each of the buttons 110 to 115, 120 to 127 and 130 in FIG.
１３２ 132 and the box 116 can be used for drawing. For example, the user presses the [Mark] button 111 to make settings for drawing a mark, and presses the [Red] button 120 and the [Middle] button 131 to set the color to red and the size to medium. Fifteen
When the mouse button is pressed at a point to be marked in 1, a medium-sized red mark is written at that point in the display window 151.

When drawing a straight line, the user presses the [Line] button 112, presses the mouse button at the start point in the display window 151, moves the mouse as it is, and releases the mouse button at the end point. A straight line connecting to the end point is displayed in the display window 151.
Is drawn within.

When drawing a circle, the [Circle] button 11
3 is pressed, and the mouse button is pressed at the upper left corner of the rectangle in which the circle (ellipse is exactly inscribed), the mouse is moved as it is, and the mouse button is released at the lower right corner, the circle appears in the display window 151. Is drawn.

To draw a free curve, hold down the [Free curve] button 114, press the mouse button at the start point, move the mouse as it is, and release the mouse button at the end point. A free curve is drawn in the display window 151 along the locus of the movement of the mouse up to.

To draw a text, the user presses the [Text] button 115 to open the [Text Input] box 1
When text is input into the window 16 and the mouse button is pressed at a point in the display window 151 where the text is to be written, the text is drawn at that point.

The operations of the buttons 160 to 172, the operation of the slide bar 180, the operations of the boxes 190 to 192, and the drawing operations using the buttons 110 to 115 and the box 116 in the moving image window 150 are all performed by According to the procedure of FIG. 4 described above, event information is distributed to all the client terminal devices 30 via the cooperative work coordinator 20, and the same action is executed by the image processing means 55 in each client terminal device 30.

FIG. 9 shows an operation example of the drawing operation. In FIG. 9, a moving image window 21 displayed on a screen on a display unit 51A of a client terminal device 30A is shown.
When the circle 211 is drawn within 0, event information corresponding to the operation is transmitted to another client terminal device 30B in real time via the coordination work coordinator 20, and
Moving image window 21 displayed on screen on display means 51B
The same circle 213 is drawn in the same place in 2.

FIG. 10 shows an operation example of the capture operation. In FIG. 10, it is assumed that a moving image is reproduced in a moving image window 221 in a work window 220 displayed on a display unit 51A of a client terminal device 30A. At this time, when a capture operation is performed on one frame of the moving image, a still image window 222 displaying the cut-out still image appears in the work window 220. Then, the event information corresponding to the capture operation is transmitted to another client terminal device 30B in real time via the cooperative work coordinator 20, and the moving image window is displayed at the same place in the work window 223 displayed on the display means 51B. A still image window 225 that displays a still image obtained by cutting out one frame of the moving image reproduced in 224 appears.

FIG. 11 shows details of the operation unit such as the buttons of the still image window. A still image is displayed in a central display window 231 in the still image window 230, and a title bar 232 provided at the top of the still image window 230 displays a still image which is opened and displayed in the display window 231. Displays the name of the image file. On the lower side of the display window 231, an “Erase All” button 2
40, [Undo] button 241, [Save] button 24
2 are provided.

Each button 2 in the still image window 230
40 to 242 are the moving image windows 15 shown in FIG.
It has the same function as each of the buttons 170 to 172 in 0. That is, the [Delete All] button 240 is a button for deleting all the drawing history, and the [Restore] button 241 is
This button is used to cancel the previous drawing. When the [Save] button 242 is pressed, the drawing history is recorded in the drawing history storage unit 43 as a separate file.

The same operation as the drawing operation that can be performed on each frame of the moving image can be performed on the still image. That is, drawing can be performed using the buttons 110 to 115, 120 to 127, 130 to 132, and the box 116 in FIG.

FIG. 12 shows details of the menu 250 provided at the top of the screen displayed on the display means 51 shown in FIGS. 5 and 7 described above. Menu 250 includes F
ile menu 251, Network menu 25
2, View menu 253, Tool menu 25
4. There are five menus, Help menu 255,
Various functions can be used by selecting each menu.

When the File menu 251 is selected, [Open] to open the file, [Close] to close the file, [Print] to print the contents displayed in the currently active window, and cooperative work [End] to end the execution of the application program.

When the network menu 252 is selected, settings relating to network connection can be made. By checking and turning on [Connection waiting], the computer becomes the coordinating work coordinator 20,
Waiting for connection from each client terminal device 30 (FIG. 3)
Steps S10 and S11). At this time, a program (subroutine) for realizing the socket connection standby unit and the notification unit of the connection processing unit 24 is started. Further, by turning off the check of [Standby for connection], all the connections from each client terminal device 30 can be cut off.

By checking and turning on [Connection Request], the host name of the coordinating work coordinator 20 or I
A window for inputting the P address appears on the screen of the display means, and when correct information is input here, the computer is connected to the coordinating work coordinator 20 and the computer becomes the client terminal device 30. In this case, the connection processing means 7
A program (subroutine) for realizing the socket connection requesting means, notification receiving means, and connected client window updating means of 0 is started. By turning off the check of [Connection Request], the connection of the client terminal device 30 can be cut off.

By checking both [Connection Standby] and [Connection Request] and turning them on at the same time, the computer can be the coordinating work coordinator 20 and also be the client terminal 30 at the same time. In this case, the function of the coordinating work coordinator 20 and the function of the client terminal device 30 are executed in a time sharing manner by multitask processing. However, FIG. 1 shows a state where one of [Connection Standby] and [Connection Request] is checked and turned on, and one computer includes the coordinating work coordinator 20 or the client terminal 30. One of them.

[Port number] is selected when the port number for connection is changed. At this time, the coordinating work coordinator 20 starts up a program (subroutine) for realizing the port number setting means of the connection processing means 24, and in each client terminal device 30, the port number setting means of the connection processing means 70 A program (subroutine) to be realized is started.

[Client name] is selected when changing the client name. In this case, the connection processing means 7
A program (subroutine) for realizing the client name setting means of 0 is started.

When the View menu 253 is selected, display / non-display of various windows can be switched. By turning on / off the [Drawing Tool] check, display / non-display of the drawing tool window 106 (see FIGS. 5 and 6) can be switched. Similarly,
Display / non-display of the connection client window 102 (see FIG. 5) by turning on / off the [Connection] check, display / non-display of the chat window 103 (see FIG. 5) by turning on / off the [Chat] check, The whiteboard can be switched between display and non-display by turning on / off the check of [Whiteboard].

Here, the whiteboard is a still image window in which a portion corresponding to the central display window 231 in the above-described still image window 230 of FIG. 11 is completely white. The display / non-display of the whiteboard operated by a certain client terminal device 30 is performed as event information according to the procedure of FIG.
0, and is distributed to all the client terminal devices 30. [Erase All] button 2 for whiteboard
40, [Undo] button 241, [Save] button 24
2 (see FIG. 11) and buttons 110-1.
15 and all of the drawing operations using the box 116 (see FIG. 6) are distributed as event information to all the client terminal devices 30 via the coordinating work coordinator 20 according to the procedure of FIG. At 30, the same action is executed by the image processing means 55.

By turning on / off the [zoom] check, the display of the moving image or the still image displayed in the current active window can be enlarged or reduced. The scaling operation performed by a certain client terminal device 30 is distributed as event information to all the client terminal devices 30 via the coordinating work coordinator 20 in accordance with the procedure of FIG. , The image processing means 55 performs the same enlargement / reduction of the screen display.

When the Tool menu 254 is selected,
You can read the drawing operation data by selecting [Read], you can write the drawing operation data by selecting [Export], and the operation target can be selected by selecting [Properties]. It is possible to refer to and change basic information of a moving image file or a still image file. Each of these operations is performed by the image processing unit 5
5 is realized by accessing the storage means 43 such as the drawing history.

Here, the basic information includes the creation date of the image file, the creator, the characteristic values (size, number of frames, etc.) of the image file, and the basic information (name, gender,
Age, etc.), keywords, special notes, etc. can be saved. However, in order to update information, authentication using a password is required. In addition, the creator can set the disclosure / non-disclosure of the basic information, and the non-disclosure items cannot be seen by anyone other than the creator.

When the Help menu 255 is selected, it is possible to refer to a help file in which information on a method of using the collaborative work support system 10 is described.

According to this embodiment, the following effects can be obtained. That is, since all the client terminal devices 30 constituting the cooperative work support system 10 are provided with the moving image file storage means 41, the plurality of client terminal devices 30
Are stored in common as moving image files as information to be held in common, so that the same moving image file used in the cooperative work is prepared in advance in all of the plurality of client terminal devices 30 participating in the cooperative work. Can be kept.

Further, since the cooperative work support system 10 is provided with the cooperative work coordinator 20, information on various operations performed by a certain client terminal device 30 is transmitted as event information to the other client via the cooperative work coordinator 20. The information can be transmitted to the terminal device 30, and information can be shared.

Therefore, each client terminal device 30
Stores the moving image file stored in each moving image file storage means 41 and prepared in advance in each client terminal device 3.
0, each of the client terminal devices 30 can open a screen including a moving image based on the event information distributed from the coordinating work coordinator 20. Can be realized.

Therefore, each client terminal 30
Perform image processing using the moving image file prepared in
Since the cooperative work is performed on the premise of so-called storage transmission (however, transfer including transmission through a recording medium such as an MO or a CD-ROM) is performed, a moving image can be handled simultaneously at a plurality of points with a real-time response. As a result, the inconvenience that a moving image viewed at the same time between the transmission side and the reception side, which has conventionally occurred, can be solved, and accurate information transmission between a plurality of workers can be performed.

Further, in the related art, there is a disadvantage that transmission and reception of high-quality moving images requires a line with a wide band, which increases communication cost. Since transmission is assumed, real-time cooperative work can be realized by connecting a plurality of client terminal devices 30 in the network 1 having a narrow band, and thus communication costs can be reduced.

[0128] Since storage transmission is assumed,
It is possible to improve the quality of the moving image and the reproducibility of the moving image during the cooperative work.

Further, since the image processing means 55 of each client terminal device 30 has a synchronization function as a reproduction function, if a plurality of moving image files are opened at the same time, The same operation at the same time. For this reason, the labor of input operation and monitoring of the operator can be saved, and the work efficiency of the cooperative work can be improved.

Since the image processing means 55 of each client terminal device 30 has an extraction function (capture function), each frame constituting a moving image can be cut out as one still image. For this reason, when it is necessary to save a frame that is considered important in performing a work such as a diagnosis among the frames constituting the moving image, the frame can be saved immediately, and the moving image can be saved. The cooperative work can be performed in a state where the image and the still image are mixed.

Further, since the image processing means 55 of each client terminal device 30 has a meeting function for holding a meeting between workers at a plurality of points, communication by chat or whiteboard can be achieved. For this reason,
The efficiency and quality of cooperative work can be improved. In addition,
Real-time voice transmission (eg, Voice over Internet Protocol (VOIP)) for conferencing functions
, Etc.), the efficiency and quality of cooperative work can be further improved.

Further, the coordinating work coordinator 20
Since the event information storage unit 23 is provided, all of the event information collected by the collection unit 21 can be stored as an operation history. For this reason, after the start of cooperative work,
If a new client terminal device 30 joins in the middle (if such mid-way participation is permitted), the client device 30 connected to the client terminal device 30 with respect to the reproduction of the moving image by that time Each operation in the terminal device 30 can be reflected. That is, when the newly connected client terminal device 30 opens the moving image file used in the cooperative operation, the drawing with the mark and the like can be made to appear in the moving image.

As a method of handling a newly connected client, there are a method of restricting the permission of the new connection only before the start of the cooperative work and a method of permitting the new connection after the start of the cooperative work. In the system 10, since the cooperative work coordinator 20 includes the event information storage unit 23 as described above, any method including the latter method can be adopted. Further, it may be possible to set whether or not to permit a new connection after the start of the cooperative work.

The cooperative work support system 10 is a system for supporting cooperative work for handling moving images.
Since it has an extraction function (capture function) and can also handle a cut-out still image, it is also possible to support cooperative work using only a still image. Therefore, the usage of the cooperative work support system 10 includes a case where only a moving image is handled, a case where only a still image is handled, and a case where a moving image and a still image are mixed and handled.

Note that the present invention is not limited to the above-described embodiment, and modifications and the like within a range that can achieve the object of the present invention are included in the present invention.

That is, in the above-described embodiment, as shown in FIG. 4, when an event occurs due to an input operation by the operator (step S21), the image processing unit 55A creates event information and sends it to the transmission unit 53A. At this time, the screen of the display means 51A is not updated, and when the event information returned via the coordinating work coordinator 20 is received by the receiving means 54A (step S26A), the received event information is not updated for the first time. , An action corresponding to the event is executed by the image processing means 55A (step S27A), and the screen of the window targeted for the action is finally updated (step S28A). However, the update of the screen in the client terminal device 30 in which the event has occurred due to the input operation of the worker (that is, the client terminal device that is the source of the event information) is performed based on the event information returned via the cooperative work coordinator 20. Instead of based on the input operation of the worker,
It may be performed directly.

In the above embodiment, the coordinating work coordinator 20 distributes the event information to all the client terminal devices 30 by the distribution means 22 (step S25 in FIG. 4). Since the client terminal device 30 that is the source of the information can grasp the input operation by its own input means 52, the event information may not be distributed to the client terminal device 30 that is the source. In this case, the source client terminal device 30 may directly update the screen based on the input operation by its own input means 52.

Further, in the above embodiment, Ne of FIG.
By checking and waiting for [connection standby] and [connection request] in the work menu 252, the computer becomes the cooperative work coordinator 20, the client terminal device 30, or the cooperative work coordinator 20. And at the same time, the client terminal device 30 can be selected. However, instead of allowing the selection setting to be performed by one program, the coordinating work coordinator 2
0 and the client terminal device 30 may be realized by separate programs. Further, a computer that can only be used as the cooperative work coordinator 20 and a computer that cannot be used as the client terminal device 30 may be connected to a network to realize the cooperative work support system of the present invention.

[0139]

As described above, according to the present invention, a moving image file is prepared in advance in each client terminal device as information to be commonly held by a plurality of client terminal devices. Each client terminal device opens the file independently and updates the screen including the moving image at each client terminal device based on the event information generated at each client terminal device sent via the coordination work coordinator. In addition, there is an effect that two-way cooperative work can be performed in which a moving image is simultaneously handled at a plurality of points with a real-time response.

[Brief description of the drawings]

FIG. 1 is an overall configuration diagram of a cooperative work support system according to an embodiment of the present invention.

FIG. 2 is a detailed configuration diagram of a cooperative work support system including a flow of cooperative work event information of the embodiment.

FIG. 3 is an explanatory diagram showing a detailed flow of a connection operation of each client terminal device of the embodiment.

FIG. 4 is an explanatory diagram showing a detailed flow of a cooperative work operation of the embodiment.

FIG. 5 is an exemplary view showing a screen display example (an example in which two moving image windows are displayed in a work window) on the display unit of the embodiment.

FIG. 6 is a detailed view of each button displayed side by side in the drawing tool window of the embodiment.

FIG. 7 is an exemplary diagram showing a screen display example (an example in which one moving image window and one still image window are displayed in a work window) on the display unit of the embodiment.

FIG. 8 is a detailed view of an operation unit such as a button of a moving image window of the embodiment.

FIG. 9 is a view showing an operation example of a drawing operation of the embodiment.

FIG. 10 is a view showing an operation example of a capture operation of the embodiment.

FIG. 11 is a detailed view of an operation unit such as a button of a still image window according to the embodiment.

FIG. 12 is a detailed view of a menu according to the embodiment.

[Explanation of symbols]

 Reference Signs List 1 network 10 cooperative work support system 20 cooperative work coordinator 21 collecting means 22 distribution means 30 client terminal device 41 moving image file storage means 42 still image file storage means 51 display means 52 input means 53 transmission means 54 reception means 55 image processing means

Claims (9)

[Claims] 1. A cooperative work support method for supporting cooperative work performed by workers at a plurality of points using a network, comprising: a plurality of client terminal devices operated by the workers participating in the cooperative work. A cooperative work coordinator that connects to the network and transmits and receives event information for cooperative work with each of the client terminal devices is connected to the network, and all of the plurality of client terminal devices are commonly held. A moving image file is prepared in advance in each of the client terminal devices as information to be performed. First, each of the moving image files is opened on each of the client terminal devices to display a moving image on the screen, and then the work is performed. Event information related to the event that has occurred at each of the client terminal devices by a user's input operation. Information to the coordinating work coordinator, and after collecting the transmitted event information by the coordinating work coordinator, collects the collected event information from the cooperative work coordinator to all of the plurality of client terminal devices or the plurality of clients. Distributing to client terminal devices other than the transmitting client terminal device among the terminal devices, based on the distributed event information, all of the plurality of client terminal devices or the transmitting client terminal device among the plurality of client terminal devices Updating a screen including the moving image displayed on a client terminal device other than the client terminal device. 2. A cooperative work support system for supporting cooperative work performed by workers at a plurality of points using a network, wherein the cooperative work support system is connected to the network and operated by the workers participating in the cooperative work. A plurality of client terminal devices, and a coordinating work coordinator connected to the network for transmitting and receiving event information for cooperative work between the client terminal devices, wherein each of the client terminal devices is A moving image file storage unit for storing a moving image file prepared as information to be held in common by all of the terminal devices, a display unit for displaying various information including a moving image on a screen, and the worker for the moving image Input means for inputting the input operation, and event information corresponding to the input operation by the input means. Transmitting means for transmitting to the coordinating work coordinator, receiving means for receiving event information distributed from the coordinating work coordinator, opening the moving image file, displaying a moving image screen on the display means, and performing the input Image processing means for updating a screen including the moving image displayed on the display means based on the event information generated by input operation by means or received by the receiving means, wherein the coordinating work coordinator comprises: Collecting means for collecting the event information transmitted from each of the client terminal apparatuses; and transmitting the event information collected by the collecting means to all of the plurality of client terminal apparatuses or a client terminal of the transmission source among the plurality of client terminal apparatuses. Distribution means for distributing to client terminal devices other than the device. A collaborative work support system characterized by being configured to include. 3. The collaborative work support system according to claim 2, wherein the event information includes information on a synchronous operation for simultaneously operating a plurality of moving images simultaneously displayed on the display unit on the screen, The image processing means has a function of opening the plurality of moving image files and simultaneously displaying the screen on the display means, and simultaneously updating the screens of the plurality of moving images based on the event information. A cooperative work support system characterized by the following. 4. The collaborative work support system according to claim 2, wherein each frame of the moving image displayed on the screen of the display unit is cut out as one still image and stored in the event information. A collaborative work support system including capture operation information, wherein each of the client terminal devices includes a still image file storage unit that saves the cut-out still image as a file. 5. The work that is connected to the network together with a coordination work coordinator and participates in the coordination work to form a coordination work support system that supports a coordination work performed by workers at a plurality of points using a network. A client terminal device for cooperative work operated by a user, wherein all of a plurality of client terminal devices for cooperative work including other client terminal devices for cooperative work participating in the cooperative work are information to be held in common in advance. A moving image file storage unit for storing a prepared moving image file, a display unit for displaying various information including a moving image on a screen, an input unit for inputting an operation of the worker with respect to the moving image, Transmitting means for transmitting event information corresponding to an input operation to the coordinating work coordinator; Cooperative work coordinator distributes to all of the plurality of cooperative work client terminal devices or cooperative work client terminal devices other than the source cooperative work client terminal device among the plurality of cooperative work client terminal devices. Receiving means for receiving the received event information; and displaying the moving image file on the display means by opening the moving image file and displaying the moving image on the display means, and the event information generated by the input operation by the input means or received by the receiving means. Image processing means for updating a screen including the moving image displayed on the display means based on the image processing means. 6. A computer which is connected to the network together with a plurality of client terminal devices to constitute a cooperative work support system for supporting cooperative work performed by workers at a plurality of points using a network. A coordinating work coordinator for transmitting and receiving event information for cooperative work between the plurality of client terminal devices, collecting means for collecting the event information transmitted from each of the client terminal devices; Distribution means for distributing to all of the client terminal devices or the client terminal devices other than the client terminal device of the transmission source among the plurality of client terminal devices; and All terminal devices should be held in common in advance The moving image file prepared as the information is information on the input operation of the operator for the moving image displayed on the screen by opening the moving image file on each of the client terminal devices. Information used for updating of a screen including a moving image performed in all of the client terminal devices or client terminal devices other than the transmission source client terminal device among the plurality of client terminal devices. Coordinator. 7. A computer-readable recording medium on which a program for causing a computer to execute a cooperative work support method for supporting cooperative work performed by workers at a plurality of points using a network is recorded. A plurality of client terminal devices operated by the worker participating in the work are connected to the network, and a coordinating work coordinator that transmits and receives event information for cooperative work with each of the client terminal devices is connected to the network. And a moving image file is prepared in advance in each of the client terminal devices as information to be commonly held by all of the plurality of client terminal devices. First, each of the moving image files is stored in each of the client terminal devices. To display the moving image on the screen. The event information relating to the event that has occurred at each of the client terminal devices by the input operation of the worker is transmitted to the coordinating work coordinator. After the transmitted event information is collected by the coordinating work coordinator, the collected event information is collected. Distributing from the coordination work coordinator to all of the plurality of client terminal devices or client terminal devices other than the transmitting client terminal device among the plurality of client terminal devices, based on the distributed event information, the plurality of client terminals Executing a collaborative work support method for a computer, comprising updating a screen including the moving image displayed on a client terminal device other than the transmission source client terminal device among all the devices or the plurality of client terminal devices. Let A computer-readable recording medium storing a program fit. 8. The work that is connected to the network together with a cooperative work coordinator to participate in the cooperative work together with a cooperative work coordinator to configure a cooperative work support system that supports a cooperative work performed by workers at a plurality of points using a network. A computer-readable recording medium storing a program for causing a computer to function as a cooperative work client terminal operated by a user, including a plurality of other cooperative work client terminals participating in the cooperative work. Moving image file storage means for storing a moving image file prepared as information that all of the client terminal devices for cooperative work should have in advance in common; display means for displaying various information including moving images on a screen; Input means for inputting the operator's operation on an image; Transmitting means for transmitting event information corresponding to an input operation by a step to the coordinating work coordinator; and transmitting from the coordinating work coordinator all of the plurality of cooperative work client terminals or the plurality of cooperative work client terminals. Receiving means for receiving event information distributed in common to a cooperative work client terminal device other than the original cooperative work client terminal device; and opening the moving image file and displaying a moving image screen on the display means And image processing means for updating a screen including the moving image displayed on the display means based on the event information generated by being input-operated by the input means or received by the receiving means. As a client terminal device for cooperative work, A computer-readable recording medium on which a program for causing a computer to function is recorded. 9. Connected to said network together with a plurality of client terminal devices to constitute a cooperative work support system for supporting cooperative work performed by workers at a plurality of points using a network, A computer-readable recording medium that records a program for causing a computer to function as a cooperative work coordinator that transmits and receives event information for cooperative work between the event information transmitted from each of the client terminal devices. Collecting means for collecting, and distribution means for distributing the event information collected by the collecting means to all of the plurality of client terminal apparatuses or to client terminal apparatuses other than the transmitting client terminal apparatus among the plurality of client terminal apparatuses. Comprising said collection The event information collected by the step is a moving image file prepared as information that all of the plurality of client terminal devices should previously hold in common, and each of the client terminal devices respectively opens and displays the moving image file on the screen. The event information to be distributed by the distribution unit is information of the input operation of the worker, and all of the plurality of client terminal devices or a client terminal device other than the source client terminal device among the plurality of client terminal devices. A computer-readable recording medium storing a program for causing a computer to function as a coordinating operation coordinator, which is information used for updating a screen including a moving image to be performed.