JPH10134001A - Multipoint terminal cooperation method and remote medical treatment support system using the same - Google Patents

Abstract

(57) [Summary] [PROBLEMS] To enable consistent processing between multipoint terminals, allow an operator to speak at any time, and improve responsiveness. A management server receives a confirmation command from all operation terminals, thereby confirming that all terminal devices have completed execution of a processing command, and completing the execution by the confirmation sub-step 406. After the confirmation, the processing command newly registered in the management server is transmitted to each terminal device, and immediately executed by each terminal device.
04. [Effect] The operation right is not always required, and the matching of processing and high responsiveness can be realized.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a multipoint terminal cooperation method for transmitting and receiving commands between a plurality of terminal devices and a management server to perform the same processing, and to use the same method for terminal devices by using this method. The present invention relates to a remote medical care support system that displays patient medical care data and performs medical care in cooperation with a plurality of doctors.

[0002]

2. Description of the Related Art Conventionally, as a method of performing a joint work between a plurality of terminals, there is a joint work support system using a multipoint video conference system. This is the IEICE OFS93-
36 (1994-01) pp. 37-42. In this conventional example, a plurality of terminal devices are controlled using a multipoint control unit (MCU) in order to realize a joint work by a plurality of terminal devices. When an instruction is input from a certain terminal device to execute a desired process, the terminal device executes the desired process indicated by the instruction input and transmits the instruction input to the MCU. Then, by transmitting an instruction input from the MCU to another terminal device, desired processing is realized by a plurality of terminal devices. At this time, in order to uniquely determine the order of processing to be performed between the terminal devices, the terminal device that wants to input an instruction first obtains an operation right, and then transmits the instruction input to the terminal device.
Transmit to CU.

Further, as an application example of a system for performing a joint work between a plurality of terminal devices as described above, it is discussed in Nippon Medical Association, Vol. 55, No. 1, 1996 (pp. 65-69). There is a remote medical care support system in which a plurality of doctors make a diagnosis in cooperation with each other while referring to the same medical care data.

[0004]

In the above-mentioned conventional method, the processing is immediately executed in the terminal that has input the instruction, but is executed after being transmitted via the MCU in the other terminals. Depending on the required time, there may be a time difference in the start of processing between the terminal devices. Further, since the MCU distributes the instruction input received from the terminal device to other terminal devices one after another, for example, in a terminal device having a lower performance than other terminals, the processing is accumulated and the execution is delayed. There was a problem that the timing was greatly different.

Further, in the above-mentioned conventional method, it is necessary to obtain an operation right in order to input an instruction. Therefore, it is not possible to simultaneously input an instruction from a plurality of terminal devices, and a plurality of operators are required Was not considered in terms of usage forms that could simultaneously speak. Further, there is a problem that a long time is required from the input of an instruction to the execution of the process because a time for the process of acquiring the operation right is required.

SUMMARY OF THE INVENTION An object of the present invention is to solve the above-mentioned problems, to make it possible to always match the processing between terminals (without time lag), to allow an operator to speak at any time, and to have a good responsiveness. An object of the present invention is to provide a cooperation method and a remote medical care support system using the same.

[0007]

In order to achieve the above object, a multipoint terminal cooperation method according to the present invention includes a plurality of terminal devices for inputting instructions by an operator and a management server for controlling the terminal devices. Then, in each terminal device, the operator registers a processing command corresponding to the instruction content in the management server, and the management server transmits the registered processing command to each terminal device to execute the same, and each terminal device performs the same processing. At the time of execution, the management server receives a confirmation command (a command for notifying the management server of completion of execution of the processing command from the terminal device) from all operation terminals, thereby completing execution of the processing command by all terminal devices. After the confirmation sub-step for confirming the execution and the execution completion confirmation by the confirmation sub-step, a processing command newly registered in the management server is transmitted to each terminal, and each terminal is transmitted. In immediately (i.e., simultaneously in each terminal device) it has to include a request executing step having an execution sub-steps to be executed.

[0008] Alternatively, in order to achieve the above object, a remote medical care support system according to the present invention displays medical data of the same patient on a plurality of terminal devices, and a plurality of doctors operating the plurality of terminal devices operate in the same manner. When performing a diagnosis in cooperation with each other while referring to medical data, a plurality of terminal devices having a display screen for displaying medical data of a patient, input means for inputting an instruction by an operator, and the plurality of terminal devices And a communication means for transmitting a command between the plurality of terminal devices and the management server, and a doctor operating a certain terminal device receives a response to medical data displayed on the terminal device. When processing is instructed, the content of the instruction is executed in each terminal device using the multipoint terminal cooperation method of the present invention,
The same screen is displayed on the plurality of terminal devices.

[0009]

BEST MODE FOR CARRYING OUT THE INVENTION

<Embodiment 1> A first embodiment of the present invention will be described with reference to FIG. FIG. 1 is a process flowchart illustrating an embodiment of the multipoint terminal cooperation method of the present invention. In this embodiment, a plurality of terminal devices and a management server (for example, a personal computer or a workstation) are connected to each other by a communication line (for example, a computer network constructed by a transmission medium such as a telephone line or a communication cable). This is a multipoint terminal cooperation method used in the system having the configuration described above (details will be described in the sixth embodiment (FIG. 12)).

In FIG. 1, reference numeral 412 transmits a processing command from a terminal device to a management server in accordance with an instruction of an operator,
A registration request step for registering in the management server is a request execution step for transmitting a registered processing command from the management server to each terminal device and causing each terminal device to execute the request.
The main process 409 and the processing command registration process 411 are processing flows of the management server.

The request registration step 412 is a step (41) of generating and transmitting a processing command executed by the terminal device.
3, 414), and steps (415, 416) of receiving and registering processing commands executed by the management server.
Steps 415 and 416 are executed as separate processes (processing command registration process 411), and thus can be executed in parallel with the request execution step 404 (that is, the processing command can be received and registered simultaneously with the request execution step).

The request execution step 404 transmits the registered processing command from the management server to each operation terminal.
Execution sub-step 405 for simultaneous execution on each terminal device
And a confirmation sub-step 406 of receiving a confirmation command (a command for notifying the management server of completion of execution of the processing command from the terminal device) from all operation terminals.

Next, referring to FIG. 1, a series of procedures from the instruction of the operator to the execution of the processing will be briefly described.

After allocating and initializing a processing command registration area (401) and activating the processing command registration process 411 (402), the operator operates the operation terminal to perform desired processing (eg, display of images and characters). Instruct. Then, a request registration step 412 is executed, and the processing command according to the instruction content of the operator is registered in the management server via generation 413, transmission 414, and reception 415 of the processing command.

After registration, the result of decision step 403 is Y
(Yes), the execution sub-step 405 of the request execution step is executed, and the registered processing commands are executed simultaneously in each terminal device (for example, images and characters are displayed simultaneously). Subsequently, the confirmation sub-step 406 is executed, and the reception 407 of the confirmation command and the determination step 408 are performed.
, And waits until confirmation commands are received from all operation terminals.

When all the confirmation commands have been received, the result of the decision step 408 is Y, and the processing shifts to processing of a new processing command. That is, when a new processing command is registered during execution of the processing command, the result of the determination step 403 becomes Y, and the request registration step is repeated.

Since the conventional method does not have the confirmation sub-step, the processing command registered in the management server is immediately transmitted to each terminal device, and each terminal device executes the previous processing command after executing the previous processing command. , Execute the newly received processing command. In the present embodiment, using the confirmation sub-step, after waiting until confirmation commands have been received from all operation terminals (that is, after all processing terminals have executed the processing command), the information is newly registered in the management server. Send processing command. Accordingly, each terminal device can execute the newly received processing command immediately (ie, simultaneously at each terminal device) because there is no processing command being executed.

Next, a more specific embodiment of the embodiment shown in FIG. 1 will be described with reference to FIG. FIG. 18 is a diagram for explaining the execution timing of each processing step and the command on the communication line in one embodiment of the multipoint terminal cooperation method of the present invention. In this example, three terminal devices (1-1 to 1-1)
3) shows an example in which one management server 2 is connected. For example, when an instruction input 3 is performed by the operator at one terminal device (1-1), the processing indicated by the instruction input is performed in the request registration step 5, the request execution step 6 (6-1, 6-2).
..) And control step 7 for controlling the two steps. The request registration step 5 and the request execution step 6 are started by start events 11, 12, and 14 from the control step 7. The request registration step 412, request execution step 404, execution sub-step 405, and confirmation sub-step 406 of FIG.
5, 6-1 to 8, 9 in the above.

In the request registration step 5, the terminal device (1-1)
This is a step of registering the process indicated by the instruction input 3 performed by the operator in any one of 1-3) in the management server 2. The processing command 4 generated by the instruction input 3 is transmitted to the management server 2, and the management server 2 registers 15 the processing command 4. The request execution step 6 is a step of executing the processing command 4 registered in the management server 2 on each of the terminal devices (1-1 to 1-3), and includes an execution sub-step 8 and a confirmation sub-step 9. The execution sub-step 8 extracts the processing command 4 registered in the management server 2 (1
6), transmit to each terminal device (1-1 to 1-3) and execute the processing indicated by processing command 4 (17-1 to 17-
3) Yes. The confirmation sub-step 9 is performed in each terminal device (1-1).
(1) to (1-3) to generate a confirmation command 10 for confirming the completion of the execution of the processing indicated by the processing command 4 (18-1 to 1).
8-3) Then, the confirmation command 10 is transmitted from each of the terminal devices (1-1 to 1-3) to the management server 2. The management server 2 receives the confirmation command 10 and receives all the terminal devices (1
It is confirmed (19) that the execution of the processing in -1 to 1-3) is completed.

The control step 7 is a step for controlling the start timing of the request registration step 5 and the request execution step 6. Processing command 4 by operator's instruction input 3
Start event of request registration step 5 at the time of occurrence (11)
When the processing command is registered, or when the completion notification (13) of the request execution step 7 is received, an event (12, 14) for starting the request execution step 6 is generated to register and execute the processing command. Control timing.

In the control step 7, each terminal device (1-1 to 1-1)
1-3) and distributed on the management server 2. In this example, the part that generates the request registration start event is arranged on each terminal device (1-1 to 1-3), and the other parts are arranged on the management server 2.

FIG. 2 is a flowchart of the control step 7 arranged on the terminal device (1-1 to 1-3).
9 is a flowchart of a control step 7 arranged on the management server 2. The control step 7 arranged on the terminal device includes:
If there is an unregistered processing command in the terminal device (20
1) A request registration start event is generated (202), and the request registration step 5 is started. The control step 7 arranged on the management server 2 generates a request execution start event (12, 14) when there is a processing command registered in the management server 2 (211) (212).
To start. Then, it waits for a notification (13) of the completion of execution of the processing command from the request execution step 6 (213), and after receiving the notification, returns to the state of waiting for the registered processing command.

Next, using the above three steps, first, the procedure for executing the processing indicated by the instruction input 3 performed by the operator of the terminal device A (1-1), and then the following processing is executed The following describes the procedure to be performed.

First, when the operator of the terminal device A (1-1) performs an instruction input 3, the control step 7 generates a request registration step 5 start event (11), and the request registration step 5
Is started, and a processing command a (4) representing the processing operated by the instruction input 3 is registered in the management server 2. Then, in the control step 7, since the registered processing command 4 exists, the start event 12 of the request execution step (6-1) is performed.
Occurs. In the request execution step (6-1) started by the start event 12, the processing indicated by the processing command a (4) is executed by each of the terminal devices (1-1 to 1-3), and the confirmation command ar (10) is executed. In response, all terminal devices (1-1 to 1-1)
At -3), it is confirmed that the execution of the processing command a (4) is completed.

If a processing command subsequent to the processing command a (4) is registered during the execution of the request execution step (6-1), the control step 7 executes the request execution step (6-
After receiving notification 13 of execution completion in all terminal devices (1-1 to 1-3) from 1), a new start event 14 is generated and the next request execution step (6-2) is executed. .
In other words, for a processing command registered at any time,
The processing commands are executed in order while confirming the execution of each processing command.

As described above, in this embodiment, the processing command 4 representing the processing desired by the operator is registered in the management server 2, and the registered processing command 4 is registered in all the terminal devices (1-1 to 1-1).
Executed and confirmed in 1-3). Accordingly, the registered processing command can be transmitted to a plurality of terminal devices and execution can be started simultaneously, so that the terminal device (1-1) that has generated the processing command and the other terminal devices (1-2, 1--1)
The execution start timing of the process in 3) can be matched. Further, since the next process is started after confirming that each process is completed, it is possible to guarantee that each terminal device is executing the same process. Furthermore, since the processing commands are executed in the order registered in the management server 2, the order of processing between the terminals can be matched without using the operation right. Furthermore, by not using the operation right, the time required for acquiring the operation right is not required, and the waiting time from the input of the instruction to the execution of the process is reduced,
The response of the system can be improved.

<Embodiment 2> Next, a second embodiment of the present invention will be described with reference to the drawings. When an instruction is continuously input by one terminal device, the frequency of occurrence of a processing command by the instruction input increases. At this time, in the multipoint terminal coordination method shown in the first embodiment, the terminal device that is performing continuous instruction input repeats the request registration step, and the request execution step cannot be executed. Therefore,
This problem is solved by using a method for controlling the start timing of the request registration step.

FIG. 4 shows a cooperative system for transmitting and receiving commands between three terminal devices (1-1 to 1-3) and one management server 2 and performing the same processing as in FIG. FIG. 5 is a diagram expressing an example of a method on a time axis. One terminal device (1-
The processing procedure when the operator of 1) continuously performs the instruction inputs 3-3 and 3-4 is shown. Request registration step (5-
3, 5-4), the operation of the request execution step (6-3) is as follows.
This is the same as the first embodiment.

The control step 7 is distributed and arranged in each terminal device and the management server as in the first embodiment, and controls the start timing of the request registration step 5 and the request execution step 6. However, the control step 7 arranged in the terminal device
Is different from the first embodiment.

FIG. 5 shows a flowchart of the control step 7 arranged in the terminal device in this embodiment. In the control step 7, when an unregistered processing command (4-3) exists (201), a request registration event (11) is generated (202), a request registration step (5-3) is performed, and the processing command is registered. I do. After that, the registered processing command is executed and the confirmation command (10-
Wait for transmission of 3) (21) (221), and return to registration of the next processing command. The control step 7 arranged in the management server 2 performs the operation shown in the flowchart of FIG. 3 as in the first embodiment.

Next, a description will be given of a procedure for executing processing when the operator of the terminal device A (1-1) continuously inputs instructions 3-3 and 3-4.

First, the operator of one terminal device (1-1) continuously inputs instruction inputs 3-3 and 3-4. Then, the control step 7 starts the request registration step (5-3) to register the processing command a1 (4-3).
Request execution step of processing command a1 (4-3) (6-
Start 3). However, registration is not started for the processing command (4-4) of the next instruction input 3-4.

In the control step 7, the terminal device A (1-1)
When the execution of the processing command (4-3) is completed and the confirmation command a1r (10-3) is transmitted (21), the terminal device A (1
-1) The request registration step of the above unregistered processing command (4-4) is started.

As described above, in the present embodiment, when processing commands are successively registered from the same terminal device, the previously registered processing command is executed by the own terminal device, and then the next processing command is registered. I did it. Therefore, even if an instruction is continuously input by one terminal device, the registered process can be reliably executed without repeating only the request registration step.

<Embodiment 3> A third embodiment of the present invention will be described with reference to the drawings. In the first and second embodiments, commands are accumulated in the terminal device or the management server, and the interval from the input of an instruction by the operator to the execution of the process may be long. For example, when an instruction is input at a plurality of terminals at the same time, a plurality of processing commands are accumulated in the management server. When an instruction is continuously input at a certain terminal device, the processing command is accumulated on the terminal device (assuming that there is a processing command buffer). These occur when the processing execution interval is longer than the instruction input interval. The processing execution interval is determined by the required communication time when the actual processing execution time is short. The communication time is occupied by a large amount of overhead, and reducing the number of times of communication leads to a reduction in execution time. Therefore, the above problem is solved by using a method of editing a plurality of commands and reducing the number of times of communication between the terminal device and the management server.

FIG. 6 shows the cooperation of a system that sends and receives commands between three terminal devices (1-1 to 1-3) and one management server 2 and performs the same processing as in FIG. FIG. 5 is a diagram expressing an example of a method on a time axis. When the operators of the terminal device (1-1) and the terminal device (1-2) input instructions (3-5, 3-6) almost at the same time, the command editing step 31 is used to execute the management server 2 or the command editing step 31. Terminal device (1-
The command is edited and the instruction input is executed.

In this embodiment, a command editing step 31-1 for combining when a plurality of processing commands are registered in the management server, and a command editing step for combining when a plurality of confirmation commands are generated in the terminal device. Step 3
1-2 was added.

FIG. 7 is a flowchart showing the operation of the command editing step 31. Command editing step 3
First, the number of existing commands is checked (23).
1). If there are a plurality of commands, the editing method is determined according to the type of command (232). If the command is a registered processing command, a plurality of processing commands are combined, and the combined command is registered instead of the original processing command (233). If the command is a confirmation command, the composition is performed (234), and execution completion is confirmed using the composed command instead of the original confirmation command.

Next, the execution procedure of the processing of this embodiment using the command editing step 31 will be described. First, when the operator of the terminal device A (1-1) performs an instruction input 3-5, a request registration step (5-5) is started by the control step 7, and the processing command a1 (4-5) is transmitted to the management server. Registered in 2. Here, the command editing step is started, but since there is only one registered command, the command editing step ends without doing anything. Subsequently, when the operator of the terminal device B (1-2) performs the instruction input 3-6, the request registration step (5-6) similarly executes the processing command b.
1 (4-6) is registered, and then the command editing step 31-1 is started. Command editing step (31-
In 1), registered processing commands a1 (4-5), b
1 (4-6) and the command a
1 + b1 (32-1) is generated, and the synthesized command a1 + b1 (32-1) is registered in place of the registered processing commands a1 (4-5) and b1 (4-6). When the request execution step (6-5) is started by the control step 7, the execution sub-step (8-5) of the request execution step (6-5) includes the combined command a1 + b1 (32-
1) is transmitted as one command, and a1 (4-5),
Execute b1 (4-6).

In the confirmation sub-step (9-5), as a result of execution of the processing commands a1 (4-5) and b1 (4-6),
Confirmation command a1r (10-5), b1r (10-6)
Generate When the confirmation command a1r (10-5) is generated, the command editing step is started, but nothing is performed because there is only one command. Confirmation command b1r (10-
6) At the time of generation, the command editing step (31-2) is started, and the confirmation commands a1r (10-5) and b1r (10
-6) to generate a command a1r + b1r (32-2). Then, in the confirmation sub-step (9-5),
By the synthesized command a1r + b1r (32-2),
Confirm execution completion.

Next, a case where a processing command stored in a terminal device is edited will be described. FIG. 8 is an example of a cooperative method of a system in which commands are transmitted and received between three terminal devices (1-1 to 1-3) and one management server 2 to perform the same processing as in FIG. FIG. 3 is a diagram expressing a time axis. When the operators of the terminal device A and the terminal device B perform continuous instruction input (3-8 to 3-9, 3-10 to 3-11), the command editing steps 31-4 and 31-5 are executed. The figure shows the process from editing to registration to the management server 2.

Command editing steps 31-4, 31-5
In the flowchart of FIG. 7, since the command type is an unregistered processing command (232), the command is combined or deleted (235), and the edited command is registered. For example, when there are instruction inputs 3-8 and 3-9 in the terminal device A (1-1), there are a plurality of processing commands a2 (4-8) and a3 (4-9). According to step 31-4, a2 (4-8),
a3 (4-9), and the synthesized command a2 + a3
(32-4) is generated. And the control step 7
When the request registration start event occurs, in the request registration step 5-8, the synthesized command a2 + a3 (32-
4) Register.

In the terminal device B, an instruction input 3-10,
If there is 3-11, command edit step 31-5
Then, the processing commands b2 (4-10) and b3 (4-1)
In 1), the older processing command b2 (4-10) is deleted. Then, in the request registration step 5-9 started by the control step 7, the processing command b3 (4-11)
Is registered in the management server 2. Here, whether to combine a plurality of commands (31-4) or to delete old commands (31-5) is determined by the contents of the command.

As described above, in this embodiment, when there are a plurality of commands, editing such as synthesis or deletion is performed in the command editing step. Therefore, when registering the processing command generated in the terminal device in the management server, when executing the registered processing command in the terminal device, and when confirming the completion of execution by the confirmation command, communication between the terminal device and the management server. The number of times can be reduced, and the waiting time from the input of the instruction by the operator to the execution can be shortened.

For example, ISD is performed between the management server and the terminal device.
It is assumed that the connection is performed by N lines (64 kbps) and a short execution time process (assumed to be 10 ms) is performed in cooperation with a command of about 100 bytes. In this case, from the generation of one processing command to the completion of execution, about 40 times
Since the communication of ms is performed three times, the processing time is about 130 ms. Therefore, the time when two commands are executed separately is about 260 ms. When this embodiment is used, the communication overhead (about 30 ms / one communication) can be reduced, so that the processing can be executed in about 170 ms, and the response time can be shortened by about 50%.

In the present embodiment, the command editing step 31 is executed when a plurality of commands exist when a command is generated in the terminal device or when the command is registered in the management server. Before starting the request execution step and before transmitting the confirmation command, the number of commands may be checked to determine whether or not to perform editing. As the editing method, a method of synthesizing all commands and a method of deleting old commands have been described. However, a method of deleting every several commands and synthesizing other commands may be used. Further, in the present embodiment, a method of connecting a plurality of processing commands is shown as a method of combining, but the contents of the commands may be analyzed in more detail and combined. For example, the content of the command may be changed or a new command may be generated.

Further, in the present embodiment, the command editing step for the confirmation command combines only the confirmation command as shown at 31-2 in FIG. 6; however, the terminal C (1-3) shown in FIG. As shown in the command editing step 31-3, when the processing command 4-7 is generated by the instruction input 3-7 at the time of editing the confirmation command, the confirmation command a1r is issued in the command editing step (31-3).
(10-5) and b1r (10-6) are combined with the processing command c1 (4-7) to produce a1r + b1r + c1.
(32-3) may be generated, and the request execution step (5-7) may be performed together with confirmation of the process completion.

<Embodiment 4> Next, a fourth embodiment of the present invention will be described with reference to the drawings. When the operator inputs a processing instruction, the format of the processing command is a set of information for identifying the processing target and processing contents for the processing target. For example, when the image displayed on the screen of the terminal device is specified as the processing target and the image is enlarged as the processing content,
The processing command is expressed by a set of image identification information and enlargement processing content. According to the present invention, even if operators of different terminal devices simultaneously input instructions to the same processing target, the processing commands are executed in the order in which the processing commands are registered in the management server. Can be executed.

However, in the above-described embodiment, the processing target may be erased by the processing command registered immediately before, and the processing command registered next may become unexecutable.
For example, when a previously registered processing command instructs erasure of a display image, an enlargement operation on the display image can be input from another terminal before erasure is performed. But when you actually try to do the expansion,
The image has already been erased by a previous processing command,
Cannot perform the zoom operation. In the present embodiment, the above problem is solved by using a method of managing the processing target of the processing command and controlling the execution of the command.

FIG. 9 shows three terminal devices (1-1 to 1--1).
3) send and receive commands between one management server 2 and
FIG. 5 is a diagram expressing an example of a coordination method of a system that performs the same processing on a time axis. The operator of the terminal device A and the terminal device B
Instruction inputs (3-12, 3-13) performed almost simultaneously are registered and executed. Here, functions other than the command management step 51 are the same as those in FIG.

The command management step 51 manages the processing target (52) of the processing command so as to execute only the executable processing command. FIG. 10 is a diagram showing an example of the processing target table (55) held by the command management step 51. The processing target table (55) holds processing target identification information 56-1 to 56-4.
The command management step 51 checks the contents of the processing command when it is registered, adds identification information of the processing target to the processing target table (55) at the time of processing for generating the processing target, and deletes the processing target. Sometimes, it is deleted from the processing target table (55). When the processing command is registered, the identification information of the processing target in the processing target table (55) is checked, and the processing command having no processing target is deleted so as not to be executed.

Next, the processing procedure of this embodiment using the command management step 51 will be described. The contents of the processing target table of the command management step 51 at the beginning of FIG. 9 are the processing targets W, X, Y, Z as indicated by 55 in FIG.
(56-1 to 56-4). First, the operator of the terminal device A (1-1) performs an instruction input 3-12 to delete X (52). Next, the request registration step
(5-10) is a processing command a4 for deleting X (52).
(4-12) is registered. Then, the command management step (51-1) looks at the processing command a4 (4-12) and deletes the identification information (56-2) of X (52) from the processing target table 55. Further, the terminal device A (1-
Almost simultaneously with the instruction input (3-12) in 1), the operator of the terminal device B (1-2) performs an instruction input 3-13 for operating the X (52). Subsequently, a request registration step (5-
11) is a processing command b4 representing an operation on X (52).
(4-13) is registered in the management server. The command management step (51-2) includes a processing command b4 (4-13).
Since the identification information of the processing target X (52) does not exist in the processing target table, the processing command b4 (4-13) is deleted. As a result, the registered processing command is X
Processing command a4 (4-1) for instructing erasure of (52)
In the request execution step (6-6), the processing command a4 (4-12) is executed.

As described above, in the present embodiment, the processing target indicated by the processing command is managed, the processing command having no processing target is deleted, and the processing command is not executed. Therefore, even when the processing target is deleted by the processing command executed immediately before and cannot be executed, inconsistency between the processing commands can be prevented, and occurrence of an error can be prevented.

In this embodiment, the command management step includes:
Processing commands that have no processing target are deleted.
The terminal device that has generated the processing command may be notified that the processing command has been deleted. Also,
In this embodiment, the command management step is executed on the management server. However, the command management step may be executed before executing the processing on the terminal device.

<Embodiment 5> Next, a fifth embodiment of the present invention will be described with reference to the drawings. According to the present invention, each terminal device can input an instruction at an arbitrary time, and the execution order of processing of each terminal device can be matched. But,
In the case where the number of terminal devices is large, if various instructions are input simultaneously from a plurality of terminals, various processes may be executed and confusion may occur. In such a case, it may be desirable to limit the number of terminals that can input instructions using the operation right.
For example, when an image is displayed on each terminal device and an operator of a certain terminal device gives an explanation to an operator of another terminal device, it is easier for the operator of the other terminal device not to operate the terminal device to explain. Therefore, a method of introducing an operation right using a method that allows and prohibits input of an instruction on a terminal device will be described.

FIG. 11 shows three terminal devices (1-1 to 1--1).
3) send and receive commands between one management server 2 and
FIG. 5 is a diagram expressing an example of a coordination method of a system that performs the same processing on a time axis. This figure shows a case where the operator of the terminal device A has input an instruction (3-14) for designating an operation right. Here, except for the operation right management step 61, FIG.
8 has a function similar to that of FIG. The operation right management step 61 includes:
In accordance with the contents of the processing command (4-14) registered by the instruction input (3-14), permission or prohibition of the instruction input of each terminal device is controlled. Processing command (4-1
In 4), identification information of the terminal device and permission or prohibition of inputting an instruction at the terminal device are described. The terminal device designated to prohibit the instruction input by the operation right management step 61 does not generate the processing command even if the operator inputs the instruction.

Next, the processing procedure of this embodiment using the operation right management step 61 will be described. First, the terminal device A (1-
The operator 1) performs the instruction input 3-14 to permit the instruction input of the own terminal A and prohibit the instruction input of the other terminal devices B (1-2) and C (1-3). The control step 7 starts a request registration step (5-12), and inputs an instruction 3-1.
The processing command a5 (4-14) for instructing the control of the operation right generated by Step 4 is registered in the management server.

In the request execution step 7 started by the control step 7, in the execution sub-step 8-7, the processing command a5 (4-15) is transmitted to each of the terminal devices (1-1 to 1-1).
-3) and execute. Then, the processing command 4-
Since the content of 14 is for controlling the operation right, the operation right management step 61 is started. Operation right management step 61
Allows the terminal device A (1-1) to input an instruction according to the content of the processing command (4-14) (62), and inputs the instruction at the terminal devices B (1-2) and C (1-3). Is prohibited (63-1, 63-2). And confirmation sub-step 9
By -7, it is confirmed that the control of the operation right is completed.

As described above, in this embodiment, the operation right management step for setting permission and prohibition of the input of the operator's instruction in each terminal device is prepared, and the instruction input on the terminal device can be controlled by the processing command. I made it. Therefore, it is possible to realize a multipoint terminal cooperation method for restricting a terminal device capable of inputting an instruction using an operation right, and further, a method not using an operation right that allows an operator to arbitrarily input an instruction, and controlling the operation right. The method can be arbitrarily switched and used depending on the scene to be used.

In the present embodiment, the instruction input on the terminal device is permitted and prohibited by the operation right management step. However, the registration of the processing command may be permitted and prohibited on the management server side. Further, in the present embodiment, the operation right management step is executed when the processing command instructing the control of the operation right is executed. However, when the processing command instructing the control of the operation right is registered, the operation right management step is executed. May be executed.

<Embodiment 6> Next, a sixth embodiment of the present invention will be described with reference to the drawings. There is a remote medical care support system in which medical data of the same patient is displayed on a plurality of terminal devices, and a plurality of doctors cooperate and diagnose while referring to the same medical data. This embodiment is an embodiment relating to a remote medical care support system using the multipoint terminal cooperation method of the present invention.

FIG. 12 is a diagram showing an example of the remote medical care support system. 1-1, 1-2, and 1-3 are terminal devices A, B, and C operated by a doctor, and displays (72-1 to 72-3) for displaying images and instruction input 3 by an operator. (73-1 to 73-3) and a mouse (74-1 to 74-3) for performing 2 is a terminal device A,
The management server controls the operations of B and C. Each terminal device and management server are realized using, for example, a personal computer or a workstation.

Reference numeral 71 denotes a communication line for transmitting a processing command between each of the terminal devices A, B, and C and the management server. The communication line is, for example, a general telephone line or ISDN.
It is realized by a computer network such as a line or a LAN.

Next, the operation of the remote medical treatment support system shown in FIG. 12 will be described. This system displays a display image on a certain terminal device on all terminal devices. For example, when the doctor of the terminal device A instructs the image displayed beforehand to perform image enlargement processing, the enlarged image is displayed on the three terminal devices A,
Display on B and C. This system has, for example, six types of function menus 301 shown in FIG. It is assumed that data of an image to be displayed (image data) is prepared in advance in each terminal device. Specifically, the image data is transmitted in advance via a communication line, and a recording medium (for example, a magneto-optical disk) storing the image data is prepared in advance. In addition, each terminal device is provided with voice communication means using a telephone, a videophone, or the like capable of interacting at multiple points, and is used together with the present system.

First, the doctor of the terminal device A (1-1) selects the image display 302 from the function menu 301. Then, a processing command corresponding to the instruction input (image display) is generated. This processing command is the processing target (image identifier)
And processing contents (image display). What is an image identifier?
Information (numerical values and names) for specifying image data. For example, a file name is used as an image identifier, and an image display 30
At the time of selection, the file name list is displayed, and the desired image is determined by the doctor selecting the desired image.

The generated image display processing command is shown in FIG.
According to the procedure of the multipoint terminal cooperation method shown in FIG. 8, the data is transmitted to each of the terminal devices A, B, and C. Here, the image display processing command corresponds to the processing command 4 in FIG.

Each of the terminal devices A, B, and C, which has received the image display processing command, selects image data having the same file name from previously prepared image data and displays it on the display in accordance with the content of the processing command. As a result, the same image (75-1, 75-2, 75-
3) is displayed. After the display is completed, the confirmation command 10 is transmitted to the management server.

Next, the doctor of the terminal device B (1-2) selects the pointer 305 from the function menu 301. Then, a point of interest on the image is designated by the mouse. Then
A processing command having a processing target (image identifier), processing content (pointer display), and parameters (pointer identifier and display coordinates) is generated. The pointer identifier is information (numerical value or name) for specifying a newly displayed pointer.
For example, a numerical code generated by an appropriate procedure based on a difference between an operator and a terminal device is used. The generated processing command is transmitted to each terminal device A, in accordance with the procedure of the multipoint terminal cooperation method shown in FIG.
B and C are transmitted. Each of the terminal devices A, B, and C that has received the pointer display processing command displays the pointer at the coordinates on the designated image according to the content of the processing command. As a result, the pointers (76-1 to 76-3) are displayed at the same positions on the images of the terminal devices A, B, and C. After the display is completed, the confirmation command 10 is transmitted to the management server.

Subsequently, the doctor of the terminal device B (1-2)
An instruction to move the pointer is input by dragging the image with the mouse.

FIG. 14 shows a screen (81) in which an instruction is input by dragging the mouse on the terminal device B, and each terminal device A,
The screen (82) as a result of displaying the pointer on B and C is shown. Reference numerals 84-1 and 76-4 denote a pointer display coordinate p1 of the pointer display processing command and a displayed pointer (corresponding to 76-1 to 76-3 in FIG. 12). 76-
When the mouse cursor 83 is moved to the coordinate p4 by dragging the mouse while the pointer of No. 4 is displayed, a processing command having a processing target (pointer identifier), processing content (pointer movement), and parameters (display coordinates) is displayed. The three display coordinates p2, p3, and p4 of the pointer are generated. The command is deleted by applying the command editing step (31-5) of FIG. 8 to the three generated commands. When deleting, the processing commands of the old coordinates p2 and p3 among the three commands are deleted, and the latest coordinates p4 are left to be executed. And p4
By transmitting and executing the processing command (4-16), the pointers of the terminal devices A, B, and C move to the position of 76-5. Similarly, the display coordinates p5, p of the pointer
Older p5, p6 for three processing commands of 6, 6
Is deleted, and the processing command of p7 is executed to move the pointer to the position of 76-6.

Next, the doctor of the terminal device A (1-1) selects the pen 306 from the function menu 301. Then, the mouse cursor is displayed in the shape of a pen, and the operator moves the pen-shaped cursor by dragging the mouse,
Display a line on the screen according to the movement trajectory.

FIG. 15 shows a screen (91) showing a state where the user inputs an instruction to display a line by dragging the mouse on the terminal device A, and the result of the line drawn on each of the terminal devices A, B and C. Is shown on the screen (92). First, when coordinates 11 are designated by using a pen-shaped mouse cursor 93 (hereinafter referred to as a pen), a process including a processing target (image identifier), processing contents (line entry start), and parameters (line identifier and line starting point coordinates 11) is performed. A command (4-18) is generated. The line identifier is information (numerical value or name) for specifying a line to be newly displayed. For example, a numerical code generated by an appropriate procedure based on a difference between an operator and a terminal device is used. Then, the processing command (4-18) is transmitted to each of the terminal devices A, B, and C, and the starting point of the line is displayed as a point at the position of the execution result 95-1. The procedure so far is the same as the procedure for displaying the pointer in FIG. When the pen 93 is moved to the coordinate 14 by the operator while the start point of the line 95-1 is displayed, the processing target (line identifier), the processing contents (extension of the line), and the parameters (extension coordinates of the line) are changed. The generated processing command is generated for three of the extended coordinates l2, l3, l4 of the line. A processing command is synthesized by applying the command editing step (31-4) of FIG. 8 to the three generated commands. When synthesizing, all coordinates l are used to draw a smooth curve.
2, 13 and 14 are all synthesized. Then, by transmitting and executing the synthesized command (32-5), the line of the section 95-2 is displayed on the screen of each of the terminal devices A, B, and C. Similarly, when three processing commands of the line extended coordinates 15, 15, 16 are generated, three processing commands l
5, 16 and 17 are synthesized. Then, by transmitting and executing the combined command (32-6), the line of the section 95-3 is displayed on each of the terminal devices A, B, and C.

Subsequently, the doctor of the terminal device B (1-2) also
The function menu 30 is the same as the doctor of the terminal device A (1-1).
The pen 306 is selected from 1. Then, the terminal devices A and B
Of doctors simultaneously display lines.

FIG. 16 shows a terminal device A with a pen (93-1).
(101-1) showing a state of inputting an instruction by the user
And a screen (101-2) showing how to input an instruction with the pen (93-2) on the terminal device B, and terminal devices A, B,
The screen (102) as a result of drawing a line on C is shown. Here, it is assumed that the doctors of the terminal devices A and B are each drawing the line by dragging the mouse.

Lines 95-4 and 95-5 are portions already displayed by the doctors of the terminal devices A and B, respectively. First, when the pen (93-1) is moved to the coordinate la4 by dragging the mouse of the doctor of the terminal device A, a processing command for instructing the extension of the line is output to the extended coordinates la1, la2, la3, and la4 of the line. Generate coordinates. The generated four processing commands are synthesized by applying the command editing step (31-4) shown in FIG. 8 as in FIG. Then, the synthesized command (32-7)
Is registered in the management server.

The pen (93-2) is moved to lb4 in the terminal device B simultaneously with the instruction input in the terminal device A.
The processing command for instructing the extension of the line is given by
Four coordinates 1, 1, lb2, lb3, lb4 are generated. The generated four processing commands are combined in the same manner as in the terminal device A, and the combined command (32-8) is registered in the management server 2.

At this point, since the composite commands 32-7 and 32-8 are stored in the management server 2 from the terminal devices A and B, respectively, the command editing step (3) in FIG.
Edit by applying 1-1). Although the two commands have different processing targets, they have the same processing content of extending a line, and high responsiveness is required for writing a line.
Perform editing to combine the two commands. Then, by transmitting and executing the synthesized command (32-9), the lines 95-4 and 95-5 are displayed on the display screens of the terminal devices A, B, and C.
Is displayed.

Next, the doctor of the terminal device A (1-1) selects the close image 303 from the function menu 301 to close the displayed image. On the other hand, the doctor of the terminal device B selects the image enlargement 304 from the function menu 301 and enlarges and displays the displayed image.

FIG. 17 shows the state (111-1) when the instruction input (3-17) for closing the image 75 displayed on the terminal device A and the image displayed on the terminal device B are enlarged. State (11) when instruction input (3-18) is performed
1-2) and the screen of the result (1) in each of the terminal devices A, B, and C.
12) is shown.

First, when the doctor of the terminal device A inputs an instruction (3-17) for selecting the menu 303 for closing the image, a processing command (4-19) is generated. This processing command (4-19) has a processing target (image identifier) and processing content (image closing). On the other hand, the doctor of the terminal device B inputs an instruction to select the image enlargement menu 304 (3-2).
By performing (0), a processing command (4-20) is generated.
This processing command (4-20) has a processing target (image identifier (same as the image identifier specified by the terminal device A)) and processing contents (image enlargement).

These two processing commands are processed according to the multipoint terminal cooperation method shown in FIG. Processing commands 4-19 and 4-20 correspond to 4-12 and 4--12 in FIG. 9, respectively.
13, the image (75) that the terminal devices A and B are about to operate corresponds to the processing target X (52) in FIG.
When the processing of closing the image of the processing command (4-19) is performed, the image to be enlarged by the processing command (4-20) does not exist. Therefore, in the command management step (51),
The processing command (4-20) is deleted. As a result, only the processing command (4-19) is transmitted and executed, and the image (75) displayed on each of the terminal devices A, B, and C is closed.

Next, the physician of the terminal device A operates the function menu 3
The exclusive / release 307 is selected from 01. Then, a processing command specifying permission or prohibition of instruction input at each terminal device is generated. The contents of the processing command include a processing target (terminal device identifier) and processing contents (whether or not an instruction can be input for each terminal device). The terminal device identifier is information (numerical value or name) for specifying each terminal device, and for example, uses a numerical code assigned to each terminal device in advance. Here, since the terminal device A wants to occupy the operation right, the terminal device A is designated to permit instruction input, and the terminal devices B and C are designated to inhibit instruction input.

The generated processing command is transmitted to each of the terminal devices A, B, and C according to the procedure of the multipoint terminal cooperation method for controlling the operation right shown in FIG. This processing command corresponds to 4-14 in FIG. In the operation right management step (61 in FIG. 11), the terminal devices A, B, and C that have received the processing command are permitted to input an instruction in the operation right management step (61 in FIG. 11), and the terminal devices B and C receive the instruction input. Is forbidden. In this way, the instruction input at the terminal device A is executed, but the instruction input at the terminal devices B and C is not executed, and the doctor of the terminal device A sends the doctor of the terminal devices B and C to the doctor shown in FIG. The description can be made using each function alone.

When the description is completed and the instruction input from the terminal devices B and C is permitted, the exclusive / release 307 is selected from the function menu 301 again. Then
This time, a processing command for permitting the instruction input in all the terminal devices A, B, and C is generated. This processing command is transmitted again according to the multipoint terminal cooperation method shown in FIG. 11 and executed by each of the terminal devices A, B, and C. In each of the terminal devices A, B, and C, the instruction input is permitted in all the terminal devices by the operation right management step 61, so that the instruction input can be performed from any terminal.

As described above, the remote medical care support system of the present invention applies the multipoint terminal cooperation method of the present invention shown in the first to fifth embodiments. Therefore, the processing content and display between the terminal devices can always be matched, so that it is possible to guarantee that each doctor is referring to the same information, and to prevent the occurrence of medical errors. Furthermore, since the operating right is not necessarily required and can be used as a part of the function, for example, when multiple doctors discuss, it is possible to input instructions at any time without using the operating right. In the case where a certain doctor gives an explanation, an operation right can be used to prohibit another operation, thereby providing an environment for collaborative work in accordance with the usage pattern at that time. Furthermore, by not using the operation right, the response time from instruction input to display can be shortened.In addition, by editing commands, the number of communication times can be reduced, thereby reducing communication overhead and preventing the accumulation of commands. Responsiveness can be improved. Further, by managing the processing target of the command, occurrence of an error can be prevented beforehand, and the reliability of the system can be improved.

In this embodiment, a configuration using three terminal devices has been described. However, any number of terminal devices may be connected as long as the number is two or more.

Further, in this embodiment, a configuration using a dedicated personal computer or workstation for operating the management server 2 has been described. However, the same personal computer or workstation as the terminal device is used for the management server. Is also good. In this case, the management server is configured by software and coexists with one of a plurality of terminal devices that cooperate.

[0088]

According to the present invention, a plurality of terminal devices including the terminal device that has input an instruction start processing at the same time by transmitting a command from the management server. After confirming the completion, start the next process. Therefore, the start timings of the processes between the terminal devices can be matched, and it can be guaranteed that each terminal device is executing the same process. In addition, since the processing proceeds in the order in which the processing commands are registered in the management server, even if each terminal performs an operation arbitrarily, the processing order can be matched between the terminal devices, and the acquisition of the operation right is not necessarily required. Instead, the operator can input an instruction at any time. Further, since the time required for acquiring the operation right is not required, the waiting time from the input of the instruction to the execution of the process can be reduced.

Therefore, according to the present invention, the multipoint terminal cooperation method which can always match the processes between the terminals (with no time lag), the operator can speak at any time and the responsiveness, and the use of the method. The remote medical care support system can be provided.

[Brief description of the drawings]

FIG. 1 is a flowchart showing one embodiment of a multipoint terminal cooperation method of the present invention.

FIG. 2 is a flowchart illustrating an example of control steps to be arranged on a terminal device.

FIG. 3 is a flowchart illustrating an example of main control steps arranged on a management server.

FIG. 4 is an explanatory diagram showing an example of a multipoint terminal cooperation method for controlling registration start timing.

FIG. 5 is a flowchart illustrating an example of control steps arranged in a terminal device that controls registration start timing.

FIG. 6 is an explanatory diagram showing an example of a multipoint terminal cooperation method for editing a command.

FIG. 7 is a flowchart illustrating an example of the operation of a command editing step.

FIG. 8 is an explanatory diagram showing an example of a multipoint terminal cooperation method for editing a command.

FIG. 9 is an explanatory diagram showing an example of a multipoint terminal cooperation method for managing command execution.

FIG. 10 is a diagram showing an example of the contents of a processing target table possessed by a command management step.

FIG. 11 is an explanatory diagram showing an example of a multipoint terminal cooperation method for controlling an operation right.

FIG. 12 is an explanatory diagram showing a remote medical care support system according to one embodiment of the present invention.

FIG. 13 is a diagram showing an example of a function menu of the remote medical assistance system.

FIG. 14 is an explanatory diagram illustrating an example of input of a pointer movement instruction and a pointer display result of each terminal device.

FIG. 15 is an explanatory diagram showing an example of a line entry instruction input and an entry result of each terminal device.

FIG. 16 is an explanatory diagram showing an example of instruction input at two terminal devices and an example of a result of entry in each terminal device.

FIG. 17 shows an instruction input for closing an image on the terminal device A,
FIG. 9 is an explanatory diagram showing an example of a screen on each terminal device when an instruction to enlarge an image is input on the terminal device B.

FIG. 18 is an operation explanatory diagram of one embodiment of the multipoint terminal cooperation method of the present invention.

[Explanation of symbols]

1-1 to 1-3: terminal device, 2: management server, 3, 3-
1-3-18: instruction input, 4, 4-1 to 4-20: processing command, 5, 5-1 to 5-12: request registration step,
6-1 to 6-7: request execution step, 7: control step, 8, 8-1 to 8-7: execution sub-step, 9, 9-
1-9-7: Confirmation substep, 10, 10-1-10
-6: confirmation command, 11: request registration start event, 1
2, 14 ... request execution start event, 13 ... execution completion notification, 15 ... registration processing, 16 ... registered command retrieval processing, 17-1 to 17-3 ... processing execution, 18-1 to 18
-3: confirmation command generation, 19: execution confirmation, 21: execution completion in terminal device A, 31-1 to 31-5: command editing step, 32-1 to 32-9: synthesis command, 51
-1 to 51-2: Command management step, 55: Processing target table, 56-1 to 56-4: Processing target identification information,
61: operation right management step, 62: instruction input permission, 63
-1 to 63-2: instruction input prohibition, 71: communication line, 72
-1 to 72-3 ... display screen, 73-1 to 73-3 ... keyboard, 74-1 to 74-3 ... mouse, 75, 75-1
... 75-3 ... Image, 76-1 to 76-6 ... Pointer, 8
1. Pointer input state, 82: Pointer display result, 83: Mouse cursor, 84-1 to 84-7: Pointer display coordinates, 91, 101-1 to 101-2 ... Line input state, 92, 102 ... line display result, 93, 93-
1-93-2: Pen-shaped mouse cursor, 94-1 to 94
-7,103-1 to 103-4,104-1 to 104-4
... coordinates of lines, 95-1 to 95-7 ... lines, 111-1 ... input of an instruction to close an image, 111-2 ... input of an instruction to enlarge an image, 112 ... screen after processing to close an image, 30
1: Function menu, 302 to 307: Contents of function menu.

Claims (6)

[Claims] 1. An information processing apparatus comprising: a plurality of terminal devices for inputting an instruction by an operator; and a management server for controlling the terminal device. Each terminal device registers a processing command corresponding to the instruction content by the operator in the management server. In the multipoint terminal cooperation method in which the management server transmits the registered processing command to each terminal device and causes each terminal device to execute the same process, the management server notifies the management server of the completion of the processing command in the terminal device. A confirmation sub-step for confirming that all terminal devices have completed execution of the processing command using the confirmation command to be notified, and a processing command newly registered in the management server after confirming execution completion by the confirmation sub-step. A request execution step having an execution sub-step of transmitting to a terminal device and executing the transmission. 2. The method according to claim 1, wherein the timing of registering a new processing command in a certain terminal device in the management server is
The processing command previously registered from the above terminal device is
A multipoint terminal cooperation method, comprising a control step of setting a time point at which execution of the terminal device ends. 3. A command editing step according to claim 1 or 2, wherein when a plurality of said processing commands and said confirmation commands are transmitted, command synthesis and command deletion are edited according to the type and amount of commands to be transmitted. A multipoint terminal cooperation method, comprising: 4. The processing command according to claim 1, wherein the processing command has information for identifying an object to be processed.
A multipoint terminal cooperation method, comprising: a command management step of detecting that a processing target of a certain processing command has been deleted by a processing command earlier than the certain processing command, and deleting the certain processing command. 5. The operation right control processing command according to claim 1, wherein the processing command includes an operation right control processing command for designating whether or not an operator can input an instruction in each terminal device. A multipoint terminal cooperation method, comprising an operation right management step of permitting or prohibiting instruction input of a plurality of terminal devices according to designated contents. 6. A remote medical care support system in which medical data of the same patient is displayed on a plurality of terminal devices, and a plurality of doctors operating the plurality of terminal devices perform a diagnosis in cooperation with each other while referring to the same medical data. In the system, a display screen for displaying medical data of a patient, a plurality of terminal devices having input means for inputting an instruction by an operator, a management server for controlling the plurality of terminal devices, the plurality of terminal devices, Communication means for transmitting commands to and from the management server,
When a doctor operating a certain terminal device instructs processing on the displayed medical data, the instruction is executed using the multipoint terminal cooperation method according to any one of claims 1 to 5, and A remote medical assistance system characterized by displaying the same screen on a terminal device.