JP2012142789A - Apparatus, remote control device, and remote control system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To certainly grasp a delay situation in video transmission and enhance an operation safety in a remote control system.SOLUTION: An RTG16a comprises: a video camera 24a; a video encoder 27a which converts video data acquired by the video camera 24a into a format suitable for IP transmission; a hub 20 which transmits the video data converted by the video encoder 27a to a remote control table 31a; and a lamp 29 which is provided within an imaging range of the video camera 24a and turns on/off based on an instruction from the remote control table 31a. The remote control table 31a outputs an instruction of turning on/off the lamp 29 to the RTG16a, and obtains a period of time from when the instruction is issued to when the video data including the turned on/off lamp 29 in the video is received, thereby detecting a delay time of the video data.

Description

  The present invention relates to, for example, a remotely operated device, a remote operation device that remotely operates the device, and a remote operation system including the device and the remote operation device.

  For example, the container terminal has a quay facility for loading or unloading containers on a container ship, and stores and stores the unloaded containers until they are delivered to the shipper, or stores the containers received from the shipper until they are loaded. Has a container yard. When the container is transferred at the container terminal, the container stored in the container yard is transferred to a trailer by a rubber tire transfer crane (hereinafter referred to as “RTG”), and the container is transported by the trailer.

In such a container terminal, the RTG is controlled by wireless remote control. In the operation control, for example, a command such as a command is transmitted to the RTG from a remote console arranged in the management building, and from the RTG. The status is sent to a remote console to control the operation (for example, see Patent Document 1).
That is, video data from a plurality of cameras, audio data from microphones and speakers, and control data such as a center signal are transmitted from the RTG to the remote operation console, and the remote operation console to the RTG is based on the various data. Control data such as a driving operation signal is transmitted.

JP 2006-180141 A JP 2007-31102 A

  By the way, as described in Patent Document 2, various data transmitted / received between the RTG and the remote console are control data (sensor signals from the RTG to the remote console, and from the remote console to the RTG). Driving operation signals and the like) are transmitted and received by wireless data communication using a modem, and video data and audio data are transmitted and received using radio waves leaked from a leaky coaxial cable.

  However, in Patent Document 2, when a delay (transmission delay) occurs in the video data, the delay state cannot be confirmed, so that there is a problem that the safety of the operation is impaired. In particular, in order to expand the range of remote operation locations and further improve the efficiency of the remote operation system, all the above-mentioned various data transmission formats are IP (Internet Protocol) transmission, and data transmission / reception on the Internet is possible. If possible, the video data can be sufficiently delayed.

  The present invention has been made in view of such circumstances, and can provide a device, a remote operation device, and a remote operation device that can reliably grasp the delay state of video transmission and can enhance the safety of operation in a remote operation system. An object is to provide an operation system.

In order to solve the above problems, the present invention employs the following means.
The present invention is a device that is remotely operated by a remote operation device and transmits video data to the remote operation device, and includes a photographing unit that obtains video data, and data transmission of the video data obtained by the photographing unit Data conversion means for converting to a format suitable for the data conversion means, transmission means for transmitting the video data converted by the data conversion means to the remote operation device, provided upstream of the video data from the data conversion means, There is provided an apparatus comprising information adding means for adding first information for causing a delay time of video data to be detected by the remote control device based on a command from the remote control device to the video data.

  According to the present invention, video data is acquired by the photographing means, the video data is converted into a format suitable for data transmission by the data converting means, and transmitted to the remote control device by the transmitting means. In this case, the video data includes first information for detecting a delay state of the video data in the remote operation device based on a command from the remote operation device on the upstream side of the video data from the data conversion unit. Added by information adding means. Thereby, in the remote control device, the delay time of the video data is detected by detecting the time from the transmission of the command to add the first information to the reception of the video data to which the first information is added. Can be grasped. In addition, since the first information is added on the upstream side of the video data with respect to the data conversion means, evaluation of a series of delay times considering not only the data transmission delay but also the delay in the conversion processing of the video data is performed. It becomes possible.

  In the above device, the information adding means may be a lamp installed within a range photographed by the photographing means, and may be turned on and off based on a command from the remote control device.

  According to such a configuration, for example, when an instruction to turn on the lamp is received from the remote control device, the lamp is turned on, and the video data on which the lit lamp is reflected is suitable for data transmission by the data conversion means. It is converted into a format and transmitted to the remote control device by the transmission means. Thus, the remote control device can detect the delay time by detecting the time from when the lamp lighting command is issued until the video data on which the lit lamp is reflected is received. Thus, according to the above configuration, the delay time of the video data can be easily detected by a simple method of turning on / off the lamp.

  In the above device, the information adding means may be a mixer for imposing predetermined data on the video data photographed by the photographing means based on a command from the remote control device.

  According to such a configuration, for example, the video data acquired by the photographing unit is input to the mixer. At this time, when a command for imposing predetermined data is received from the remote control device, the predetermined data is imposed on the video data in the mixer. Then, the video data on which the predetermined data is imposed is converted into a format suitable for data transmission by the data conversion means, and transmitted to the remote control device by the transmission means. As a result, the remote control device detects the delay time of the video data by detecting the time from when the impose command for the predetermined data is transmitted until the video data on which the predetermined data is imposed is received. It becomes possible to do. Thus, according to the above configuration, the delay time of the video data can be easily detected by a simple method of imposing predetermined data.

  The present invention is a remote control device for remotely operating any one of the devices described above, wherein the first information for detecting the delay time of the video data is added to the video data. Provided is a remote control device that detects a delay time of video data by outputting a command and obtaining a time from when the command is issued until the video data including the first information is received.

  According to the present invention, by detecting the time from when the instruction to add the first information to the video data is output to the device until receiving the video data to which the first information is added, The delay time can be easily detected.

  The remote control device may stop the operation of the device when the delay time of the video data is equal to or greater than a predetermined threshold value.

  When the delay time of the video data is equal to or greater than a predetermined threshold, the operation of the device is stopped. Therefore, an operation error caused by the delay of the video data can be prevented, and the safety of the device operation can be improved.

  Furthermore, the remote operation device may resume the operation of the device that has been stopped when the delay time of the video data becomes less than the predetermined threshold.

  When the delay time of the video data becomes less than the predetermined threshold, the operation of the equipment that has been stopped is automatically restarted, so that the efficiency of the operation can be improved.

  The present invention provides a remote operation system including any of the above-described devices and the above-described remote operation device.

  According to the present invention, it is possible to reliably grasp the delay state of the video data, and to improve the operation safety in the remote operation system.

It is a schematic structure perspective view of the container terminal concerning one embodiment of the present invention. It is a schematic block diagram of the RTG remote control system which concerns on one Embodiment of this invention. It is explanatory drawing which shows the procedure of the delay time detection method of RTG remote control video data which concerns on one Embodiment of this invention. It is the figure which showed an example of the RTG remote control video data concerning one Embodiment of this invention. It is explanatory drawing which shows the procedure of the delay time detection method of RTG remote control video data which concerns on other embodiment of this invention. It is the figure which showed an example of the RTG remote control video data based on other embodiment of this invention.

  Hereinafter, an embodiment in which the device, the remote control device, and the remote control system of the present invention are applied to remote control of a rubber tire transfer crane (hereinafter referred to as “RTG”) in a container terminal will be described with reference to the drawings. explain.

FIG. 1 is a schematic perspective view of a container terminal according to an embodiment of the present invention.
As shown in FIG. 1, a quay crane (hereinafter referred to as “GC”) 14 for loading and unloading a container 13 with respect to a container ship 12 is installed in the container terminal 11 and the container 13 is loaded and stored. A plurality of container yards 15 are provided. A large number of containers 13 are accumulated in each container yard 15, and a plurality of RTGs 16 as transfer machines are arranged so as to straddle the containers 13 accumulated in the container yard 15. Each RTG 16 is movable in the direction indicated by the solid line arrow in the figure.

  On the other hand, a plurality of trailers 17 as a transport machine are arranged in the container terminal 11. These trailers 17 travel between the container yards 15 and travel between the GC 14 and the container yards 15. For example, the container 13 on the container yard 15 is mounted on the trailer 17 by the RTG 16, transported to the GC 14 by the trailer 17, and loaded by the GC 14. The container 13 on the container ship 12 is mounted on the trailer 17 by the GC 14, transported to the container yard 15 by the trailer 17, and loaded on the container yard 15 by the RTG 16.

  A management wing 18 is arranged in the container terminal 11, and a remote control console (not shown) installed in the management wing 18 is connected to the RTG 16 and the trailer 17 by a wireless line (for example, a wireless LAN). Wirelessly controlled by a desk.

  Referring to FIG. 2 exemplifying the RTG 16, the hub 20 mounted on each of the plurality of RTGs 16 a and 16 b to 16 n arranged in the container terminal and the hub 21 in the management building 18 of the container terminal are respectively connected by radios 22 and 23. Connected by wireless LAN.

  Each RTG 16a, 16b to 16n is photographed by a plurality of (two in FIG. 2) video cameras (photographing means) 24a, 24b that capture the situation of the container 13 and trailer 17, and at least one video camera 24a. A lamp (information adding means) 29 installed in the range, a microphone 25 and a speaker 26 for exchanging with the driver of the manned trailer are mounted. The video data of the analog signal acquired by the video cameras 24a and 24b is converted into IP (Internet protocol) data which is public line data via video encoders (data conversion means / transmission means) 27a and 27b, and the hub ( The sound data of the microphone 25 and the speaker 26 are also converted into IP data via the control computer 28 and input to the hub 20.

  On the other hand, a hub 21 in the management building 18 in the container terminal where the RTGs 16a, 16b to 16n are arranged is provided with a remote operation management computer (host computer) 30 and a plurality for remotely operating the RTGs 16a, 16b to 16n. Two (two in FIG. 2) remote consoles (remote control devices) 31a and 31b are connected.

  The remote operation management computer 30 determines the operating status of each of the RTGs 16a, 16b-16n based on the remote operation request from the RTGs 16a, 16b-16n, and can transmit / receive the remote consoles 31a, 31b according to the operating status RTGs 16a and 16b to 16n are sorted.

  As shown in FIG. 3, each remote control console 31a, 31b includes a monitor 40a for displaying video data of the video cameras 24a, 24b, and a microphone 40b and a speaker corresponding to the microphone 25 and speaker 26 of each RTG 16a, 16b to 16n. 40c, a control computer 40d corresponding to the control computer 28 of each RTG 16a, 16b to 16n, and an operation input device (not shown) such as a joystick or a button, which correspond to various IP data and each RTG 16a Control data such as driving operation signals transmitted to 16b to 16n are also unified into IP data.

Further, as shown in FIG. 2, the hub 21 in the management building 18 in the container terminal where the RTGs 16a and 16b to 16n are arranged is remotely operated in the management building 18a in the other container terminal 11a that is distant from each other. The console 31n is connected by the public line 32a of the Internet, and the remote operation console 31m in the management building 18b in the other container terminal 11b that is distant is connected by the dedicated line 32b.
That is, the RTGs 16a and 16b to 16n in the container terminal 11 can be remotely operated by being sorted by the remote operation management computer 30 from the remote consoles 31n and 31m.

The Internet public line 32a includes an optical line and a mobile connection of a mobile phone. Therefore, as shown in the figure, not only the remote operation consoles 31n and 31m, but also remote operation can be performed from the operation base other than the container terminal such as home or office by the mobile phone 33 and the personal computer 34.
In this embodiment, the delay time of the RTG remote operation video data can be detected by the procedure shown in FIG.

  In FIG. 3, first, the control computer 40d of the remote console (31a, 31b) outputs a lamp 29 lighting command to the control computer 28 of the operation destination (RTGs 16a, 16b to 16n) (step S1). . The control computer 28 of the operation destination that has received the lamp lighting command turns on the lamp 29 (step S2). Thereby, video data in which the lit lamp is reflected is acquired by the video camera 24a. Video data in which the lit lamp 29 is reflected and video data acquired by the video camera 24b are converted into IP data by the video encoders 27a and 27b and transmitted to the control computer 40d as the operation source via the hub 20 ( Step S3).

  In the transmission source control computer 40d, the received video data of the IP data is decoded and displayed on the operation monitor 40a. Here, FIG. 4 shows a display example of video data on the monitor 40a. FIG. 4 shows a display example when the RTGs 16a and 16b to 16n are provided with four video cameras. Thus, one of the displayed video data includes the lamp 50a that is lit.

  Subsequently, the control computer 40d determines the lighting state of the lamp 29 included in the video data by performing image processing on the video data (step S4), and issues a lamp lighting command to turn on the lamp 29 that has been turned on. The delay time of the video is detected by detecting the time until receiving the video data in which the video is displayed (step S5).

  Subsequently, when the delay time of the detected image is equal to or longer than a predetermined time, the control computer 40d sets all operation signals to zero and transmits them to the operation control computer 28 to stop the crane ( Step S6). Then, the control computer 40d of the remote consoles 31a and 31b repeatedly transmits, for example, a lamp 29 turn-on command and a turn-off command at regular time intervals to turn on / off the lamp 29 included in each RTG 16, 16b to 16n. The delay state of the video data can be grasped at all times by checking the lighting and extinguishing states of the lamp 29 reflected in the received video data.

  Then, when the delay time of the video data becomes equal to or longer than the predetermined time, the control computer 40d continues the detection processing of the delay time of the video data even after the operation of the RTG is stopped. When the time is less than the predetermined time, the operation signal set to zero is returned to the normal operation signal, and the operation is resumed. Thereby, the operating efficiency of RTG can be improved.

  The delay time detection of the video data described above is performed by using the remote control console 31n, the mobile phone 33, and the personal computer in the management building 18a in the other container terminal 11a connected to the hub 21 in the management building 18 in the container terminal 11 by the public line 32a. This is also performed with the computer 34 and also with the remote control console 31m in the management building 18b in the other container terminal 11b connected to the hub 21 through the dedicated line 32b.

  As described above, according to the device, the remote operation device, and the remote operation system according to the present embodiment, video data transmitted and received between each RTG 16a, 16b to 16n and the remote operation consoles 31a, 31b to 31n, Since all transmission formats such as voice data and control data are unified to IP transmission, data transmission / reception on the Internet becomes possible. As a result, the remote control console can remotely operate the RTGs 16a, 16b to 16n not only from the base where the RTGs 16a and 16b to 16n are installed, but also from a distance from the base. Can be greatly expanded. As a result, it is not necessary for the operator to go to the base where the RTGs 16a and 16b to 16n are installed, and furthermore, an expert can remotely check the status of the RTGs 16a and 16b to 16n when a malfunction occurs, thereby realizing quick recovery. It becomes possible.

  Furthermore, according to the device, the remote control device, and the remote control system according to the present embodiment, the delay state of the video data transmitted / received between the RTGs 16a, 16b to 16n and the remote consoles 31a, 31b to 31n can be reliably confirmed. Therefore, the safety of operation in the remote operation system can be improved. In particular, according to the present embodiment, the lamp lighting / extinguishing information for detecting the delay time on the remote console side is provided upstream of the video data from the video encoders 27a and 27b that convert the video data to IP data. Therefore, it is possible to evaluate not only a data transmission delay but also a series of delay times including an encoding processing delay in the video encoders 27a and 27b.

  In the present embodiment, the delay state of the video data is ascertained based on the lighting state and extinguishing state of the lamp 29. However, as another embodiment, for example, as shown in FIG. A mixer (information adding means) 60 is installed between the video encoders 27a and 27b. In the mixer 60, predetermined data is imposed on the video data, and the video data on which the data has been imposed is remotely operated as IP data. It is good also as transmitting to the desk side.

In this case, on the remote consoles 31a and 31b side, the delay of the video data is detected by detecting the time from when the RTG side is instructed to receive the data until the video data with the predetermined data is received. Time will be detected. FIG. 6 shows an example of video data displayed on the monitor 40a in the present embodiment. FIG. 6 shows a display example when four video cameras are installed. In this way, the video data includes predetermined data (a code “07” here) 50b added by the mixer 60.
The predetermined data imposed by the mixer 60 may always be the same or may change from time to time.

  In the above-described embodiment, the RTG in the container terminal 11 is illustrated and described as an application destination of the device, the remote operation device, and the remote operation system of the present invention. However, the device, the remote operation device, and the remote operation of the present invention are described. The system is not limited to this example, and is widely applied to a remote operation system that remotely operates a device.

11, 11a Container terminal 12 Container ship 13 Container 14 Quay crane 15 Container yard 16, 16a, 16b-16n Rubber tire type transfer crane 17 Trailer 18, 18a, 18b Management building 20, 21 Hub 22, 23 Radio 24a, 24b Video camera 25 Microphone 26 Speaker 27a, 27b Video encoder 28 Control computer 29 Lamp 30 Remote operation management computer 31a, 31b, 31m, 31n Remote console 32a Internet public line 32b Dedicated line 33 Mobile phone 34 Personal computer 40a Monitor 40b Microphone 40c Speaker 40d Control computer 60 Mixer

Claims (7)

A device that is remotely operated by a remote operation device and transmits video data to the remote operation device,
Photographing means for acquiring video data;
Data conversion means for converting the video data acquired by the photographing means into a format suitable for data transmission;
Transmitting means for transmitting the video data converted by the data converting means to the remote control device;
Provided on the upstream side of the video data with respect to the data conversion means, and adds to the video data first information for detecting the delay time of the video data in the remote control device based on a command from the remote control device A device comprising information adding means.   The apparatus according to claim 1, wherein the information adding unit is a lamp installed within a range photographed by the photographing unit, and is turned on and off based on a command from the remote control device.   2. The apparatus according to claim 1, wherein the information adding unit is a mixer that imposes predetermined data on video data shot by the shooting unit based on a command from the remote control device. A remote operation device for remotely operating the device according to any one of claims 1 to 3,
A command for adding the first information for detecting the delay time of the video data to the video data is output to the device, and the video data including the first information is output after the command is issued. A remote control device that detects the delay time of video data by obtaining the time until reception.   The remote control device according to claim 4, wherein the operation of the device is stopped when the delay time of the video data is equal to or greater than a predetermined threshold value set in advance.   The remote control device according to claim 5, wherein when the delay time of the video data becomes less than the predetermined threshold, the operation of the device that has been stopped is resumed. The device according to any one of claims 1 to 3,
A remote control system comprising the remote control device according to any one of claims 4 to 6.

Images