CN114938441A - Intelligent mobile terminal remote control method, system, equipment and storage medium - Google Patents
Intelligent mobile terminal remote control method, system, equipment and storage medium Download PDFInfo
- Publication number
- CN114938441A CN114938441A CN202210291927.XA CN202210291927A CN114938441A CN 114938441 A CN114938441 A CN 114938441A CN 202210291927 A CN202210291927 A CN 202210291927A CN 114938441 A CN114938441 A CN 114938441A
- Authority
- CN
- China
- Prior art keywords
- mobile terminal
- target mobile
- maintenance system
- remote control
- control method
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 37
- 238000012423 maintenance Methods 0.000 claims abstract description 64
- 238000004891 communication Methods 0.000 claims abstract description 11
- 230000002159 abnormal effect Effects 0.000 claims description 10
- 238000004590 computer program Methods 0.000 claims description 9
- 230000008569 process Effects 0.000 abstract description 6
- 238000004458 analytical method Methods 0.000 abstract description 3
- 230000003993 interaction Effects 0.000 description 8
- 230000005856 abnormality Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000003672 processing method Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 208000015181 infectious disease Diseases 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000008054 signal transmission Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/18—Status alarms
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/61—Control of cameras or camera modules based on recognised objects
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Telephonic Communication Services (AREA)
- Selective Calling Equipment (AREA)
- Manipulator (AREA)
Abstract
The invention discloses a remote control method, a system, equipment and a storage medium for an intelligent mobile terminal, wherein the control method is applied to an operation and maintenance system connected with a user terminal and a mobile terminal and comprises the following steps: acquiring a video viewing request and pushing the video viewing request to a target mobile terminal in an alarm state, so that the target mobile terminal responds to the video viewing request to execute real-time shooting operation; acquiring video stream data obtained by real-time shooting of the target mobile terminal, and pushing the video stream data to a specified user terminal for analysis and display; acquiring a control instruction issued by the user terminal, and pushing the control instruction to the target mobile terminal so that the target mobile terminal executes corresponding operation according to the control instruction; the control instructions include movement instructions. The invention can realize safe remote operation based on real-time video communication, so as to process the robot abnormity in real time to achieve the purpose of intelligent operation and maintenance, thereby greatly reducing the labor cost.
Description
Technical Field
The invention relates to the technical field of remote control of intelligent equipment, in particular to a remote control method, a remote control system, remote control equipment and a remote control storage medium for an intelligent mobile terminal.
Background
At the present stage, the application scenarios of the intelligent mobile terminal are more and more extensive, for example, an indoor automatic driving robot can provide intelligent delivery service due to the functions of autonomous path planning, automatic obstacle avoidance, automatic charging and the like, and is widely used in hospitals and other places at present for material delivery in hospitals, so that the labor cost is saved, and particularly, the risk of contact infection is greatly reduced during epidemic situations.
In the process of providing services for intelligent mobile terminals such as robots and the like, due to the fact that the robots are affected by abnormal conditions such as location loss, navigation abnormality and the like, the robots stop in place based on a safety mechanism at the moment, in the traditional processing method, after problems are found, field personnel press down the robots to stop suddenly, then the robots are pushed manually to specified positions to be maintained, however, the processing method is low in efficiency from the point that the problems are found to the point that the problems are processed, and when the robots are in the abnormal conditions, users cannot observe the environment conditions where the robots are located in time, and at the moment, the robots are controlled to move by sending remote instructions to the robots, and safety cannot be guaranteed.
Disclosure of Invention
In order to overcome the defects of the prior art, one of the purposes of the invention is to provide an intelligent mobile terminal remote control method, which can realize safe remote operation based on real-time video communication, so as to process the robot abnormity in real time to achieve the purpose of intelligent operation and maintenance, and greatly reduce the labor cost.
The invention also aims to provide an intelligent mobile terminal remote control system.
It is a further object of the present invention to provide an electronic device.
It is a further object of the present invention to provide a computer readable storage medium.
One of the purposes of the invention is realized by adopting the following technical scheme:
a remote control method of an intelligent mobile terminal is applied to an operation and maintenance system connected with a user terminal and the mobile terminal, and the control method comprises the following steps:
acquiring a video viewing request and pushing the video viewing request to a target mobile terminal in an alarm state, so that the target mobile terminal responds to the video viewing request to execute real-time shooting operation;
acquiring video stream data obtained by real-time shooting of the target mobile terminal, and pushing the video stream data to a specified user terminal for analysis and display;
acquiring a control instruction issued by the user terminal, and pushing the control instruction to the target mobile terminal so that the target mobile terminal executes corresponding operation according to the control instruction; the control instructions include movement instructions.
Further, the method for determining the target mobile terminal in the alarm state comprises the following steps:
and judging whether the navigation operation data of each mobile terminal is abnormal or not, and if the navigation operation data of a certain mobile terminal is abnormal, judging that the mobile terminal is in an alarm state.
Furthermore, the target mobile terminal is provided with a communication module, and when the target mobile terminal in the alarm state is identified, the communication module is used for pushing alarm information to the operation and maintenance system for display.
Further, after the target mobile terminal pushes the alarm information to the operation and maintenance system, the method further includes:
and the operation and maintenance system pushes the alarm information to an appointed user terminal for displaying, so that a user sends the video viewing request to the operation and maintenance system through the user terminal after looking up the displayed alarm information.
Further, the control instruction further includes a shooting adjustment instruction, and when the target mobile terminal receives the shooting adjustment instruction, the starting state and/or the shooting angle of each camera of the target mobile terminal are/is adjusted.
Further, still include:
and acquiring a feedback message when the target mobile terminal executes operation, and pushing the feedback message to the user terminal for real-time display.
The second purpose of the invention is realized by adopting the following technical scheme:
an intelligent mobile terminal remote control system comprises a target mobile terminal, an operation and maintenance system and a user terminal;
the target mobile terminal is used for sending alarm information to the operation and maintenance system and executing corresponding operation according to a video viewing request or a control instruction sent by the operation and maintenance system;
the user terminal is used for sending a video viewing request to the operation and maintenance system and displaying the video viewing request according to video stream data pushed by the operation and maintenance system;
the operation and maintenance system executes the intelligent mobile terminal remote control method.
Further, the target mobile terminal is connected with the operation and maintenance system through a websocket protocol.
The third purpose of the invention is realized by adopting the following technical scheme:
an electronic device comprises a processor, a memory and a computer program stored on the memory and capable of running on the processor, wherein the processor executes the computer program to realize the intelligent mobile terminal remote control method.
The fourth purpose of the invention is realized by adopting the following technical scheme:
a computer-readable storage medium having stored thereon a computer program which, when executed, implements the intelligent mobile terminal remote control method as described above.
Compared with the prior art, the invention has the beneficial effects that:
the operation and maintenance system pushes the received video viewing request to the target mobile terminal in the warning state, so that the target mobile terminal can realize real-time video communication according to the video viewing request, and sends video stream data of the real-time video communication to the user terminal, the real-time environment video of the target mobile terminal can be viewed through the user terminal, and a control instruction is sent to the target mobile terminal according to the environment condition so that the target mobile terminal can safely move to an appointed place, the effect of safe remote operation is achieved, the purpose of intelligent operation and maintenance is achieved by processing the abnormity of the target mobile terminal in real time, and labor cost is greatly reduced.
Drawings
Fig. 1 is a schematic signal transmission diagram of an intelligent mobile terminal remote control system according to the present invention;
fig. 2 is a schematic flow chart of the remote control method of the intelligent mobile terminal according to the present invention.
Detailed Description
The present invention is further described with reference to the accompanying drawings and the detailed description, and it should be noted that, in the case of no conflict, any combination between the embodiments or technical features described below may form a new embodiment.
Example one
The embodiment provides an intelligent mobile terminal remote control system, as shown in fig. 1, the system includes a mobile terminal, an operation and maintenance system and a user terminal; the mobile terminal can be a mobile robot or other mobile intelligent terminals. The mobile terminal is connected with the operation and maintenance system through a websocket protocol and used as a terminal to respond to the operation and maintenance system request.
In this embodiment, the operation and maintenance system is deployed in the cloud server in advance, and information of the mobile terminal is entered into the operation and maintenance system, so as to implement information binding between the mobile terminal and the operation and maintenance system, where the terminal information includes a terminal name, a device type, a device number, and the like.
The mobile terminal of the embodiment specifically comprises a human-computer interaction module, a communication module, a navigation control module, a driving control module and a camera module, wherein the navigation control module comprises positioning equipment such as an ultrasonic radar and a GPS (global positioning system) and is used for carrying out real-time positioning and route navigation on the mobile position of the mobile terminal; the drive control module is used for controlling the moving state of the mobile terminal; the camera module can comprise an infrared camera, a common camera, a distance sensor and other devices for shooting or detecting the surrounding environment condition of the mobile terminal.
When the mobile terminal has alarm conditions such as positioning loss or abnormal navigation, the navigation operation data of the navigation control module is abnormal, whether the mobile terminal is in an alarm state can be known according to the navigation operation data, if the mobile terminal is in the alarm state, the mobile terminal is marked as a target mobile terminal, and alarm information is generated and sent to the man-machine interaction module; the man-machine interaction module establishes websocket connection with the operation and maintenance system through the communication module, and therefore the alarm information is pushed to the operation and maintenance system.
After the target mobile terminal sends the alarm information to the operation and maintenance system, the operation and maintenance system pushes the alarm information to a pre-bound specified user terminal for displaying so as to obtain the alarm information of the target mobile terminal in time; in addition, the user can also use the user terminal to send a video viewing request to the operation and maintenance system, the operation and maintenance system pushes the request to the target mobile terminal after obtaining the video viewing request, and the target mobile terminal can automatically shoot the site environment in real time in response to the video viewing request.
In some embodiments, the user may also directly log in the operation and maintenance system to obtain the alarm information of the target mobile terminal, initiate a video viewing request under the operation and maintenance system, and push the video viewing request to the target mobile terminal.
And after receiving the video viewing request, the human-computer interaction module of the target mobile terminal starts each camera to shoot a real-time field environment, acquires a video stream of each camera and pushes the video stream to the operation and maintenance system through an RTMP protocol, and the operation and maintenance system pushes the video stream to the user terminal for display.
When the target mobile terminal shoots a real-time field picture, various sensors on the target mobile terminal can be started, for example, a distance sensor is started to detect the distance between the target mobile terminal and a front obstacle, so that a user can accurately control the moving distance and the moving direction of the target mobile terminal.
After a user views a real-time video image, a control instruction is issued to the operation and maintenance system by using the user terminal and combining with the field condition, and the operation and maintenance system pushes the control instruction to a human-computer interaction system of a target mobile terminal.
In some embodiments, the user may also directly issue the control instruction through the operation and maintenance system, and the operation and maintenance system directly pushes the control instruction to the human-computer interaction system of the target mobile terminal.
The control instruction can be a moving instruction for controlling the movement of the target mobile device, the human-computer interaction system sends the moving instruction to the driving control module, and the driving control module executes the moving instruction to change the moving route of the target mobile terminal; and then, the target mobile terminal returns the result to the man-machine interaction module after moving, and then the result is sent to the operation and maintenance system to inform the user.
In some embodiments, the control instruction may also be a shooting adjustment instruction, and when the target mobile terminal receives the shooting adjustment instruction, the start state and/or the shooting angle of each camera of the target mobile terminal are adjusted, so as to change the shooting angle, so that the user can further know the live view.
The target mobile terminal of the embodiment establishes connection with the operation and maintenance system through the websocket, when the service process of the target mobile terminal is abnormal, the alarm information is pushed to the operation and maintenance system, a user requests to check a real-time video of the target mobile terminal in the operation and maintenance system, the target mobile terminal pushes a video stream to the operation and maintenance system through an RTMP protocol after receiving the request and displays the video stream to the user, the user judges whether the target mobile terminal needs to be operated according to the real-time video, if the target mobile terminal needs to be operated, the mobile request is issued to the robot, safe remote operation is achieved, the purpose of intelligent operation and maintenance is achieved by processing the abnormality of the target mobile terminal in real time, and labor cost is greatly reduced.
Example two
The embodiment provides a remote control method for an intelligent mobile terminal, which is applied to an operation and maintenance system described in the first embodiment, and as shown in fig. 2, the remote control method executed by the operation and maintenance system specifically includes the following steps:
step S1: acquiring a video viewing request and pushing the video viewing request to a target mobile terminal in an alarm state, so that the target mobile terminal responds to the video viewing request to execute real-time shooting operation;
wherein the video viewing request is generated based on the alert information of the target mobile terminal. When the navigation operation data of the target mobile terminal is abnormal, the target mobile terminal generates the alarm information, and the alarm information is pushed to the operation and maintenance system by using a communication module of the target mobile terminal for display, or is forwarded to a user terminal for display by the operation and maintenance system.
The video viewing request can be a request manually initiated by a user using a user terminal or an operation and maintenance system after the user views the alarm information, or can be automatically generated by the operation and maintenance system after the operation and maintenance system receives the alarm information, and the automatic generation mode can reduce troubles brought by manual operation and improve the efficiency of intelligent operation and maintenance.
Step S2: the method comprises the steps of obtaining video stream data obtained by real-time shooting of the target mobile terminal, pushing the video stream data to a specified user terminal for analysis and display, enabling a user to know the field environment condition of the target mobile terminal in time according to a real-time video image, judging whether the target mobile terminal needs to be operated or not by the user according to the real-time video, and issuing a control request to the target mobile terminal if the target mobile terminal needs to be operated.
Step S3: acquiring a control instruction issued by the user terminal, and pushing the control instruction to the target mobile terminal so that the target mobile terminal executes corresponding operation according to the control instruction; the control instruction comprises a moving instruction, and the target mobile terminal moves to a place appointed by a user according to the moving instruction to perform fault maintenance after receiving the moving instruction. In addition, the control instruction further comprises a shooting adjustment instruction, and when the target mobile terminal receives the shooting adjustment instruction, the starting state and/or the shooting angle of each camera of the target mobile terminal are/is adjusted, so that the shooting angle is changed, a user can further know a scene picture, and the user can accurately send the instruction. The control instruction can also be a sensor control instruction, various sensors on the target mobile terminal, such as a distance sensor and the like, are started through the sensor control instruction, the moving route of the target mobile terminal is accurately controlled based on the various sensors, and safety is improved.
Step S4: and acquiring a feedback message when the target mobile terminal executes the operation, and pushing the feedback message to the user terminal for real-time display, so that the user can timely know the execution condition of the target mobile terminal executing the instruction issued by the user, and the accuracy of remote control is improved.
EXAMPLE III
The embodiment provides an electronic device, which comprises a processor, a memory and a computer program stored on the memory and capable of running on the processor, wherein the processor executes the computer program to realize the intelligent mobile terminal remote control method in the first embodiment; in addition, the present embodiment also provides a computer-readable storage medium, on which a computer program is stored, which, when executed, implements the intelligent mobile terminal remote control method described above.
The device and the storage medium in this embodiment are based on two aspects of the same inventive concept, and the method implementation process has been described in detail in the foregoing, so that those skilled in the art can clearly understand the structure and implementation process of the device and the storage medium in this embodiment according to the foregoing description, and for the sake of brevity of the description, details are not repeated here.
The above embodiments are only preferred embodiments of the present invention, and the protection scope of the present invention is not limited thereby, and any insubstantial changes and substitutions made by those skilled in the art based on the present invention are within the protection scope of the present invention.
Claims (10)
1. A remote control method for an intelligent mobile terminal is applied to an operation and maintenance system connected with a user terminal and the mobile terminal, and comprises the following steps:
acquiring a video viewing request and pushing the video viewing request to a target mobile terminal in an alarm state, so that the target mobile terminal responds to the video viewing request to execute real-time shooting operation;
acquiring video stream data obtained by real-time shooting of the target mobile terminal, and pushing the video stream data to a specified user terminal for displaying;
acquiring a control instruction issued by the user terminal, and pushing the control instruction to the target mobile terminal so that the target mobile terminal executes corresponding operation according to the control instruction; the control instructions include movement instructions.
2. The intelligent mobile terminal remote control method according to claim 1, wherein the method of determining the target mobile terminal in the alarm state is:
and judging whether the navigation operation data of each mobile terminal is abnormal or not, and if the navigation operation data of a certain mobile terminal is abnormal, judging that the mobile terminal is in an alarm state.
3. The remote control method for the intelligent mobile terminal according to claim 1, wherein the target mobile terminal is provided with a communication module, and when the target mobile terminal in an alarm state is identified, the communication module is used for pushing alarm information to the operation and maintenance system for display.
4. The intelligent mobile terminal remote control method according to claim 3, wherein after the target mobile terminal pushes the alarm information to the operation and maintenance system, the method further comprises:
and the operation and maintenance system pushes the alarm information to a specified user terminal for displaying, so that a user sends the video viewing request to the operation and maintenance system through the user terminal after looking up the displayed alarm information.
5. The remote control method for the intelligent mobile terminal according to claim 1, wherein the control instruction further includes a shooting adjustment instruction, and when the target mobile terminal receives the shooting adjustment instruction, the start state and/or the shooting angle of each camera of the target mobile terminal is adjusted.
6. The intelligent mobile terminal remote control method according to claim 1, further comprising:
and acquiring a feedback message when the target mobile terminal executes operation, and pushing the feedback message to the user terminal for real-time display.
7. An intelligent mobile terminal remote control system is characterized by comprising a target mobile terminal, an operation and maintenance system and a user terminal;
the target mobile terminal is used for sending alarm information to the operation and maintenance system and executing corresponding operation according to a video viewing request or a control instruction sent by the operation and maintenance system;
the user terminal is used for sending a video viewing request to the operation and maintenance system and displaying the video viewing request according to video stream data pushed by the operation and maintenance system;
the operation and maintenance system executes the intelligent mobile terminal remote control method according to any one of claims 1-6.
8. The intelligent mobile terminal remote control system according to claim 7, wherein the target mobile terminal is connected to the operation and maintenance system through a websocket protocol.
9. An electronic device, comprising a processor, a memory and a computer program stored in the memory and operable on the processor, wherein the processor implements the intelligent mobile terminal remote control method according to any one of claims 1 to 6 when executing the computer program.
10. A computer-readable storage medium, characterized in that a computer program is stored thereon, which when executed, implements the intelligent mobile terminal remote control method of any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210291927.XA CN114938441A (en) | 2022-03-23 | 2022-03-23 | Intelligent mobile terminal remote control method, system, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210291927.XA CN114938441A (en) | 2022-03-23 | 2022-03-23 | Intelligent mobile terminal remote control method, system, equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114938441A true CN114938441A (en) | 2022-08-23 |
Family
ID=82862987
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210291927.XA Pending CN114938441A (en) | 2022-03-23 | 2022-03-23 | Intelligent mobile terminal remote control method, system, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114938441A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115514622A (en) * | 2022-11-18 | 2022-12-23 | 阿里巴巴（中国）有限公司 | Interactive object processing method, network communication system, device, and storage medium |
-
2022
- 2022-03-23 CN CN202210291927.XA patent/CN114938441A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115514622A (en) * | 2022-11-18 | 2022-12-23 | 阿里巴巴（中国）有限公司 | Interactive object processing method, network communication system, device, and storage medium |
| CN115514622B (en) * | 2022-11-18 | 2023-04-14 | 阿里巴巴（中国）有限公司 | Interactive object processing method, network communication system, device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9052714B2 (en) | Computer-implemented method and system for controlling operation of an autonomous driverless vehicle in response to obstacle detection | |
| CN106485736B (en) | Panoramic visual tracking method for unmanned aerial vehicle, unmanned aerial vehicle and control terminal | |
| US9829873B2 (en) | Method and data presenting device for assisting a remote user to provide instructions | |
| WO2018214079A1 (en) | Navigation processing method and apparatus, and control device | |
| CN105278362B (en) | The control method of unmanned Reconnaissance system, apparatus and system | |
| CN108776481B (en) | Parallel driving control method | |
| CN108629961B (en) | Equipment inspection method, equipment inspection device, remote controller and unmanned aerial vehicle | |
| KR101959366B1 (en) | Mutual recognition method between UAV and wireless device | |
| CN114938441A (en) | Intelligent mobile terminal remote control method, system, equipment and storage medium | |
| US7651027B2 (en) | Remote instruction system and method thereof | |
| KR101448278B1 (en) | Method for matching control command about robot and video of robot, control apparatus | |
| US10937256B2 (en) | Self-driving vehicle stop position notification system and vehicle stop range registration method | |
| CN108398127A (en) | A kind of indoor orientation method and device | |
| CN112799428B (en) | Control method, control device, controlled device and readable storage medium | |
| WO2019127302A1 (en) | Control method for unmanned aerial vehicle, control method of control terminal, and related device | |
| US11981036B2 (en) | Robot and control system | |
| CN111010543B (en) | Robot remote-viewing video monitoring method and device, electronic equipment and storage medium | |
| CN118400608A (en) | Remote support system and remote support method | |
| WO2023202423A1 (en) | Path planning method of mower and related device | |
| JP2009015527A (en) | Monitoring system | |
| CN113099114A (en) | Method, device, terminal and storage medium for remotely checking robot camera | |
| JP2008154188A (en) | Image transmission system, and image transmitting method | |
| CN220067522U (en) | Remote monitoring system | |
| US20240053746A1 (en) | Display system, communications system, display control method, and program | |
| JP2000249542A (en) | Remote-locating device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |