CN111050112A - Method for remote operation command or guidance by displaying mark on screen - Google Patents
Method for remote operation command or guidance by displaying mark on screen Download PDFInfo
- Publication number
- CN111050112A CN111050112A CN202010024212.9A CN202010024212A CN111050112A CN 111050112 A CN111050112 A CN 111050112A CN 202010024212 A CN202010024212 A CN 202010024212A CN 111050112 A CN111050112 A CN 111050112A
- Authority
- CN
- China
- Prior art keywords
- video
- computer equipment
- signal
- module
- instructor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 20
- 230000005540 biological transmission Effects 0.000 claims description 39
- 238000006243 chemical reaction Methods 0.000 claims description 3
- 238000004891 communication Methods 0.000 claims description 2
- 239000003550 marker Substances 0.000 claims 14
- 238000010586 diagram Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000007429 general method Methods 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a method for carrying out remote operation command or guidance by displaying marks on a screen, which comprises the following steps: (1) the method comprises the following steps that a video acquisition and marking display terminal (2) is additionally arranged between a computer equipment host to be operated and a computer equipment display by a commanded or instructor, and the remote command or instructor views a computer equipment host video output signal of the commanded or instructor in real time through a network; (3) the remote commander or the instructor marks a computer equipment display video of the operated computer equipment host which is played in real time; (4) and the video acquisition and mark display terminal acquires mark signal data, overlaps the mark at the corresponding position of the screen video signal and outputs the mark to the display of the operated computer equipment. The invention does not need to install or embed any additional software on the computer equipment, does not need the computer equipment to be connected to the Internet, and has no requirement on the network connection of the controlled equipment.
Description
Technical Field
The invention relates to a method for commanding or guiding computer operation, in particular to a method for remotely commanding or guiding operation by displaying marks on a screen.
Background
In many cases, a user needs to command or guide the operation of a computer device or a device containing a computer by other users. (the computer device herein refers to a device including computer functions, and generally includes a host for providing software functions, a display connected to the host, and input control devices associated therewith, including a home PC, a workstation, or a computer terminal with a screen included in various devices dedicated to medical and industrial fields, etc.)
Under the existing conditions, if remote operation command or guidance aiming at the operation of computer equipment needs to be performed, a general method is to record operation training or instruction teaching materials in a video mode, a PPT mode and the like, or install controlled end software in the computer equipment, and perform remote control through the software to perform function command or guidance. The former has the disadvantages of lack of interactivity and low communication efficiency, and the latter has the disadvantages of needing to add a controlled end software module into an operating system or software of the computer equipment, needing to modify the software and needing to connect the computer equipment of a commanded or instructor to the internet. For many users, especially for computer terminals contained in industrial dedicated devices, the internet is not generally accessed for information security protection, and in this case, it is very difficult to perform function demonstration through remote control.
Disclosure of Invention
The present invention is directed to a method for remote operation command or guidance by displaying a mark on a screen to solve the problems set forth in the background art described above.
In order to achieve the purpose, the invention provides the following technical scheme:
a method for remote operation command or guidance by displaying a mark on a screen, comprising the steps of: (1) a video acquisition and marking display terminal is additionally arranged between a computer equipment host to be operated and a computer equipment display by a director or a director, the video acquisition and marking display terminal is provided with a video input and video output port, the video input port is connected to a video output port of the computer equipment host, and the video output port is connected to a video input port of the computer equipment display; (2) the remote commander or director checks the video output signal of the computer equipment host of the commanded or director in real time through the network; (3) the remote commander or director marks the video of the computer equipment display of the computer equipment host machine which is played in real time and operated by the commander or director, the commander or director is instructed to operate on the interface of the computer equipment display through the mark, and the shape of the mark and the relative coordinate relative to the screen are sent back to a network transmission module of the video acquisition and mark display terminal through the network; (4) the video acquisition and mark display terminal acquires mark signal data, overlaps the mark at the corresponding position of the screen video signal to form an output signal, and outputs the output signal to the computer equipment display of the commanded or instructor.
As a further scheme of the invention: the video acquisition and marking display terminal comprises the following functional modules:
the video copying loop-out module is connected with a video input interface of the video acquisition and marking display terminal and is used for acquiring a computer equipment host video signal input to the video acquisition and marking display terminal and copying the video signal into two paths of video signals, wherein one path of video signal is supplied to the video acquisition module for acquisition, and the other path of video signal is supplied to the marking superposition module and is superposed with a marking signal on the video signal;
the video acquisition module is used for acquiring the acquired video signals of the host computer of the computer equipment into digital signals for coding transmission;
the video coding module is used for coding the acquired digital video signals into video coding streams for internet transmission and sending the video coding streams to the network transmission module for transmission;
the network transmission module is used for sending the coded video coding stream to a computer of a remote commander or director on the network in a mode of 4G, WIFI and Ethernet network link so that the commander or director can remotely browse the video signal of a display screen of the computer equipment; meanwhile, screen marking signals from a commander or a director are received and sent to a marking superposition module;
and the mark superposition module is used for receiving the copied video signal of the computer equipment display from the video copying loop-out module, receiving the screen mark signal sent by a remote commander or a director from the network transmission module, and superposing the screen mark signal onto the copied video signal of the computer equipment display.
As a further scheme of the invention: the step (2) is realized by the following steps: a) the video copying loop-out module is used for copying a video input signal of a computer equipment host into two paths of video signals, wherein one path of video signals is supplied to the video acquisition module for acquisition, and the other path of video signals is supplied to the mark superposition module; b) the video acquisition module acquires the acquired video signals of the host computer of the computer equipment into digital signals and sends the digital signals to the video coding module; c) the video coding module codes the acquired digital video signals into video coding streams for internet transmission through video coding standards such as H.264, H.265 and the like, and sends the video coding streams to the network transmission module for transmission; d) the network transmission module transmits the coded video coding stream to a computer of a remote commander or director on the network in a mode of 4G, WIFI and Ethernet network link; f) the computer of the remote commander or the director operates the video decoding software to decode and play the video stream, thereby viewing the video output signal of the computer equipment host of the commander or the director in real time.
The method comprises the further steps that a network transmission module in an ① video acquisition and marking display terminal receives real-time marking signal data from a network, wherein the real-time marking signal data comprise relative coordinates of a screen corresponding to a mark, the network transmission module sends the marking signal to a video superposition module, a ② video superposition module reads the real-time marking signal and the coordinates, the actual coordinate position of the marking signal in a computer equipment host video signal is obtained through conversion, the coordinates are superposed in a computer equipment host video signal in an equal ratio mode, a ③ video superposition module outputs the superposed computer equipment host video signal to a computer equipment display and displays the superposed computer equipment video signal on the computer equipment display, and a ④ director or instructor can see the real-time marking signal on the computer equipment display except the computer equipment host video signal, so that the director or instructor at a far end can understand the operation required by the director or instructor at the specific position on the screen, and the operation command or instruction purpose is achieved.
As a still further scheme of the invention: before or at the same time of implementing the step (3), the remote commander or the instructor also communicates with the commanded or instructor by viewing the screen of the computer equipment host of the commanded or instructor and by telephone or network chat.
Compared with the prior art, the invention has the beneficial effects that: 1. compared with the traditional remote video guidance mode, the method is more visual (marks are directly made on the screen), because all the indication marks are directly displayed on the computer equipment display of the commanded or instructor, the problems currently encountered by the commanded or instructor can be pointed out and solved in real time, and the situation that two parties cannot accurately understand or indicate the position of a specific operation area caused by the traditional modes such as dictation or video chat is avoided; 2. the method does not need to install any controlled software or build in any additional software module on the computer equipment, does not need the computer equipment to be connected to the Internet, and has no requirement on the network connection of the controlled equipment, because the scheme is realized by the mode of externally hanging a video acquisition and mark display terminal, the method can work only by acquiring the video signal of the display of the host computer of the computer equipment, all network transmission is realized by the video acquisition and mark display terminal, and the method does not need the host computer equipment to be connected to the Internet and install software; plug and play without any configuration on the computer equipment; meanwhile, if the function needs to be closed, the acquisition and mark display terminal only needs to be simply detached.
Drawings
Fig. 1 is a schematic diagram of the electrical connection among a video capture and tag display terminal, a computer device display, and a computer device host according to the present invention.
Fig. 2 is a schematic diagram of a video capture and tag display terminal function module according to the present invention.
FIG. 3 is a schematic view of the overall process of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In the embodiment of the invention, the method for carrying out remote operation command or guidance by displaying the mark on the screen comprises the following steps: (1) a video acquisition and marking display terminal is additionally arranged between a computer equipment host to be operated and a computer equipment display by a director or a director, the video acquisition and marking display terminal is provided with a video input and video output port, the video input port is connected to a video output port of the computer equipment host, the video output port is connected to a video input port of the computer equipment display, and the connection mode is shown in figure 1;
the video acquisition and marking display terminal comprises the following functional modules:
the video copying loop-out module is connected with a video input interface of the video acquisition and marking display terminal and is used for acquiring a computer equipment host video signal input to the video acquisition and marking display terminal and copying the video signal into two paths of video signals, wherein one path of video signal is supplied to the video acquisition module for acquisition, and the other path of video signal is supplied to the marking superposition module and is superposed with a marking signal on the video signal;
the video acquisition module is used for acquiring the acquired video signals of the host computer of the computer equipment into digital signals for coding transmission;
the video coding module is used for coding the acquired digital video signals into video coding streams for internet transmission and sending the video coding streams to the network transmission module for transmission;
the network transmission module is used for sending the coded video coding stream to a computer of a remote commander or director on the network in a mode of 4G, WIFI and Ethernet network link so that the remote commander or director can remotely browse a screen video signal of a display of computer equipment; meanwhile, screen marking signals from remote commands or instructions are received and sent to a marking superposition module;
the mark superposition module is used for receiving the copied video signal of the computer equipment display from the video copying loop-out module, receiving a screen mark signal sent by a remote command or a director from the network transmission module, and superposing the screen mark signal to the copied video signal of the computer equipment display;
(2) the remote commander or director checks the video output signal of the computer equipment host of the commanded or director in real time through the network, and the specific implementation steps are as follows: a) the video copying loop-out module is used for copying a video input signal of a computer equipment host into two paths of video signals, wherein one path of video signals is supplied to the video acquisition module for acquisition, and the other path of video signals is supplied to the mark superposition module; b) the video acquisition module acquires the acquired video signals of the host computer of the computer equipment into digital signals and sends the digital signals to the video coding module; c) the video coding module codes the acquired digital video signals into video coding streams for internet transmission through video coding standards such as H.264, H.265 and the like, and sends the video coding streams to the network transmission module for transmission; d) the network transmission module transmits the coded video coding stream to a computer of a remote commander or director on the network in a mode of 4G, WIFI and Ethernet network link; e) running video decoding software on a computer of a remote commander or director, decoding and playing a video stream so as to check a video output signal of a computer equipment host of the commander or director in real time;
(3) the remote commander or director also communicates with the commanded or director by viewing the screen of the computer equipment host of the commanded or director and by telephone and network chat; the remote commander or director marks the video of the computer equipment display of the computer equipment host of the commanded or director played in real time, indicates the commanded or director to operate on the interface of the computer equipment display through the mark, and sends the shape of the mark and the relative coordinate relative to the screen back to the network transmission module of the video acquisition and mark display terminal through the network;
the video acquisition and marking display terminal acquires marking signal data, and marks the marking at the corresponding position of a screen video signal to form a path of output signal which is output to a computer equipment display of a commanded or instructor, and the specific implementation steps are that ① a network transmission module in the video acquisition and marking display terminal receives real-time marking signal data from a network, wherein the real-time marking signal data comprises relative coordinates of a screen corresponding to the marking, the network transmission module sends the marking signal to a video superposition module, ② the video superposition module reads the real-time marking signal and the coordinates, obtains the actual coordinate position of the marking signal in a computer equipment host video signal through conversion, and superposes the coordinates in an equal ratio to the computer equipment host video signal, ③ the video superposition module outputs the superposed computer equipment host video signal to the computer equipment display to be displayed on the computer equipment display, ④ the commanded or instructor can see the real-time marking signal on the computer equipment display, and understand the remote end or the operation position of the commanded or instructor on the computer equipment display, except seeing the computer equipment host video signal, thereby realizing the operation of the remote end or the instructed operator.
By the above mode, the remote commander or director who watches at the remote end can indicate the position needing to be operated on the watched screen video, and the commanded or director beside the machine can display the mark on the display thereof, so as to understand the operation indicated by the remote commander or director.
It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential attributes thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned.
Furthermore, it should be understood that although the present description refers to embodiments, not every embodiment may contain only a single embodiment, and such description is for clarity only, and those skilled in the art should integrate the description, and the embodiments may be combined as appropriate to form other embodiments understood by those skilled in the art.
Claims (5)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010024212.9A CN111050112A (en) | 2020-01-10 | 2020-01-10 | Method for remote operation command or guidance by displaying mark on screen |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010024212.9A CN111050112A (en) | 2020-01-10 | 2020-01-10 | Method for remote operation command or guidance by displaying mark on screen |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111050112A true CN111050112A (en) | 2020-04-21 |
Family
ID=70244284
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010024212.9A Pending CN111050112A (en) | 2020-01-10 | 2020-01-10 | Method for remote operation command or guidance by displaying mark on screen |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111050112A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013023195A1 (en) * | 2011-08-10 | 2013-02-14 | Castine Nicholas J | Device and method for remote computer operation |
| CN106339094A (en) * | 2016-09-05 | 2017-01-18 | 山东万腾电子科技有限公司 | Interactive remote expert cooperation maintenance system and method based on augmented reality technology |
| US20180211445A1 (en) * | 2015-07-17 | 2018-07-26 | Sharp Kabushiki Kaisha | Information processing device, terminal, and remote communication system |
| CN108769517A (en) * | 2018-05-29 | 2018-11-06 | 亮风台（上海）信息科技有限公司 | A kind of method and apparatus carrying out remote assistant based on augmented reality |
| CN110138831A (en) * | 2019-03-29 | 2019-08-16 | 亮风台（上海）信息科技有限公司 | A kind of method and apparatus carrying out remote assistance |
| WO2019211045A1 (en) * | 2018-05-04 | 2019-11-07 | Stanfeld Aps | A remote support device |
-
2020
- 2020-01-10 CN CN202010024212.9A patent/CN111050112A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013023195A1 (en) * | 2011-08-10 | 2013-02-14 | Castine Nicholas J | Device and method for remote computer operation |
| US20180211445A1 (en) * | 2015-07-17 | 2018-07-26 | Sharp Kabushiki Kaisha | Information processing device, terminal, and remote communication system |
| CN106339094A (en) * | 2016-09-05 | 2017-01-18 | 山东万腾电子科技有限公司 | Interactive remote expert cooperation maintenance system and method based on augmented reality technology |
| WO2019211045A1 (en) * | 2018-05-04 | 2019-11-07 | Stanfeld Aps | A remote support device |
| CN108769517A (en) * | 2018-05-29 | 2018-11-06 | 亮风台（上海）信息科技有限公司 | A kind of method and apparatus carrying out remote assistant based on augmented reality |
| CN110138831A (en) * | 2019-03-29 | 2019-08-16 | 亮风台（上海）信息科技有限公司 | A kind of method and apparatus carrying out remote assistance |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN210867774U (en) | Remote control system | |
| EP2209299A1 (en) | A method and system for using ip network to connect a television and a computer to process interactive entertainment | |
| CN111240490A (en) | Equipment insulation test training system based on VR virtual immersion and circular screen interaction | |
| CN111182000A (en) | Method for remotely controlling computer through video acquisition and USB signal transmission | |
| CN108495119A (en) | Operating terminal system and method for stage performance | |
| CN107741785B (en) | Remote guidance method and system for protecting front end safety | |
| CN107872655A (en) | A kind of method and system for determining hidden danger point | |
| EP2922285A1 (en) | Smart home access device | |
| CN107046631A (en) | A kind of method and system that can be encoded 2 roads simultaneously and be demonstrated with many people's wireless session rooms of streaming media | |
| CN1940703A (en) | Realization of interactive projection system | |
| CN205983949U (en) | Teaching management system | |
| CN111050112A (en) | Method for remote operation command or guidance by displaying mark on screen | |
| CN111698568A (en) | Interactive video labeling method | |
| CN113141346B (en) | VR one-to-multiple system and method based on series flow | |
| CN114842704A (en) | Training system and training method | |
| CN113504461A (en) | Track circuit fault positioning and processing method and system based on MR technology | |
| CN108965813A (en) | A kind of video multiple domain complex control system and method | |
| CN101808221A (en) | Subtitle remote control method and system | |
| CN111901628A (en) | Cloud rendering method based on zSpace desktop VR all-in-one machine | |
| CN111131854A (en) | Medical teaching host and system | |
| CN1299192C (en) | Remote-wireless controller for computer | |
| CN215770121U (en) | Remote collaborative training system for simulation detection operation of extra-high voltage GIS equipment | |
| CN108172045A (en) | A kind of remote education video communication apparatus and system based on AR | |
| CN210222693U (en) | Virtual assembly system | |
| CN201479265U (en) | Television with remote control function |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20200421 |