CN115437499A - A virtual video recognition control system and method - Google Patents

Abstract

The invention relates to the technical field of virtual videos, and particularly discloses a virtual video identification control system which comprises a camera, an operation module, a display medium and a control signal output module, wherein the operation module is connected with the camera through a wire, the display medium is connected with the operation module through a wire, and the control signal output module is connected with the display medium through a wire. The setting of above system can carry out the contactless and carry out the button to operating panel for the human body does not contact with operating panel, reduces the propagation of disease, can contactless control complicated computer interface, wisdom blackboard, computer, projection etc. make user's control mode leave the constraint situation that mouse keyboard and handheld electronic equipment come the operation, provides the opening to freely controlling in the sky with both hands in the field of vision environment and operating computer, thing networking.

Description

A virtual video recognition control system and method

technical field

The invention relates to the technical field of virtual video, in particular to a virtual video recognition control system and method.

Background technique

At present, when pressing keys on the operation panel, physical buttons are usually used to press the keys. For electronic whiteboards for teaching, the speaker needs to sit in front of the computer and use the mouse to control or stand in front of the touch screen to touch the screen with his hands. Playing a slide show is flexible enough with a laser pointer, but it can only turn pages up and down.

However, in the prior art, it is necessary to manually touch the operation panel, which will easily spread infectious diseases, and it cannot be recovered after a wrong press. When teaching the electronic whiteboard, the position of the speaker cannot leave the range of the touch screen. It reduces the interaction between classrooms and the lack of close communication with everyone.

Contents of the invention

The purpose of the present invention is to provide a virtual video recognition control system and method, which aims to solve the technical problem in the prior art that the operation panel needs to be touched, resulting in easy transmission of infectious diseases, and aims to solve the problem of electronic devices such as mouse and keyboard. The equipment restricts the movement of personnel and hands, and directly controls the computer interface with fingers and palms.

In order to achieve the above object, a virtual video recognition control system adopted by the present invention includes a camera, an operation module, a display medium and a control signal output module, the operation module is connected to the camera wire, the display medium is connected to the The operation module is connected with wires, and the control signal output module is connected with the display medium wires.

Wherein, the operation module includes an action recognition module, a control interface module, a superposition module and a signal trigger module, the action recognition module is connected to the camera wire, the control interface module is connected to the action recognition module by wire, the The superposition module is connected to the control interface module by wires, and the signal trigger module is connected to the superposition module by wires.

Wherein, the display medium may be any one including but not limited to a display screen, a monitor, a display or a projection.

The present invention also provides a virtual video recognition control method, which is applied to the above-mentioned virtual video recognition control system, including the following steps:

Recognize fingers, pointers and palms through the camera and the action recognition module;

And through the identification module and the control interface module to identify the finger, so that the live image of the camera in the image and the control interface in the image can be seen through the display medium, so that when the operator moves the finger, the The finger in the display medium follows and moves;

Move the finger to the corresponding virtual position;

Click or drag at this time;

Carrying out video algorithm calculation and judging the correctness of the action through the superposition module and the signal trigger module;

After confirming that the action is effective, an instruction to execute the corresponding action is issued, received by the control signal output module, and finally sent to the execution equipment such as elevators, computers, and the Internet of Things.

A virtual video recognition control system and method of the present invention, the operator sees the live image of the camera in the image and the control interface in the image through the display medium, and the operator looks at the moving finger, pointer and infrared finger mouse in the video image Go to the corresponding virtual position in the video image, so that the object is recognized by the action recognition module and the control interface module, at this time, click and drag, and within the recognition range and recognition action of the action recognition module, The recognition program performs video algorithm calculations to judge the correctness of the action, and the confirmation program issues an instruction to execute the corresponding action. The above system settings can be used to press keys on the operation panel in a non-contact manner, so that the human body does not come into contact with the operation panel, reducing the spread of disease.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. Those skilled in the art can also obtain other drawings based on these drawings without creative work.

Fig. 1 is a schematic diagram showing the operation of a virtual video recognition control system of the present invention.

Fig. 2 is a schematic structural diagram of a virtual video recognition control system of the present invention.

Fig. 3 is a flowchart of method steps of a virtual video recognition control method of the present invention.

Fig. 4 is a schematic diagram of operating steps of a virtual video recognition control method of the present invention.

Fig. 5 is a schematic diagram showing a computer operation of a virtual video recognition control system of the present invention.

1-camera, 2-display medium, 3-control signal output module, 4-action recognition module, 5-control interface module, 6-overlay module, 7-signal trigger module.

detailed description

Embodiments of the present invention are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals designate the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary and are intended to explain the present invention and should not be construed as limiting the present invention.

Referring to Fig. 1 and Fig. 2, the present invention provides a kind of virtual video recognition control system, comprises camera 1, operation module, display medium 2 and control signal output module 3, and described operation module is connected with described camera 1 wire , the display medium 2 is connected to the operation module by wires, and the control signal output module 3 is connected to the display medium 2 by wires.

In this embodiment, the camera 1 collects images of the finger or the pointer, the operation module recognizes the movement of the finger, the display medium 2 displays the operation panel and the finger, and finally passes through the control signal output module 3 Transfer the selected data.

Further, the operation module includes a motion recognition module 4, a control interface module 5, a superposition module 6 and a signal trigger module 7, the motion recognition module 4 is connected to the camera 1 by wires, and the control interface module 5 is connected to the The action recognition module 4 is connected with wires, the superposition module 6 is connected with the control interface module 5 with wires, and the signal trigger module 7 is connected with the superposition module 6 with wires.

In this embodiment, the motion recognition module 4 recognizes the motion track and motion direction of the finger or pointer, and simultaneously judges whether the motion is within the recognition range and motion approval range, and the control interface module 5 is an operation panel operation The background can be the desktop interface of an ordinary computer, and the superposition module 6 performs superimposition calculations on the operation background and finger movements, and feeds back on the display medium 2, so that the operator can select the required keys, and the signal The trigger module 7 reads the selected key for transmission to the control signal output module 3 .

Further, the display medium 2 may be any one including but not limited to a display screen, a monitor, a display or a projection.

In this embodiment, different display media 2 can be selected according to different requirements.

Please refer to FIG. 3 to FIG. 5 , the present invention also provides a virtual video recognition control method, which is applied to the above-mentioned virtual video recognition control system, including the following steps:

S1: Recognize fingers, pointers and palms through the camera 1 and the action recognition module 4;

S2: and identify the finger through the identification module and the control interface module 5, so that the live image of the camera 1 in the image and the control interface in the image can be seen through the display medium 2, so that the operator can move When fingering, the finger in the display medium 2 follows and moves;

S3: moving the finger to the corresponding virtual position;

S4: click or drag at this time;

S5: Perform video algorithm calculation through the superimposition module 6 and the signal trigger module 7 to judge the correctness of the action;

S6: After confirming that the action is effective, issue an instruction to execute the corresponding action, which is received by the control signal output module 3 and finally sent to the execution equipment such as the elevator, the computer, and the Internet of Things.

The operator sees the on-site video image and the elevator button operation interface in the image presented on the display medium 2 in the elevator, stretches his finger to the image range, and after adjusting to a suitable distance from the camera 1, selects the content to be selected Select, and do the button action of clicking the position. After the action takes effect, the real-time button number display or language prompt or the prompt mode of the button color change is made on the display medium 2, and the operator knows that the button action takes effect. Carry out the next button action by analogy;

Corresponding to the judgment of recognition, preset the range of a certain pixel size, the recognition of slightly pointed objects at the top, and the recognition of pointer and finger features;

For the recognition of screen swiping actions, a range of a certain pixel size is preset, and the moving range from far to near moves quickly in the horizontal direction after a long distance;

In special cases, in order to make the interface clear and unaffected by the video image, a small video sensor cover can be worn on the fingertip. Set of visible, in order to ensure the clarity of the interface.

The above virtual video recognition control method takes the elevator button as an example, but it is not limited to the elevator button. It can control complex operation computer interface, teaching wisdom blackboard, large-size touch screen and computer projection, so that the user control method is separated from the mouse. The situation of being bound by keyboards and handheld electronic devices provides a start for the free and empty control of computers and the Internet of Things in the field of vision; the original button-type devices that are simple to control without contact, such as elevator buttons, unit door buttons, various A kind of access control device button, which reduces the transmission of diseases through buttons. For scenes that require control personnel to move more flexibly for presentations, the camera 1 can be tracked and identified for specific moving objects, so that the camera 1 can perform behavior recognition, Automatically adjust the focus and automatically track moving objects, so that the operator or speaker can move freely in a relatively large range and reach out to control the operating software interface; Infrared-sensitive reflective cover, so that when the brightness of the recognition camera is lowered to blur the image, the finger can be moved. Of course, it can also be a palm or a pointer and other features to recognize objects, which can be highlighted in the control interface.

What is disclosed above is only a preferred embodiment of the present invention, and of course it cannot limit the scope of rights of the present invention. Those of ordinary skill in the art can understand all or part of the process for realizing the above embodiments, and according to the rights of the present invention The equivalent changes required still belong to the scope covered by the invention.

Claims (4)

1. A virtual video recognition control system, characterized in that, It includes a camera, an operation module, a display medium and a control signal output module, the operation module is connected with the camera wire, the display medium is connected with the operation module wire, and the control signal output module is connected with the display Media wire connection. 2. a kind of virtual video recognition control system as claimed in claim 1, is characterized in that, The operation module includes a motion recognition module, a control interface module, a superimposition module and a signal trigger module, the motion recognition module is connected to the camera wire, the control interface module is connected to the motion recognition module wire, and the superimposition The module is connected to the control interface module by wires, and the signal trigger module is connected to the superposition module by wires. 3. a kind of virtual video recognition control system as claimed in claim 2, is characterized in that, The display medium may be any one including, but not limited to, a display screen, a monitor, a monitor, or a projection. 4. A virtual video recognition control method, applied to a virtual video recognition control system as claimed in claim 3, characterized in that, comprising the steps of: Recognize fingers, pointers and palms through the camera and the action recognition module; And through the identification module and the control interface module to identify the finger, so that the live image of the camera in the image and the control interface in the image can be seen through the display medium, so that when the operator moves the finger, the The finger in the display medium follows and moves; Move the finger to the corresponding virtual position; Click or drag at this point, Carrying out video algorithm calculation and judging the correctness of the action through the superposition module and the signal trigger module; After confirming that the action is effective, an instruction to execute the corresponding action is issued, received by the control signal output module, and finally sent to the execution equipment such as elevators, computers, and the Internet of Things.

Images