CN106790612B - Dynamic virtual camera mapping method and system - Google Patents

Abstract

The invention provides a dynamic virtual camera mapping method and a system, wherein the method comprises the following steps: the server side and the client side establish communication connection; the server detects whether the server is connected with the USB camera equipment or not, and when the server detects that the USB camera equipment is connected, the server sends the insertion information of the camera equipment and the attribute information of the camera equipment to the client; after receiving insertion information and attribute information of camera equipment sent by a server, a client adds a video conversion format supported by the server to the attribute information, and combines and stores the video conversion format into equipment description information; the USB virtual bus module creates virtual camera equipment corresponding to the camera equipment according to the equipment description information; the camera application module uses the corresponding USB camera equipment through the virtual camera equipment. The dynamic virtual camera mapping method provided by the invention dynamically maps the USB camera equipment to another host machine for use in a virtual camera mode, keeps the consistency of attribute information such as the equipment name, the equipment PID, the VID and the like of the camera, and has good compatibility and convenient use.

Description

A dynamic virtual camera mapping method and system

technical field

The invention relates to the technical field of computer information, in particular to a dynamic virtual camera mapping method and system.

Background technique

With the development of computer information technology, a scenario of using a remote camera device has gradually emerged, that is, through a local terminal device, the USB camera device connected to the terminal is mapped to the remote host for use. The camera application in the remote host The software can use the USB camera device on the terminal like a local device. This application method is called USB camera mapping.

At present, most virtual camera technologies only virtualize permanent virtual camera devices with fixed properties in the remote host, and cannot dynamically adapt to the property parameters of the camera devices actually installed on the terminal, such as the device name, PID, VID, etc. information, the camera-specific application bound with this information cannot recognize the virtual camera, so it cannot be used compatibly, and it is very inconvenient in actual use.

For example, the patent with the publication number of CN104199723A provides a camera mapping method based on a virtual device, so that the user application can operate the virtual camera as if it were operating the camera locally. However, it cannot obtain the physical property information of the local camera, and at the same time, a virtual camera with the same physical property information is created in the Windows system to realize the mapping; therefore, the compatibility is poor, and some dedicated camera application software cannot be used.

SUMMARY OF THE INVENTION

In view of the above problems, the purpose of the patent of the present invention is to design a dynamic virtual camera mapping method and system, which dynamically maps the USB camera device to another host in the form of a virtual camera. The same device name, PID and VID attribute information as the USB camera ensures good compatibility with the application module. On the other hand, the required video conversion format can be selected according to the network bandwidth, which is convenient for use in different scenarios.

The concrete technical scheme of the present invention is as follows:

A dynamic virtual camera mapping method, comprising:

Step S101, the server and the client establish a communication connection;

Step S102, the server detects whether it is connected with a USB camera device, and when it is detected that the USB camera device is connected, sends the insertion information of the camera device and the attribute information of the camera device to the client, the attribute information includes the device name, device PID and device VID;

Step S103, after receiving the insertion information and attribute information of the camera device sent by the server, the client adds the video conversion format supported by the server to the attribute information, and merges and saves it as device description information;

Step S104, the client sends the insertion message of the camera device and the device description information to the USB virtual bus module, and the USB virtual bus module creates a virtual camera device corresponding to the camera device according to the device description information;

Step S105, the camera application module uses the corresponding USB camera device through the virtual camera device;

Step S106, when removing the USB camera device, the server will notify the client and the USB virtual bus module to automatically delete the corresponding virtual camera device according to the attribute information corresponding to the camera device; specifically including:

When removing the camera device, the server will automatically check the removal information of the USB camera device, and send the removal information and the attribute information corresponding to the camera device to the client;

After receiving the removal information, the client sends the removal information and the corresponding attribute information to the USB virtual bus module;

After receiving the removal information and the attribute information, the USB virtual bus module deletes the corresponding virtual camera device according to the attribute information.

Further, the camera application module of the present invention uses the corresponding USB camera device through the virtual camera device, specifically including:

The virtual camera device sends a request message for requesting video data to the client via the USB virtual device bus, where the request message includes attribute information of the camera device and the requested video format;

The client sends the request message to the server, and the server obtains the video data of the corresponding USB camera device after receiving the request message;

After receiving the video data of the USB camera device, the server sends the video data to the client. After receiving the video data, the client sends the video data to the camera application module via the USB virtual bus and the virtual camera device.

Further, after receiving the video data of the USB camera device, the server of the present invention sends the video data to the client, further comprising:

The server determines whether to perform video format conversion according to the video format requested by the client; if the video format of the video data obtained by the server is consistent with the format requested by the client, the server directly sends the video data to the client. If the video format of the acquired video data is inconsistent with the requested format, the server will convert the video data into the format requested by the client, and then send it to the client.

Further, the establishment of a communication connection between the server and the client according to the present invention specifically includes:

The client runs initially and initiates a connection request according to the configured server address. If the connection is successful, the client and the server establish a persistent communication connection; if the connection fails, the client attempts to repeat the connection request every once in a while;

The server initializes and runs, and initiates a connection request according to the configured client address. If the connection is successful, the client and the server establish a persistent communication connection; if the connection fails, the server enters the listening state and waits for the client to initiate the connection request.

A dynamic virtual camera mapping system, comprising a server module, a client module, a USB virtual bus module, and a virtual camera device module;

The server module is used to detect whether it is connected with a USB camera device. When it is detected that the camera device is connected, it sends the insertion information of the camera device and the attribute information of the camera device to the client module. The attribute information includes the device name, device PID and device VID;

The client module is configured to obtain the video conversion format supported by the server and add it to the attribute information after receiving the insertion information and attribute information of the camera device sent by the server, and merge and save it as device description information; And sending the insertion message of the camera device and the device description information to the USB virtual bus module;

The USB virtual bus module is configured to create a virtual camera device module corresponding to the camera device according to the device description information.

Further, the server module and the client module of the present invention further include: when the USB camera device is removed, the server module will notify the client module and the USB virtual bus module to automatically delete the corresponding attribute information according to the corresponding attribute information of the camera device. Virtual camera device.

Further, the camera application module of the present invention further includes:

The camera application module sends a request message for requesting video data to the client module via the USB virtual bus module, where the request message includes attribute information of the camera device and the requested video format;

The client module sends the request message to the server module, and the server module obtains the video data of the corresponding USB camera device after receiving the request message;

After receiving the video data of the USB camera device, the server module sends the video data to the client module, and after receiving the video data, the client module sends the video data to the camera application module

The dynamic virtual camera mapping method provided by the present invention realizes the dynamic creation and removal of virtual camera devices, and at the same time keeps the device name, PID and VID of the actual camera consistent; On the one hand, the appropriate video transmission format can be selected according to the network quality, which has a wide range of applications.

Description of drawings

The embodiments of the present invention will be further described below with reference to the accompanying drawings, wherein:

Fig. 1 is the flow chart of a kind of dynamic virtual camera mapping method of the present invention;

FIG. 2 is a block diagram of a dynamic virtual camera mapping system of the present invention.

Detailed ways

The present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments.

The present invention proposes a dynamic virtual camera mapping method. The method maps the USB camera device connected on the A host to another B host through the network as a virtual camera, and keeps the virtual camera and the USB on the A host. The basic device attributes such as the name, PID, and VID of the camera device remain unchanged. Specifically, the method includes:

A persistent communication message transmission channel is established between host A and host B;

Host B can dynamically discover the events of camera device insertion and removal on host A;

When detecting that there is a camera device insertion event in host A, host B obtains the properties of the USB camera device through host A, and creates a virtual camera device with the same device name, PID, and VID in host B;

When the camera application module in host B opens the virtual camera device, host B sends a video stream request message to host A, including video encoding format parameters; when host A receives the video stream request message from host B, it will follow the corresponding Video encoding format requirements, send the corresponding USB camera device video data to B host;

When host A detects a camera device removal event, host A will notify host B to delete the corresponding virtual camera device.

Please refer to FIG. 1, this embodiment specifically includes the following steps:

Step S101, the server on the A host establishes a communication connection with the client on the B host.

Specifically include:

The client runs initially and initiates a connection request according to the configured server address. If the connection is successful, the client and the server establish a persistent communication connection; if the connection fails, the client attempts to repeat the connection request every once in a while;

The server initializes and runs, and initiates a connection request according to the configured client address. If the connection is successful, the client and the server establish a persistent communication connection; if the connection fails, the server enters the listening state and waits for the client to initiate the connection request.

Step S102, the server detects whether it is connected with a USB camera device, and when it detects that the camera device is connected, sends the insertion information of the camera device and the attribute information of the camera device to the client, the attribute information includes the device name, device PID and Device VID.

Step S103, after receiving the insertion information and attribute information of the camera device sent by the server, the client converts the video format supported by the server into a combined format and saves it as device description information. Specifically, for example, a USB camera device supports the YUV video data format, but the server supports both YUV to H.264 and YUV to MJPG formats. The client will add the video format attributes of MJPG and H.264 to the device description information. It means that the virtual camera device can provide video data formats of YUV, H.264 and MJPG.

Step S104, the client sends the device description information of the camera device to the USB virtual bus module, and the USB virtual bus module creates a virtual camera device corresponding to the camera device according to the device description information.

Step S105, the camera application module uses the USB camera device by using the virtual camera device.

After the virtual camera device is created, the camera application module on host B can use the virtual camera device, including:

The camera application module running on the B host opens the virtual camera device through the USB device read-write interface, and the camera application module sends a request message requesting video data to the client through the USB virtual bus module, and the request message includes the attribute information of the camera device. and the requested video format;

The client sends the request message to the server, and after receiving the request message, the server reads the video data of the corresponding USB camera device through the USB device read-write interface;

After receiving the video data of the USB camera device, the server sends the video data to the client. After receiving the video data, the client sends the video data to the USB virtual bus module and the virtual camera device module. Camera application module.

The server determines whether to perform video format conversion according to the video format requested by the client; if the video format of the video data obtained by the server is consistent with the format requested by the client, the server directly sends the video data to the client. If the video format of the acquired video data is inconsistent with the requested format, the server will convert the video data into the format requested by the client, and then send it to the client.

Step S106, when the camera device is removed, the server will notify the client and the USB virtual bus module to automatically delete the corresponding virtual camera device according to the attribute information corresponding to the camera device.

Specifically, when the USB camera device is removed from the host A, the server will automatically check the removal information of the USB camera device, and send the removal information and the attribute information corresponding to the camera device to the client , the attribute information includes device name, device PID and device VID;

After receiving the removal information, the client sends the removal information and the corresponding attribute information to the USB virtual bus module;

After receiving the removal information and the attribute information, the USB virtual bus module deletes the corresponding virtual camera device according to the attribute information.

A dynamic virtual camera mapping system, please refer to FIG. 2, this embodiment includes a server module, a client module, a USB virtual bus module, a virtual camera device module and a camera application module.

The server module is installed on the A host, which can detect the insertion and removal events of the USB camera device on the A host, and read and write the camera device through the USB interface;

The client module is installed on the B host and establishes a communication connection with the server module;

The USB virtual bus module is installed on the B host, which can simulate the operation mechanism of the physical USB bus, and can create and remove virtual camera devices;

The virtual camera module is installed on the B host, and refers to the device program of the camera, including the driver of the virtual camera device read-write interface;

The camera application module is installed on the B host, and refers to the application program using the USB camera device.

The server module is used to detect whether it is connected with a USB camera device. When it is detected that the camera device is connected, it sends the insertion information of the camera device and the attribute information of the camera device to the client module. The attribute information includes the device name, device PID and device VID;

The client module is used to convert the video format supported by the server module into device description information after receiving the insertion information and attribute information of the USB camera device sent by the server module; The module sends the insertion information and device description information of the camera device,

The USB virtual bus module is configured to create a virtual camera device module corresponding to the USB camera device according to the device description information.

Further, the server module and the client module of the present invention further include: when the USB camera device is removed, the server module will notify the client module and the USB virtual bus module to automatically delete the corresponding attribute information according to the corresponding attribute information of the camera device. Virtual camera device. Specifically, when the USB camera device is removed from the host A, the server module will automatically check the removal information of the USB camera device, and send the removal information and the corresponding camera device to the client module. attribute information, the attribute information includes device name, device PID and device VID; after receiving the removal information, the client module sends the removal information and the corresponding attribute information to the USB virtual bus module; the USB virtual After receiving the removal information and the attribute information, the bus module deletes the corresponding virtual camera device according to the attribute information.

Further, the virtual camera device module of the present invention runs on the B host, and provides a driver that includes a USB camera device read-write interface, further comprising:

The camera application module sends a request message for requesting video data to the client module via the virtual camera device module and the USB virtual bus module, where the request message includes attribute information of the camera device and the requested video format;

The client module sends the request message to the server module, and the server module obtains the video data of the corresponding USB camera device after receiving the request message;

After the server module receives the video data of the USB camera device, it sends the video data to the client module. After the client module receives the video data, it sends the video data to the client module through the USB virtual bus module and the virtual camera device module. The camera application module described above.

The specific embodiments of the present invention described above do not limit the protection scope of the present invention. Any other corresponding changes and modifications made according to the technical concept of the present invention shall be included in the protection scope of the claims of the present invention.

Claims (6)

1. A dynamic virtual camera mapping method is characterized by comprising the following steps:

step S101, a server and a client establish communication connection;

step S102, a server detects whether a USB camera device is connected, and when the USB camera device is detected to be connected, the server sends insertion information of the camera device and attribute information of the camera device to a client, wherein the attribute information comprises a device name, a device PID and a device VID;

step S103, after receiving the insertion information and the attribute information of the camera equipment sent by the server, the client adds the video conversion format supported by the server to the attribute information, and combines and stores the video conversion format as equipment description information;

step S104, the client sends the insertion information of the camera equipment and the equipment description information to a USB virtual bus module, and the USB virtual bus module creates virtual camera equipment corresponding to the camera equipment according to the equipment description information;

step S105, the camera application module uses the corresponding USB camera device through the virtual camera device, and specifically includes: the virtual camera equipment sends a request message for requesting video data to a client through a USB virtual equipment bus, wherein the request message comprises attribute information of the camera equipment and a requested video format; the client sends the request message to the server, and the server acquires video data of corresponding USB camera equipment after receiving the request message; the server side sends the video data to the client side after receiving the video data of the USB camera equipment, and the client side sends the video data to the camera application module through the USB virtual bus and the virtual camera equipment after receiving the video data;

the server sends the video data to the client after receiving the video data of the USB camera device, and the method further comprises the following steps: the server side determines whether video format conversion needs to be executed or not according to the video format requested by the client side; if the video format of the video data acquired by the server is consistent with the format requested by the client, the server directly sends the video data to the client; and if the video format of the acquired video data is inconsistent with the requested format, the server side converts the video data into the format requested by the client side and then sends the format to the client side.

2. The dynamic virtual camera mapping method according to claim 1, wherein the method further comprises:

step S106, when the USB camera equipment is removed, the server side informs the client side and the USB virtual bus module to automatically delete the corresponding virtual camera equipment according to the attribute information corresponding to the camera equipment; the method specifically comprises the following steps:

when the camera equipment is removed, the server side automatically checks the removal information of the USB camera equipment and sends the removal information and the attribute information corresponding to the camera equipment to the client side;

after receiving the removal information, the client sends the removal information and the corresponding attribute information to a USB virtual bus module;

and after receiving the removal information and the attribute information, the USB virtual bus module deletes the corresponding virtual camera equipment according to the attribute information.

3. The dynamic virtual camera mapping method according to claim 1, wherein the establishing of the communication connection between the server and the client specifically includes:

the client side initializes operation and initiates a connection request according to the configured address of the server side, if the connection is successful, the client side and the server side establish persistent communication connection; if the connection fails, the client terminal tries to repeatedly initiate a connection request at intervals;

the server side initializes operation and initiates a connection request according to the configured address of the client side, if the connection is successful, the client side and the server side establish persistent communication connection; if the connection fails, the server enters an interception state and waits for the client to initiate the connection request.

4. A dynamic virtual camera mapping system is characterized by comprising a server module, a client module, a USB virtual bus module and a virtual camera equipment module;

the server module is used for detecting whether the USB camera equipment is connected with the server module, and when the camera equipment is detected to be connected with the server module, the server module sends insertion information of the camera equipment and attribute information of the camera equipment to the client module, wherein the attribute information comprises an equipment name, an equipment PID (proportion integration differentiation) and an equipment VID (video identifier);

the client module is used for acquiring a video conversion format supported by the server and adding the video conversion format to the attribute information after receiving the insertion information and the attribute information of the camera equipment sent by the server, and merging and storing the video conversion format into equipment description information; sending the insertion information of the camera equipment and the equipment description information to a USB virtual bus module;

the USB virtual bus module is used for creating a virtual camera equipment module corresponding to the USB camera equipment according to the equipment description information;

the system operating according to the method of any one of claims 1-3.

5. The dynamic virtual camera mapping system of claim 4, wherein the server module and the client module further comprise: when the USB camera equipment is removed, the server module informs the client module and the USB virtual bus module to automatically delete the corresponding virtual camera equipment according to the attribute information corresponding to the camera equipment.

6. The dynamic virtual camera mapping system according to claim 4, wherein the camera application module further comprises:

the camera application module sends a request message for requesting video data to the client module through the USB virtual bus module, wherein the request message comprises attribute information of camera equipment and a requested video format;

the client module sends the request message to the server module, and the server module acquires video data of corresponding USB camera equipment after receiving the request message;

the server module receives video data of the USB camera equipment and then sends the video data to the client module, and the client module receives the video data and then sends the video data to the camera application module.

Images