CN112950947B - Vehicle information processing method, device and system - Google Patents

Abstract

A vehicle information processing method, device and system are provided. The method comprises the following steps: communicating with an on-board unit on a vehicle to obtain first information sent by the on-board unit; shooting the vehicle to acquire second information of the vehicle according to the shot image; and performing processing for the acquired first information and second information. The on-board unit may be a dedicated on-board OBU or other standalone device capable of communicating vehicle information with the road side unit. According to the invention, the information interaction and visual recognition of the vehicle-mounted unit are combined, so that the automatic binding and matching of the vehicle-mounted unit and the vehicle characteristics can be realized. The above-mentioned matching verification can be carried out several times so as to implement supervision of abnormal condition.

Description

Vehicle information processing method, device and system

technical field

The present invention relates to the field of information processing, in particular to a vehicle information processing method, device and system.

Background technique

In daily life, there are various scenarios that require vehicle identification, such as parking lot and expressway toll collection, and general road monitoring, etc. In these scenarios, the on-board unit is usually used as a certificate to identify the vehicle identity, and thus complete the operation based on the vehicle identity. For example, when a vehicle with a vehicle-mounted unit passes through a highway, it will be charged according to the location of the vehicle-mounted unit when it enters and exits the highway. However, only relying on specific credentials to identify vehicles will lead to many problems, such as the unavoidable problem of different vehicles exchanging vehicle-mounted units privately before leaving the expressway to avoid tolls as a whole, or the problem of vehicle-mounted units being artificially shielded and invalidated.

Therefore, there is a need for a solution that can ensure that the identity of the vehicle is correctly identified.

Contents of the invention

In view of this, the present invention proposes a vehicle information processing solution, which can realize automatic binding and matching of vehicle features with vehicle features by combining vehicle unit information interaction with visual recognition. The above-mentioned matching verification can be performed multiple times to realize the supervision of abnormal situations.

According to the first aspect of the present invention, a vehicle information processing method is proposed, including: communicating with the on-board unit on the vehicle to obtain the first information sent by the on-board unit; photographing the vehicle to obtain second information of the vehicle; and performing processing on the acquired first information and the second information. The on-board unit may be a dedicated on-board OBU, or other independent equipment capable of communicating vehicle information with the roadside unit.

According to the second aspect of the present invention, a vehicle information processing method is proposed, including: when the first vehicle enters a specific area, communicate with the first vehicle-mounted unit on the first vehicle to obtain the information sent by the first vehicle-mounted unit The first information; photographing the first vehicle to obtain the second information of the first vehicle according to the photographed image; when the second vehicle is located in the specific area or leaves the specific area, communicate with the second vehicle on the second vehicle Unit communication to obtain third information sent by the second vehicle-mounted unit; in the case where the first information corresponds to the third information, determine that the second vehicle-mounted unit is the same as the first vehicle-mounted unit an on-board unit; photographing a second vehicle to obtain fourth information of the second vehicle according to the photographed image; and determining that the second vehicle is the same vehicle as the first vehicle based on the second information and the fourth information .

According to a third aspect of the present invention, a vehicle information processing system is proposed, comprising: a first device, configured to communicate with a vehicle-mounted unit on the vehicle, to obtain first information sent by the vehicle-mounted unit; a second device, configured to photographing the vehicle to acquire second information of the vehicle according to the photographed image; and a third device configured to perform processing on the acquired first information and the second information.

According to the fourth aspect of the present invention, a vehicle information processing device is proposed, including: a communication unit, used for: communicating with the vehicle-mounted unit on the vehicle, so as to obtain the first information sent by the vehicle-mounted unit, and notify adjacent shooting A device photographs the vehicle to acquire second information of the vehicle according to the photographed image, and a processing unit is configured to perform processing on the acquired first information and the second information.

According to a fifth aspect of the present invention, a computing device is proposed, including: a processor; and

A memory, on which executable codes are stored, which, when executed by the processor, cause the processor to perform the method as described above.

According to a sixth aspect of the present invention, a non-transitory machine-readable storage medium is provided, on which executable code is stored, and when the executable code is executed by a processor of an electronic device, the processor executes method as above.

From the above, the vehicle information processing solution of the present invention can realize the automatic binding and matching of the vehicle-mounted unit and vehicle features by combining the vehicle-mounted unit information interaction with visual recognition. The above-mentioned matching verification can be performed multiple times to realize the supervision of abnormal situations.

Description of drawings

The above and other objects, features and advantages of the present disclosure will become more apparent by describing the exemplary embodiments of the present disclosure in more detail with reference to the accompanying drawings, wherein, in the exemplary embodiments of the present disclosure, the same reference numerals generally represent same parts.

Fig. 1 shows a schematic flowchart of a vehicle information processing method according to an embodiment of the present invention.

Fig. 2 shows a schematic flowchart of a vehicle information processing method according to another embodiment of the present invention.

Fig. 3 shows an example of the composition of the expressway toll system based on the principle of the present invention.

Fig. 4 shows an example of the interaction process between the entrance toll station and the vehicle.

Fig. 5 shows an example of the interaction process between the exit toll station and the vehicle.

FIG. 6 shows an example of a plurality of roadside units arranged on the way of traveling of the vehicle.

Fig. 7 shows an example where there are queue-jumping vehicles when charging.

Fig. 8 shows an example where there is a trailing vehicle when tolling.

FIG. 9 shows an example of the processing flow when there is a violating vehicle.

Fig. 10 shows another example where there is a trailing vehicle when tolling.

FIG. 11 shows an example of the processing flow when there is a violating vehicle.

FIG. 12 shows a composition example of a vehicle information processing system according to an embodiment of the present invention.

FIG. 13 shows a composition example of a vehicle information processing device according to an embodiment of the present invention.

Fig. 14 shows a schematic structural diagram of a computing device according to an embodiment of the present invention.

Detailed ways

Preferred embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although preferred embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

In the automatic processing scenario for vehicles, for example, in the automatic toll collection scenario on the highway, the vehicle can be completed by equipping the vehicle with an on-board unit that has a communication function (at least a short-distance communication function) and can identify the vehicle identity. Confirmation of identity and follow-up operations based on confirmation, such as deduction of high-speed fees on linked accounts.

In the above-mentioned automation scenarios, the cooperation of the on-board unit and the roadside unit is usually required to complete related operations. Here, on-board unit refers to a broad sense of "on-board" unit, that is, a unit equipped on a vehicle that can communicate with a roadside unit to help determine the identity of the vehicle, such as a specific chip or hardware unit installed on the vehicle , or a more general independent device owned by the driver or passenger on the vehicle that can communicate with the roadside unit, such as a smart terminal or a wearable device. The roadside unit is a unit that is installed near the vehicle's driving path and can communicate with the on-board unit. In a specific scenario, an on-board unit (OBU: on-board unit) can narrowly refer to a hardware unit installed on a vehicle that can realize V2X communication and support V2X applications at the same time. A road side unit (RSU: road side unit) may be a hardware unit installed on the roadside that can realize V2X communication and support V2X applications at the same time. Here, V2X (Vehicle to Everything) refers to the communication between vehicle-mounted units and other devices, including but not limited to vehicle-to-vehicle (V2V), vehicle-to-road (V2I), vehicle-to-people (V2P), vehicle-to-cloud (V2C), etc. information exchange and sharing.

It should be understood that although the embodiments of the present invention will be preferably described below in conjunction with V2X communication, the vehicle information processing solution of the present invention is also applicable to application scenarios where the vehicle-mounted unit communicates with the roadside unit based on other communication protocols. For example, independent devices such as smartphones, GPS navigators, watches, or wristbands of drivers, passengers, or vehicle owners can be bound to specific vehicles and communicate with roadside units and communicate with roadside units. The images captured by the roadside units collectively act as vehicle identity verification.

In the existing scene where the vehicle-mounted unit is used for automatic identification of the vehicle's identity, since the identification of the vehicle's identity is only related to the vehicle-mounted unit, there is a case of cheating through the operation of the vehicle-mounted unit. For example, after a vehicle loaded with V2X OBU equipment enters the expressway, or the V2X equipment fails due to human reasons (such as shutdown, shielding, etc.), the vehicle cannot be identified by the roadside V2X RSU equipment, and the exit toll station system cannot automatically After completing the restoration of the passing path, the billing can only be done according to the shortest path at the entrance and exit. Or long-distance trucks and short-distance cars exchange OBU equipment, each of which automatically pays the toll through the exit, so as to evade the toll as a whole. In addition, when a vehicle loaded with V2X OBU equipment drives out of the automatic exit toll booth, it may follow other vehicles in an attempt to evade the toll; or insert other vehicles in front of it, causing normal toll-paying vehicles to fail to pass normally.

In order to solve at least one of the above problems, the present invention proposes a vehicle information processing scheme, which improves the credibility of the vehicle-mounted unit to identify a specific vehicle by automatically matching the vehicle-mounted unit information with the vehicle appearance information, and can flexibly deal with other vehicles The trailing fee evasion problem.

Fig. 1 shows a schematic flowchart of a vehicle information processing method according to an embodiment of the present invention. In particular, the method can be implemented by a roadside unit in combination with a camera unit. In different embodiments, the photographing unit can be a separate device, or can be integrated with the roadside unit.

In step S110, communicate with the vehicle-mounted unit on the vehicle to acquire the first information sent by the vehicle-mounted unit. In step S120, the vehicle is photographed, so as to acquire second information of the vehicle according to the photographed image. Subsequently, in step S130, processing is performed on the acquired first information and the second information, for example, processing of associating the first and second information is performed.

Since the first and second information need to be correlated (for example, to generate or verify correlation), the operations of steps S110 and S120 need to be performed simultaneously or sequentially within a limited space. In other words, the first information and the second information are acquired at a location and time interval that are not far apart, and both may be acquired "on-site".

Usually, the first information obtained from the on-board unit includes identification information of the on-board unit. In different embodiments, the information of the vehicle associated with the vehicle-mounted unit can be found remotely through the identification code of the vehicle-mounted unit itself, and the information of the vehicle associated with the vehicle-mounted unit can also be included in the first information. The "associated vehicle" of an OBU is the vehicle for which the OBU is believed to represent. As mentioned above, in one embodiment, the on-board unit can be a narrow OBU, at this time, the vehicle that the on-board unit is considered to represent can be the on-board unit issuing structure or the record of the traffic control agency that the on-board unit is installed the vehicle on it. The information about the vehicle associated with the vehicle-mounted unit may include, for example, the license plate number information of the vehicle.

As an alternative or in addition, the on-board unit can be a unit equipped on a vehicle in the broadest sense. At this time, the vehicle-mounted unit may include the above-mentioned OBU in the narrow sense, or other independent devices that can communicate with the roadside unit and can indicate the identity of the vehicle, such as smart terminals such as mobile phones or GPS navigators, or watches, wristbands, etc. class of wearable devices. These devices can be bound to a specific vehicle, for example, the corresponding vehicle-mounted unit function APP can be downloaded on a smart phone, and the corresponding binding and/or authentication steps (for example, uploading a vehicle ownership certificate or driver's license, etc.) A binding for one or more vehicles. When these stand-alone devices are initially "onboarded", for example, when the device holder gets on the vehicle as a driver or passenger, they can automatically or manually pair with the vehicle (for example, Bluetooth pairing) and use it as the paired vehicle on-board unit.

Correspondingly, the second information may include appearance characteristic information of the vehicle visually recognized by photographing the vehicle. Here, "appearance feature information" refers to visually distinguishable features of the vehicle itself, such as model, color, and size. In a preferred embodiment, the "appearance feature information" may also include more detailed external features, for example, features recognizable to the naked eye, such as body patterns, window stickers, external damage, and modifications.

In the case that the first information and the second information contain different types of information as described above, the processing of step S130 may include performing a binding operation of the first information and the second information. For example, the on-board unit identification number and license plate number provided by the on-board unit are bound with the processed appearance feature information identified from the captured image. For example, it is considered that a vehicle with a vehicle-mounted unit identification number A and a license plate number B has an appearance feature C (for example, a red XX model vehicle).

In the case that the first information and the second information already contain similar information, step S130 may include performing a matching operation between the first information and the second information. For example, in one embodiment, the first information provided by the vehicle-mounted unit already includes appearance characteristic information of the associated vehicle (for example, model information entered during registration). At this point, the vehicle model information in the first information can be compared with the identified vehicle model information in the second information to confirm whether they match. For example, if the model of the associated vehicle included in the first information is also C (for example, a red XX model vehicle), then the first information and the second information are successfully matched. Otherwise, it may be considered that the matching is unsuccessful, and a corresponding alarm or notification operation is performed.

In other embodiments, the associating operation for the first and second information may include matching and binding, for example, verifying whether similar items are the same, and binding different items if the similar items are the same. In an embodiment, the second information may further include license plate number information of the vehicle visually recognized by photographing the vehicle. The above information can be verified for similar items with the license plate number information in the first information.

As mentioned above, the operations of steps S110 and S120 are preferably performed on site. For example, a roadside unit installed on site performs short-distance communication to obtain the first information, and a photographing device near or integrated with the roadside unit photographs the vehicle to obtain the second information. To this end, the communication with the onboard unit in step S110 may be broadcast communication. For example, the roadside unit may receive the first information broadcast by the vehicle-mounted unit, or the roadside unit may broadcast a communication request and receive the first information responded by the vehicle-mounted unit. Likewise, in step S120, the vehicle may be photographed using a visual recognition device installed on site. Thus, accurate acquisition of the first and second information is ensured through on-site operations.

In addition, although the operations of steps S110 and S120 may be performed on-site, there is no limitation on the object that issues instructions to perform the above operations. That is, in some embodiments, the above operations may be performed under the control of the roadside unit, and in other embodiments, the above operations may involve remote communication with a server (eg, cloud platform). For example, performing processing on the acquired first information and the second information in step S130 may include: uploading a result of the processing to a server. In other embodiments, step S130 may include acquiring previous processing results from the server for subsequent verification.

When the visual recognition equipment installed on site is used to photograph vehicles, the above visual recognition equipment can also identify illegal vehicles, such as tailgating and queue-jumping vehicles. Therefore, when there is a trailing vehicle behind the vehicle photographed by the visual recognition device, relevant parties may be notified to perform anti-escape operations for the trailing vehicle. In other embodiments, the vehicle itself can be used to identify the violating vehicle, for example, the vehicle can be notified to use the on-board camera to take images to determine whether there is a trailing vehicle behind or a front-jumping vehicle.

The vehicle information processing method of the present invention is especially suitable for multiple matching authentications between the vehicle and the vehicle-mounted unit within a specific period of time. In other words, it is confirmed that a certain vehicle-mounted unit is always mounted on its associated vehicle through multiple matching operations within a certain period of time. Fig. 2 shows a schematic flowchart of a vehicle information processing method according to another embodiment of the present invention. This method can be regarded as the implementation of the method shown in Figure 1 in a specific scenario.

When the first vehicle enters a specific area, in step S210, communicate with the first vehicle-mounted unit on the first vehicle to obtain first information sent by the first vehicle-mounted unit. In step S220, the first vehicle is photographed, so as to acquire second information of the first vehicle according to the photographed image. Thus, information processing when the vehicle enters the specific area is performed.

When the second vehicle is located in the specific area or leaves the specific area, in step S230, communicate with the second vehicle-mounted unit on the second vehicle to obtain third information sent by the second vehicle-mounted unit. In step S240, in the case that the first information corresponds to the third information, it is determined that the second vehicle-mounted unit is the same vehicle-mounted unit as the first vehicle-mounted unit. In step S250, photograph the second vehicle, so as to obtain fourth information of the second vehicle according to the photographed image. In step S260, based on the second information and the fourth information, it is determined that the second vehicle is the same vehicle as the first vehicle. In this way, information processing is performed when the vehicle is within the specific area or when it leaves the specific area.

The specific areas mentioned above may include highways, closed roads or parking lots. For example, when a vehicle enters an expressway, the first information (for example, identification number A and license plate number B) can be obtained from the vehicle-mounted unit of the first vehicle at the entrance of the expressway, and the appearance of the first vehicle can be visually recognized by taking a vehicle image. Model characteristic information (for example, model C). When the vehicle is driving on or off the highway, the first information (for example, the identification number A and the license plate number B) can be obtained from the on-board unit of the vehicle, and the appearance feature information can be visually recognized by taking the vehicle image. If the identified appearance characteristic information remains unchanged at this time (for example, it is still a model C), it can be considered that the vehicle-mounted unit is always located on its registered associated vehicle and has not been replaced. As a result, subsequent operations are facilitated, for example, automatic payment of highway tolls and the like.

In some embodiments, the matching operation performed in a specific area or at the exit can be performed directly according to the first and second information acquired at the entrance. In other embodiments, binding and/or matching operations may be performed on the acquired first information and the second information at the entrance. Similar to the above description, the binding operation may be to bind information items of different types in the first and second information, and the matching operation may be to compare and verify information items of the same type.

In a preferred embodiment, the results of the above binding and/or matching operations can also be uploaded to the server. Therefore, step S260 may include: obtaining the result of the binding and/or matching operation from the server; and determining the second vehicle according to the fourth information and the result of the binding and/or matching operation is the same vehicle as said first vehicle.

Similar to the foregoing, the communication with the on-board unit may be broadcast-based communication. Therefore, when the first vehicle enters a specific area, communicating with the first vehicle-mounted unit on the first vehicle may include: broadcasting a communication request; and receiving the first information replied by the first vehicle-mounted unit. When the second vehicle is located in the specific area or leaves the specific area, communicating with the second vehicle-mounted unit on the second vehicle may include: receiving the third information broadcast by the second vehicle-mounted unit; or broadcasting communication request, and receive the third information replied by the second vehicle-mounted unit.

After determining that the second vehicle is the same vehicle as the first vehicle, a transaction may be performed with the second on-board unit of the second vehicle. Further, based on the position information when the first vehicle enters a specific area and the position information when the second vehicle is in the specific area or leaves the specific area, the second vehicle-mounted unit of the second vehicle can Transactions, for example, are charged based on import and export locations.

In addition, when the second vehicle is located in the specific area, it is also possible to perform at least one communication with the second vehicle-mounted unit and photograph the second vehicle for the second vehicle, so as to obtain at least one group of second vehicle Information, a set of second vehicle information includes fifth information sent by the second vehicle-mounted unit, sixth information obtained according to the captured image, and second vehicle position information at the time of shooting; at least one set of second vehicle information to be acquired uploading to the server; using the at least one set of second vehicle information to confirm the spatio-temporal information of the second vehicle in the specific area. In this way, for example, acquisition of information while the vehicle is traveling can be realized. Based on the spatio-temporal information, it can be determined that the second vehicle loaded with the first vehicle-mounted unit is always the same vehicle as the first vehicle. In addition, transactions with the second on-board unit of the second vehicle are also based on the spatio-temporal information, for example, for realizing charging based on driving route.

After the transaction is successful, the second vehicle may be allowed to leave the specific area, for example, an automatic barrier is raised and allowed to pass. In a preferred embodiment, matching can be performed again before release. Therefore, after the transaction is successful, the second vehicle may be photographed to obtain seventh information of the second vehicle according to the photographed image; and after determining that the seventh information corresponds to the second or fourth information Thereafter, the second vehicle is allowed to leave the specific area.

In addition, the method may further include: when a trailing vehicle is photographed behind the vehicle, performing an operation of not allowing the trailing vehicle to leave the specific area. The above-mentioned determination of the trailing vehicle may be based on a camera installed on the roadside, or may be based on a camera of the vehicle. Therefore, the method may include informing the second vehicle to turn on the rear view camera; and using the rear view camera to take pictures to identify whether there is a trailing vehicle.

The present invention combines vehicle-mounted unit communication (for example, V2X communication) and visual sensor vehicle identification technology to realize (1) vehicle-mounted unit contains characteristics (such as ID, MAC address, etc.) and vehicle characteristics (such as license plate, model, color, size, etc.) Automatic binding at the entrance of a specific area, and fault-tolerant processing, (2) Recognition, recording, and early warning of passing vehicles at each RSU point in a specific area, through geographic location and motion trajectory, and deployment in the full coverage of RSU, based on video recognition Supervision of abnormal situations such as parking card replacement, card replacement, etc., (3) at the exit of a specific area, by comparing the visual recognition of the driving path and vehicle characteristics, combined with the vehicle-mounted unit (for example, V2X OBU device) driving trajectory to conduct transactions, such as TOLL.

The principle of the present invention will be described in detail below in conjunction with an example in which the specific area is a toll expressway. Fig. 3 shows an example of the composition of the expressway toll system based on the principle of the present invention. As shown in Figure 3, the toll collection system includes a roadside unit, a visual identification unit and a release device. Among them, the roadside unit is a roadside V2XRSU with V2X communication function, which can perform short-distance communication with the vehicle-mounted unit (such as a vehicle-mounted V2XOBU or an independent intelligent terminal device equipped on the vehicle), such as broadcast communication, and can also communicate with the cloud The server communicates remotely. The above-mentioned toll collection system can be arranged at the entrance and exit of the expressway.

In FIG. 3 , the visual recognition unit is shown as visual sensing devices arranged one behind the other. It should be understood that, in other embodiments, the visual identification unit may have other implementation forms, for example, it may be arranged in only one direction of front and back, or it may be arranged in a single or multiple directions of front, back, up, down, left, and right, and may be single or multiple A device, or a device integrated with a roadside unit.

Fig. 4 shows an example of the interaction process between the entrance toll station and the vehicle.

As shown in Figure 4, when a vehicle loaded with an on-board unit (for example, a V2X OBU device or an independent intelligent terminal device) enters the entrance lane of the expressway,

·Road side unit RSU broadcast toll station release capability;

The on-board unit OBU receives the release capability of the toll station broadcast, completes the P2P communication session with the RSU, and responds "I am a car", including feedback of OBU logo, vehicle identification code, car type, color, size, location and other information;

At the same time, the visual recognition system captures and recognizes vehicle features, such as license plate, type, color, etc.;

The roadside unit RSU compares the vehicle features identified by the visual recognition system with the vehicle information sent by the OBU, automatically matches the V2X device and the vehicle after completing the verification, and reports the binding result to the cloud control platform;

· Release the vehicle and end the V2X communication.

Fig. 5 shows an example of the interaction process between the exit toll station and the vehicle.

When a vehicle loaded with V2X OBU equipment exits the expressway exit lane,

·Road side unit RSU broadcast toll station charging capacity;

The on-board unit OBU receives the toll station broadcast charging capability, completes the P2P communication session with the RSU, and responds "I am a car", including feedback of OBU logo, vehicle identification code, vehicle type, color, size, location and other information;

At the same time, the visual recognition system photographs and recognizes vehicle features;

According to the binding information recorded by the OBU logo and the cloud control platform, the roadside unit RSU determines the vehicle driving route and calculates the cost; and uses the visual recognition system to verify the vehicle information;

The road test unit RSU requests payment information from the vehicle-mounted unit OBU, including the payment amount, RSU logo, and position lights;

When the vehicle-mounted unit OBU receives the RSU payment request, after verifying the RSU device, it responds to the payment information, including the payment account number, payment amount, payment key, etc.;

After the RSU completes the payment deduction, it will notify the OBU of the deduction result.

·At the same time, the visual recognition system takes another photo and recognizes the passing vehicle; RSU verifies that the vehicle has been paid and then released.

In order to prevent the occurrence of behaviors such as replacing the vehicle-mounted unit or license plate midway, roadside units can also be installed at other locations than expressway entrances and exits. FIG. 6 shows an example of a plurality of roadside units arranged on the way of traveling of the vehicle.

As shown in Figure 6, when a vehicle loaded with V2X OBU equipment drives through the highway to test the V2X RSU,

Vehicle OBU broadcasts vehicle information, including but not limited to model, size, location, speed and other information;

·The road test visual recognition system photographs and recognizes passing vehicles;

The road test RSU receives the vehicle information broadcast by the OBU, compares and fuses it with the recognition results of the visual recognition system, uploads the vehicle information to the cloud control platform, and records the vehicle driving path in combination with the RSU location information.

If the road test RSU does not receive the OBU broadcast information of passing vehicles, it will mark the vehicle as suspicious when uploading the results of the visual recognition system, and give an early warning of suspected toll evasion.

The roadside unit shown in Figure 6 can be used to record the spatio-temporal information of the vehicle during driving. The spatio-temporal information can restore the driving route of the vehicle in the expressway as described above, so as to realize the charging according to the driving route.

The high-speed toll collection system described based on Figure 3-6 can also identify and respond to queue jumping and tailgating behaviors. Fig. 7 shows an example where there are queue-jumping vehicles when charging. When the truck loaded with V2X OBU equipment was paying the toll, another car that had not paid the toll jumped in front of the queue. Fig. 8 shows an example where there is a trailing vehicle when tolling. When the truck loaded with V2X OBU equipment was paying the toll, another car that had not paid the toll followed.

FIG. 9 shows an example of the processing flow when there is a violating vehicle. As shown in the figure, the forward-facing (for trailing vehicles) or backward-facing (for queue-jumping vehicles) visual recognition system shoots and checks violation vehicles. At this point, the offending vehicle information can be sent to the cloud through the drive test V2X RSU, and then the station staff can be notified. At the same time, it is possible to control the automatic railings not to let go.

Fig. 10 shows another example where there is a trailing vehicle when tolling. As shown in the figure, when the truck loaded with V2X OBU equipment is paying the toll, another car that has not paid the toll is trailing behind. At this time, because the visual recognition system lacks the forward recognition function (only one rearward camera), therefore, the vehicle equipped with the rear view camera can be used for the recognition of the trailing vehicle.

FIG. 11 shows an example of the processing flow when there is a violating vehicle. When the truck loaded with V2X OBU equipment passes through the communication coverage of the cloud platform of the automatic toll collection system, the rear view camera on the vehicle takes pictures of the rear of the vehicle, and uploads the captured images or videos to the cloud platform (for example, via V2X) for communication.

The cloud platform conducts vehicle identification and toll evasion behavior analysis based on these images or videos, and sends the results to the toll booth:

If the position of the subsequent vehicle is not enough to "follow" the vehicle through the automatic barrier even if it accelerates, the current truck will be quickly released;

If the subsequent vehicle may "follow" the vehicle through the automatic railing, you can perform operations to prevent the subsequent vehicle from escaping, such as controlling the automatic railing to accelerate and fall, warning the subsequent vehicle to pay the toll through the screen or sound, or notifying the on-site personnel for emergency treatment wait;

·If the follow-up vehicle forcibly "tailgating" passes, the video or image of the vehicle and its "toll evasion" behavior can be recorded on the cloud platform for subsequent processing (for example, calling the police, or making up when the vehicle re-enters the expressway). payment of fees and fines, etc.).

It should be understood that, in other embodiments, for the queue-jumping vehicle, the current vehicle may also be notified to turn on the front camera. In addition, image recognition, analysis, and warning processing can also be implemented by roadside units.

When two or more vehicles with the same characteristics pass through the same entrance lane in sequence, there may be a wrong binding between the on-board V2X OBU device and the vehicle (usually a vehicle identification code, such as a license plate), but as long as the verification system Auto-correction is supported and accurate billing is still guaranteed.

For example, it is assumed that three vehicles V1, V2, V3 with the same characteristics carry V2X OBU devices O1, O2, O3 respectively. When they pass through the same entrance lane in sequence, they are automatically bound as V1O2, V2O3, and V3O1.

1) If they go out through the same exit at the same time, regardless of whether the system detects a binding error, it can be inferred that they have the same driving route and the same cost;

2) If a road test unit RSU receives the information of the on-board unit O1, but the visual recognition system recognizes it as vehicle V1; at this time, the cloud control platform finds V1O2 and V3O1, then the binding relationship between the vehicle and the V2X device can be revised as V1O1, V3O2, keeping other vehicle characteristics unchanged. At this time, the binding relationship between the vehicle and the V2X device recorded by the cloud control platform is V1O1, V2O3, V3O2;

3) For V2O3 and V3O2, if they go out through the same exit, proceed as in 1); otherwise proceed as in 2), the result will be V2O2 and V3O3.

Similarly, if the verification system supports fuzzy matching, the binding relationship can be maintained and accurate charging can still be achieved. If the queue-jumping vehicle or the trailing vehicle has the same characteristics as the current vehicle, the visual verification system can distinguish and identify it by strictly comparing the vehicle identification code (eg, license plate number).

The application example of the present invention in the expressway tolling scene is described above with reference to FIGS. 3-11 . It should be understood that the present invention is also applicable to other scenarios based on vehicle unit communication and visual recognition matching and binding, such as parking lot charge verification, urban expressway and ordinary road monitoring, etc. In different embodiments, for a specific area, one or more sets of matching roadside units and visual identification units may be arranged. For example, in a small parking lot with the same exit and entrance, a set of roadside units and visual recognition units can be installed only at the entrance and exit for matching when vehicles enter and leave (even during parking). In addition, the cloud control platform is not necessary, it can be directly connected to the transfer management system, or all can be handled locally.

FIG. 12 shows a composition example of a vehicle information processing system according to an embodiment of the present invention. The system can be used as a highway toll station as shown in the figure above, for example, a toll system arranged at the entrance and exit, and the roadside components of the highway shown in FIG. 6 .

As shown in FIG. 12 , the vehicle information processing system 1200 of the present invention may include a first device 1210 , a second device 1220 and a third device 1230 .

Wherein, the first device 1210 may communicate with the vehicle-mounted unit on the vehicle to acquire the first information sent by the vehicle-mounted unit. The second device 1220 may photograph the vehicle, so as to acquire second information of the vehicle according to the photographed image. The third device 1230 may perform processing on the acquired first information and the second information. Here, the first device 1210 may be implemented as a roadside V2XRSU in a highway toll booth scenario. The second device 1220 can implement a vehicle identification and verification device, for example, two cameras arranged at the front and rear. The third device 1230 for performing processing may be implemented as a separate device, or may be integrated in the first or second device, for example, it is preferable to integrate both the first device 1210 and the third device 1230 by a roadside unit. However, in a scenario such as that shown in FIG. 6 , the roadside unit may further integrate the second device 1220 to completely include the first to third devices.

The second device 1220 may perform a visual recognition operation on the captured vehicle image to obtain the appearance feature information of the vehicle as the second information. Except that the photographing operation itself is implemented by the second device 1220, in different embodiments, the visual recognition operation may be implemented by any one of the first device, the second device or the third device. The first information may include the identification information of the vehicle unit and the information of the vehicle associated with the vehicle unit. In some embodiments, the first information may also include associated vehicle appearance characteristic information.

System 1200 can be implemented at least in part at the entrance of a particular area, for example, a toll system at the entrance of a highway. Therefore, the first device may include a first device arranged at the entrance of a specific area, and the first device receives the first information sent by the on-board unit on the vehicle based on broadcast communication; the second device may include a device arranged in a specific area The second device at the entrance, and photograph the vehicle when the vehicle reaches the entrance, so as to obtain the appearance feature information of the vehicle according to the photographed image; the third device can target the acquired first information Perform binding and/or matching processing with the second information. The system 1200 may further include: a release device arranged at the entrance of a specific area, and after the third device completes the binding and/or matching process, the release device allows the vehicle to enter the specific area.

The system 1200 can be at least partially implemented at the exit of a specific area, for example, a toll system at the exit of an expressway; it can also be at least partially implemented in this area, for example, the unit installed on the roadside of the expressway shown in FIG. 6 . Therefore, the first device may include a first device arranged at the exit of a specific area or in a specific area, and the first device receives the first information sent by the on-board unit on the vehicle based on broadcast communication; the second device includes an arrangement The second device at the exit of a specific area or within a specific area, and photographing the vehicle when the vehicle reaches the vicinity of the second device, so as to obtain appearance feature information of the vehicle according to the captured image.

In different application scenarios, the system 1200 may have one or more groups of devices. For example, in a small parking lot with the same entrance and exit, the first and second equipment for the entrance and exit can be implemented by the same set of equipment. At this point, system 1200 includes only one set of devices. In a large parking lot with multiple entrances, each entrance can be equipped with a set of first and second devices for communicating with the on-board unit and taking pictures of the vehicle. At this point, the third device can be realized by a single device through networking, or it can be realized at each entrance and exit separately, for example, by a roadside unit at each entrance and exit, and the system 1200 can include multiple sets of devices equipped with each entrance and exit. In the expressway, not only each entrance and exit needs to be equipped with a set of first and second devices for communicating with the vehicle-mounted unit and taking pictures of the vehicle, but also as shown in Figure 6, it can be equipped in the expressway to monitor the driving Vehicles communicate and film. At this point, system 1200 may include more groups of devices. In the above various scenarios, the system 1200 may also include a server (or a cloud platform) according to specific implementations, so as to realize centralized storage, processing and delivery of information. For example, the system 1200 may upload information obtained via the first device, the second device and the third device to a server, and download required data from the server. For example, the entrance toll collection system can upload the acquired vehicle initial binding/matching data to the server. The exit toll collection system can download the above-mentioned initial binding/matching data from the server, for example, based on the vehicle unit identification code, and use it together with the data obtained at the exit for subsequent processing, such as matching and charging calculation.

The third device may determine, based on the processing result of the binding and/or matching process at the entrance of a specific area, that the appearance characteristic information of the vehicle acquired at the exit of the specific area or within the specific area is different from the information of the vehicle acquired at the entrance. Whether the shape feature information matches. If there is a match, the third device communicates with the vehicle's on-board unit to perform the transaction. If there is a mismatch, an alert can be raised on-site or uploaded to the cloud.

System 1200 may also include clearance devices, such as automatic barriers. When the transaction is completed, the third device notifies the release device to release the vehicle to leave the specific area.

The system 1200 of the present invention may also have automatic processing capabilities for offending vehicles. For example, when the second device (eg, the camera at the exit) captures a trailing vehicle behind the vehicle, the system 1200 may notify the clearance device that the trailing vehicle is not allowed to leave the specific area. In other embodiments, the system 1200 can also order the vehicle located at the exit of the specific area to turn on the rear camera, so as to determine whether there is a trailing vehicle through the image captured by the rear camera; or by turning on the front camera, by The image taken by the front camera judges whether there is a vehicle that jumps in line.

In the case that multiple sets of communication and photographing devices are equipped within a specific area as shown in FIG. 6 , the third device can acquire the spatio-temporal information when the vehicle is photographed or communicates with the vehicle-mounted unit in the specific area. The above spatio-temporal information can be used for transactions and identification of abnormal behaviors. For example, the third device may conduct a transaction with the on-board unit of the vehicle based on the spatio-temporal information. The third device or the cloud platform can also determine that a certain vehicle is always physically close to its associated vehicle unit when it is in a specific area based on multiple sets of spatiotemporal information.

In order to comprehensively acquire the appearance feature information of the vehicle, the second device 1220 may include a camera device arranged on the roadside and used to photograph the vehicle from at least two directions. For example, the second device 1220 may include two separate cameras as shown in FIG. 3 . In other embodiments, the second device 1220 may also be, for example, a single camera that can rotate. In some embodiments, the second device 1220 may also be a camera capable of measuring depth information.

FIG. 13 shows a composition example of a vehicle information processing device according to an embodiment of the present invention. The device can be used as a roadside unit in a highway tollbooth as shown in the figure above, for example, a roadside V2XRSU arranged at the entrance and Identify functional roadside components.

As shown in FIG. 13 , the vehicle information processing device 1300 may include: a communication unit 1310 and a processing unit 1320 .

The communication unit 1310 may be used to: communicate with the vehicle-mounted unit to obtain the first information sent by the vehicle-mounted unit, notify the adjacent photographing device to photograph the vehicle, and acquire the second information of the vehicle according to the photographed image. information. Here, the communication unit 1310 may be a short-distance communication unit, for example, a unit having a broadcast communication capability. The processing unit 1320 may perform processing on the acquired first information and the second information.

The first information may include the identification information (for example, ID or MAC) of the vehicle-mounted unit and the information (for example, the license plate number) of the vehicle associated with the vehicle-mounted unit, and the second information may include visually recognized appearance feature information of the vehicle , and the processing unit executes a binding process of binding the first information and the second information.

The first information may also include appearance characteristic information of the vehicle associated with the vehicle-mounted unit, and the processing unit executes combining the appearance characteristic information included in the first information and the appearance characteristic information included in the second information Perform matching matching processing.

In the case of involving a cloud platform, the apparatus 1300 may further include: a second communication unit for communicating with the server. The second communication unit is capable of remote communication, and uploads the obtained information and/or processed results to the server, and obtains required information from the server.

The device 1300 can be arranged at different positions in a specific area to achieve different functions individually or jointly. For example, the device 1300 may be: an entrance device arranged at the entrance of a specific area to process vehicle information on vehicles entering the area; an in-area device arranged in a specific area to process vehicle information on vehicles in the specific area; and An exit device arranged at the exit of a specific area to process vehicle information for exit vehicles.

The device at the exit and/or the device in the area may be used to: based on the first information obtained from the vehicle-mounted unit of the vehicle at the exit and/or in the area, look up the vehicle information of the device at the entrance for the vehicle-mounted unit, so as to target The vehicle information at the entrance is matched with the vehicle information at the exit and/or within the area. Upon matching, the exit device and/or in-area device may notify its communication unit to conduct a transaction with the on-board unit of said exit and/or in-area vehicle. Subsequently, when it is determined that the transaction is completed, the processing unit may notify the communication unit to release the vehicle whose transaction has been completed to leave the specific area.

Likewise, the device 1300 may have the function of automatic identification and processing of violating vehicles. For example, in some embodiments, the exit device may be configured to: in a case where it is determined from the captured image that there is a trailing vehicle, perform an operation of not allowing the trailing vehicle to leave the specific area. In other embodiments, the device at the exit may be used to: notify the vehicle at the exit to turn on the rear camera, so as to determine whether there is a trailing vehicle through the image captured by the rear camera.

In order to provide more comprehensive matching information between the vehicle-mounted unit and the characteristics of the vehicle, the processing unit may record the time and location information of obtaining the first information and/or the second information to generate spatio-temporal information, and the exit device And/or the in-area device is used for: based on the spatio-temporal information of the exit and/or vehicles in the area, conduct transactions with the on-board units of the exit and/or vehicles in the area.

Fig. 14 shows a schematic structural diagram of a computing device according to an embodiment of the present invention.

Referring to FIG. 14 , a computing device 1400 includes a memory 1410 and a processor 1420 .

The processor 1420 may be a multi-core processor, or may include multiple processors. In some embodiments, the processor 1420 may include a general-purpose main processor and one or more special co-processors, such as a graphics processing unit (GPU), a digital signal processor (DSP), and so on. In some embodiments, processor 1420 may be implemented using custom circuitry, such as an Application Specific Integrated Circuit (ASIC) or a Field Programmable Gate Array (FPGA).

The memory 1410 may include various types of storage units such as system memory, read only memory (ROM), and persistent storage. Wherein, the ROM can store static data or instructions required by the processor 1420 or other modules of the computer. The persistent storage device may be a readable and writable storage device. Persistent storage may be a non-volatile storage device that does not lose stored instructions and data even if the computer is powered off. In some embodiments, the permanent storage device adopts a mass storage device (such as a magnetic or optical disk, flash memory) as the permanent storage device. In some other implementations, the permanent storage device may be a removable storage device (such as a floppy disk, an optical drive). The system memory can be a readable and writable storage device or a volatile readable and writable storage device, such as dynamic random access memory. System memory can store some or all of the instructions and data that the processor needs at runtime. In addition, memory 1410 may include any combination of computer-readable storage media, including various types of semiconductor memory chips (DRAM, SRAM, SDRAM, flash memory, programmable read-only memory), and magnetic and/or optical disks may also be used. In some embodiments, memory 1410 may include a readable and/or writable removable storage device, such as a compact disc (CD), a read-only digital versatile disc (e.g., DVD-ROM, dual-layer DVD-ROM), Read-Only Blu-ray Disc, Super Density Disc, Flash memory card (such as SD card, mini SD card, Micro-SD card, etc.), magnetic floppy disk, etc. Computer-readable storage media do not contain carrier waves and transient electronic signals transmitted by wireless or wire.

Executable codes are stored in the memory 1410 , and when the executable codes are processed by the processor 1420 , the processor 1420 can execute the vehicle information processing method mentioned above.

The vehicle information processing method, device and system according to the present invention have been described in detail above with reference to the accompanying drawings. The vehicle information processing solution of the present invention can realize the automatic binding and matching of vehicle features with vehicle features by combining vehicle-mounted unit information interaction with visual recognition. The above-mentioned matching verification can be performed multiple times to realize the supervision of abnormal situations.

In addition, the method according to the present invention can also be realized as a computer program or computer program product, the computer program or computer program product including computer program code instructions for executing the above-mentioned steps defined in the above-mentioned method of the present invention.

Alternatively, the present invention can also be implemented as a non-transitory machine-readable storage medium (or computer-readable storage medium, or machine-readable storage medium), on which executable code (or computer program, or computer instruction code is stored) ), when the executable code (or computer program, or computer instruction code) is executed by the processor of the electronic device (or computing device, server, etc.), causing the processor to perform the steps of the above method according to the present invention .

Those of skill would also appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented as electronic hardware, computer software, or combinations of both.

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems and methods according to various embodiments of the present invention. In this regard, each block in a flowchart or block diagram may represent a module, program segment, or part of code that includes one or more Executable instructions. It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks in succession may, in fact, be executed substantially concurrently, or they may sometimes be executed in the reverse order, depending upon the functionality involved. It should also be noted that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented by a dedicated hardware-based system that performs the specified functions or operations , or may be implemented by a combination of dedicated hardware and computer instructions.

Having described various embodiments of the present invention, the foregoing description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and alterations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principle of each embodiment, practical application or improvement of technology in the market, or to enable other ordinary skilled in the art to understand each embodiment disclosed herein.

Claims (55)

1. A vehicle information processing method, comprising: communicating with the on-board unit on the vehicle to acquire first information sent by the on-board unit, the first information including identification information of the on-board unit; photographing the vehicle to acquire second information of the vehicle according to the photographed image, where the second information includes information on the exterior features of the vehicle visually recognized by photographing the vehicle; and Performing processing on the acquired first information and the second information includes associating the first information with the second information, including: In the case that the first information and the second information contain different types of information, a binding operation of the first information and the second information is performed. 2. The method of claim 1, wherein performing processing on the acquired first information and the second information comprises: In the case that the first information and the second information contain similar information, a matching operation of the first information and the second information is performed. 3. The method according to claim 1, wherein the first information includes information on a vehicle associated with the on-board unit, and the information on the vehicle associated with the on-board unit includes license plate number information of the vehicle. 4. The method according to claim 3, wherein the information of the vehicle associated with the vehicle unit includes appearance feature information of the vehicle associated with the vehicle unit. 5. The method according to claim 1, wherein the second information further includes license plate number information of the vehicle visually recognized by photographing the vehicle. 6. The method of claim 1, wherein communicating with an on-board unit on the vehicle comprises one of: receiving broadcast information from the vehicle-mounted unit, broadcast communication requests; and The first message replied by the vehicle unit is received. 7. The method of claim 1, wherein the on-board unit comprises: Dedicated hardware units placed or installed on the vehicle; Intelligent Terminal; Mobile wearable device. 8. The method of claim 1, wherein photographing the vehicle comprises: The vehicle is photographed using visual identification equipment installed on site. 9. The method of claim 8, wherein photographing the vehicle using field-installed visual identification equipment comprises: When the visual recognition device captures that there is a trailing vehicle behind the vehicle, a relevant party is notified to perform an escape prevention operation for the trailing vehicle. 10. The method of claim 1, further comprising: The vehicle is notified to use the on-board camera to take an image to determine whether there is a trailing vehicle. 11. The method of claim 1, wherein performing processing on the acquired first information and the second information comprises: Upload the result of the processing to the server. 12. A vehicle information processing method, comprising: When the first vehicle enters a specific area, communicating with a first vehicle-mounted unit on the first vehicle to obtain first information sent by the first vehicle-mounted unit, where the first information includes identification information of the first vehicle-mounted unit; photographing the first vehicle to obtain second information of the first vehicle according to the photographed image, the second information of the first vehicle includes the appearance of the first vehicle visually recognized by photographing the image of the first vehicle characteristic information; Associating the first information with the second information includes: In the case that the first information and the second information contain different types of information, perform a binding operation of the first information and the second information; when the second vehicle is within the specific area or leaves the specific area, communicating with a second vehicle-mounted unit on the second vehicle to obtain third information sent by the second vehicle-mounted unit, where the third information includes identification information of the second vehicle-mounted unit; In a case where the first information corresponds to the third information, determining that the second vehicle-mounted unit is the same vehicle-mounted unit as the first vehicle-mounted unit; photographing the second vehicle to obtain fourth information of the second vehicle according to the photographed image, the fourth information of the second vehicle includes the appearance of the second vehicle visually recognized by photographing the image of the second vehicle characteristic information; and Based on the second information and fourth information, it is determined that the second vehicle is the same vehicle as the first vehicle. 13. The method according to claim 12, said associating said first information with said second information further comprising: A matching operation is performed on the acquired first information and the second information. 14. The method of claim 13, further comprising: Uploading the results of the binding and/or matching operations to the server. 15. The method of claim 14, wherein, based on the second and fourth information, determining that the second vehicle is the same vehicle as the first vehicle comprises: retrieving the results of said binding and/or matching operations from said server; and Based on the fourth information and the result of the binding and/or matching operation, it is determined that the second vehicle is the same vehicle as the first vehicle. 16. The method of claim 12, wherein communicating with the first on-board unit on the first vehicle when the first vehicle enters the specific area comprises: broadcast communication requests; and The first message replied by the first vehicle-mounted unit is received. 17. The method of claim 12, wherein communicating with the second on-board unit on the second vehicle when the second vehicle is within or out of the specified area comprises: receiving the third information broadcast by the second vehicle-mounted unit; or broadcasting a communication request, and receiving the third message in reply from the second vehicle-mounted unit. 18. The method of claim 12, further comprising: After determining that the second vehicle is the same vehicle as the first vehicle, conducting a transaction with the second on-board unit of the second vehicle. 19. The method of claim 18, wherein, after determining that the second vehicle is the same vehicle as the first vehicle, conducting a transaction with the second onboard unit of the second vehicle comprises: A transaction is performed with the second vehicle-mounted unit of the second vehicle based on the position information when the first vehicle enters a specific area and the position information when the second vehicle is inside or leaves the specific area. 20. The method of claim 19, further comprising: when the second vehicle is located within the specific area, Carrying out at least one communication with the second vehicle-mounted unit and photographing the second vehicle for the second vehicle to acquire at least one set of second vehicle information, a set of second vehicle information includes the information sent by the second vehicle-mounted unit The fifth information of the vehicle, the sixth information obtained according to the captured image, and the second vehicle position information at the time of capturing; uploading the acquired at least one set of second vehicle information to the server; The spatio-temporal information of the second vehicle within the specific area is confirmed using the at least one set of second vehicle information. 21. The method of claim 20, further comprising: Based on the spatio-temporal information, it is determined that the second vehicle loaded with the first vehicle-mounted unit is always the same vehicle as the first vehicle. 22. The method of claim 20, wherein, after determining that the second vehicle is the same vehicle as the first vehicle, conducting a transaction with the second on-board unit of the second vehicle comprises: A transaction is conducted with the second onboard unit of the second vehicle based on the spatiotemporal information. 23. The method of claim 19, further comprising: After the transaction is successful, the second vehicle is allowed to leave the specific area. 24. The method of claim 23, wherein after the transaction is successful, allowing the second vehicle to leave the specific area further comprises: After the transaction is successful, photographing the second vehicle, so as to obtain seventh information of the second vehicle according to the photographed image; and The second vehicle is allowed to leave the specific area after it is determined that the seventh information corresponds to the second or fourth information. 25. The method of claim 23, further comprising: When it is photographed that there is a trailing vehicle behind the vehicle, an operation of not allowing the trailing vehicle to leave the specific area is performed. 26. The method of claim 25, further comprising: notifying the second vehicle to turn on the rear view camera; and Filming is performed using the rear view camera to identify trailing vehicles. 27. A vehicle information processing system, comprising: The first device is configured to communicate with the vehicle-mounted unit on the vehicle to obtain first information sent by the vehicle-mounted unit, where the first information includes identification information of the vehicle-mounted unit; The second device is configured to photograph the vehicle, so as to obtain second information of the vehicle according to the photographed image, the second information including information on the exterior characteristics of the vehicle visually recognized by photographing the vehicle; and A third device, configured to perform processing on the acquired first information and the second information, including associating the first information with the second information, including: In the case that the first information and the second information contain different types of information, a binding operation of the first information and the second information is performed. 28. The system of claim 27, wherein obtaining the second information of the vehicle according to the captured image comprises: performing a visual recognition operation on the captured vehicle image to obtain the appearance feature information of the vehicle, Wherein, the visual recognition operation is implemented by one of the first device, the second device or the third device. 29. The system of claim 28, wherein the first information includes information about a vehicle associated with the on-board unit. 30. The system according to claim 29, wherein the first device comprises a first device arranged at an entrance of a specific area, and the first device receives first information transmitted by an on-board unit on the vehicle based on broadcast communication ; The second device includes a second device arranged at the entrance of a specific area, and photographs the vehicle when the vehicle reaches the entrance, so as to obtain appearance characteristic information of the vehicle according to the photographed image; The third device is further configured to perform matching processing on the acquired first information and the second information. 31. The system of claim 30, further comprising: A passing device arranged at the entrance of a specific area, after the third device completes the binding and/or matching process, the passing device allows the vehicle to enter the specific area. 32. The system of claim 30, wherein, The first device includes a first device arranged at an exit of a specific area or within a specific area, and the first device receives first information sent by an on-board unit on the vehicle based on broadcast communication; The second device includes a second device arranged at the exit of a specific area or in a specific area, and the vehicle is photographed when the vehicle reaches the vicinity of the second device, so as to obtain the appearance of the vehicle according to the captured image characteristic information. 33. The system according to claim 32, wherein the third device determines that vehicles are acquired at the exit of the specific area or within the specific area based on the processing results of the binding and/or matching process at the entrance of the specific area Whether the appearance feature information of the vehicle matches the appearance feature information of the vehicle obtained at the entrance. 34. The system according to claim 32, wherein the third device determines that the acquisition of the appearance feature information of the vehicle at the exit of the specific area or within the specific area is the same as the acquisition of the appearance feature information of the vehicle at the entrance In the case of a match, the third device communicates with the vehicle's on-board unit to conduct the transaction. 35. The system of claim 34, further comprising: The release device, when the transaction is completed, the third device notifies the release device to release the vehicle to leave the specific area. 36. The system according to claim 35, when the second device captures a trailing vehicle behind the vehicle, the system notifies the release device that the trailing vehicle is not allowed to leave the specific area. 37. The system according to claim 34, wherein the system commands the vehicle at the exit of the specific area to turn on the rear camera, so as to judge whether there is a trailing vehicle through the image captured by the rear camera. 38. The system of claim 32, wherein the third device acquires spatio-temporal information when the vehicle is photographed within the specific area or communicates with an on-board unit. 39. The system of claim 38, wherein the third device conducts a transaction with the onboard unit of the vehicle based on the spatiotemporal information. 40. The system of claim 28, wherein the second device includes a camera device disposed on a roadside for photographing the vehicle from at least two directions. 41. The system of claim 27, wherein the first device performs at least some of the functions of the third device. 42. The system of claim 27, wherein the system uploads information obtained via the first device, the second device, and the third device to a server. 43. A vehicle information processing device, comprising: communication unit for: communicating with the on-board unit on the vehicle to obtain first information sent by the on-board unit, the first information including identification information of the on-board unit, Notifying the adjacent photographing device to photograph the vehicle, so as to obtain second information of the vehicle according to the photographed image, the second information including the exterior feature information of the vehicle visually recognized by photographing the vehicle, and A processing unit, configured to perform processing on the acquired first information and the second information, including associating the first information and the second information, including: In the case that the first information and the second information contain different types of information, a binding operation of the first information and the second information is performed. 44. The apparatus of claim 43, wherein the first information includes information of a vehicle associated with the on-board unit. 45. The apparatus according to claim 44, wherein the first information further includes appearance feature information of the vehicle associated with the vehicle unit, and The processing unit executes a matching process of matching the appearance characteristic information included in the first information with the appearance characteristic information included in the second information. 46. The apparatus of claim 43, further comprising: A second communication unit for communicating with the server, where the second communication unit uploads the acquired information and/or processing results to the server. 47. The apparatus of claim 43, wherein the apparatus comprises at least one of: An entrance device arranged at the entrance of a specific area to process vehicle information for vehicles entering; An in-area device arranged in a specific area to process vehicle information on vehicles in the specific area; and An exit device arranged at the exit of a specific area to process vehicle information for exit vehicles. 48. The device of claim 47, wherein said outlet device and/or said in-zone device is for: Based on the first information obtained from the on-board unit of the vehicle at the exit and/or in the area, look up the vehicle information of the on-board unit of the device at the entrance, so as to compare the vehicle information at the entrance with the vehicle at the exit and/or in the area matching of information. 49. The device of claim 48, wherein said outlet device and/or said in-zone device is for: If it is determined that the vehicle information at the entrance matches the vehicle information at the exit and/or within the area, the communication unit is notified to conduct a transaction with the on-board unit of the vehicle at the exit and/or within the area. 50. The apparatus of claim 49, wherein the processing unit is configured to: When it is determined that the transaction is completed, the communication unit is notified to release the vehicle whose transaction has been completed to leave the specific area. 51. The device of claim 47, said outlet device for: In a case where it is determined from the captured image that there is a following vehicle, an operation of not allowing the following vehicle to leave the specific area is performed. 52. The device of claim 51, said outlet device for: Informing the vehicle at the exit to turn on the rear camera, so as to determine whether there is a trailing vehicle through the image captured by the rear camera. 53. The apparatus of claim 49, wherein the processing unit is configured to: recording the time and location information of obtaining the first information and/or the second information to generate spatiotemporal information, and Said exit device and/or said in-zone device is used to: Carrying out transactions with on-board units of vehicles at the exit and/or within the area based on the spatio-temporal information of the vehicles at the exit and/or within the area. 54. A computing device comprising: processor; and A memory on which executable code is stored, and when the executable code is executed by the processor, causes the processor to execute the method according to any one of claims 1-26. 55. A non-transitory machine-readable storage medium, on which executable codes are stored, and when the executable codes are executed by a processor of an electronic device, the processor is executed to execute any one of claims 1-26. one of the methods described.

Images