CN112288904B - Vehicle terminal, distributed vehicle terminal integrated management method and system - Google Patents
Vehicle terminal, distributed vehicle terminal integrated management method and system Download PDFInfo
- Publication number
- CN112288904B CN112288904B CN202011319817.7A CN202011319817A CN112288904B CN 112288904 B CN112288904 B CN 112288904B CN 202011319817 A CN202011319817 A CN 202011319817A CN 112288904 B CN112288904 B CN 112288904B
- Authority
- CN
- China
- Prior art keywords
- vehicle
- data
- mounted terminal
- video
- semi
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000007726 management method Methods 0.000 title claims abstract description 22
- 238000000034 method Methods 0.000 claims abstract description 15
- 230000005540 biological transmission Effects 0.000 claims description 15
- 238000012545 processing Methods 0.000 claims description 13
- 238000004806 packaging method and process Methods 0.000 claims description 6
- 238000013523 data management Methods 0.000 claims description 3
- 238000012544 monitoring process Methods 0.000 abstract description 15
- 230000000007 visual effect Effects 0.000 abstract description 2
- YXFVVABEGXRONW-UHFFFAOYSA-N Toluene Chemical compound CC1=CC=CC=C1 YXFVVABEGXRONW-UHFFFAOYSA-N 0.000 description 6
- CURLTUGMZLYLDI-UHFFFAOYSA-N Carbon dioxide Chemical compound O=C=O CURLTUGMZLYLDI-UHFFFAOYSA-N 0.000 description 4
- 238000004891 communication Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- UGFAIRIUMAVXCW-UHFFFAOYSA-N Carbon monoxide Chemical compound [O+]#[C-] UGFAIRIUMAVXCW-UHFFFAOYSA-N 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 2
- 229910002092 carbon dioxide Inorganic materials 0.000 description 2
- 239000001569 carbon dioxide Substances 0.000 description 2
- 229910002091 carbon monoxide Inorganic materials 0.000 description 2
- 230000007613 environmental effect Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- WSFSSNUMVMOOMR-NJFSPNSNSA-N methanone Chemical compound O=[14CH2] WSFSSNUMVMOOMR-NJFSPNSNSA-N 0.000 description 2
- 230000002085 persistent effect Effects 0.000 description 2
- 239000003208 petroleum Substances 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000010267 cellular communication Effects 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 239000000428 dust Substances 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000009449 lightweight packaging Methods 0.000 description 1
- 239000005416 organic matter Substances 0.000 description 1
- 239000013618 particulate matter Substances 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 238000005057 refrigeration Methods 0.000 description 1
- 238000013515 script Methods 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C5/00—Registering or indicating the working of vehicles
- G07C5/008—Registering or indicating the working of vehicles communicating information to a remotely located station
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C5/00—Registering or indicating the working of vehicles
- G07C5/08—Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time
- G07C5/0841—Registering performance data
- G07C5/085—Registering performance data using electronic data carriers
- G07C5/0866—Registering performance data using electronic data carriers the electronic data carrier being a digital video recorder in combination with video camera
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
- H04L67/025—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
- H04N21/64322—IP
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
- H04N21/6437—Real-time Transport Protocol [RTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/30—Services specially adapted for particular environments, situations or purposes
- H04W4/38—Services specially adapted for particular environments, situations or purposes for collecting sensor information
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/30—Services specially adapted for particular environments, situations or purposes
- H04W4/40—Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P]
- H04W4/44—Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P] for communication between vehicles and infrastructures, e.g. vehicle-to-cloud [V2C] or vehicle-to-home [V2H]
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Traffic Control Systems (AREA)
Abstract
公开了一种车载终端、分布式车载终端集成管理方法和系统。该方法包括：车载终端采集非结构化视频数据以及半结构化车辆行驶状态数据和/或车内环境数据，在采集的数据中加入车载终端注册节点ID和时空标签；服务器接入分布式车载终端采集的多源异构数据；在获取到对注册节点ID下的车载终端采集的视频进行播放的指令时，将对应的实时视频数据推流到服务器网页前端进行拉流，拉流过程中提取时空标签，根据注册节点ID和时空标签检索与视频流在时间、空间上匹配的车内环境数据和/或车辆行驶状态数据；将检索到的数据发送到服务器网页前端同步显示在视频显示页面上，复现车内场景。本发明实现对分布式车辆的行驶状态、车内环境的实时监控与可视化复现。
Disclosed are a vehicle terminal, a distributed vehicle terminal integrated management method and system. The method includes: collecting unstructured video data and semi-structured vehicle driving state data and/or in-vehicle environment data by the vehicle-mounted terminal, adding the vehicle-mounted terminal registration node ID and spatiotemporal label to the collected data; the server is connected to the distributed vehicle-mounted terminal The collected multi-source heterogeneous data; when the instruction to play the video collected by the vehicle terminal under the registered node ID is obtained, the corresponding real-time video data is pushed to the front end of the server web page for streaming, and the time and space are extracted during the streaming process. tag, retrieve the in-vehicle environment data and/or vehicle driving status data that match the video stream in time and space according to the registered node ID and spatiotemporal tags; send the retrieved data to the server web front-end to display on the video display page synchronously, Reproduce the scene inside the car. The invention realizes the real-time monitoring and visual reproduction of the running state of the distributed vehicle and the environment inside the vehicle.
Description
Technical Field
The invention relates to a vehicle-mounted terminal, a distributed vehicle-mounted terminal integrated management method and a distributed vehicle-mounted terminal integrated management system, which can be applied to the field of logistics.
Background
In order to ensure the safety of transportation, the commonly adopted management and control modes are as follows: cameras and sensors are arranged in vehicles such as petroleum transport vehicles, buses and logistics vehicles to monitor the transportation process. With the continuous increase of monitored vehicles, a remote monitoring system faces the requirements of massive, high-concurrency, real-time data processing and intelligent analysis, and how to upload, summarize, store and utilize massive traffic flow data in real time and how to reproduce the data visually becomes a great problem.
Disclosure of Invention
The invention provides a vehicle-mounted terminal, and a distributed vehicle-mounted terminal integrated management method and system, which are used for realizing real-time monitoring and visual reproduction of the running state of a distributed vehicle and the environment in the vehicle.
According to a first aspect of the embodiments of the present invention, a distributed vehicle-mounted terminal integrated management method is provided, including:
performing node registration on the vehicle-mounted terminal, generating a registration node ID for verifying the vehicle-mounted terminal, and registering a sensor and a camera on the vehicle-mounted terminal to form registration information of the sensor and the camera;
acquiring semi-structured vehicle running state data and/or vehicle internal environment data through a sensor, and acquiring unstructured video data through a camera;
adding a registration node ID and a time-space label into the acquired semi-structured data and the acquired unstructured video data, packaging the semi-structured data, and encoding the unstructured video data;
and transmitting the packaged and coded semi-structured data and the unstructured video data to a server in a multi-path parallel transmission mode.
In some examples, semi-structured data is transmitted using the TCP/IP protocol and unstructured video data is transmitted using the RTMP streaming protocol.
According to a second aspect of the embodiments of the present invention, there is provided a distributed integrated management system for vehicle-mounted terminals, including:
the node registration module is used for performing node registration on the vehicle-mounted terminal, generating a registration node ID for verifying the vehicle-mounted terminal, and registering a sensor and a camera on the vehicle-mounted terminal to form sensor and camera registration information;
the data acquisition module is used for acquiring semi-structured vehicle driving state data and/or vehicle internal environment data through a sensor and acquiring unstructured video data through a camera;
the data processing module is used for adding a registration node ID and a space-time label into the acquired semi-structured data and the acquired unstructured video data, packaging the semi-structured data and encoding the unstructured video data;
and the data transmission module is used for transmitting the semi-structured data and the unstructured video data which are packaged and coded to the server in a multi-path parallel transmission mode.
According to a third aspect of the embodiments of the present invention, there is provided a vehicle-mounted terminal including: and the processor executes the steps of the distributed vehicle-mounted terminal integrated management method according to the first aspect when executing the program stored in the memory.
According to a fourth aspect of the embodiments of the present invention, there is provided a distributed vehicle-mounted terminal integrated management method, including:
the method comprises the steps that unstructured video data acquired by a vehicle-mounted terminal, semi-structured vehicle driving state data and/or vehicle internal environment data are accessed in a multi-path parallel mode through a master-slave multi-thread mode, wherein the semi-structured data and the unstructured video data are provided with vehicle-mounted terminal registration node IDs and space-time labels;
respectively storing the accessed unstructured video data and the semi-structured data of the vehicle driving state data and/or the vehicle internal environment data;
when an instruction for playing a video collected by a vehicle-mounted terminal under a registered node ID is acquired, pushing real-time video data corresponding to the registered node ID to the front end of a web server webpage for stream pulling;
extracting a space-time label in the video streaming process, and retrieving the in-vehicle environment data and/or vehicle driving state data matched with the video streaming in time and space according to the registered node ID and the space-time label;
and sending the retrieved in-vehicle environment data and/or vehicle driving state data to the front end of the web server webpage, and synchronously displaying the data on the video display page.
According to a fifth aspect of the embodiments of the present invention, there is provided a distributed integrated management system for vehicle-mounted terminals, including:
the data access module is used for accessing unstructured vehicle video data acquired by the vehicle-mounted terminal, semi-structured vehicle driving state data and/or vehicle internal environment data in a multi-path parallel mode through a master-slave multi-thread mode, wherein the semi-structured data and the unstructured data are provided with vehicle-mounted terminal registration node IDs and space-time labels;
the data management module is used for storing the accessed unstructured video data, and semi-structured vehicle driving state data and/or vehicle internal environment data;
and the in-vehicle environment reproduction module is used for pushing the real-time video data corresponding to the registered node ID to the front end of the web server webpage for streaming when an instruction for playing the video collected by the vehicle-mounted terminal under the registered node ID is acquired, extracting a space-time label in the video streaming process, retrieving in-vehicle environment data and/or vehicle running state data matched with the video stream in time and space according to the registered node ID and the space-time label, sending the retrieved in-vehicle environment data and/or vehicle running state data to the front end of the web server webpage, and synchronously displaying the in-vehicle environment data and/or vehicle running state data on the video display page.
According to a sixth aspect of the embodiments of the present invention, there is provided a server including: and the processor executes the steps of the distributed vehicle-mounted terminal integrated management method according to the fourth aspect when executing the program stored in the memory.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings of the embodiments will be briefly described below.
Fig. 1 is a block diagram of a vehicle-mounted terminal according to an embodiment of the present invention.
Fig. 2 is a block diagram of a functional module of a vehicle-mounted terminal according to an embodiment of the present invention.
Fig. 3 is a UML model associated with monitoring data of a vehicle-mounted terminal according to an embodiment of the present invention.
Fig. 4 is a server-side software architecture according to an embodiment of the present invention.
Fig. 5 is a high concurrency processing framework based on the Netty technology according to an embodiment of the present invention.
Fig. 6 is a schematic diagram illustrating a distributed in-vehicle environment visualization process according to an embodiment of the present invention.
Detailed Description
The term "in-vehicle terminal" in the present invention refers to an electronic device component mounted on a vehicle to acquire in-vehicle image or video data, vehicle driving state data, and/or in-vehicle environment data. The vehicle driving state data may include, but is not limited to, one or more of the following: the position coordinate, the angle, the speed, the angular speed, the steering angle of the front wheel relative to the vehicle body and the battery parameters of the new energy vehicle. In-vehicle environmental data may include, but is not limited to, one or more of the following: temperature and humidity, particulate matter concentration, carbon monoxide concentration, carbon dioxide concentration, and volatile organic matter (formaldehyde, toluene, etc.) concentration. The vehicle-mounted terminal can be used for monitoring petroleum and chemical transport vehicles, public transport vehicles and logistics vehicles.
Fig. 1 shows a block diagram of a vehicle-mounted terminal, which includes a processing device, a sensor, a camera, a communication module, and a display. And according to the actual monitoring requirement, configuring a sensor and acquiring vehicle running state data and/or vehicle internal environment data. The sensor refers to a non-image type sensor, and may include, but is not limited to, one or more of the following monitoring modules: a GNSS positioning module; the device comprises a temperature and humidity sensor, an infrared sensing module, a dust sensor, a formaldehyde, PM2.5, toluene, carbon monoxide or carbon dioxide gas sensor and the like; the monitoring module of the running state of hardware facilities such as air conditioners, engines and the like; vehicle motion information monitoring modules (speed, acceleration, angular acceleration, displacement); angle information monitoring modules (pitch angle, roll angle, azimuth angle); new energy automobile battery information monitoring module. The camera captures image or video data. The sensor establishes physical connection with the processing device through a serial port, and the selectable serial port may include: UART, RS232, RS485, I2C, SPI and USB. The camera can establish physical connection with the processing equipment through a USB interface, an MIPI interface or a DMI interface. The communication module is responsible for the wireless communication connection between the vehicle-mounted terminal and the server and can be connected with the processing equipment through a serial port. The vehicle-mounted terminal has strong mobility due to the fact that the vehicle-mounted terminal moves along with a vehicle, the data volume is small, the transmission frequency is high, and meanwhile long-distance transmission needs to be considered. The invention adopts the transmission mode of cellular communication (4G/5G) to realize remote transmission.
The camera collects video data, the sensor collects vehicle running state data and/or vehicle internal environment data, the vehicle running state and/or vehicle internal environment dynamic changes are displayed and reflected in real time through the displayer, and the displayer is connected with the processing equipment through a VGA (video graphics array), HDMI (high-definition multimedia interface) or USB (universal serial bus) interface.
Functional software of the vehicle-mounted terminal can be developed based on a Linux operating system. As shown in fig. 2, the in-vehicle terminal may include four functional modules: the system comprises a node registration module, a data acquisition module, a data processing module and a data transmission module.
The node registration module realizes the registration function of the vehicle-mounted terminal, mainly comprises an application demonstration theme, a node type, node related meta-information, the number of sensors and meta-data information of each sensor, and randomly generates 8-bit nodeID as the node ID for verifying the vehicle-mounted terminal after registration is finished.
The vehicle-mounted terminal has different requirements on observation perception of vehicle data according to different application demonstration scenes. Therefore, the terminal node registration module needs to include not only the node type and the related information, but also provide a corresponding application demonstration theme so as to facilitate data analysis and make an accurate judgment on the vehicle state. The application demonstration themes mainly comprise a logistics scene, a passenger carrying scene and the like. The logistics scene can be further divided according to the type attributes of goods, such as refrigeration, fragility, flammability and the like.
The sensors have different sampling frequencies, and each data can represent the running state information of the vehicle or the environmental element information in the vehicle in the sampling time. The data acquired by the vehicle-mounted terminal has heterogeneity, the acquired data has different formats and structural characteristics according to different standards, for example, the data acquired by the GNSS positioning module, the temperature and humidity sensor, the gas sensor and the like is semi-structured text information data, and the data acquired by the camera is a real-time video stream and is unstructured data. Therefore, the data acquisition module respectively realizes the acquisition of the semi-structured data and the unstructured data.
And the data processing module performs json format packaging on the acquired semi-structured data according to metadata information, wherein the json format is a lightweight packaging format, and the data processing module is concise and clear in hierarchy and easy to read. And the data processing module adopts H264 video coding for the unstructured video data.
The data transmission module is realized by adopting two process scripts and is divided into two channels for respectively transmitting video data and sensor data. Because the GNSS positioning data, the non-image sensor data and the clock data are semi-structured text data, the transmission of the automobile driving state information and the automobile internal environment data is realized by adopting socket communication programming based on a TCP/IP protocol; the video image data is structured file data, and the RTMP streaming protocol is adopted to carry out video streaming pushing.
The main characteristic of the data collected by the vehicle-mounted terminal is multisource heterogeneity. Considering that the subsequent storage is difficult due to different structural sources of various data, the unified description is carried out on the multi-source data by constructing the metadata dictionary, and the unit or format of the data is normalized. On the basis of the unified description, a data association model is established by using the registered vehicle-mounted terminal node ID, as shown in FIG. 3. And carrying out node registration on the vehicle-mounted terminal to form vehicle-mounted terminal registration information, and ensuring the specificity of the vehicle-mounted terminal deployed in each automobile. And simultaneously registering the vehicle-mounted terminal, registering the mounted sensor and the camera to form sensor and camera registration information. By inquiring the registered node ID of the vehicle-mounted terminal, all sensor and camera information related to the node ID can be inquired. The registered node ID is also added into the sensor data and the video data collected by the sensor and the camera as a label, and the corresponding non-image data and the video data collected by the camera can be inquired through the attribute of the registered node ID, so that the association among the automobile terminal, the sensor and the sensor data and the association among the sensor data and the sensor data are established through the node ID. On the basis, when multi-source heterogeneous data collected by the distributed vehicle-mounted terminals are accessed to a data center of the server side, the data of different vehicle-mounted terminals can be distinguished through the node IDs, and classified storage is carried out according to the data of the vehicle-mounted terminals and information of various sensors registered by the terminals, so that follow-up data query, the automobile driving state and the in-automobile environment can be conveniently and visually reproduced. The invention relates to a method for adding node ID and time labels into data generated by different data sources, which can associate multi-source heterogeneous data and fuse data while ensuring data integrity.
A large amount of semi-structured sensor data and unstructured video stream data acquired by a vehicle-mounted terminal are accessed to a data access management platform of a server side in a multi-path parallel transmission mode. As shown in fig. 4, the server-side system may include four functional modules: the system comprises a log monitoring module, a data access module, a data management module and an in-vehicle environment reproduction module.
The method comprises the steps that non-image sensor data and video data collected by a vehicle-mounted terminal are parallelly accessed to a data layer in an access layer in a unified mode, different data are decoded in the data layer according to coding rules of a client to obtain corresponding data, the data in different formats are classified and packaged, type registration and standardized description are carried out on the sensor data, the data and metadata information of the data are stored in corresponding sets of a database according to storage rules of the database, unified packaging of the data and persistent management of the data are achieved, and corresponding services are provided for users by controlling the persistent data. The invention aims at the characteristics of different heterogeneous data structures, classifies data according to types or application scenes, and combines a database and a file system according to data characteristics so as to overcome the defects of a single storage form and meet the requirements on multi-source heterogeneous data storage.
The whole operation process of the server side is that before a user accesses the server, an access request is sent to the server, after the server receives the access request of the user, whether the request is received or not is judged according to relevant information, if the request is received, the server establishes a service thread for each user, and a special socket port is distributed. Since the data collected by the vehicle-mounted terminal is heterogeneous, a large number of service threads need to be established when massive heterogeneous data is accessed into the system for operation, which causes a high concurrency problem. In order to solve the problem, as shown in fig. 5, a master-slave multithreading mode is adopted on the basis of a netty framework, the mode does not use only a single thread when receiving data acquired by a vehicle-mounted terminal, the single thread is changed into a thread pool, the main thread of the thread pool is only responsible for connection requests, and the auxiliary thread is responsible for allocation of request tasks, so that massive concurrent requests can be processed. The data transmission that will gather of many sensors of deployment in the car is main for receiving the request to main Reactor, and under the condition of only receiving the client request, main Reactor can receive million grades of connection requests, can satisfy the simultaneous access of multichannel sensor in the car, in addition, can also compensate the unstable problem of Reactor thread pool when connecting concurrent request. The main Reactor only receives a connection request of data access transmitted by a vehicle-mounted terminal sensor, the concrete operation of the corresponding request after connection is that tasks are dispatched through the sub Reactor, the sub Reactor dispatches data of the sensor in the vehicle to the thread pool, different types of sensor data are injected into a certain thread in the sub Reactor thread pool, the data transmitted into the thread pool are packaged and encoded through a data format, the thread pool calculates the encoded sensor data, the associated different data are decoded to obtain corresponding vehicle driving state data and vehicle internal environment monitoring data, the heterogeneous data parallel access of various sensors deployed in the vehicle is further realized through a netty frame, and the vehicle driving state data and the vehicle internal environment monitoring data are stored after being successfully accessed into the system.
As shown in fig. 6, for the real-time reproduction requirements of videos in the distributed vehicle, the driving state and the environment in the vehicle, the invention aggregates data collected by different sensors and real-time video stream data transmitted by the vehicle-mounted camera, and visually displays the driving state and the environment in the vehicle on the web page platform according to the query requirements of the user. A user can log in a web webpage platform through a mobile phone or a computer to watch the running state of the automobile and real-time data and videos of the environment in the automobile. The web page platform is built on a web server, the web server interacts with the data server through a local area network to realize the query and feedback of data, and the data is fed back to the intelligent terminal of the user through the Internet. Real-time video stream collected by the vehicle-mounted camera and data measured by the sensor are provided with time empty labels. When a user logs in a webpage to select to view in-vehicle videos, in-vehicle environment data and vehicle running state data, a registered node ID corresponding to a vehicle-mounted terminal of a vehicle is selected, the registered node ID is clicked to play, a camera carried by the vehicle-mounted terminal pushes collected real-time videos to a web server, and the front end of the webpage is pulled to display in-vehicle pictures in real time. The video stream extracts a space-time label from the video stream, and the database searches sensor data which are closest to the video stream in time and space, such as coordinate data, temperature and humidity, gas content and the like according to the node ID and the space-time label registered by the vehicle-mounted terminal of the automobile, so that space-time matching of the real-time video stream, the environment data and the driving state data is realized. And sending the retrieved data to the front end of the webpage, and synchronously displaying the data on a video display page, so that the user can simultaneously see the real-time video in the vehicle and various data measured by the sensor. When the user clicks to stop playing, the camera stops pushing the stream, the webpage stops pulling the stream, the database stops data retrieval, and therefore the webpage stops displaying all data. Therefore, the user clicks playing and stopping to control push streaming and pull streaming of the video, and the bearing pressure of the server can be relieved. According to the invention, the multi-source heterogeneous data are aggregated and the aggregated data are visualized by a multi-source heterogeneous data space-time matching method. The functions of the sensor data and the real-time video stream through the air-space tag matching and synchronous display can well meet the requirements of intelligent logistics on reproduction and real-time monitoring of the environment in the vehicle.
Claims (7)
1. A distributed vehicle-mounted terminal integrated management method is characterized by comprising the following steps:
performing node registration on the vehicle-mounted terminal, generating a registration node ID for verifying the vehicle-mounted terminal, and registering a sensor and a camera on the vehicle-mounted terminal to form registration information of the sensor and the camera;
acquiring semi-structured vehicle running state data and/or vehicle internal environment data through a sensor, and acquiring unstructured video data through a camera;
adding a registration node ID and a time-space label into the acquired semi-structured vehicle driving state data and/or the vehicle internal environment data and the unstructured video data, packaging the semi-structured vehicle driving state data and/or the vehicle internal environment data, and encoding the unstructured video data;
and transmitting the packaged semi-structured vehicle driving state data and/or the vehicle environment data and the encoded unstructured video data to a server in a multi-path parallel transmission mode.
2. The integrated management method for the distributed vehicle-mounted terminals according to claim 1, characterized in that a TCP/IP protocol is adopted to transmit semi-structured data, and an RTMP streaming protocol is adopted to transmit unstructured video data.
3. The utility model provides a distributed vehicle mounted terminal integrated management system which characterized in that includes:
the node registration module is used for performing node registration on the vehicle-mounted terminal, generating a registration node ID for verifying the vehicle-mounted terminal, and registering a sensor and a camera on the vehicle-mounted terminal to form sensor and camera registration information;
the data acquisition module is used for acquiring semi-structured vehicle driving state data and/or vehicle internal environment data through a sensor and acquiring unstructured video data through a camera;
the data processing module is used for adding a registration node ID and a time-space label into the acquired semi-structured vehicle driving state data and/or the vehicle internal environment data and the unstructured video data, packaging the semi-structured vehicle driving state data and/or the vehicle internal environment data and encoding the unstructured video data;
and the data transmission module is used for transmitting the packaged semi-structured vehicle driving state data and/or the vehicle internal environment data and the coded unstructured video data to the server in a multi-path parallel transmission mode.
4. A vehicle-mounted terminal characterized by comprising: a processor, when executing the program stored in the memory, executing the steps of the distributed vehicle terminal integrated management method according to any one of claims 1-2.
5. A distributed vehicle-mounted terminal integrated management method is characterized by comprising the following steps:
the method comprises the steps that unstructured video data acquired by a vehicle-mounted terminal and semi-structured vehicle driving state data and/or vehicle internal environment data are accessed in a multi-path parallel mode through a master-slave multi-thread mode, wherein the semi-structured vehicle driving state data and/or the vehicle internal environment data and the unstructured video data are provided with vehicle-mounted terminal registration node IDs and space-time labels;
respectively storing the accessed unstructured video data, and semi-structured vehicle driving state data and/or vehicle internal environment data;
when an instruction for playing a video collected by a vehicle-mounted terminal under a registered node ID is acquired, pushing real-time video data corresponding to the registered node ID to the front end of a web server webpage for stream pulling;
extracting a space-time label in the video streaming process, and retrieving the in-vehicle environment data and/or vehicle driving state data matched with the video streaming in time and space according to the registered node ID and the space-time label;
and sending the retrieved in-vehicle environment data and/or vehicle driving state data to the front end of the web server webpage, and synchronously displaying the data on the video display page.
6. The utility model provides a distributed vehicle mounted terminal integrated management system which characterized in that includes:
the data access module is used for accessing unstructured vehicle video data acquired by the vehicle-mounted terminal, and semi-structured vehicle driving state data and/or vehicle internal environment data in a multi-path parallel mode through a master-slave multi-thread mode, wherein the semi-structured vehicle driving state data and/or the vehicle internal environment data and the unstructured video data are provided with vehicle-mounted terminal registration node IDs and space-time labels;
the data management module is used for storing the accessed unstructured video data, and semi-structured vehicle driving state data and/or vehicle internal environment data;
and the in-vehicle environment reproduction module is used for pushing the real-time video data corresponding to the registered node ID to the front end of the web server webpage for streaming when an instruction for playing the video collected by the vehicle-mounted terminal under the registered node ID is acquired, extracting a space-time label in the video streaming process, retrieving in-vehicle environment data and/or vehicle running state data matched with the video stream in time and space according to the registered node ID and the space-time label, sending the retrieved in-vehicle environment data and/or vehicle running state data to the front end of the web server webpage, and synchronously displaying the in-vehicle environment data and/or vehicle running state data on the video display page.
7. A server, comprising: a processor, when executing the program stored in the memory, executing the steps of the distributed vehicle terminal integrated management method according to claim 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011319817.7A CN112288904B (en) | 2020-11-23 | 2020-11-23 | Vehicle terminal, distributed vehicle terminal integrated management method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011319817.7A CN112288904B (en) | 2020-11-23 | 2020-11-23 | Vehicle terminal, distributed vehicle terminal integrated management method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112288904A CN112288904A (en) | 2021-01-29 |
| CN112288904B true CN112288904B (en) | 2022-04-01 |
Family
ID=74425256
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011319817.7A Active CN112288904B (en) | 2020-11-23 | 2020-11-23 | Vehicle terminal, distributed vehicle terminal integrated management method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112288904B (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114064789A (en) * | 2021-11-12 | 2022-02-18 | 上汽通用五菱汽车股份有限公司 | Visualization method and device for vehicle-mounted terminal data and storage medium |
| CN114327838B (en) * | 2022-03-07 | 2022-05-24 | 中电云数智科技有限公司 | Video scheduling engine device and method based on distributed management |
| CN115118759B (en) * | 2022-05-31 | 2024-03-22 | 在行(杭州)大数据科技有限公司 | Data transmission method and system of vehicle-mounted equipment |
| CN115311852A (en) * | 2022-07-12 | 2022-11-08 | 重庆长安汽车股份有限公司 | Method, system, vehicle and storage medium for predicting traffic congestion |
| CN117670172B (en) * | 2023-10-27 | 2024-06-14 | 广东省电子口岸管理有限公司 | Foreign trade data processing method and system |
| CN118368451A (en) * | 2024-06-17 | 2024-07-19 | 湖南大学 | Vehicle-mounted video and operation data fusion display system and method |
| CN119052517B (en) * | 2024-07-31 | 2025-06-20 | 广东保伦电子股份有限公司 | Data distribution method, device, storage medium and computer program product |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103984737A (en) * | 2014-05-22 | 2014-08-13 | 武汉大学 | Optimization method for data layout of multi-data centres based on calculating relevancy |
| CN104111998A (en) * | 2014-07-09 | 2014-10-22 | 江西理工大学 | Method and device for sorting coding and integrated exchange and management of heterogeneous data of enterprise |
| US10178638B1 (en) * | 2016-07-29 | 2019-01-08 | Senseware, Inc. | System, method and apparatus for sensor control applications |
| CN109766329A (en) * | 2018-12-29 | 2019-05-17 | 湖南网数科技有限公司 | A kind of clinical data unit generation method and device for supporting that exchange is shared |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10390114B2 (en) * | 2016-07-22 | 2019-08-20 | Intel Corporation | Memory sharing for physical accelerator resources in a data center |
-
2020
- 2020-11-23 CN CN202011319817.7A patent/CN112288904B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103984737A (en) * | 2014-05-22 | 2014-08-13 | 武汉大学 | Optimization method for data layout of multi-data centres based on calculating relevancy |
| CN104111998A (en) * | 2014-07-09 | 2014-10-22 | 江西理工大学 | Method and device for sorting coding and integrated exchange and management of heterogeneous data of enterprise |
| US10178638B1 (en) * | 2016-07-29 | 2019-01-08 | Senseware, Inc. | System, method and apparatus for sensor control applications |
| CN109766329A (en) * | 2018-12-29 | 2019-05-17 | 湖南网数科技有限公司 | A kind of clinical data unit generation method and device for supporting that exchange is shared |
Non-Patent Citations (3)
| Title |
|---|
| 云计算为轨道交通插上隐形的翅膀;曾虹云;《中国安防》;20130901(第09期);全文 * |
| 云计算对轨道交通的影响;杨迎卯;《中国高新技术企业》;20150120(第03期);全文 * |
| 机车监控视频自动转储与分析系统的设计实现;吕峰;《机车监控视频自动转储与分析系统的设计实现》;20190915(第09期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112288904A (en) | 2021-01-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112288904B (en) | Vehicle terminal, distributed vehicle terminal integrated management method and system | |
| US12259923B2 (en) | Short-term and long-term memory on an edge device | |
| CN106790367A (en) | The vehicle safety hidden danger early warning of big data treatment and accident reproduction system and method | |
| CN112969049B (en) | Intelligent detection system for ship violation behaviors | |
| US11269947B2 (en) | Method and system for providing a federated wide area motion imagery collection service | |
| CN102982311B (en) | Based on automobile video frequency Feature Extraction System and the method for video structural description | |
| US20230412769A1 (en) | Scalable Visual Computing System | |
| CN102637040B (en) | Unmanned aerial vehicle cluster visual navigation task coordination method and system | |
| CN110866991A (en) | Marine inspection supervisory systems based on unmanned aerial vehicle takes photo by plane | |
| CN108924461B (en) | Video image processing method and device | |
| CN117009324B (en) | Vehicle-mounted system supporting multimodal real-time database extended playback and implementation method | |
| CN116627901A (en) | A method and system for multi-modal data storage management of autonomous driving | |
| CN110956483A (en) | Advertisement information pushing method, system, server and vehicle | |
| CN105528417A (en) | Body-based community surveillance video semantic model application system and method | |
| CN104581639B (en) | A kind of seamless space-time cut-in method applied to mobile terminal sensor senses information | |
| CN108898072A (en) | Video image intelligent studying and judging system for public security criminal investigation application | |
| CN103595968B (en) | Video sensor access method based on geographical position | |
| US20030215218A1 (en) | System and method of processing audio/video data in a remote monitoring system | |
| Sun et al. | CDVA/VCM: Language for intelligent and autonomous vehicles | |
| JP2022131099A (en) | Electronic apparatus, server to animate still picture, program and the like | |
| CN205039932U (en) | Intelligent analysis camera device based on wireless network and location | |
| CN109886234A (en) | Object detection method, device, system, electronic equipment, storage medium | |
| CN116320452A (en) | Robot multi-sensor information fusion video display method, device, system and storage medium | |
| CN208867976U (en) | Intelligent vehicle-mounted terminal and automobile | |
| Han et al. | Research and practice of remote monitoring system for road test of intelligent connected vehicle |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |