CN110032131A - Electric vehicle state monitoring processing system and monitoring system based on Storm - Google Patents

Abstract

The invention discloses a state monitoring and processing system for electric vehicles based on Storm, comprising: a message bus for receiving and sending electric vehicle state data to a Storm cluster; The vehicle status data is processed to obtain monitoring information; the database is used to store relevant data; wherein, the relevant data includes data generated during processing and electric vehicle status data. The system can realize real-time and stable supervision of electric vehicles. The invention also discloses a state monitoring system for electric vehicles based on Storm, which has the above beneficial effects.

Description

Electric vehicle state monitoring processing system and monitoring system based on Storm

technical field

The invention relates to the field of electronic technology, in particular to a Storm-based electric vehicle state monitoring and processing system and a Storm-based electric vehicle state monitoring system.

Background technique

With the continuous improvement of people's living standards and the rapid increase in the number of vehicles, traffic safety has become a social problem that needs to be solved as soon as possible. As an important branch of the Internet of Things, the Internet of Vehicles is a real-time and efficient transportation system established by applying a variety of advanced sensors, intelligent control, and wireless communication technologies in the automotive industry and organically applied to the entire transportation management system. Integrated management and monitoring system.

In recent years, new energy vehicles, mainly hybrid or pure electric vehicles, have gradually entered the market, and have ushered in a very good period of development in China. Compared with foreign countries, because the development of electric vehicles in my country has just started, our accumulation of professional technology and management technology for electric vehicles is a little late, and the maturity is low, and it is still in the applicable stage. All or part of the electric vehicle is monitored.

With the popularization of electric vehicles and the large-scale application of the Internet of Vehicles, a large amount of real-time vehicle information will be generated every moment. At present, most of the vehicle monitoring systems are based on the traditional stand-alone framework. The scalability is not high. In the current big data environment of the Internet of Vehicles, with the expansion of the platform business scale, its monitoring activities are difficult to process large-scale data, the system load is not high, it is easy to crash, and the real-time performance and reliability are not high, which cannot be satisfied. In the current era of big data, people have regulatory requirements for vehicles.

Therefore, how to realize the real-time and stable supervision of electric vehicles is a technical problem to be solved by those skilled in the art.

SUMMARY OF THE INVENTION

The object of the present invention is to provide a state monitoring and processing system for electric vehicles based on Storm, which can realize real-time and stable supervision of electric vehicles; another object of the invention is to provide a state monitoring system for electric vehicles based on Storm , has the above beneficial effects.

In order to solve the above technical problems, the present invention provides a Storm-based electric vehicle state monitoring and processing system, including: a message bus for receiving and sending electric vehicle state data to the Storm cluster;

The Storm cluster is used to process the electric vehicle status data through the Storm distributed big data real-time processing framework to obtain monitoring information;

The database is used for storing relevant data; wherein, the relevant data includes the data generated by the processing process and the state data of the electric vehicle.

Preferably, the message bus is specifically: ActiveMq message queue.

Preferably, the database includes: a first database and a second database;

the first database is used for storing the electric vehicle state data;

The second database is used for storing data generated during the processing of the Storm cluster.

Preferably, the first database is specifically: a Mysql database.

Preferably, the second database is specifically: a Redis database.

The invention discloses a Storm-based electric vehicle state monitoring system, comprising:

The vehicle terminal is used to send the collected electric vehicle status data;

The vehicle background is used for receiving and sending the electric vehicle state data to the electric vehicle state monitoring and processing system;

The electric vehicle status monitoring and processing system is used to receive the electric vehicle status data, process the electric vehicle status data through the Storm distributed big data real-time processing framework, obtain monitoring information, and store relevant data; wherein, the relevant data includes processing Process-generated data and said electric vehicle status data;

The output device is used for acquiring the monitoring information, performing output processing on the monitoring information, and outputting the processed monitoring information.

Preferably, the vehicle background is further configured to classify the received electric vehicle state data according to system functions, and send the data that needs to be processed in real time to the electric vehicle state monitoring and processing system.

Preferably, the output device includes: a web background and a web front end;

The Web background is used to obtain monitoring data from the database and the message bus, and sends it to the Web front end after processing;

The Web front end is used to receive and display the processed monitoring data.

Preferably, the in-vehicle background adopts the Netty framework.

Preferably, the on-board terminal is further configured to connect with the on-board background, to receive and display the processed monitoring data.

The Storm-based electric vehicle state monitoring system provided by the present invention includes a message bus, a Storm cluster and a database. The collected electric vehicle state data is received through the message bus, and the electric vehicle state data is sent to the Storm cluster; the Storm cluster distributes the data through the Storm cluster. The data real-time processing framework processes the status data of electric vehicles. Compared with the stand-alone processing, the Storm distributed big data real-time processing framework can process more data per second and is faster, thus improving the real-time monitoring of electric vehicles. The data processing capability has been greatly improved and more stable. After processing the electric vehicle status data through the Storm distributed big data real-time processing framework, monitoring information can be obtained, and the relevant data can be stored in the database. Therefore, the purpose of real-time and stable supervision of electric vehicles can be achieved.

The present invention also discloses a Storm-based electric vehicle state monitoring system, which has the above beneficial effects, and will not be repeated here.

Description of drawings

In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only It is an embodiment of the present invention. For those of ordinary skill in the art, other drawings can also be obtained according to the provided drawings without creative work.

1 is a structural block diagram of a Storm-based electric vehicle state monitoring and processing system provided by an embodiment of the present invention;

2 is a structural block diagram of a Storm-based electric vehicle state monitoring system provided by an embodiment of the present invention;

FIG. 3 is a schematic structural diagram of a Storm-based electric vehicle state monitoring system provided by an embodiment of the present invention.

Detailed ways

The core of the present invention is to provide a state monitoring and processing system for electric vehicles based on Storm, which can realize real-time and stable supervision of electric vehicles; another core of the present invention is to provide a state monitoring system for electric vehicles based on Storm The system has the above beneficial effects.

In order to make the purposes, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments These are some embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

Due to the short development time of electric vehicles, the monitoring technology of electric vehicles at home and abroad mostly adopts the stand-alone framework of traditional monitoring vehicles. The real-time vehicle status data sent by the terminal on the electric vehicle is either stored in the database or transmitted to the Internet of Vehicles monitoring. After analysis in the background, the results are fed back to the electric vehicle terminal. However, in the current big data environment of the Internet of Vehicles, with the expansion of the business scale of the platform, its monitoring activities are difficult to process large-scale data, the system load is not high, it is easy to crash, and the real-time performance and reliability are not high, which can no longer meet the current big data requirements. the needs of the times.

The Storm-based electric vehicle state monitoring and processing system provided by the present invention processes through the Storm cluster, disassembles and distributes data computing tasks to each scattered node in the cluster, can handle a large amount of concurrent access, and has good real-time performance. For details, please refer to FIG. 1 , which is a structural block diagram of a Storm-based electric vehicle state monitoring and processing system provided by an embodiment of the present invention; the system may include: a message bus 100 , a Storm cluster 200 and a database 300 .

The message bus 100 is a communication tool that can transfer messages, files, etc. between machines. The message bus plays a role of message routing and has a complete routing mechanism to determine the direction of message transmission. The sending segment only needs to send a message to the message bus regardless of how the message is forwarded. In order to avoid message loss, the message bus generally provides a certain persistent storage and disaster recovery mechanism.

In the present invention, the message bus 100 is connected with the external equipment, receives the collected real-time state data of the electric vehicle, and sends the real-time state data of the electric vehicle to the Storm cluster connected thereto. Wherein, the real-time state data of the electric vehicle may generally include information such as information of the electric vehicle, motor CAN information, and body state information.

The message bus can be divided into various types, such as MessageBroker, ActiveMq, etc. The specific model of the message bus 100 is not limited here. Wherein, preferably, the message bus 100 may specifically be: ActiveMq message queue. ActiveMq is an open source compatible Java Message Service (JMS), message-oriented middleware, can provide a loosely coupled application architecture, can realize asynchronous style architecture of heterogeneous platforms, and has strong scalability.

In addition, the message bus 100 is also used to store data, including vehicle information data and monitoring information processed in real time by the Storm cluster.

The Storm cluster 200 is connected to the message bus 100, receives the electric vehicle real-time status data sent by the message bus 100, and processes the electric vehicle status data through its Storm distributed big data real-time processing framework to obtain monitoring information.

Storm adopts the Master/Slave architecture. Distributed computing is implemented by two types of service processes, Nimbus and Supervisor. The Nimbus process runs on the master node of the cluster and is responsible for task assignment and distribution. The Supervisor runs on the slave node of the cluster and accepts tasks assigned by nimbus. , start and stop the worker process that belongs to its own management.

The Storm architecture uses the Spout/Bolt programming model to stream messages. The message flow is the basic abstraction of data in Storm. A message flow is the encapsulation of a piece of input data. The continuous input message flow is processed in a distributed manner. The Spout component is the message producer and the data input in the Storm architecture. The source, it can read data from a variety of heterogeneous data sources and emit message streams. The Bolt component is responsible for receiving the information stream emitted by the Spout component and completes the specific processing logic. Storm's stream processing computing mode ensures that tasks can be initialized only once and can be continuously calculated. At the same time, ZeroMQ (Netty) is used as the underlying message queue, which effectively improves the data processing efficiency of the overall architecture.

Storm can process a steady stream of incoming messages and can achieve continuous computing; Storm uses Netty to transmit messages, eliminating the intermediate queuing process, allowing messages to flow directly between tasks themselves, making the flow of messages automated and efficient; Storm has Guaranteed message processing, each tuple (Turple) will be fully processed through the topology (Topology) structure, if a tuple is found to be unprocessed, it will be automatically resent from Spout; Storm also implements task-level fault detection , in the event of a task failure, messages are automatically redistributed to quickly restart processing. Storm includes more intelligent processing management than Hadoop, managed through zookeeper, to ensure that resources are fully utilized.

Storm is simple to develop, greatly reduces the complexity of developing parallel real-time processing tasks, supports flexible horizontal expansion, has strong fault tolerance, has reliable message assurance, can process messages quickly, and adopts the Storm real-time distributed processing framework to handle the needs The data processed in a timely manner, compared with the single-machine processing of these data, increases the amount of data that can be processed per second, and at the same time processes the data faster and improves the real-time performance. Therefore, when applying the Storm distributed real-time processing system to the field of electric vehicle monitoring system, the data processing capability is greatly improved compared with the traditional stand-alone framework, the larger the concurrent access that can be processed, and the better the real-time performance.

The Storm-based electric vehicle state monitoring and processing system provided by the present invention further includes a database 300. The database 300 is respectively connected to the Storm cluster 200 and external devices, and is mainly used to store relevant data; the relevant data mainly includes cached data generated during processing and electric car status data.

Since data of various data types is stored in the database, in order to adapt to the different functions of different data types, preferably, the database 300 may include: a first database and a second database; the first database is used to store the state data of the electric vehicle; the second database The database is used to store the data generated during the processing of the Storm cluster, including the intermediate variables and processing results generated during the processing.

The specific types of the first database and the second database are not limited here, and an appropriate database can be selected according to needs. Preferably, the first database can specifically be: Mysql database. Mysql database is a traditional relational database, supports transaction mechanism, and has high security and stability. In the present invention, the MySQL database needs to be used to store electric vehicle-related data persistently, and storage through the Mysql database can greatly increase the stability of the stored data.

Preferably, the second database may specifically be: a Redis database. The Redis database is a memory-based key-value database, and the reading speed is very fast. In the present invention, the real-time data processing process of the Storm cluster in the Storm cluster needs to use the redis database to cache the intermediate variables and calculation results of the calculation process. Therefore, the high reading speed Redis database is used to Storing the data generated by the Storm cluster processing can improve the data processing speed to a certain extent.

In addition, in order to reduce the amount of data to be processed, improve the processing speed, and realize real-time processing, the electric vehicle status data received by the message bus 100 may be the filtered data that needs to be processed in time. Only processing real-time status data that needs to be processed in time can reduce data redundancy and greatly improve data processing speed.

In order to reduce the space occupied by storage, the electric vehicle state data stored in the first database may be filtered data that does not need to be processed in time. The electric vehicle status data that needs to be processed in time is directly processed through the Storm cluster, reducing information redundancy.

Based on the above technical solutions, the Storm-based electric vehicle state monitoring and processing system provided by the present invention receives the collected electric vehicle state data through the message bus, and sends the electric vehicle state data to the Storm cluster; the Storm cluster processes the distributed big data in real time through the Storm The framework processes the status data of electric vehicles. Compared with stand-alone processing, the Storm distributed big data real-time processing framework can process more data per second and is faster, thus improving the real-time performance of electric vehicle supervision and data processing capabilities. It has been greatly improved and more stable. After processing the electric vehicle status data through the Storm distributed big data real-time processing framework, the monitoring information can be obtained, and the relevant data can be stored in the database. Therefore, the Storm-based electric vehicle state monitoring and processing system provided by the present invention greatly increases the throughput of the electric vehicle monitoring system for processing real-time electric vehicle data, satisfies the management needs in today's big data environment, realizes the horizontal expansion of the system, and It has strong real-time performance and good load performance, which greatly increases the number of vehicles monitoring services at the same time, and has high stability and reliability, which can realize the purpose of real-time and stable supervision of electric vehicles.

The following describes the Storm-based electric vehicle state monitoring system provided by the present invention, please refer to FIG. 2 , which is a structural block diagram of the Storm-based electric vehicle state monitoring system provided by an embodiment of the present invention; the system may include: an on-board terminal 400 , the vehicle background 500 , the electric vehicle state monitoring and processing system 600 and the output device 700 .

The in-vehicle terminal 400 is mainly used for sending the collected electric vehicle state data. The type of real-time status information of the electric vehicle provided by the vehicle terminal is not limited, and may mainly include GPS positioning information, motor CAN information, vehicle body status information, etc. In addition, the vehicle terminal 400, as a human-computer interaction terminal, can also be used to interact with the vehicle background 500. The in-vehicle terminal generally includes in-vehicle multimedia equipment, such as a display screen, an audio system, etc. The in-vehicle terminal 400 can also be used to display real-time vehicle status information.

The vehicle background 500 is mainly used for receiving the electric vehicle status data sent by the vehicle terminal 400, and sending the electric vehicle status data to the electric vehicle status monitoring and processing system. Real-time transmission of the status information of each vehicle terminal to the message bus and database.

The vehicle background is also used to classify the received electric vehicle status data according to system functions, and send the data that needs to be processed in real time to the electric vehicle status monitoring and processing system. The data that does not need real-time processing is stored in the mysql database for the background program when needed use.

The frame type of the in-vehicle background is not limited here. Preferably, the in-vehicle background program can use the Netty framework, which is a java open source framework provided by JBOSS. Netty provides an asynchronous, event-driven network application framework and tools, with better throughput than the core Java API, low latency, low resource consumption, and simple, fast, and secure processing of large-capacity data streams.

The electric vehicle state monitoring and processing system 600 is mainly used to receive electric vehicle state data, process the electric vehicle state data through the distributed big data real-time processing framework Storm, obtain monitoring information, and store relevant data; wherein, the relevant data includes the data in the processing process. The resulting cached data. For a specific introduction to the electric vehicle state monitoring and processing system 600 , reference may be made to the Storm-based electric vehicle state monitoring and processing system corresponding to FIG. 1 , which will not be repeated here.

The output device 700 is mainly used for acquiring monitoring information, performing output processing on the monitoring information, and outputting the processed monitoring information. Specifically, the type of the output device 700 is not limited here, and a corresponding output device, such as a mobile terminal, a display screen and other devices, can be arbitrarily selected as required.

Preferably, the output device may include: a web backend and a web frontend.

The output of the processed monitoring information through the Web terminal can be realized through any networkable device. Users can view the real-time status information of the electric vehicle through the Web terminal in real time, which is convenient and requires low equipment, and no special single output is required. equipment with good scalability.

The web background is used to obtain monitoring data from the database and the message bus, and send it to the web front end after processing; the background can use SpringMVC and Mybatis architecture, which is responsible for obtaining data from the database and the message bus and displaying it to the front end in real time after processing.

The web front end is used to receive the processed monitoring data and display it. The front-end page can use JSP, HTML, Javascript technology, and is responsible for the management and display of the real-time status information of electric vehicle monitoring through the front-end display program.

In addition, the in-vehicle terminal can also be connected with the in-vehicle background for receiving monitoring data processed in the background, and displaying the processed monitoring data through the in-vehicle terminal.

Specifically, a Storm-based electric vehicle status monitoring system may include an electric vehicle status monitoring and processing system (ActiveMq message bus, Mysql database, Storm cluster, and Redis database), on-board terminal, on-board back-end, Web back-end, and Web front-end. The schematic diagram is shown in the figure. As shown in 3, the vehicle terminal is connected to the vehicle background, the vehicle background is respectively connected to the Mysql database and the ActiveMq message bus in the electric vehicle status monitoring and processing system, the ActiveMq message bus is connected to the Storm cluster, the Storm cluster is connected to the Redis database, and the web background is respectively connected to Mysql database and ActiveMq message bus connection, Web front-end and Web back-end connection.

In the whole system architecture, the vehicle terminal is used as the source of vehicle information data. The vehicle background stores the data that does not need real-time processing into the Mysql database, and the data that needs to be processed in real time is sent to the ActiveMq message bus, and the Storm cluster processes the data in real time. Write back to ActiveMq message bus and store in Redis database. The result data on the ActiveMq message bus is pushed to the vehicle terminal and the web front end in real time through the vehicle backend and the web backend, and displayed to the end users and web backend managers to monitor the real-time status of the electric vehicle.

The Storm-based electric vehicle state monitoring system provided by the invention greatly increases the throughput of the electric vehicle monitoring system for processing real-time electric vehicle data, satisfies the management needs in today's big data environment, realizes the horizontal expansion of the system, and has strong real-time performance. , the load performance is good, so that the number of vehicles that can be monitored and served at the same time is greatly increased, the stability and reliability are high, and the purpose of real-time and stable supervision of electric vehicles can be realized.

The Storm-based electric vehicle state monitoring and processing system and the Storm-based electric vehicle state monitoring system provided by the present invention have been described above in detail. The principles and implementations of the present invention are described herein by using specific examples, and the descriptions of the above embodiments are only used to help understand the method and the core idea of the present invention. It should be pointed out that for those skilled in the art, without departing from the principle of the present invention, several improvements and modifications can also be made to the present invention, and these improvements and modifications also fall within the protection scope of the claims of the present invention.

Claims (10)

1. an electric vehicle state monitoring and processing system based on Storm, is characterized in that, comprises: The message bus is used to receive and send electric vehicle status data to the Storm cluster; The Storm cluster is used to process the electric vehicle status data through the Storm distributed big data real-time processing framework to obtain monitoring information; The database is used for storing relevant data; wherein, the relevant data includes the data generated by the processing process and the state data of the electric vehicle. 2 . The state monitoring and processing system for electric vehicles based on Storm according to claim 1 , wherein the message bus is specifically: ActiveMq message queue. 3 . 3. The electric vehicle state monitoring and processing system based on Storm according to claim 1, wherein the database comprises: a first database and a second database; the first database is used for storing the electric vehicle state data; The second database is used for storing data generated during the processing of the Storm cluster. 4 . The state monitoring and processing system for electric vehicles based on Storm according to claim 3 , wherein the first database is specifically: a Mysql database. 5 . 5 . The Storm-based electric vehicle state monitoring and processing system according to claim 3 , wherein the second database is specifically: a Redis database. 6 . 6. an electric vehicle state monitoring system based on Storm, is characterized in that, comprises: The vehicle terminal is used to send the collected electric vehicle status data; The vehicle background is used for receiving and sending the electric vehicle state data to the electric vehicle state monitoring and processing system; The electric vehicle status monitoring and processing system is used to receive the electric vehicle status data, process the electric vehicle status data through the Storm distributed big data real-time processing framework, obtain monitoring information, and store relevant data; wherein, the relevant data includes processing Process-generated data and said electric vehicle status data; The output device is used for acquiring the monitoring information, performing output processing on the monitoring information, and outputting the processed monitoring information. 7. the electric vehicle state monitoring system based on Storm as claimed in claim 6, is characterized in that, described on-board background is also used to classify the electric vehicle state data received according to system function, and the data that needs real-time processing is sent to. The electric vehicle state monitoring and processing system. 8. The electric vehicle state monitoring system based on Storm as claimed in claim 6, wherein the output device comprises: a Web background and a Web front end; The Web background is used to obtain monitoring data from the database and the message bus, and sends it to the Web front end after processing; The Web front end is used to receive and display the processed monitoring data. 9 . The electric vehicle state monitoring system based on Storm as claimed in claim 8 , wherein the on-board background adopts Netty framework. 10 . 10 . The state monitoring system for electric vehicles based on Storm according to claim 6 , wherein the on-board terminal is further configured to connect with the on-board background to receive and display the processed monitoring data. 11 .