Big data information based capture analysis system
Technical Field
The invention relates to the technical field of data information analysis, in particular to a big data information capture analysis system.
Background
Big data, an IT industry term, refers to a data set that cannot be captured, managed and processed by a conventional software tool within a certain time range, is a massive, high-growth rate and diversified information asset that needs a new processing mode to have stronger decision making power, insight discovery power and process optimization capability, and has a strategic significance not in mastering huge data information but in specialized processing of meaningful data.
When big data information is captured and analyzed, a better analysis capture system is needed to analyze various data information, but various data values can be conveyed in the working process in the existing system, abnormal values in the data values cannot be extracted, a large number of abnormal values are easily conveyed, and the operation and processing work of external operators is not facilitated.
Disclosure of Invention
Aiming at the defects of the prior art, the invention provides a big data information-based capture analysis system, which solves the problems that various data values can be conveyed in the working process of the interior of the existing system, abnormal values in the data values cannot be extracted, a large number of abnormal values are easily conveyed, and the operation and processing work of external operators is not facilitated.
In order to achieve the purpose, the invention is realized by the following technical scheme: the big data information capturing and analyzing system comprises a data acquisition system, a data sorting system, a data analysis system and a display terminal, wherein the output end of the data acquisition system is electrically connected with the input end of the data sorting system, the output end of the data sorting system is electrically connected with the input end of the data analysis system, and the output end of the data analysis system is electrically connected with the input end of the display terminal;
the data analysis system comprises each data independent receiving module inside, the output end of each data independent receiving module is electrically connected with the input end of the data processing module, the data processing module is connected with the big database in a bidirectional way, the output end of the data processing module is electrically connected with the input end of the control terminal, the output end of the control terminal is respectively and electrically connected with the input ends of the data value confirmation module and the abnormal data extraction module, the output end of the abnormal data extraction module is electrically connected with the input end of the abnormal information transmission module, the output end of the abnormal information transmission module is electrically connected with the input end of the counting module, the output end of the counting module is electrically connected with the input end of the alarm module, the output end of the data value confirming module is electrically connected with the input end of the data value integrating module, and the output end of the data value integrating module is electrically connected with the input end of the data value conveying module.
Preferably, the data processing module comprises a data comparing unit inside, the output end of the data comparing unit is electrically connected with the input end of the data analyzing unit, the output end of the data analyzing unit is electrically connected with the input end of the data processing unit, the output end of the data processing unit is electrically connected with the input end of the data value difference calculating unit, the data value difference calculating unit is bidirectionally connected with the interval value setting unit, and the output end of the data value difference calculating unit is electrically connected with the input end of the data storage unit.
Preferably, the control terminal internally comprises an abnormal value marking unit, an ECU control unit and a threshold unit, and the output end of the abnormal value marking unit is electrically connected with the input end of the abnormal data extraction module.
Preferably, the data acquisition system comprises a data information acquisition module, a data acquisition module, an image acquisition module, a voice acquisition module and a personal information acquisition module, the image acquisition module and the voice acquisition module output are electrically connected with the input end of the A/D conversion module, the data information acquisition module, the data acquisition module and the personal information acquisition module output are electrically connected with the input end of each data collection module, and the output end of each data collection module is electrically connected with the input end of each data transmission module.
Preferably, each data receiving module is included in the data arrangement system, the output end of each data receiving module is electrically connected with the input end of a special data arrangement module, the output end of the special data arrangement module is electrically connected with the input ends of the data information extraction module, the data extraction module, the image extraction module, the voice extraction module and the personal information extraction module respectively, the output ends of the image extraction module and the voice extraction module are electrically connected with the input end of the D/A conversion module, and the output end of the D/A conversion module is electrically connected with the input end of each data independent conveying module.
Preferably, the input end of each data receiving module is electrically connected with the output end of each data transmitting module, the output end of each data independent transmitting module is electrically connected with the input end of each data independent receiving module, and the special data arrangement module internally comprises a data information arrangement unit, a data arrangement unit, an image arrangement unit, a voice arrangement unit and a personal information arrangement unit.
Preferably, the data information acquisition module, the data acquisition module, the image acquisition module, the voice acquisition module and the personal information acquisition module are all electrically connected with an external sensor, and each data summarization module is internally provided with a summarization unit.
Preferably, the data comparison unit is in bidirectional connection with the large database, the interval value in the interval value setting unit is set by external personnel, and the difference formula is set in the data value difference calculating unit.
Advantageous effects
The invention provides a big data information capture and analysis system. Compared with the prior art, the method has the following beneficial effects:
1. the big data information capture-based analysis system receives data information through each data independent receiving module in the data analysis system, the received information is conveyed into the data processing module, the data comparison unit in the data processing module compares the received information with the data in the big database, the data analysis unit can analyze and process each data, the data processing unit processes the data, the data value difference unit performs difference on the compared numerical value and sets the interval value into the interval value setting unit, after the setting is completed, the data is conveyed into the control terminal when the difference value is larger, the abnormal value marking unit in the control terminal marks the abnormal value in the control terminal, the abnormal data extraction module can directly extract the abnormal value marked in the control terminal and convey the abnormal value into the display terminal through the abnormal information conveying module, the abnormal value detection device is convenient for external personnel to check, the counting module counts the number of times of outputting the abnormal value, and after the number of times of outputting the abnormal value exceeds a specified value, the alarm module starts to work and sends out an alarm, so that the external personnel can be effectively warned, a good warning effect is achieved, the abnormal value in the data value can be effectively marked, and the external personnel can conveniently process the abnormal value.
2. The big data information capturing and analyzing system extracts various information through a data information acquisition module, a data acquisition module, an image acquisition module, a voice acquisition module and a personal information acquisition module, an A/D conversion module converts image and voice information and transmits the converted information to various data summarization modules to summarize the various information, various data transmission modules output the summarized various data information, various data receiving modules in the data summarization system receive the information in the various data transmission modules, a special data arrangement module arranges various different information in sequence, and after the information arrangement is finished, the data information extraction module, the data extraction module, the image extraction module, the voice extraction module and the personal information extraction module extract various data information, the D/A conversion module converts the data information, can effectively arrange and process various data in sequence, avoids data confusion, and achieves a good data detection effect.
Drawings
FIG. 1 is a schematic diagram of the framework of the present invention;
FIG. 2 is a schematic diagram of the framework of the data acquisition system of the present invention;
FIG. 3 is a schematic diagram of a framework of the data collation system of the present invention;
FIG. 4 is a schematic diagram of a framework of the data analysis system of the present invention;
FIG. 5 is a schematic diagram of a framework of a data processing module according to the present invention;
fig. 6 is a schematic diagram of a framework of the control terminal according to the present invention.
In the figure: 1. a data acquisition system; 11. a data information acquisition module; 12. a data acquisition module; 13. an image acquisition module; 14. a voice acquisition module; 15. a personal information acquisition module; 16. an A/D conversion module; 17. each item of data summarization module; 18. each item of data transmission module; 2. a data collation system; 21. each item of data receiving module; 22. a special data arrangement module; 23. a data information extraction module; 24. a data extraction module; 25. an image extraction module; 26. a voice extraction module; 27. a personal information extraction module; 28. a D/A conversion module; 29. each item of data is independently transmitted to the module; 3. a data analysis system; 31. each item of data is received by the module separately; 32. a large database; 33. a data processing module; 331. a data comparison unit; 332. a data analysis unit; 333. a data processing unit; 334. a data value difference unit; 335. an interval value setting unit; 336. a data storage unit; 34. a control terminal; 341. an abnormal value labeling unit; 342. an ECU control unit; 343. a threshold unit; 35. an abnormal data extraction module; 36. an abnormal information delivery module; 37. a counting module; 38. an alarm module; 39. a data value validation module; 310. a data value integration module; 311. a data value delivery module; 4. and displaying the terminal.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The invention provides two technical schemes:
example 1
Referring to fig. 1 and 4, the big data information capture analysis system includes a data acquisition system 1, a data sorting system 2, a data analysis system 3 and a display terminal 4, wherein an output end of the data acquisition system 1 is electrically connected to an input end of the data sorting system 2, an output end of the data sorting system 2 is electrically connected to an input end of the data analysis system 3, and an output end of the data analysis system 3 is electrically connected to an input end of the display terminal 4;
the data analysis system 3 includes therein individual data receiving modules 31, the output end of each individual data receiving module 31 is electrically connected to the input end of the data processing module 33, the data processing module 33 is bidirectionally connected to the large database 32, the output end of the data processing module 33 is electrically connected to the input end of the control terminal 34, the output end of the control terminal 34 is electrically connected to the input ends of the data value confirming module 39 and the abnormal data extracting module 35, the output end of the abnormal data extracting module 35 is electrically connected to the input end of the abnormal information delivering module 36, the output end of the abnormal information delivering module 36 is electrically connected to the input end of the counting module 37, the output end of the counting module 37 is electrically connected to the input end of the alarm module 38, the output end of the data value confirming module 39 is electrically connected to the input end of the data value integrating module 310, and the output end of.
Referring to fig. 5, the data processing module 33 includes a data comparing unit 331 therein, an output end of the data comparing unit 331 is electrically connected to an input end of the data analyzing unit 332, an output end of the data analyzing unit 332 is electrically connected to an input end of the data processing unit 333, an output end of the data processing unit 333 is electrically connected to an input end of the data value difference calculating unit 334, the data value difference calculating unit 334 is bidirectionally connected to the interval value setting unit 335, and an output end of the data value difference calculating unit 334 is electrically connected to an input end of the data storing unit 336;
the data comparison unit 331 is connected with the big database 32 in a bidirectional manner, the interval value in the interval value setting unit 335 is set by an outside person, and the difference formula is set in the data value difference unit 334.
Referring to fig. 6, the control terminal 34 includes an abnormal value marking unit 341, an ECU control unit 342, and a threshold unit 343, and an output end of the abnormal value marking unit 341 is electrically connected to an input end of the abnormal data extracting module 35.
Example 2
Referring to fig. 1 and 4, the big data information capture analysis system includes a data acquisition system 1, a data sorting system 2, a data analysis system 3 and a display terminal 4, wherein an output end of the data acquisition system 1 is electrically connected to an input end of the data sorting system 2, an output end of the data sorting system 2 is electrically connected to an input end of the data analysis system 3, and an output end of the data analysis system 3 is electrically connected to an input end of the display terminal 4;
the data analysis system 3 comprises an individual data receiving module 31 inside, the output end of the individual data receiving module 31 is electrically connected with the input end of a data processing module 33, the data processing module 33 is bidirectionally connected with a big database 32, the output end of the data processing module 33 is electrically connected with the input end of a control terminal 34, the output end of the control terminal 34 is electrically connected with the input ends of a data value confirming module 39 and an abnormal data extracting module 35 respectively, the output end of the abnormal data extracting module 35 is electrically connected with the input end of an abnormal information conveying module 36, the output end of the abnormal information conveying module 36 is electrically connected with the input end of a counting module 37, the output end of the counting module 37 is electrically connected with the input end of an alarm module 38, the output end of the data value confirming module 39 is electrically connected with the input end of a data value integrating module 310, and the output;
referring to fig. 2, the data acquisition system 1 includes a data information acquisition module 11, a data acquisition module 12, an image acquisition module 13, a voice acquisition module 14, and a personal information acquisition module 15, the output ends of the image acquisition module 13 and the voice acquisition module 14 are electrically connected to the input end of an a/D conversion module 16, the output ends of the a/D conversion module 16, the data information acquisition module 11, the data acquisition module 12, and the personal information acquisition module 15 are electrically connected to the input ends of data summarization modules 17, and the output ends of the data summarization modules 17 are electrically connected to the input ends of data transmission modules 18;
the data information acquisition module 11, the data acquisition module 12, the image acquisition module 13, the voice acquisition module 14 and the personal information acquisition module 15 are all electrically connected with an external sensor, and each data summarization module 17 comprises a summarization unit inside.
Referring to fig. 3, the data arrangement system 2 includes various data receiving modules 21 therein, the output ends of the various data receiving modules 21 are electrically connected to the input end of a special data arrangement module 22, the output end of the special data arrangement module 22 is electrically connected to the input ends of a data information extraction module 23, a data extraction module 24, an image extraction module 25, a voice extraction module 26 and a personal information extraction module 27, the output ends of the image extraction module 25 and the voice extraction module 26 are electrically connected to the input end of a D/a conversion module 28, and the output end of the D/a conversion module 28 is electrically connected to the input end of a data individual transmission module 29;
the input end of each data receiving module 21 is electrically connected with the output end of each data transmitting module 18, the output end of each data individual transmitting module 29 is electrically connected with the input end of each data individual receiving module 31, and the special data arrangement module 22 internally comprises a data information arrangement unit, a data arrangement unit, an image arrangement unit, a voice arrangement unit and a personal information arrangement unit.
When in use, various information is extracted through the data information acquisition module 11, the data acquisition module 12, the image acquisition module 13, the voice acquisition module 14 and the personal information acquisition module 15, the A/D conversion module 16 converts the image and the voice information and transmits the converted information to each data summarizing module 17 to summarize each information, each data transmission module 18 outputs each summarized data information, each data receiving module 21 in the data collating system 2 receives the information in each data transmission module 18, the special data arranging module 22 arranges and processes each different information in sequence, after the information arrangement is completed, each data information is extracted through the data information extraction module 23, the data extraction module 24, the image extraction module 25, the voice extraction module 26 and the personal information extraction module 27, the D/A conversion module 28 converts the data information and outputs various data to the outside through various data individual transmission modules 29;
the data receiving module 31 receives data information individually in the data analysis system 3, the received information is transmitted to the data processing module 33, the data comparing unit 331 in the data processing module 33 compares the received information with the data in the big database 32, the data analyzing unit 332 can analyze and process the data, the data processing unit 333 processes the data, the data value difference unit 334 compares the compared values and sets the interval value in the interval value setting unit 335, after setting, when the difference value is large, the data is transmitted to the control terminal 34, the abnormal value marking unit 341 in the control terminal 34 marks the abnormal value in the control terminal 34, the abnormal data extracting module 35 can directly extract the abnormal value marked in the control terminal and transmit the abnormal value to the display terminal 4 through the abnormal information transmitting module 36, the abnormal value detection method is convenient for external personnel to check, the counting module 37 counts the number of times of outputting the abnormal value, and after the number of times of outputting the abnormal value exceeds a specified value, the alarm module 38 starts to work and send out an alarm, so that the external personnel can be effectively warned, a good warning effect is achieved, the abnormal value in the data value can be effectively marked, and the external personnel can conveniently process the abnormal value.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus.
Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that changes, modifications, substitutions and alterations can be made in these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.