Intelligent power data managing method and system based on AMI and J2EE
Technical field
The present invention relates to electricity consumption data management, electricity consumption data collection, displaying and field of intelligent monitoring, are bases specifically
In the intelligent power data managing method and system of AMI and J2EE.
Background technology
Wide variety of in the U.S. at present is senior measurement system AMI, and wherein it is important that measure data management system
(MDMS).MDMS is a database with analysis tool, by using cooperatively with AMI automaticdata cell phone systems, is located
The variable of reason and storage ammeter, can interact, such as power information system, Billing System, electricity and other information system between
Power website, Outage Management Systems, Power quality management and load prediction system, the management of mobile working group, GIS-Geographic Information System, change
Depressor load management system.
Even if a basic function of MDMS be AMI data are confirmed, are edited, estimated, to guarantee communication network end
End and during user side failure, the data flow for flowing to above- mentioned information system or software is also that complete this is accurate.
Each main electric power company of China from the nineties in 20th century so far, has been set up being directed to according to business development needs
The acquiring electric energy information system of different type user, mainly there is critical point Electric Energy Acquisition System, power load management system, client
Electric Energy Acquisition System, low pressure automatic meter reading system and electrical power distribution automatization system, and the installation of various electric energy acquisition terminals
It is of certain scale.Acquiring electric energy information system using the technology such as microelectronics and computer network, sensing automatically reading and
Meter data are processed, by the in addition integrated treatment of the power information of city dweller.It mainly realizes electricity consumption data collection, electricity consumption data
Management, meter control, sales service integrated application, meter operation maintenance management.
Existing acquisition system cannot meet the collection demand of different type user, the different type energy, lack unified rule
Draw, unified standard specification, often a stoichiometric point several acquisition terminals and respective system main website exchange data to be installed.This is not only
The significant wastage of the resources such as human and material resources is caused, the burden of measuring equipment is also add, the degree of accuracy and the equipment of metering is have impact on
Reliable rows.
Such as user power utilization information intelligent acquisition system lays particular emphasis on collection, analysis and the prediction of data, and reduces data
The function with data mining is checked, thus the integrality and correctness of unwarrantable data.
The acquisition system for making up data integrity is designed for this, the power information for such as having backup concentrator is adopted, mainly
It is by when electricity consumption data can not be sent to main website by the communication failure between master concentrator and main website or when main collection
Communication failure between middle device and collector and when being unable to Real-time Collection electricity consumption data, start and be switched in trim set
Device, backup concentrator continues the electricity consumption data from master concentrator for not yet issuing main website to be sent to main website, and continues to receive
The collection collector electricity consumption data for collecting and the method that is sent to main website are reducing the defect of data integrity.But the method
It is to be solved by increasing the method for hardware device, thus undesirably increases input cost, also increases input
Benefit payback period.
The content of the invention
It is an object of the invention to provide the intelligent power data managing method and system based on AMI and J2EE, is being not required to
Under conditions of increasing hardware facility, using technological means automatic or manual filling mining, accomplish the integrality of data.
The present invention is achieved through the following technical solutions:Based on the intelligent power data managing method of AMI and J2EE, including with
Lower step:
Step A, acquisition tasks distribution:According to different business demand, require according to the configuration condition of data to be collected, carry out
Distribution acquisition tasks;
Step B, acquisition tasks are performed:Jing steps A, according to the acquisition tasks for weaving, issue as requested collection automatically
Acquisition terminal or measurement equipment are instructed, the Various types of data of acquisition terminal or measurement equipment is obtained;
Step C, data checks:The data that the collection of step B is returned are carried out to include business rule inspection, data integrity inspection
Look into, quality of data inspection, with the inspection carried out for data result correctness;
Step D, data storage:The data that acquisition terminal or measurement equipment collection are returned are divided into into one according to service needed
Class real time data, two class historical datas, three class event datas, set up respectively corresponding message queue, store data into caching
Area reaches and carry out after set amount batch storage.
Further, methods described to better implement the present invention, step A includes:
Step A.1, data acquisition:Intelligent power data management system is to Q/GDW 376.1-2009 agreements, MODBUS etc.
The compatible exploitation of acquisition terminal normal protocol and feature development, according to different service neededs, by intelligent electric meter, concentrator,
Collector gathers energy consumption equipment data, and by sensor the data such as ambient temperature data, radiation, wind speed, pressure are gathered;
Step A.2, data filtering:By from mainly by sensor group into measurement equipment and it is main by intelligent electric meter, concentrate
The response message that device, the acquisition terminal of collector composition are obtained passes through the various built-in filters of intelligent power data management system
Carry out Data Matching and filter, be ultimately converted to data and information that intelligent power data management system is capable of identify that.
Further, methods described to better implement the present invention, step B is comprised the steps of:
Step B.1, collect the communication protocol of various main flow acquisition terminals or measurement equipment on the market;
Step B.2, for these protocal analysis rule of communications, look for general character, develop compatible communication bag;
Step B.3, for the individual character rule of communication of main flow collecting device, carry out minimum difference melt send out;
Step B.4, be packaged into a big general character, the compatible CommAPI of the little opposite sex;
Step B.5, build test environment, main flow collecting device is tested
B.6, according to test result step changes program;
Step B.7, complete acquisition tasks implementation procedure.
Further, methods described to better implement the present invention, step C is comprised the steps of:
Step C.1, data acquisition:For the acquisition tasks information that administration interface is received, by its concrete configuration bar
Part carries out being grouped timesharing execution to acquisition tasks, and the communication protocol correspondence of target acquisition terminal is matched in intelligence according to configuration condition
The acquisition instructions of API are carried out by the API in the parsing of electricity consumption data management agreement by intelligent power data management data analysis layer
Data conversion, issues the acquisition instructions of the encryption that collecting device is capable of identify that to acquisition terminal, intelligence according to acquisition tasks automatically
The data of the encryption that electricity consumption data management data analysis layer feeds back to acquisition terminal enter line algorithm decryption, and the number that collection is returned
According to being converted to the form that intelligent power data management system is capable of identify that and stores.
Step C.2, quality of data inspection:Effective data checks index is provided, the reasonability of the data to gathering, effectively
Property is checked;
Step C.3, inspection result:Referred to according to the data verification that traffic profile is arranged by intelligent power data management system
Mark is verified to realize the integrality and correctness of data to data;
Step C.4, Jing steps C.3, by execution step if institute's gathered data is qualified data or gathered data success
D;If institute's gathered data is that number of non-compliances evidence or gathered data are unsuccessful, the selection of data filling mining will be carried out, when selection is mended
Adopt, execution step C.1, when selecting not filling mining, execution step D.
Further, methods described to better implement the present invention, step is C.3 further comprising the steps of:
Step C3.1, acquisition quality inspection:The execution quality of acquisition tasks is checked, statistical data collection success
Rate, the percentage of head rice of collection;
Step C3.2, call together adopt in real time:The differentiation collection communication that existing problems are carried out is found after the completion of data checks.
Intelligent power data managing method and system based on AMI and J2EE, including sensor, serial server, communication
Service Circuit, acquisition terminal, the sensor is connected by serial server with Communications service circuit, the Communications service circuit
Connection acquisition terminal, the acquisition terminal includes intelligent electric meter, concentrator and collector;It is provided with the Communications service circuit
The response message of the gained terminal such as sensor, intelligent electric meter, concentrator, collector or measurement equipment is carried out into Data Matching and mistake
The filtration link layer of filter;The Communications service circuit is provided with the IoHandler business for completing step B, step C, step D
Process layer;The filtration link layer include link layer filter, encryption filter, request response filter, application filters device,
Event filter, heartbeat filter, clock synchronous filtering device, authentication filter, upstream message queue filter and descending
Message queue filter;Data objects processing is eventually converted into business by IoHandler Business treatments described in Jing filtration link layer
Data are stored.
Further, the system to better implement the present invention, the serial server and Communications service circuit it
Between monitor using tcp/ip communication and using JMX when being communicated;Communicated between acquisition terminal and Communications service circuit
Shi Caiyong tcp/ip communications and using JMX monitor.
Further, the system to better implement the present invention, is communicated in Communications service circuit using IOService
Service.
The present invention compared with prior art, with advantages below and beneficial effect:
(1)The present invention, using technological means automatic or manual filling mining, accomplishes under conditions of it need not increase hardware facility
The integrality of data.
(2)The present invention arranges planning requirement and series of standards specification, all of collection standard based on State Grid Corporation of China
With the equal unified standard of specification, various collection demands are conveniently adapted to.
(3)The present invention is provided with data checks index a set of configurable, complete and through effectively verifying, can guarantee that data
The accuracy and validity of data are guaranteed on the premise of integrality.
(4)The present invention assurance function it is complete improve on the premise of reduce input cost;And with more stable, efficiency
Higher advantage.
(5)Data acquisition of the present invention is realized realizing that the automatic or manual benefit mode of calling together ensures number using clog-free circulation road technology
According to completeness and efficiency.
(6)Data checks of the present invention realizes the configurable, adjustable of data checks using configurable Index for examination mode, and
Design the data checks index scheme of complete set.
Description of the drawings
Fig. 1 is the method for the invention flow chart.
Fig. 2 is system of the present invention and data acquisition figure.
Fig. 3 is the communication monitoring figure of JMX monitoring of the present invention.
Specific embodiment
The present invention is described in further detail with reference to embodiment, but embodiments of the present invention not limited to this.
J2EE, is a set of entirely different Technical Architecture in traditional application and development, comprising many components, mainly can simplify and
The exploitation and deployment of specification application system, and then improve portable, safety and again with value.
AMI, senior measurement system (advanced metering infrastructure, AMI) is one for surveying
Amount, collect, storage, analysis, use and transmit user power utilization data, the complete network of electricity price information and system operation situation and
System, can effectively support demand response.
MDMS, metric data management system.A database with analysis tool, by with AMI automaticdata hands
Machine system(ADCS)Use cooperatively, the variable that can process and store ammeter is obtained, and is an important composition portion in AMI systems
Point.
JMX, JMX are the aggregates of a kind of API, extendible object and method, can be used for crossing over a series of
Different OS platform, system architecture and the network transmission protocol, system, the net of flexible exploitation Seamless integration-
Network and Service Management application it provide user interface instruct, java class and exploitation integrated system, network and network management-application
Specification.
Embodiment 1:
Equipment in system is opened first, completes to open step, then complete the intelligent power data with J2EE based on AMI
Management method, as shown in figure 1, comprising the following steps:
Step A, acquisition tasks distribution:According to different business demand, require according to the configuration condition of data to be collected, carry out
Distribution acquisition tasks;
Step B, acquisition tasks are performed:Jing steps A, according to the acquisition tasks for weaving, issue as requested collection automatically
Acquisition terminal or measurement equipment are instructed, the Various types of data of acquisition terminal or measurement equipment is obtained;
Step C, data checks:The data that the collection of step B is returned are carried out to include business rule inspection, data integrity inspection
Look into, a series of inspections to carry out for data result correctness such as quality of data inspection;
Step D, data storage:The data that acquisition terminal or measurement equipment collection are returned are divided into into one according to service needed
Class real time data, two class historical datas, three class event datas, set up respectively corresponding message queue, store data into caching
Area reaches and carry out after set amount batch storage.
Data acquisition will be terminated after the completion of step D, end step will be completed.
Embodiment 2:
The present embodiment is further optimized on the basis of above-described embodiment, first opens equipment in system, is completed out
Start rapid, complete following step:
Step A, acquisition tasks distribution:According to different business demand, require according to the configuration condition of data to be collected, carry out
Distribution acquisition tasks, comprise the steps:
Step A.1, data acquisition:Intelligent power data management system is to Q/GDW 376.1-2009 agreements, MODBUS etc.
The compatible exploitation of acquisition terminal normal protocol and feature development, according to different service neededs, by intelligent electric meter, concentrator,
Collector gathers energy consumption equipment data, and by sensor the data such as ambient temperature data, radiation, wind speed, pressure are gathered;
Step A.2, data filtering:By from mainly by sensor group into measurement equipment and it is main by intelligent electric meter, concentrate
The response message that device, the acquisition terminal of collector composition are obtained passes through the various built-in filters of intelligent power data management system
Carry out Data Matching and filter, be ultimately converted to data and information that intelligent power data management system is capable of identify that.
Step B, acquisition tasks are performed:Jing steps A, according to the acquisition tasks for weaving, issue as requested collection automatically
Acquisition terminal or measurement equipment are instructed, the Various types of data of acquisition terminal or measurement equipment, data acquisition global design base is obtained
Require and standard in unified standard, various collection demands are accomplished with perfect compatibility, comprise the steps:
Step B.1, collect the communication protocol of various main flow acquisition terminals or measurement equipment on the market;
Step B.2, for these protocal analysis rule of communications, look for general character, develop compatible communication bag;
Step B.3, for the individual character rule of communication of main flow collecting device, carry out minimum difference melt send out;
Step B.4, be packaged into a big general character, the compatible CommAPI of the little opposite sex;
Step B.5, build test environment, main flow collecting device is tested
B.6, according to test result step changes program;
Step B.7, complete acquisition tasks implementation procedure.
Step C:Data checks:The data that the collection of step B is returned are carried out to include business rule inspection, data integrity inspection
Look into, a series of inspections to carry out for data result correctness such as quality of data inspection, data acquisition realized using without hindrance
Plug flow passage technology realizes that the automatic or manual benefit mode of calling together ensures the completeness and efficiency of data, and data checks is using configurable
Index for examination mode realizes the configurable, adjustable of data checks, and designs the data checks index scheme of complete set, institute
State step C to comprise the steps of:
Step C.1, data acquisition:For the acquisition tasks information that administration interface is received, by its concrete configuration bar
Part carries out being grouped timesharing execution to acquisition tasks, and the communication protocol correspondence of target acquisition terminal is matched in intelligence according to configuration condition
The acquisition instructions of API are carried out by the API in the parsing of electricity consumption data management agreement by intelligent power data management data analysis layer
Data conversion, issues the acquisition instructions of the encryption that collecting device is capable of identify that to acquisition terminal, intelligence according to acquisition tasks automatically
The data of the encryption that electricity consumption data management data analysis layer feeds back to acquisition terminal enter line algorithm decryption, and the number that collection is returned
According to being converted to the form that intelligent power data management system is capable of identify that and stores.
Step C.2, quality of data inspection:Effective data checks index is provided, the reasonability of the data to gathering, effectively
Property is checked;
Step C.3, inspection result:Referred to according to the data verification that traffic profile is arranged by intelligent power data management system
Mark is verified to realize the integrality and correctness of data to data;
Step C.4, Jing steps C.3, by execution step if institute's gathered data is qualified data or gathered data success
D;If institute's gathered data is that number of non-compliances evidence or gathered data are unsuccessful, the selection of data filling mining will be carried out, when selection is mended
Adopt, execution step C.1, when selecting not filling mining, execution step D.
Step D:Data storage:The data that acquisition terminal or measurement equipment collection are returned are divided into into one according to service needed
Class real time data, two class historical datas, three class event datas, set up respectively corresponding message queue, store data into caching
Area reaches and carry out after set amount batch storage.
Embodiment 3:
The present embodiment is further optimized on the basis of above-described embodiment, further, to better implement the present invention
Methods described, step is C.3 further comprising the steps of:
Step C3.1, acquisition quality inspection:The execution quality of acquisition tasks is checked, statistical data collection success
Rate, the percentage of head rice of collection;
Step C3.2, call together adopt in real time:The differentiation collection communication that existing problems are carried out is found after the completion of data checks.In real time
Call together and adopt, according to the real-time data acquisition requirement for receiving, by remote technology means, acquisition instructions are issued automatically, call together adopt in real time
The data of terminal or measurement equipment.Various information in Real-time Collection electric unit of the present invention, mainly including illumination, temperature, wet
The information such as degree, smog, pressure, flow, power consumption, equipment state, carry out real-time exhibition, Based Intelligent Control and anomalous event monitoring and
Report to the police.
Embodiment 4:
Based on the intelligent power data management system of AMI and J2EE, as shown in Fig. 2 including sensor, serial server,
Communications service circuit, acquisition terminal, the sensor is connected by serial server with Communications service circuit, the Communications service
Circuit connects acquisition terminal, and the acquisition terminal includes intelligent electric meter, concentrator and collector;Set in the Communications service circuit
Be equipped with carries out Data Matching by the response message of the gained terminal such as sensor, intelligent electric meter, concentrator, collector or measurement equipment
With the filtration link layer for filtering;The Communications service circuit is provided with the IoHandler for completing step B, step C, step D
Business treatment;The filtration link layer includes link layer filter, encryption filter, request response filter, application layer mistake
Filter, event filter, heartbeat filter, clock synchronous filtering device, authentication filter, upstream message queue filter and
Downstream message queue filter;IoHandler Business treatments described in Jing filtration link layer are eventually converted into data objects processing
Business datum is stored.
Data acquisition is led to based on the hardware facilities such as concentrator, collector, intelligent electric meter, sensor, serial server
Tcp/ip agreements and IOService communication services are crossed, and is filtered through filtering the link layer filter set by link layer, encryption
Device, request response filter, event filter etc. are acquired filtration to data, continue through the object of data analysis layer setting
Process(I classes, II classes, parameter, event, modbus data), quality of data inspection, adopt benefit, batch data stock finally converting
Stored for business datum.
Set such as illuminance transducer, temperature sensor, humidity sensor by the use of in the sensor as measurement equipment
Device, Smoke Sensor, pressure sensor, the collectable data of an inductive sensing device are acquired;And using intelligent electric meter, collection
The acquisition terminal that device and concentrator are constituted is transferred to Communications service to informations such as flow, power consumption, equipment states
In circuit, link layer filter, encryption filter in the filtration link layer set by its inside, request response filter, should
With layer filter, event filter, heartbeat filter, clock synchronous filtering device, authentication filter, upstream message queue
Filter and downstream message queue filter are filtered accordingly, filter out the different data filtered set by link layer simultaneously clear
Remove, data after filtering, continue through the object handles of data analysis layer setting(I classes, II classes, parameter, event, modbus
Data), quality of data inspection, adopt benefit, batch data stock and stored being eventually converted into business datum.
Present invention is mainly used for the operation displaying and intelligent monitoring of electrical equipment, for the real time execution feelings of electrical equipment
Condition, the real-time parameter of microenvironment carry out link displaying and Based Intelligent Control, each to what is may occurred when electrical equipment unmanned
Plant anomalous event to be predicted, the various failures to having occurred are recorded and notified automatically responsible person concerned.
On the one hand the present invention can free people from daily heavy labor, on the other hand can improve equipment
Service efficiency, is particularly important for the China dirty to intelligent reduction of discharging, synergy drop.
Embodiment 5:
The present embodiment is further optimized on the basis of above-described embodiment, further, to better implement the present invention
The system, adopts tcp/ip communication and adopts JMX when being communicated between the serial server and Communications service circuit
Monitoring;Monitor using tcp/ip communication and using JMX when being communicated between acquisition terminal and Communications service circuit.
System shows in real time the status information of managed resource by JMX monitoring, when exception occurs in the state of managed resource
When, the monitoring system is reported to the police by sending Email or sending short message way.
As shown in figure 3, system collects managed resource status information using the JXM monitoring set by JMX Agent layers.JMI is acted on behalf of
Layer and managed resource are operated on same machine.Agent layer is collected controlled money by JMX Distributed Services layer assembly
Source status information is sent to the monitoring applications client management program of monitoring system.Monitoring applications client management program receives prison
The managed resource status information that control application proxy end sends over, and information is for further processing.
Further, the system to better implement the present invention, is communicated in Communications service circuit using IOService
Service.
Data exhibiting aspect realizes various ways of presentation, and inquiry displaying is not only carried out to basic data, and is dug by data
Pick, data analysis realize many kinds of parameters(Density of personnel, air humidity, environment temperature, initial data, special status etc.)Situation
Under carry out the various predictions of energy data.
The present invention is met needed for information system rights management, and enterprise identity data are managed collectively, all of controlled
Resource object or resourceabstract object are managed concentratedly, effectively improved the efficiency of management, are reduced production and management cost.
The above, is only presently preferred embodiments of the present invention, not does any pro forma restriction to the present invention, it is every according to
According to any simple modification, equivalent variations that the technical spirit of the present invention is made to above example, the protection of the present invention is each fallen within
Within the scope of.