CN102254036A - Time sequence database testing method and system - Google Patents
Time sequence database testing method and system Download PDFInfo
- Publication number
- CN102254036A CN102254036A CN2011102263667A CN201110226366A CN102254036A CN 102254036 A CN102254036 A CN 102254036A CN 2011102263667 A CN2011102263667 A CN 2011102263667A CN 201110226366 A CN201110226366 A CN 201110226366A CN 102254036 A CN102254036 A CN 102254036A
- Authority
- CN
- China
- Prior art keywords
- test
- time series
- system server
- series data
- application system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 120
- 230000006870 function Effects 0.000 claims abstract description 22
- 238000010998 test method Methods 0.000 claims description 10
- 238000012986 modification Methods 0.000 claims description 3
- 230000004048 modification Effects 0.000 claims description 3
- 230000006835 compression Effects 0.000 claims description 2
- 238000007906 compression Methods 0.000 claims description 2
- 238000012217 deletion Methods 0.000 claims description 2
- 230000037430 deletion Effects 0.000 claims description 2
- 239000000725 suspension Substances 0.000 claims description 2
- 238000004088 simulation Methods 0.000 claims 2
- 238000000034 method Methods 0.000 abstract description 7
- 238000012545 processing Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 238000004519 manufacturing process Methods 0.000 description 3
- 230000007613 environmental effect Effects 0.000 description 2
- 238000011156 evaluation Methods 0.000 description 2
- 238000012797 qualification Methods 0.000 description 2
- 208000035126 Facies Diseases 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 238000011990 functional testing Methods 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000011056 performance test Methods 0.000 description 1
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a time sequence database testing method and system. The method comprises the following steps: setting test point types to be tested, wherein the test point types comprise a function index, an advanced function index, a performance index and availability; and testing the test point types respectively, and recording the test results of testing on each test point type. According to the scheme of the invention, the functions and performance of the time sequence database can be comprehensively tested, and the functions and performances of time sequence databases of different manufacturers can be compared conveniently, and the model selection of the time sequence database is facilitated.
Description
Technical field
The present invention relates to a kind of time series data library test method and a kind of time series data library test system.
Background technology
The time series data storehouse is as the senior base application technology of computer realm core, it is a set algorithm, realize, instrument and degree of ripeness are the complication system engineering of one, external time series data storehouse manufacturer is by long market operation, occupied market, very big progress has all been obtained in domestic time series data storehouse in theory and practice, yet, have nothing in common with each other in the time series data storehouse of producer's Development and Production that each are different, the information data type that is comprised is also inequality, thereby also can't be directly the different time sequence library of variant producer be compared, can't do assessment and carry out type selecting the function and the performance of the different time sequence library of variant producer.
Summary of the invention
At above-mentioned problems of the prior art, the object of the present invention is to provide a kind of time series data library test method and time series data library test system, it can be tested the function and the performance in time series data storehouse all sidedly, is convenient to the assessment of comparing of the function of the different time sequence library of variant producer and performance.
For achieving the above object, the present invention by the following technical solutions:
A kind of time series data library test method comprises step:
Set the test point type that needs test, this test point type comprises functional parameter, Premium Features index, performance index;
Above-mentioned test point type is tested the test result that record is tested each test point type respectively.
A kind of time series data library test system, comprise: the test data generator that is connected with time series data to be measured storehouse, the first application system server, the second application system server, first operating system, second operating system that are connected with the first application system server, the 3rd operating system, the 4th operating system that are connected with the second application system server, on the first application system server first kind dispatch automated system is installed, the second class dispatch automated system is installed on the second application system server.
According to the invention described above scheme, it is by setting the test point type that need test, and the time series data storehouse is tested according to these test point types, because the test point type that sets is the big event of evaluation time sequence library, the time series data storehouse of variant manufacturer production is tested according to identical test point type, thereby not only can test the function and the performance in time series data storehouse all sidedly, also be convenient to the function and the performance in the time series data storehouse of variant producer are compared, be convenient to type selecting the time series data storehouse.
Description of drawings
Fig. 1 is the schematic flow sheet of time series data library test method embodiment of the present invention;
Fig. 2 is the structural representation of time series data library test system embodiment of the present invention;
Fig. 3 is a structural representation of using test macro of the present invention in the concrete example.
Embodiment
Below in the mode of specific embodiment, the present invention program is described in detail.
Referring to shown in Figure 1, be the schematic flow sheet of time series data library test method embodiment of the present invention, it comprises step:
Step S101: set the test point type that needs test, this test point type comprises functional parameter, Premium Features index, performance index, enters step S102;
Step S102: above-mentioned test point type is tested the test result that record is tested each test point type respectively.
According to the invention described above scheme, it is by setting the test point type that need test, and the time series data storehouse is tested according to these test point types, because the test point type that sets is the big event of evaluation time sequence library, the time series data storehouse of variant manufacturer production is tested according to identical test point type, thereby not only can test the function and the performance in time series data storehouse all sidedly, also be convenient to the function and the performance in the time series data storehouse of variant producer are compared, be convenient to type selecting the time series data storehouse.
Below with in the concrete example, carry out illustrated in greater detail respectively at the test process of variant test point type.
With the test point type is that functional parameter is an example, and the test process of functional parameter is comprised concurrent efficient, submits data to, submits to the end suspension to recover, submit to end local cache, real time data single-point/batch query, historical data single-point/batch query, maximal value inquiry, minimum value inquiry, step value inquiry, multithreading support, label foundation/deletion/modification, multiple spot section, the test of storehouse section, multiple spot random time section, self-starting function entirely by an ID.Concrete test mode can be to carry out corresponding operation at the time series data storehouse to test.
With concurrent efficient is example, test process to concurrent efficient can be: several inquiring client terminals are set in operation simultaneously, for example 100,120, data to difference, different time sections are inquired about, Query Result, query time to each inquiring client terminal are comprehensively compared, thereby obtain the test result at concurrent efficient.
Test process to the Premium Features index can comprise: to the SQL of compression efficiency, image feature, disaster function, advanced interface, time series data visit, in/type RDMS is integrated, core pressure, oppositely set up the test of functions such as index, backup functionality, concrete test mode can be to carry out corresponding operation at the time series data storehouse to test:
Test process to performance index can comprise: to submitting efficient, search efficiency, the test of functions such as memory property, application characteristic in the unit interval to, concrete test mode can be to carry out corresponding operation at the time series data storehouse to test:
To submit efficient to is example, can be to submit above data to twice, and for example different bar numbers, difference are counted, different frame number, writes down each time and submits to data institute's time-consuming and CPU usage conduct to submitting the test result of efficient to;
With the search efficiency is example, can be to submit some data to server end, move several then simultaneously and carry out, inquiry set point, the interior data of setting-up time section wherein, the occupancy of the consuming time and CPU of record queries is as the test result to search efficiency;
With the memory property in the unit interval is example, can be that the consuming time and CPU usage of these data of recording storage is as the test result to memory property at the interval stored record of setting-up time plurality of data;
With the application characteristic is example, can be the data point that several are set in full storehouse is carried out the section inquiry of two above setting-up times, and with the consuming time and CPU usage of section inquiry as test result to the application characteristic.
Except the test of above-mentioned each performance to the time series data storehouse, the present invention program can also test the availability in time series data storehouse.For the availability in time series data storehouse is tested, the present invention program provides a kind of test structure.Referring to shown in Figure 2, be the synoptic diagram of the test macro in the embodiment of this test structure.
Test macro as shown in Figure 2, include the test data generator, the first application system server, the second application system server, first operating system, second operating system, the 3rd operating system, the 4th operating system, wherein, time series data to be tested storehouse and test data generator, the first application system server, and second the application system server connect, first operating system, second operating system can be connected with the first application system server, the 3rd operating system, the 4th operating system can be connected with the second application system server, install on the first application system server and be provided with corresponding first kind dispatch automated system, install on the second application system server and be provided with the corresponding second class dispatch automated system.Can be connected by switch, Ethernet between test data generator, the first application system server, the second application system server and the time series data to be measured storehouse.This test macro can also include the storage of time series disk array, and this time series disk array storage can be connected by fiber optic network with the time series data storehouse, for example optical fiber switch.
During test, insert time series data to be measured storehouse, the test data generator produces corresponding emulated data, the emulated data here can comprise total gauge point number, factory's station quantity, delta data or the like, by first operating system, second operating system, the 3rd operating system, the 4th operating system is via the first application system server, the second application system server is respectively to time series data storehouse executable operations, make the time series data storehouse be in running status, and move the Preset Time section continuously, for example 48 hours, 72 hours, 96 hours or other time period, and be recorded in test data in during this period of time the operational process, thereby not only can test stability that simultaneously can test duration sequence library long-term operation under high strength pressure to the availability in time series data storehouse.
Wherein, above-mentioned test data generator can be provided with many, that is, each test data generator can send the emulated data of respective number respectively, thereby these many test data generators can produce needed huge emulated data together.Counting with overall measurement is 600,000 to be example, and 6 test data generators then can be set, and each test data generator can send 100,000 number of test points.Certainly, according to actual needs, the test data generator of other numbers and the number of test points that each test data generator sends can be set also.
In addition, under the enough powerful situation of the processing power of equipment, the above-mentioned first application system server can be arranged on the equipment, in order to improve under the powerful inadequately situation of the processing power of handling operational efficiency or equipment, it can be the function of carrying out this first application system server by a plurality of different equipment jointly, for variant equipment, can be connected with first operating system, second operating system respectively.Correspondingly, under the enough powerful situation of the processing power of equipment, the above-mentioned second application system server also can be arranged on the equipment, in order to improve under the powerful inadequately situation of the processing power of handling operational efficiency or equipment, it can be the function of carrying out this second application system server by a plurality of different equipment jointly, for variant equipment, can be connected with the 3rd operating system, the 4th operating system respectively.
In addition, the above-mentioned first application system server, the second application system server, test data generator can be the virtual first application system server, the virtual second application system server, the virtual test data generators that adopts Intel Virtualization Technology.
Above-mentioned test macro can be connected with time series data library backup to be measured simultaneously, and time series data to be measured storehouse is moved with the form of two-node cluster hot backup.Simultaneously, this test macro can insert simultaneously time series data storehouse dissimilar, different manufacturers, so that the availability in these different time series data storehouses and other functions and performance are tested, and can conveniently compare to the test result in each time series data storehouse, because each residing environmental facies in time series data storehouse together, thereby can selection function and the better time series data of performance storehouse, type selecting is carried out in the time series data storehouse.
For fear of using the first application system server, the place environmental difference was caused when second application server was tested time series data to be measured storehouse influence, above-mentioned first operating system can be identical with the 3rd operating system, and above-mentioned second operating system can be identical with the 4th operating system.
Use the test macro of the invention described above, not only can test, can also use this test macro simultaneously above-mentioned each function and the performance in time series data to be measured storehouse are tested the availability in time series data to be measured storehouse.
As shown in Figure 3, show the configuration diagram of the test macro of the present invention program in a concrete example, in the diagram, be to describe with test that two class time sequence libraries are compared, this two classes database runs on 6 database servers with the form of two-node cluster hot backup.
In shown in Figure 3, be to be that to amass into electronic application server, the second application system server be to continue and protect that application system server, the first application system server are separately positioned on three equipment with the second application system server, each equipment connects different operating system respectively and describes in Nanjing with the first application system server, and be that two tame time series data storehouses are tested, each time series data storehouse runs on 4 database servers with the form of two-node cluster hot backup respectively.In shown in Figure 3, the storage of time series disk array is respectively the disk array of 10TB.Need to prove that shown in Figure 3 only is detailed description to a concrete example, the framework shown in Fig. 3 can not constitute the qualification to the present invention program.
As shown in Figure 3, the data source of testing, can be to send with Millisecond by the test data generator, also can be sending of the first application system server, the second application system server, the data source that data source that the first application system server, the second application system server send and test data generator send is exported this time series data storehouse, and concrete generation is sent mode and do not repeated them here.The data source here can be the Millisecond data source.
According to the invention described above scheme, can comprehensively test time series data to be measured storehouse, comprise usability testing, functional test and performance test.In addition, when carrying out usability testing, can use true application system server to test, adopt the test data generator to send emulated data, thus issuable variety of issue can in test, find time series data to be tested storehouse and the break-in of application system server the time.In addition, be to have set the sufficiently long test duration availability is tested, stability that more can the long-time running under high strength pressure of test duration sequence library.
Above-described embodiment of the present invention only is the detailed description to better embodiment of the present invention, does not constitute the qualification to protection domain of the present invention.Any modification of being done within the spirit and principles in the present invention, be equal to and replace and improvement etc., all should be included within the claim protection domain of the present invention.
Claims (9)
1. a time series data library test method is characterized in that, comprises step:
Set the test point type that needs test, this test point type comprises functional parameter, Premium Features index, performance index;
Above-mentioned test point type is tested the test result that record is tested each test point type respectively.
2. time series data library test method according to claim 1 is characterized in that, also comprises step: build true/simulation application environment, the availability in time series data storehouse is tested.
3. time series data library test method according to claim 2, it is characterized in that, described true/the simulation application environment comprises: the test data generator that is connected with time series data to be measured storehouse, the first application system server, the second application system server, first operating system that is connected with the first application system server, second operating system, the 3rd operating system that is connected with the second application system server, the 4th operating system, on the first application system server first kind dispatch automated system is installed, the second class dispatch automated system is installed on the second application system server.
4. according to claim 1 or 2 or 3 described time series data library test methods, it is characterized in that:
Described functional parameter comprises concurrent efficient, submits data to, submits to the end suspension to recover, submit to end local cache, real time data single-point/batch query, historical data single-point/batch query, maximal value inquiry, minimum value inquiry, step value inquiry, multithreading support, label foundation/deletion/modification, multiple spot section, full storehouse section, multiple spot random time section, self-starting function by an ID;
And/or
Described Premium Features index comprises: the SQL of compression efficiency, image feature, disaster function, advanced interface, time series data visit, in/type RDMS is integrated, core pressure, oppositely set up index, backup functionality; And/or
Described performance index comprise: submit memory property, application characteristic in efficient, search efficiency, unit interval to.
5. time series data library test system, it is characterized in that, comprise: the test data generator that is connected with time series data to be measured storehouse, the first application system server, the second application system server, first operating system, second operating system that are connected with the first application system server, the 3rd operating system, the 4th operating system that are connected with the second application system server, on the first application system server first kind dispatch automated system is installed, the second class dispatch automated system is installed on the second application system server.
6. according to claim 5 or 6 described time series data library test systems, it is characterized in that described test data generator comprises more than two.
7. according to claim 5 or 6 described time series data library test systems, it is characterized in that the described first application system server is the virtual application system server, the described second application system server is the virtual application system server.
8. according to claim 5 or 6 described time series data library test systems, it is characterized in that:
The described first application system server is arranged on two equipment at least, and the described second application system server is arranged on two equipment at least;
And/or
First operating system is identical with the 3rd operating system, and second operating system is identical with the 4th operating system.
9. according to claim 5 or 6 described time series data library test systems, it is characterized in that, be connected by switch between described test data generator, the first application system server, the second application system server and the time series data to be measured storehouse.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011102263667A CN102254036A (en) | 2011-08-09 | 2011-08-09 | Time sequence database testing method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011102263667A CN102254036A (en) | 2011-08-09 | 2011-08-09 | Time sequence database testing method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102254036A true CN102254036A (en) | 2011-11-23 |
Family
ID=44981300
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2011102263667A Pending CN102254036A (en) | 2011-08-09 | 2011-08-09 | Time sequence database testing method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102254036A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104243554A (en) * | 2014-08-20 | 2014-12-24 | 南京南瑞继保工程技术有限公司 | Method for synchronizing time memories of host and standby of time series database in cluster system |
| CN104808163A (en) * | 2015-04-08 | 2015-07-29 | 国家电网公司 | Electric energy quality monitoring system performance detection method |
| CN104933175A (en) * | 2015-06-30 | 2015-09-23 | 深圳市金证科技股份有限公司 | Performance data dependency analyzing method and performance monitoring system |
| CN106777111A (en) * | 2016-12-15 | 2017-05-31 | 华南师范大学 | A kind of sequential search index system and method for ultra-large data |
| CN107885654A (en) * | 2017-05-05 | 2018-04-06 | 平安科技（深圳）有限公司 | Data library test method and system |
| CN112948356A (en) * | 2021-03-10 | 2021-06-11 | 河海大学 | Method for constructing time sequence database availability enhancement mechanism based on resource perception |
| CN115658648A (en) * | 2022-10-24 | 2023-01-31 | 浪潮软件集团有限公司 | Time-series database comparison method and device based on Internet of things scene |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070083630A1 (en) * | 2005-09-27 | 2007-04-12 | Bea Systems, Inc. | System and method for performance testing framework |
| CN101727383A (en) * | 2008-10-16 | 2010-06-09 | 上海市医疗保险信息中心 | Simulation test method and system of database |
| CN101789002A (en) * | 2010-01-22 | 2010-07-28 | 浪潮(北京)电子信息产业有限公司 | Database compatibility test device and method for server |
| CN101883019A (en) * | 2010-03-15 | 2010-11-10 | 浪潮电子信息产业股份有限公司 | A test method for verifying whether a storage server satisfies video applications |
-
2011
- 2011-08-09 CN CN2011102263667A patent/CN102254036A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070083630A1 (en) * | 2005-09-27 | 2007-04-12 | Bea Systems, Inc. | System and method for performance testing framework |
| CN101727383A (en) * | 2008-10-16 | 2010-06-09 | 上海市医疗保险信息中心 | Simulation test method and system of database |
| CN101789002A (en) * | 2010-01-22 | 2010-07-28 | 浪潮(北京)电子信息产业有限公司 | Database compatibility test device and method for server |
| CN101883019A (en) * | 2010-03-15 | 2010-11-10 | 浪潮电子信息产业股份有限公司 | A test method for verifying whether a storage server satisfies video applications |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104243554A (en) * | 2014-08-20 | 2014-12-24 | 南京南瑞继保工程技术有限公司 | Method for synchronizing time memories of host and standby of time series database in cluster system |
| CN104243554B (en) * | 2014-08-20 | 2017-10-20 | 南京南瑞继保工程技术有限公司 | A kind of timing sequence library standby machine internal memory synchronous method in group system |
| CN104808163A (en) * | 2015-04-08 | 2015-07-29 | 国家电网公司 | Electric energy quality monitoring system performance detection method |
| CN104933175A (en) * | 2015-06-30 | 2015-09-23 | 深圳市金证科技股份有限公司 | Performance data dependency analyzing method and performance monitoring system |
| CN104933175B (en) * | 2015-06-30 | 2020-06-26 | 深圳市金证科技股份有限公司 | Performance data correlation analysis method and performance monitoring system |
| CN106777111A (en) * | 2016-12-15 | 2017-05-31 | 华南师范大学 | A kind of sequential search index system and method for ultra-large data |
| CN107885654A (en) * | 2017-05-05 | 2018-04-06 | 平安科技（深圳）有限公司 | Data library test method and system |
| CN112948356A (en) * | 2021-03-10 | 2021-06-11 | 河海大学 | Method for constructing time sequence database availability enhancement mechanism based on resource perception |
| CN115658648A (en) * | 2022-10-24 | 2023-01-31 | 浪潮软件集团有限公司 | Time-series database comparison method and device based on Internet of things scene |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102254036A (en) | Time sequence database testing method and system | |
| CN110082579B (en) | A kind of intelligent anti-stealing electricity monitoring method, system, equipment and medium in Taiwan area | |
| CN104516894B (en) | Method and apparatus for managing time series databases | |
| CN102254035A (en) | Relational database testing method and system | |
| KR102043928B1 (en) | Bi-directional association and graphical acquisition of time-based equipment sensor data and material-based metrology statistical process control data | |
| CN102890682A (en) | Method for creating index, searching method, device and system | |
| CN102243610A (en) | Operating system test method and test system | |
| CN110806730A (en) | Big data operation and maintenance platform, server and storage medium | |
| CN109063885A (en) | A kind of substation's exception metric data prediction technique | |
| CN105302730A (en) | Calculation model detection method, testing server and service platform | |
| CN120849202A (en) | Hard disk data reliability testing method and system | |
| CN101414273A (en) | Method for evaluating storage system RAID redundant data risk | |
| Li et al. | Dynamic time warping distance method for similarity test of multipoint ground motion field | |
| CN117573452A (en) | Performance test method, apparatus, computer device, storage medium, and program product | |
| CN119652254B (en) | A method, apparatus, equipment, and storage medium for performance monitoring of a photovoltaic power plant. | |
| CN114880153A (en) | Data processing method, apparatus, electronic device, and computer-readable storage medium | |
| CN120336332A (en) | A data governance method and system for distributed data architecture | |
| US9092508B1 (en) | Overseeing data storage equipment power usage via local collection of power consumption data and remote evaluation and reporting of performance | |
| CN114860549B (en) | Buried data verification method, buried data verification device, buried data verification equipment and storage medium | |
| Zhang et al. | A simulation‐based differential evolution algorithm for stochastic parallel machine scheduling with operational considerations | |
| CN111125066A (en) | Method and device for detecting functions of database audit equipment | |
| CN110515955A (en) | Data storage, query method, system, electronic device and storage medium | |
| Liu et al. | A versatile event-driven data model in hbase database for multi-source data of power grid | |
| Benefico et al. | Evaluation of the cap properties on amazon simpledb and windows azure table storage | |
| CN110493326B (en) | Zookeeper-based cluster configuration file management system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20111123 |