[go: up one dir, main page]

CN113448990A - Quasi-real-time multi-dimensional data query method and device for unitized system - Google Patents

Quasi-real-time multi-dimensional data query method and device for unitized system Download PDF

Info

Publication number
CN113448990A
CN113448990A CN202110780210.7A CN202110780210A CN113448990A CN 113448990 A CN113448990 A CN 113448990A CN 202110780210 A CN202110780210 A CN 202110780210A CN 113448990 A CN113448990 A CN 113448990A
Authority
CN
China
Prior art keywords
data
quasi
real
dimensional data
groups
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110780210.7A
Other languages
Chinese (zh)
Inventor
邢海岚
熊维
戈星晨
刘楠楠
杨小芳
杨毅刚
赵书祥
闫琨
简季铭
孙龙堂
王汝娇
张阳
戴雪梅
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Bank of China Ltd
Original Assignee
Bank of China Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Bank of China Ltd filed Critical Bank of China Ltd
Priority to CN202110780210.7A priority Critical patent/CN113448990A/en
Publication of CN113448990A publication Critical patent/CN113448990A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23Updating
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28Databases characterised by their database models, e.g. relational or object models
    • G06F16/283Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computational Linguistics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention provides a quasi-real-time multi-dimensional data query method and a quasi-real-time multi-dimensional data query device for a unitized system, which relate to the technical field of mobile interconnection, and the method comprises the following steps: acquiring the update data of a plurality of target units according to the subscription information; grouping and storing the updated data to obtain a plurality of groups of dimensional data; and inquiring the multiple groups of dimensional data according to the strategy parameters to obtain an inquiry result. The invention can collect the service data in a quasi-real time mode according to multiple dimensions, and provides data access services with different dimensions to the outside through the collected data.

Description

Quasi-real-time multi-dimensional data query method and device for unitized system
Technical Field
The invention relates to the technical field of mobile interconnection, in particular to a quasi-real-time multi-dimensional data query method and device for a unitized system.
Background
This section is intended to provide a background or context to the embodiments of the invention that are recited in the claims. The description herein is not admitted to be prior art by inclusion in this section.
The characteristics of financial business operations such as payment and account transfer of customers are different from the requirements of personal data inquiry of customers. The financial business operation of the customer only accesses the single point of data, namely the customer completes the business by using a specific card or account. And the data query operation of the client, the associated data is in a star or mesh structure, namely, the associated data is radiated to various client associated information such as account, card, transaction data and the like from the client number.
The behavior example of using mobile phone bank by the client is used. There are many credit cards, debit cards, also periodic accounts, financial accounts, etc. under the customer's name. After the customer logs in the mobile phone bank, the mobile phone bank can display all account and card information under the name of the customer, which is a typical customer data query request. The customer can select a certain account to perform specific business operations such as transfer, financing and the like.
After the system is unitized, the customer's account, card, etc. information may be dispersed among different units. The single-point data access in the service is not obviously different from the centralized service system, but the difficulty of the quasi-real-time access to the scattered data is improved, and the service response time is also increased.
Disclosure of Invention
The invention provides a quasi-real-time multi-dimensional data query method and a quasi-real-time multi-dimensional data query device for a unitized system, which can collect business data in a quasi-real-time manner according to multiple dimensions and provide data access services with different dimensions to the outside through the collected data.
In a first aspect, an embodiment of the present invention provides a quasi-real-time multidimensional data query method for a unitized system, where the method includes:
acquiring the update data of a plurality of target units according to the subscription information; grouping and storing the updated data to obtain a plurality of groups of dimensional data; and querying the multiple groups of dimensional data according to the strategy parameters to obtain query results.
In a second aspect, an embodiment of the present invention further provides a quasi-real-time multidimensional data query device for a unitized system, where the device includes:
the acquisition module is used for acquiring the update data of the target units according to the subscription information; the distribution module is used for storing the updated data in groups to obtain a plurality of groups of dimensional data; and the access module is used for inquiring the multiple groups of dimensional data according to the strategy parameters to obtain an inquiry result.
In a third aspect, an embodiment of the present invention further provides an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor implements the quasi-real-time multi-dimensional data query method of the unitized system when executing the computer program.
In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium, where a computer program for executing the quasi-real-time multi-dimensional data query method of the unitized system is stored in the computer-readable storage medium.
The embodiment of the invention has the following beneficial effects: the embodiment of the invention provides a quasi-real-time multi-dimensional data query scheme of a unitized system, which comprises the following steps: acquiring the update data of a plurality of target units according to the subscription information; grouping and storing the updated data to obtain a plurality of groups of dimensional data; and inquiring the multiple groups of dimensional data according to the strategy parameters to obtain an inquiry result. The embodiment of the invention can collect the service data in a quasi-real time mode according to multiple dimensions, and provides data access services with different dimensions to the outside through the collected data.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
In order to make the aforementioned and other objects, features and advantages of the present invention comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
FIG. 1 is a flow chart of a quasi-real-time multi-dimensional data query method for a unitized system according to an embodiment of the present invention;
fig. 2 is a schematic diagram of an implementation architecture of a quasi-real-time multidimensional data query method of a unitized system according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of a data distribution process provided by an embodiment of the present invention;
fig. 4 is a schematic diagram of a data access redirection process provided in an embodiment of the present invention;
FIG. 5 is a block diagram of a quasi-real-time multi-dimensional data query apparatus of a unitized system according to an embodiment of the present invention;
FIG. 6 is a block diagram of a quasi-real-time multi-dimensional data query device of another unitized system according to an embodiment of the present invention;
fig. 7 is a block diagram of a computer device according to an embodiment of the present invention.
Detailed Description
To make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is apparent that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In the centralized system, different indexes need to be added for different data access dimensions, and when data is inserted, not only the data record itself but also various index data need to be written, so that IO time consumption of data insertion operation increases with the increase of the number of indexes. The data read and write operations of the centralized system are all directed to the same data source.
In a unitized system, a database can provide read-write separation capability, but an application system still accesses isomorphic data, so that different indexes need to be added for different data access dimensions. The application system queries all unit data nodes concurrently, receives the returned data for data integration, the interactive data volume is higher than the actual query data volume, and the network data transmission during the transaction occupies a large bandwidth.
In both centralized systems and unitized systems, when a scattered data request is received, a large amount of data needs to be integrated and sorted in real time according to data access dimensions in a data query service, so that the transaction response time is long.
Based on this, the quasi-real-time multi-dimensional data query method and the quasi-real-time multi-dimensional data query device for the unitized system provided by the embodiment of the invention realize quasi-real-time synchronization of the duplicate data through quasi-real-time data acquisition, and further ensure the consistency of the main and duplicate data through a timing data checking mechanism. Through data subscription and distribution, the acquired data is actively pushed, heterogeneous data mapping is realized by a rule engine, quasi-real-time data collection and data integration of different using dimensions are completed, and the processing efficiency of various dimension data read-only services is improved. By the aid of the data access strategy device, application and data source selection are decoupled, corresponding databases can be automatically selected according to data access dimensions through analysis and rule matching of data access, and extra application complexity cannot be increased due to data reading and writing of data sources.
Different access dimensions of the read operation and the access dimensions of the write operation are decoupled, so that the phenomenon that the IO time of the database write operation is increased due to the increase of the access dimensions and the index is avoided, the phenomenon that the read operation index cannot meet the requirement of a partition key is avoided, and the operation efficiency of data query is reduced.
In order to facilitate understanding of the embodiment, a method for querying quasi-real-time multi-dimensional data of a unitized system disclosed by the embodiment of the invention is first described in detail.
First, the terms involved are explained.
The centralized system stores data in a centralized mode, and the problem of data dispersion does not exist. Corresponding indexes are set for different data access dimensions so as to improve the data query speed.
And the unitized system is used for concurrently inquiring all unit data nodes when receiving the scattered data request, and performing data integration according to the data access dimension after collecting all return data by the application.
The embodiment of the invention provides a quasi-real-time multi-dimensional data query method of a unitized system, which is shown in a flow chart of the quasi-real-time multi-dimensional data query method of the unitized system shown in figure 1, and the method comprises the following steps:
and step S102, acquiring the updating data of a plurality of target units according to the subscription information.
In the embodiment of the present invention, the subscription information may be set according to actual requirements, and is used to determine data and data types that are interested by the user, for example, the subscription information may include a data table that is interested by the user, fields that are interested by the user, and the like. The unitized system comprises a plurality of target units, and each target unit can update data in real time.
It should be noted that, when any target unit of the plurality of target units has data update, the acquisition of the update data of the target unit may be triggered. The specified update data can be acquired among the update data by the subscription information.
And step S104, grouping and storing the updated data to obtain a plurality of groups of dimensional data.
In the embodiment of the invention, the update data packet is stored so as to obtain multidimensional data. Referring to fig. 2, the data of N units may be divided into M dimensions for storage, so as to obtain M sets of dimension data.
And step S106, inquiring multiple groups of dimensional data according to the strategy parameters to obtain inquiry results.
In the embodiment of the present invention, the policy parameter may be set according to an actual requirement, which is not specifically limited in the embodiment of the present invention. Data screening can be performed on multiple groups of dimensional data through the strategy parameters, and a query result desired by a user is obtained.
The embodiment of the invention provides a quasi-real-time multi-dimensional data query scheme of a unitized system, which comprises the following steps: acquiring the update data of a plurality of target units according to the subscription information; grouping and storing the updated data to obtain a plurality of groups of dimensional data; and inquiring the multiple groups of dimensional data according to the strategy parameters to obtain an inquiry result. The embodiment of the invention can collect the service data in a quasi-real time mode according to multiple dimensions, and provides data access services with different dimensions to the outside through the collected data.
In one embodiment, obtaining the update data of the plurality of target units according to the subscription information may be performed according to the following steps:
and respectively acquiring the update data of the target units by using the data acquisition units according to the subscription information.
In the embodiment of the invention, the data acquisition unit can perform automatic data acquisition. When a client carries out services such as payment and account transfer, which relate to database updating operation, and when database updating operation occurs in all units, automatic data acquisition is triggered, and quasi-real-time data synchronization of data copies is realized.
In an embodiment, the update data is stored in groups to obtain multiple groups of dimension data, and the method may be performed according to the following steps:
determining a dimension type of the updating data; grouping the updated data according to the dimension type; and converting each group of updating data by using a rule engine to obtain a plurality of groups of dimension data.
In the embodiment of the invention, a data subscription and distribution mechanism is realized through a data subscription/distribution center. The data summarization target table can subscribe specific fields of a specific table according to the requirements of using dimensions. The quasi-real-time collected data is automatically distributed to target tables with different dimensions according to the subscription condition.
Through the rule engine, field level data mapping rule settings are provided. And carrying out field-level mapping setting on the acquired data according to different use dimensions so as to automatically map the acquired data into the heterogeneous target table.
In one embodiment, querying the sets of dimensional data according to the policy parameters may be performed as follows:
receiving a query request; and querying multiple groups of dimensional data according to the query request and the strategy parameters.
In the embodiment of the invention, a data access strategy is set through a data access strategy device, and different data sources are hit according to a data request. Accurate data reading and writing can directly access the database in the unit. For read-only data requests of various dimensions, the summary data held by the dimension is accessed.
In one embodiment, the method may further perform the steps of:
and checking consistency of the dimension data and the updating data.
In the embodiment of the invention, each dimension data copy carries out data check according to the data downloading text of each unit every day, and the accuracy and consistency of the data are ensured.
The following describes the implementation of the method in a specific embodiment.
1) And a data acquisition device. A data collection tool, such as a database log collection tool, is deployed at the master data source. Different data standardization processes may be required according to different collected data formats. And the automatically collected data is pushed to the data subscription/distribution platform through the message queue middleware.
2) A data subscription/distribution center. According to the need of standardization process for source maintenance, and standardization processing method. And subscribing the source data field according to the data structures with different dimensions. After the collected data reach the data subscription/distribution center, if data standardization is needed, standardization processing is firstly carried out. For example, the collected data format is a data access statement, normalized into a list of tables, fields, and values. And traversing the subscription list, and if the fields of the subscription are hit, distributing the standardized data to the subscriber through a data distribution channel. The specific implementation steps can refer to a data distribution flow diagram shown in fig. 3.
3) A rules engine. And maintaining the table of the source data and the mapping field and the organization mode of the field in the dimension data. The data received by the subscriber is firstly matched with the data mapping rule of the table and the field of the received data through the rule engine. The rule engine outputs the result, and the result is converted into a data organization operation of the mapping field, such as a data insertion or updating operation, and is synchronized into the heterogeneous data table through a data access application on the heterogeneous data table. And if the data does not meet the uniqueness constraint of the heterogeneous data table, the expired data is backed up to the history file after being marked with a failure time tag.
4) A data access policer. Data access policies may be set, and policies associated with data operations, data access scenarios, or condition fields and data sources may be maintained. The data access policy device intercepts a data access request of a user, selects a data source according to the data request, and then redirects and forwards the data access. The default data access policy is the master data source. Specifically, refer to the data access redirection flowchart shown in fig. 4.
5) A data collation mechanism. Data download text of feed data. And after the received full/incremental data downloading text is received, performing data check on the local data copy and the downloaded data according to a data mapping rule to generate a check result text. And supporting data restoration of abnormal data according to the checking result.
From the development point of view, the following work needs to be done: 1) selecting a data acquisition unit; 2) selecting a message queue middleware and defining and realizing a data standardized interface; 3) the implementation of a rules engine and a data synchronization application; 4) implementation of a data access policier; 5) and (4) implementation of a data checking mechanism.
The embodiment of the invention provides a quasi-real-time multi-dimensional data query method and a quasi-real-time multi-dimensional data query device for a unitized system. The data subscription/distribution center routes and distributes the source data, and the synchronization from the source data to the heterogeneous data is completed through the conversion of the rule engine. And the data checking mechanism provides data correctness, consistency guarantee and abnormal repair basis. And the data access policy device is used for carrying out real-time routing and scheduling of the data access request.
In the embodiment of the invention, after the master data is changed, the data acquisition device automatically triggers to acquire the master data in a quasi-real time manner and pushes the master data to the data subscription/distribution center through the message middleware. And the data subscription/distribution center performs standardized processing on the master data according to the subscription list and pushes the master data to all subscribers through the message middleware. And after passing through the rule engine, the standardized data are converted into data of a local data storage dimension and written into a local database through a local data access application. And the data checking mechanism acquires the full/incremental data download text of the master data and performs data checking with the local database. And the access requests of the users to the data with different dimensions are intercepted by the data access policy device and then redirected to the data access application with the corresponding dimensions.
According to the embodiment of the invention, the data are ensured to meet different use dimension requirements through a dimension-based data organization mechanism. Data access is divided into write operation and read operation, and master data are organized according to access dimensionality of the write operation. And creating heterogeneous data copies according to different access dimensions of the read operation. Heterogeneous data copies of different dimensions come from the same source data, but the data organization of each dimension is decoupled from each other. Through a data source dividing mechanism, data access services provided by all the dimension data pairs are mutually decoupled. And performing data source matching by analyzing the data access statement. And the writing operation accesses the master data source, and the reading operation directly matches the corresponding data source according to the access dimension. The data volume of invalid network interaction during data access is reduced, and the time consumption of operations such as large data volume integration, screening and sequencing during data access is reduced. The influence range when the data access service is abnormal is reduced. And synchronizing the quasi-real-time synchronized main source data to each heterogeneous data copy through a rule engine according to subscription rules, mapping rules and the like through a heterogeneous data synchronization mechanism.
The embodiment of the invention also provides a quasi-real-time multi-dimensional data query device of the unitized system, which is described in the following embodiment. The principle of the device for solving the problems is similar to the quasi-real-time multi-dimensional data query method of the unitized system, so the implementation of the device can refer to the implementation of the quasi-real-time multi-dimensional data query method of the unitized system, and repeated parts are not described again. Referring to fig. 5, a block diagram of a quasi-real-time multidimensional data query device of a unitized system is shown, the device includes:
an obtaining module 51, configured to obtain update data of a plurality of target units according to the subscription information; the distribution module 52 is configured to store the updated data in groups to obtain multiple sets of dimensional data; and the access module 53 is configured to query multiple sets of dimensional data according to the policy parameters to obtain query results.
In one embodiment, the obtaining module is specifically configured to: and respectively acquiring the update data of the target units by using the data acquisition units according to the subscription information.
In one embodiment, a dimension type of the update data is determined; grouping the updated data according to the dimension type; and converting each group of updating data by using a rule engine to obtain a plurality of groups of dimension data.
In one embodiment, the access module is specifically configured to: receiving a query request; and querying multiple groups of dimensional data according to the query request and the strategy parameters.
In an embodiment, referring to a block diagram of a quasi-real-time multi-dimensional data query apparatus of another unitized system shown in fig. 6, the apparatus further includes a checking module 54, specifically configured to: and checking consistency of the dimension data and the updating data.
Based on the same inventive concept, the embodiment of the invention also provides an embodiment of electronic equipment for realizing all or part of contents in the quasi-real-time multi-dimensional data query method of the unitized system. The electronic device specifically comprises the following contents:
a processor (processor), a memory (memory), a communication Interface (Communications Interface), and a bus; the processor, the memory and the communication interface complete mutual communication through the bus; the communication interface is used for realizing information transmission between related devices; the electronic device may be a desktop computer, a tablet computer, a mobile terminal, and the like, but the embodiment is not limited thereto. In this embodiment, the electronic device may be implemented with reference to the embodiments of the quasi-real-time multidimensional data query method for implementing the unitized system and the embodiments of the quasi-real-time multidimensional data query device for implementing the unitized system in the embodiments, which are incorporated herein, and repeated details are not repeated herein.
Fig. 7 is a schematic diagram of a system configuration structure of an electronic device according to an embodiment of the present invention. As shown in fig. 7, the electronic device 70 may include a processor 701 and a memory 702; a memory 702 is coupled to the processor 701. Notably, this fig. 7 is exemplary; other types of structures may also be used in addition to or in place of the structure to implement telecommunications or other functions.
In one embodiment, the functions implemented by the quasi-real-time multi-dimensional data query method of the unitized system may be integrated into the processor 701. Wherein, the processor 701 may be configured to control as follows:
acquiring the update data of a plurality of target units according to the subscription information; grouping and storing the updated data to obtain a plurality of groups of dimensional data; and inquiring the multiple groups of dimensional data according to the strategy parameters to obtain an inquiry result.
As can be seen from the above, the electronic device provided in the embodiment of the present invention may collect service data in a quasi-real-time manner according to multiple dimensions, and provide data access services with different dimensions to the outside through the collected data.
In another embodiment, the quasi real-time multidimensional data query device of the unitized system may be configured separately from the processor 701, for example, the quasi real-time multidimensional data query device of the unitized system may be configured as a chip connected to the processor 701, and the function of the quasi real-time multidimensional data query method of the unitized system is realized by the control of the processor.
As shown in fig. 7, the electronic device 70 may further include: a communication module 703, an input unit 704, an audio processing unit 705, a display 706, and a power supply 707. It is noted that the electronic device 70 does not necessarily include all of the components shown in fig. 7; furthermore, the electronic device 70 may also comprise components not shown in fig. 7, which can be referred to in the prior art.
As shown in fig. 7, the processor 701, which is sometimes referred to as a controller or operational control, may include a microprocessor or other processor device and/or logic device, and the processor 701 receives input and controls the operation of the various components of the electronic device 70.
The memory 702 may be, for example, one or more of a buffer, a flash memory, a hard drive, a removable media, a volatile memory, a non-volatile memory, or other suitable device. The information relating to the failure may be stored, and a program for executing the information may be stored. And the processor 701 may execute the program stored in the memory 702 to realize information storage or processing, or the like.
The input unit 704 provides input to the processor 701. The input unit 704 is, for example, a key or a touch input device. The power supply 707 is used to supply power to the electronic device 70. The display 706 is used for displaying display objects such as images and characters. The display may be, for example, an LCD display, but is not limited thereto.
The memory 702 may be a solid state memory such as Read Only Memory (ROM), Random Access Memory (RAM), a SIM card, or the like. There may also be a memory that holds information even when power is off, can be selectively erased, and is provided with more data, an example of which is sometimes called an EPROM or the like. The memory 702 may also be some other type of device. Memory 702 includes a buffer memory 7021 (sometimes referred to as a buffer). The memory 702 may include an application/function storage portion 7022, the application/function storage portion 7022 being used to store application programs and function programs or procedures for performing operations of the electronic device 70 by the processor 701.
The memory 702 may also include a data store 7023, the data store 7023 being for storing data, such as contacts, digital data, pictures, sounds, and/or any other data used by the electronic device. The driver storage portion 7024 of the memory 702 may include various drivers of the electronic device for communication functions and/or for performing other functions of the electronic device (e.g., messaging application, address book application, etc.).
The communication module 703 is a transmitter/receiver that transmits and receives signals via the antenna 708. A communication module (transmitter/receiver) 703 is coupled to the processor 701 to provide an input signal and receive an output signal, which may be the same as in the case of a conventional mobile communication terminal.
Based on different communication technologies, a plurality of communication modules 703, such as a cellular network module, a bluetooth module, and/or a wireless local area network module, may be provided in the same electronic device. The communication module (transmitter/receiver) 703 is also coupled to a speaker 709 and a microphone 710 via an audio processing unit 705 to provide audio output via the speaker 709 and receive audio input from the microphone 710 to implement general telecommunication functions. The audio processing unit 705 may include any suitable buffers, decoders, amplifiers and so forth. Additionally, an audio processing unit 705 is also coupled to the processor 701 to enable recording of sound locally through a microphone 710 and to enable playing of locally stored sound through a speaker 709.
An embodiment of the present invention further provides a computer-readable storage medium for implementing all steps in the quasi-real-time multidimensional data query method of the unitized system in the above embodiments, where the computer-readable storage medium stores a computer program, and the computer program, when executed by a processor, implements all steps of the quasi-real-time multidimensional data query method of the unitized system in the above embodiments, for example, when the processor executes the computer program, the processor implements the following steps:
acquiring the update data of a plurality of target units according to the subscription information; grouping and storing the updated data to obtain a plurality of groups of dimensional data; and inquiring the multiple groups of dimensional data according to the strategy parameters to obtain an inquiry result.
As can be seen from the above, the computer-readable storage medium provided in the embodiment of the present invention can collect business data in a quasi-real-time manner according to multiple dimensions, and provide data access services with different dimensions to the outside through the collected data.
Although the present invention provides method steps as described in the examples or flowcharts, more or fewer steps may be included based on routine or non-inventive labor. The order of steps recited in the embodiments is merely one manner of performing the steps in a multitude of orders and does not represent the only order of execution. When an actual apparatus or client product executes, it may execute sequentially or in parallel (e.g., in the context of parallel processors or multi-threaded processing) according to the embodiments or methods shown in the figures.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
In this document, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. The terms "upper", "lower", and the like, indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings, and are only for convenience in describing the present invention and simplifying the description, but do not indicate or imply that the referred devices or elements must have a specific orientation, be constructed and operated in a specific orientation, and thus, should not be construed as limiting the present invention.
Unless expressly stated or limited otherwise, the terms "mounted," "connected," and "connected" are intended to be inclusive and mean, for example, that they may be fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations.
It should be noted that the embodiments and features of the embodiments may be combined with each other without conflict. The present invention is not limited to any single aspect, nor is it limited to any single embodiment, nor is it limited to any combination and/or permutation of these aspects and/or embodiments. Each aspect and/or embodiment of the invention can be used alone or in combination with one or more other aspects and/or embodiments.
Finally, it should be noted that: the above-mentioned embodiments are only specific embodiments of the present invention, which are used for illustrating the technical solutions of the present invention and not for limiting the same, and the protection scope of the present invention is not limited thereto, although the present invention is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: any person skilled in the art can modify or easily conceive the technical solutions described in the foregoing embodiments or equivalent substitutes for some technical features within the technical scope of the present disclosure; such modifications, changes or substitutions do not depart from the spirit and scope of the embodiments of the present invention, and they should be construed as being included therein. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims (12)

1. A quasi-real-time multi-dimensional data query method of a unitized system is characterized by comprising the following steps:
acquiring the update data of a plurality of target units according to the subscription information;
grouping and storing the updated data to obtain a plurality of groups of dimensional data;
and querying the multiple groups of dimensional data according to the strategy parameters to obtain query results.
2. The method of claim 1, wherein obtaining update data for a plurality of target units based on subscription information comprises:
and respectively acquiring the update data of the target units by using the data acquisition units according to the subscription information.
3. The method of claim 1, wherein storing the updated data in groups to obtain multiple sets of dimension data comprises:
determining a dimension type of the update data;
grouping the update data according to the dimension type;
and converting each group of updating data by using a rule engine to obtain a plurality of groups of dimension data.
4. The method of claim 1, wherein querying the plurality of sets of dimensional data according to policy parameters comprises:
receiving a query request;
and querying the multiple sets of dimensional data according to the query request and the strategy parameters.
5. The method according to any one of claims 1-4, further comprising:
and checking the consistency of the dimension data and the updating data.
6. A quasi-real-time multi-dimensional data query device of a unitized system, comprising:
the acquisition module is used for acquiring the update data of the target units according to the subscription information;
the distribution module is used for storing the updated data in groups to obtain a plurality of groups of dimensional data;
and the access module is used for inquiring the multiple groups of dimensional data according to the strategy parameters to obtain an inquiry result.
7. The apparatus of claim 6, wherein the obtaining module is specifically configured to:
and respectively acquiring the update data of the target units by using the data acquisition units according to the subscription information.
8. The apparatus of claim 6, wherein the dispensing die is specifically configured to:
determining a dimension type of the update data;
grouping the update data according to the dimension type;
and converting each group of updating data by using a rule engine to obtain a plurality of groups of dimension data.
9. The apparatus of claim 6, wherein the access module is specifically configured to:
receiving a query request;
and querying the multiple sets of dimensional data according to the query request and the strategy parameters.
10. The apparatus according to any one of claims 6 to 9, further comprising a verification module, in particular for:
and checking the consistency of the dimension data and the updating data.
11. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the quasi real-time multidimensional data query method of the unitized system of any one of claims 1 to 5 when executing the computer program.
12. A computer-readable storage medium storing a computer program for executing the quasi-real-time multi-dimensional data query method of the unitized system according to any one of claims 1 to 5.
CN202110780210.7A 2021-07-09 2021-07-09 Quasi-real-time multi-dimensional data query method and device for unitized system Pending CN113448990A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110780210.7A CN113448990A (en) 2021-07-09 2021-07-09 Quasi-real-time multi-dimensional data query method and device for unitized system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110780210.7A CN113448990A (en) 2021-07-09 2021-07-09 Quasi-real-time multi-dimensional data query method and device for unitized system

Publications (1)

Publication Number Publication Date
CN113448990A true CN113448990A (en) 2021-09-28

Family

ID=77815812

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110780210.7A Pending CN113448990A (en) 2021-07-09 2021-07-09 Quasi-real-time multi-dimensional data query method and device for unitized system

Country Status (1)

Country Link
CN (1) CN113448990A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114723397A (en) * 2022-03-28 2022-07-08 阿里云计算有限公司 Flow execution method and device
CN118966902A (en) * 2024-08-13 2024-11-15 江苏臻云技术有限公司 A supplier portrait management system and method for manufacturing industry
CN119739545A (en) * 2024-12-26 2025-04-01 浙江吉利控股集团有限公司 Business data verification method, device, storage medium, and verification platform

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107451142A (en) * 2016-05-31 2017-12-08 北京京东尚科信息技术有限公司 The method and apparatus and its management system of data are write and inquired about in database
CN112860711A (en) * 2021-03-18 2021-05-28 杭州云灵科技有限公司 Data storage method and system and data query method and system

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107451142A (en) * 2016-05-31 2017-12-08 北京京东尚科信息技术有限公司 The method and apparatus and its management system of data are write and inquired about in database
CN112860711A (en) * 2021-03-18 2021-05-28 杭州云灵科技有限公司 Data storage method and system and data query method and system

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114723397A (en) * 2022-03-28 2022-07-08 阿里云计算有限公司 Flow execution method and device
CN118966902A (en) * 2024-08-13 2024-11-15 江苏臻云技术有限公司 A supplier portrait management system and method for manufacturing industry
CN119739545A (en) * 2024-12-26 2025-04-01 浙江吉利控股集团有限公司 Business data verification method, device, storage medium, and verification platform

Similar Documents

Publication Publication Date Title
US9922360B2 (en) Recommendations system
CN111951101B (en) Data checking method and device
CN100471113C (en) Post-cache substitution of blocks in cached content
CN113051269B (en) Form configuration method and device
CN113448990A (en) Quasi-real-time multi-dimensional data query method and device for unitized system
CN112163946A (en) Accounting processing method and device based on distributed transaction system
EP3020017A1 (en) Method and system for creating tax configuration templates
CN113297179A (en) Method and device for processing supervision submission data
CN103207882A (en) Shop visiting data processing method and system
CA2927580A1 (en) Method and system for document data extraction template management
CN113204558A (en) Method and device for automatically updating data table structure
US6631378B1 (en) Communication unit and communication method with profile management
CN110198327B (en) Data transmission method and related equipment
CN112003957A (en) Method, device, server and storage medium for scheduling access point
CN109767274B (en) Method and system for carrying out associated storage on massive invoice data
CN107798135A (en) Paging query method and device and electronic equipment
CN110309164B (en) Information updating method, device, equipment and computer readable storage medium
CN109255587A (en) A kind of cooperative processing method and device of operational data
CN113010443B (en) Database test data generation method and device based on financial core transaction scene
CN114579398A (en) Log storage method, device, equipment and storage medium
US20220391384A1 (en) Geographical location determination system
CN114092226A (en) Method and device for recommending foreign exchange products of bank outlets
CN113761053A (en) Data query method and device, electronic equipment and storage medium
CN114564637B (en) Information processing method and device
CN112416924B (en) Data synchronization query method, device, computer device and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination