CN109144992A - A kind of method and apparatus of data storage - Google Patents
A kind of method and apparatus of data storage Download PDFInfo
- Publication number
- CN109144992A CN109144992A CN201710451809.XA CN201710451809A CN109144992A CN 109144992 A CN109144992 A CN 109144992A CN 201710451809 A CN201710451809 A CN 201710451809A CN 109144992 A CN109144992 A CN 109144992A
- Authority
- CN
- China
- Prior art keywords
- stored
- data
- information
- caching
- characteristic information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 137
- 238000013500 data storage Methods 0.000 title claims abstract description 35
- 230000008569 process Effects 0.000 claims abstract description 82
- 230000001360 synchronised effect Effects 0.000 claims description 48
- 238000004590 computer program Methods 0.000 claims description 6
- 230000010354 integration Effects 0.000 claims description 3
- 238000005516 engineering process Methods 0.000 abstract description 3
- 230000006870 function Effects 0.000 description 16
- 238000010586 diagram Methods 0.000 description 11
- 230000000694 effects Effects 0.000 description 11
- 238000012545 processing Methods 0.000 description 8
- 230000001960 triggered effect Effects 0.000 description 8
- 230000026676 system process Effects 0.000 description 7
- 230000006854 communication Effects 0.000 description 6
- 238000004891 communication Methods 0.000 description 5
- 238000012217 deletion Methods 0.000 description 5
- 230000037430 deletion Effects 0.000 description 5
- 238000004321 preservation Methods 0.000 description 4
- 230000008439 repair process Effects 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 238000004140 cleaning Methods 0.000 description 3
- 230000005291 magnetic effect Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 235000014510 cooky Nutrition 0.000 description 2
- 238000000151 deposition Methods 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000002411 adverse Effects 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 238000013497 data interchange Methods 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 210000003127 knee Anatomy 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000002035 prolonged effect Effects 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses the method and apparatus of data storage, are related to field of computer technology.One specific embodiment of this method includes: to store data to be stored into caching；Message queue is added in the characteristic information of the data to be stored；The characteristic information is obtained from the message queue using the first process, and is searched data to be stored corresponding with the characteristic information and then stored into database.The embodiment can be improved data rate memory, promote the robustness of storage system.
Description
Technical field
The present invention relates to the method and apparatus that field of computer technology more particularly to a kind of data store.
Background technique
It obtains the data that user provides and carries out storing this process and be widely used in many business scenarios, for example,
It needs to obtain the registration informations such as the account name, password and mailbox of user in Account Registration, is stored so as to as offer
The foundation of service；The comment information for needing to obtain user when acquiring and commenting on, is stored to show in corresponding review pages
Face；In the personal information for carrying out needing to obtain user when personal information registration, stored in order to inquiring and authenticating.
The data that the scheme of the prior art directly provides user are stored into database, be in the operation of write-in database
These data can be called after success, and save successfully prompt to user feedback data.
In realizing process of the present invention, at least there are the following problems in the prior art for inventor's discovery: existing data are deposited
Method for storing has extremely strong dependence for the writing speed of database, and data need to write direct in database；On the one hand, exist
Under the high concurrent state that multi-user stores simultaneously, the writing speed of database is unable to satisfy demand, cause to occur it is waiting for a long time,
The problem of poor user experience or even data storage failure；On the other hand, the strong of storage system is led to for the dependence of database
Strong property is poor, will affect the normal operation of storage system if database goes wrong, or even the accident of loss of data occurs.
Summary of the invention
In view of this, the embodiment of the present invention provides a kind of method and apparatus of data storage, data storage speed can be improved
Degree, promotes the robustness of storage system.
To achieve the above object, according to an aspect of an embodiment of the present invention, a kind of method of data storage, packet are provided
It includes:
Data to be stored is stored into caching；
Message queue is added in the characteristic information of the data to be stored；
The characteristic information is obtained from the message queue using the first process, and is searched and the characteristic information pair
Then the data to be stored answered is stored into database.
Optionally, the data to be stored is equipped with status indication；The method also includes:
It after the step of obtaining the characteristic information in the message queue, is determined and the feature using the first process
The status indication of the corresponding data to be stored of information is not synchronize；And
After searching then step that data to be stored corresponding with the characteristic information is stored into database, by the shape
State label is to have synchronized by non-synchronous vacations.
Optionally, the method also includes:
After data to be stored is stored the step into caching, using described in the second procedure retrieval caching in described in wait deposit
Data are stored up, are that the not synchronous data to be stored is stored into the database by status indication.
Optionally, the method also includes:
After the step of message queue is added in the characteristic information of the data to be stored, searches and exist in the caching
Duration is greater than duration threshold value and status indication is the data to be stored synchronized and then is deleted from the caching.
Optionally, the method also includes:
Before the step of obtaining the characteristic information in the message queue, determining there is new feature using the first process
Information is added into the message queue, and determines that first process is idle.
Optionally, the method also includes:
After data to be stored to be stored to the step into caching, if it is determined that the data to be stored is not deposited successfully
Storage then stores the data to be stored into the database to the caching.
Optionally, the method also includes:
Before data to be stored to be stored to the step into caching, the every terms of information stored as needed generates structuring number
Data to be stored is obtained accordingly；And
Data to be stored, which is stored the step into caching, includes:
The data to be stored is parsed to obtain the every terms of information for needing to store, and the every terms of information is stored respectively
In corresponding data table into caching；
Searching then step that data to be stored corresponding with the characteristic information is stored into database includes:
Data to be stored corresponding with the characteristic information is searched, parses the data to be stored then to obtain needing depositing
The every terms of information of storage, and the every terms of information is stored respectively in the corresponding data table into database.
Optionally, it is described to it is data cached include registration information and/or relevant information；The registration information includes user
At least one of in name, password, the pet name, mobile phone and mailbox, the relevant information includes handset binding state, mailbox binding shape
At least one of in state, unbundlings user name, grade, source, registion time and registration IP；The caching is that Redis is cached.
To achieve the above object, other side according to an embodiment of the present invention provides a kind of device of data storage,
Include:
Cache memory module, for storing data to be stored into caching；
Message adding module, for message queue to be added in the characteristic information of the data to be stored；
First synchronization module, for using the first process to obtain the characteristic information, Yi Jicha from the message queue
Data to be stored corresponding with the characteristic information is looked for then to store into database.
Optionally, the data to be stored is equipped with status indication；
First synchronization module is also used to determine that the status indication of data to be stored corresponding with the characteristic information is
It does not synchronize；And after searching data to be stored corresponding with the characteristic information and then storing into database, by the state
Label is to have synchronized by non-synchronous vacations.
Optionally, described device further include:
Status indication is not synchronous for retrieving the data to be stored in the caching by the second synchronization module
The data to be stored is stored into the database.
Optionally, described device further include:
Removing module, length is greater than duration threshold value in the presence of for searching in the caching and status indication is to have synchronized
Then the data to be stored is deleted from the caching.
Optionally, first synchronization module is also used to, described in being obtained from the message queue using the first process
Before characteristic information, determining has new characteristic information to be added into the message queue, and determines that first process is idle.
Optionally, described device further include:
Cache memory module, for if it is determined that the data to be stored is not successfully stored to the caching, then will
The data to be stored is stored into the database.
Optionally, described device further include:
Data Integration module, the every terms of information for storing as needed generate structural data to obtain number to be stored
According to；
The cache memory module is also used to parse the data to be stored to obtain the every terms of information for needing to store, and
The every terms of information is stored respectively in the corresponding data table into caching；
First synchronization module is also used to search data to be stored corresponding with the characteristic information, then described in parsing
Data to be stored stores the correspondence into database to obtain the every terms of information for needing to store, and by the every terms of information respectively
In tables of data.
Optionally, it is described to it is data cached include registration information and/or relevant information；The registration information includes user
At least one of in name, password, the pet name, mobile phone and mailbox, the relevant information includes handset binding state, mailbox binding shape
At least one of in state, unbundlings user name, grade, source, registion time and registration IP；The caching is that Redis is cached.
To achieve the above object, another aspect according to an embodiment of the present invention provides a kind of electronics of data storage
Equipment, comprising:
One or more processors；
Storage device, for storing one or more programs,
When one or more of programs are executed by one or more of processors, so that one or more of processing
Device is at least realized:
Data to be stored is stored into caching；
Message queue is added in the characteristic information of the data to be stored；
The characteristic information is obtained from the message queue using the first process, and is searched and the characteristic information pair
Then the data to be stored answered is stored into database.
To achieve the above object, another aspect according to an embodiment of the present invention provides a kind of computer-readable medium,
On be stored with computer program, at least realized when described program is executed by processor:
Data to be stored is stored into caching；
Message queue is added in the characteristic information of the data to be stored；
The characteristic information is obtained from the message queue using the first process, and is searched and the characteristic information pair
Then the data to be stored answered is stored into database.
One embodiment in foregoing invention has the following advantages that or the utility model has the advantages that because uses data to be stored head
It first stores to caching, is then gradually stored data to be stored using distributed process to the technological means of database, one side
Using the high read or write speed of caching, reduce be reflected in user side data storage it is time-consuming, improve user experience, and can be with
The problems such as avoiding the data exception and storage failure under the conditions of high concurrent, has reached the technology effect for improving data rate memory
Fruit increases the form of data storage, is gone by this on the other hand by the secondary storage structure of setting caching and database
The mode of coupling improves data storage efficiency, even if the either side in caching and database goes wrong, can also repair
Another party is relied on during multiple and exercises normal store function, has reached the technical effect for improving system robustness.
Further effect possessed by above-mentioned non-usual optional way adds hereinafter in conjunction with specific embodiment
With explanation.
Detailed description of the invention
Attached drawing for a better understanding of the present invention, does not constitute an undue limitation on the present invention.Wherein:
Fig. 1 is the schematic diagram of the key step of the method for data storage according to an embodiment of the present invention；
Fig. 2 be the embodiment of the present invention data storage method be applied to user's registration scene when key step signal
Figure；
Fig. 3 is the schematic diagram of the main modular of the device of data storage according to an embodiment of the present invention；
Fig. 4 is that the embodiment of the present invention can be applied to exemplary system architecture figure therein；
Fig. 5 is adapted for the structural representation of the computer system for the terminal device or server of realizing the embodiment of the present invention
Figure.
Specific embodiment
Below in conjunction with attached drawing, an exemplary embodiment of the present invention will be described, including the various of the embodiment of the present invention
Details should think them only exemplary to help understanding.Therefore, those of ordinary skill in the art should recognize
It arrives, it can be with various changes and modifications are made to the embodiments described herein, without departing from scope and spirit of the present invention.Together
Sample, for clarity and conciseness, descriptions of well-known functions and structures are omitted from the following description.
Fig. 1 is the schematic diagram of the key step of the method for data storage according to an embodiment of the present invention.
As shown in Figure 1, a kind of method of data storage provided according to an embodiment of the present invention, comprising:
S10 stores data to be stored into caching.Data to be stored is to be stored and not yet stored to data
Data in library, this step store data to be stored first into caching, are higher than database using the writing speed of caching
The characteristics of writing speed, improves the speed of data storage；After data to be stored is stored into caching, it can be checked or be adjusted
With, therefore it is presented as that data have been stored in user side, to substantially increase the corresponding speed of business, shorten user's
Waiting time promotes user experience.
Message queue is added in the characteristic information of the data to be stored by S11.The characteristic information of data to be stored be with to
The unique corresponding information of storing data can uniquely retrieve corresponding data to be stored by characteristic information.
Characteristic information can be one/several information in data to be stored, be also possible to that other are obtained by certain way with to
The unique corresponding information of storing data；For example, Hash operation can be carried out to data to be stored to obtain condition code, with this feature
Code is used as key, key-value pair storage is carried out using data to be stored as value, at this time then using this feature code as the characteristic information.Disappear
Breath queue is the queue of a first in, first out formula, for storing characteristic information, so that characteristic information is performed process as task
(such as first process and the second process hereinafter) is extracted to complete.
S12 obtains the characteristic information using the first process from the message queue, and searches and believe with the feature
It ceases corresponding data to be stored and then stores into database.First process be distinguish in this present embodiment execute step S10 and
Another distributed process of the system process of S11, i.e. system process can constantly repeat step S10 and S11, constantly will be wait deposit
Storage data store to caching and add task in message queue, and the first process is then triggered under certain condition, with system process
Then asynchronous operation gets characteristic information from message queue and executes corresponding data store tasks.It should be noted that institute
Stating database is the database using traditional magnetic hard-disk or solid state hard disk as storage medium.
The condition that first process is triggered, which can be, detects that message queue and the first process is added in new characteristic information
It is idle；After first process is triggered, the progress of one or more features information can be disposably taken out according to the sequence of message queue
Processing will not trigger the first process and take again during the treatment if there is new characteristic information that message queue is added again
Characteristic information out, but after the corresponding data to be stored of the characteristic information taken out is disposed by the first process, next
Secondary characteristic information is triggered when being added into message queue.The reason of being arranged in this way is the characteristic information pair in message queue
The data to be stored answered has been stored in caching for checking and calling, therefore suitably delaying to write database manipulation will not be right
Normal service has an impact；In order to save the write-in resource and computing resource of database as far as possible, gradually using 1 treatment progress
Data to be stored is written in database.It certainly, can be with if the write-in resource and computing resource of database have a margin
2 or 2 or more the first processes are set, by set interval or message queue in the trigger conditions such as number of tasks, will
Information to be stored in deposit message queue substantially evenly distributes to these the first processes, to further increase number to be stored
According to the speed of write-in database.
In addition to the message queue, in some alternative embodiments, the present embodiment, which can also be arranged, has consumed queue,
After taking out the task comprising characteristic information in message queue, which removes first process from message queue；First process
After being disposed, task deposit is consumed in queue, to realize the cleaning for message queue.Having consumed queue can be with
For carrying out quality examination, such as check by way of selection whether is the corresponding data to be stored of characteristic information in each task
It has been stored in database.Cleaning can also be executed to having consumed queue as needed.
The caching should have higher data read-write efficiency, and can satisfy the requirement of distributed data processing；
Optionally, the caching can be the Redis database configured based on memory.The message queue should have first in, first out
Data access logic keeps the processing time-consuming of each task average as far as possible to guarantee fairness；Optionally, the message queue can be with
It is MQ (Message Queue, message queue), such as can be the MQ built in Redis database；The characteristic information quilt at this time
It is stored in message-oriented middleware used in MQ and is then added to MQ；Correspondingly, when the message queue is MQ, described first
Process is the worker process cooperated with MQ.
From the above it can be seen that the method for the data storage provided according to an embodiment of the present invention, because using
Data to be stored is stored to caching first, is then gradually stored data to be stored to database using distributed process
Technological means reduces the data storage time-consuming for being reflected in user side, improves use on the one hand using the high read or write speed of caching
Family experience, and to avoid data exception under the conditions of high concurrent and the problems such as failing can be stored, reach raising data and has deposited
The technical effect of speed is stored up, on the other hand by the secondary storage structure of setting caching and database, increases data storage
Form improves data storage efficiency by way of this uncoupling, reduces dependence of the data write-in manipulation to database
Property, even if the either side in caching and database goes wrong, another party can also be relied in repair process and is exercised normally
Store function, reached improve system robustness technical effect.
In some alternative embodiments, the data to be stored is equipped with status indication；The method also includes:
It after the step of obtaining the characteristic information in the message queue, is determined and the feature using the first process
The status indication of the corresponding data to be stored of information is not synchronize；And
After searching then step that data to be stored corresponding with the characteristic information is stored into database, by the shape
State label is to have synchronized by non-synchronous vacations.
The present embodiment, which further provides, judges whether data to be stored has completed synchronous method.Wherein, the shape
State label is that uniquely corresponding label, status indication have at least two diacritic states, be respectively intended to data to be stored
Mark its corresponding data to be stored not yet synchronous and synchronized.For example, can be stored by an interim table wait store
Data and its status indication, are arranged 2 fields in interim table, and one of field stores data to be stored, another field
Be used to store status indication, status indication can be set to 0 and 1, respectively indicate data to be stored do not synchronize with it is synchronous.
In some alternative embodiments, the method also includes:
After data to be stored is stored the step into caching, using described in the second procedure retrieval caching in described in wait deposit
Data are stored up, are that the not synchronous data to be stored is stored into the database by status indication.
The characteristic information being stored in message queue in order to prevent is abnormal or loses, and improves the serious forgiveness of storage system and is good for
Strong property, the present embodiment check the data to be stored in caching by the second process, if it find that having in not synchronous shape
The data to be stored of state, then stored into database；Second process is similarly distributed treatment process, can be with the system
System process and the first process asynchronous operation, second process for example can be the worker process with MQ cooperation.The
The trigger condition of two processes can be prefixed time interval, for example, the second process can be set to every 1 hour, 12 hours or
It is triggered within 24 hours primary；The trigger condition of second process can also be the characteristic information quantity that message queue receives, such as
It is triggered when message queue receives 500 characteristic informations, so as to adapt to service pressure, has found that it is likely that appearance in time
Mistake.
In some alternative embodiments, the method also includes:
After the step of message queue is added in the characteristic information of the data to be stored, searches and exist in the caching
Duration is greater than duration threshold value and status indication is the data to be stored synchronized and then is deleted from the caching.
The present embodiment further provides the method cleared up caching.In the present embodiment, what is saved in caching is
Data to be stored, can be to being stored in data in order to improve the calling speed of user data in some other embodiment
Before user data in library is operated, user data is read from database first and is stored into caching, needed again in this way
It can be directly called from caching when secondary calling user data, to improve the speed of data call.Either which kind of mode,
The amount of data to be stored or user data in caching can be more and more huger with the use of system, is limited to memory capacity limit
System, needs to clear up the data in caching.
The present embodiment be provided with threshold value duration, preset time (such as daily moment in morning) retrieval caching in wait cache
Data, and will existing duration is greater than threshold value duration (such as 3 days) in the buffer and status indication is the number to be cached synchronized
According to deletion.So it can either guarantee not being synchronized to will not being deleted to data cached for database, and can control caching
Capacity occupy.In addition, in the present embodiment, after data to be stored is stored into caching, can simultaneously by storage time with to
Storing data is associated preservation, so as to subsequent calculating data to be stored existing duration in the buffer.
In some alternative embodiments, the method also includes:
After data to be stored to be stored to the step into caching, if it is determined that the data to be stored is not deposited successfully
Storage then stores the data to be stored into the database to the caching.It, can when caching is written in data to be stored
To judge whether to be written successfully according to the return value of the function used；If be not successfully written, in order to ensure that data will not
It loses, directly data to be stored is written in database.
In other optional embodiments, can not also it be successfully stored determining the data to be stored to institute
When stating caching, carries out primary or multiple write buffer and attempt, if still cannot succeed, then the data to be stored is deposited
Storage is into the database.
In some alternative embodiments, the method also includes:
Before data to be stored to be stored to the step into caching, the every terms of information stored as needed generates structuring number
Data to be stored is obtained accordingly；And
Data to be stored, which is stored the step into caching, includes:
The data to be stored is parsed to obtain the every terms of information for needing to store, and the every terms of information is stored respectively
In corresponding data table into caching；
Searching then step that data to be stored corresponding with the characteristic information is stored into database includes:
Data to be stored corresponding with the characteristic information is searched, parses the data to be stored then to obtain needing depositing
The every terms of information of storage, and the every terms of information is stored respectively in the corresponding data table into database.
The present embodiment, which is directed to, to be needed to be optimized using the data that multiple tables of data are stored；When total appearance of data
When measuring identical, containing multinomial information and the storage speed of data that every terms of information needs to be stored respectively to different tables of data, phase
It is slow for only having the storage speed of the data of an information, such as user's registration, user information registration, questionnaire tune
Look into etc., belong to this kind of scene.In this regard, the present embodiment will need first the every terms of information that stores be integrated into one (if there is
Need to be integrated into two or multinomial, the principle that should be followed is to reduce the project sum for needing to store) structuring number
According to and stored, specifically, obtained data to be stored can be stored into database, write tables of data due to reducing
Quantity, therefore a large amount of time can be saved for data are written in multiple tables of data directly into database；Except this
Except, the data to be stored can also be stored in the buffer, the time can be further saved relative to write-in database.
In the present embodiment, for containing multinomial information, the data for needing to be stored using multiple tables of data, in order to make
It can be checked and be called when storing in the buffer, be provided in the buffer in database it is the same or similar respectively and respectively
The corresponding multiple tables of data of item information are generated according to the every terms of information first after getting the every terms of information for needing to store
The data to be stored of structuring and preservation store successful message to user feedback after preservation finishes；Then, it parses wait store
Data and respectively by it includes every terms of information store into caching in corresponding tables of data, thus make caching realize and database
Identical function.It can be seen that the present embodiment execute speed on relative to directly to database write-in have very big advantage, especially
Speed when storage entry data is further improved, will can quickly store successful message feedback to user.
In subsequent synchronisation to the database the step of, when data to be stored is further stored into database, solve again
The structural data is analysed to obtain the every terms of information for needing to store, it is right then respectively to store the every terms of information into database
In the tables of data answered.Alternatively, data can also be obtained directly from each tables of data in caching and the correspondence number of database is written
According in table.
Current embodiment require that the every terms of information of storage is integrated into single structural data and carries out transimission and storage, relatively
The time can be saved in storage every terms of information respectively.Wherein, structural data refers to using the preservation of certain data interchange format
Data, such as the data saved with JSON format or XML format.
In some alternative embodiments, application scenarios of the invention are user's registration, including new user's registration, mailbox/
Phone number binding and unbundlings etc., it is described to it is data cached include registration information and/or relevant information；The registration information includes
At least one of in user name, password, the pet name, mobile phone and mailbox, the relevant information includes handset binding state, mailbox binding
At least one of in state, unbundlings user name, grade, source, registion time and registration IP；The caching is that Redis is cached.
The application method of technical solution in order to further illustrate the present invention, below by a specific embodiment to this
Inventive method is described in detail.
Fig. 2 be the embodiment of the present invention data storage method be applied to user's registration scene when key step signal
Figure.
The application scenarios of the present embodiment are user's registration, including new user's registration, mailbox/phone number binding and unbundlings
Deng.It needs to save to the information of server when user's registration to generally comprise: as the user name of registration information, password, the pet name, hand
Machine and mailbox etc., and the handset binding state as relevant information, mailbox binding state, unbundlings user name, grade, source,
Registion time and registration IP etc..
As shown in Fig. 2, when being applied to user's registration scene, which comprises
Check value and expired time are written into the cookie of user terminal when user terminal accesses enrollment page by S200, and
The check value and the expired time are saved in server-side.By the registration information of user and relevant information store to caching or
In database, and when verification user name, phone number, mailbox etc. or other process steps, first from the cookie of user terminal
It is middle to obtain the check value and expired time, and it is compared with the check value of server-side and expired time, however, it is determined that it uses
The check value at family end and the check value of server-side are identical, and determine that the check value of user terminal is not out of date according to expired time, then into
One step executes process.Otherwise stop follow-up process, and return to the prompt informations such as registration failure to user terminal.The function of step S200
It is filtering fallacious user, malicious registration can be prevented.
S201 obtains the user data comprising registration information and relevant information that user terminal is sent, then by the user
(user data and the structural data generated according to user data correspond to the number to be stored in previous embodiment to data
According to) be written with JSON format in the data field of interim table；It further include status flag field in interim table, the value of the field is 0
Perhaps 1 information for respectively indicating in same interim table in data field is not yet synchronized in database or has been synchronized to number
It is 0 according to the initial value that status flag field in library, is arranged.Interim table for temporarily saving user data and its state in the buffer
Label, can be also used for saving other information relevant to user data.Interim table can give birth to when needing to save user data
At.
S202, judges whether user data is successfully written interim table.S203 is thened follow the steps if not, if executing step
S204 and S207.
S203 is registered to client feeds back and is lost if interim table successfully is not written in user data and status indication
The prompt information lost.Interim table can save in the database, can also save in the buffer.
S204 succeeds in registration if interim table successfully is written in user data and status indication to client feeds back
Prompt information, and execute the instruction user data in the interim table stored into Redis caching.Further, will face
When table in user data store to Redis cache, the data field in interim table can be parsed to obtain registration information and correlation
Then information respectively stores projects in registration information and relevant information to the corresponding data being arranged in Redis caching
In table.Tables of data includes such as Basic Information Table, extension information table, log-on message table, mobile phone concordance list, mailbox concordance list, ID
Concordance list, pet name concordance list, registration correlation table, change_log log sheet etc., every terms of information is in a manner of key-value pair in correspondence
Tables of data in store respectively.
S205 judges whether successfully to store the interim table into Redis caching or in database.If otherwise executing step
Rapid S206；It is cached successfully if then determining and writing Redis.
S206 parses the data field of the interim table to obtain registration information and relevant information, and by the registration
Every terms of information in information and the relevant information is stored into database in corresponding tables of data.I.e. successfully will not be interim
Table store to Redis caching in and database in when, then execute database write enter process, data directly are written into every terms of information
In library, to prevent loss of data.
The corresponding characteristic information of user data is added in message-oriented middleware S207, and it is flat to MQ to send the message-oriented middleware
Platform stores message-oriented middleware addition message queue.Characteristic information be with the one-to-one information of user data, i.e., it is logical
One group of user data can be uniquely determined by crossing characteristic information.Characteristic information for example can be user name when registration.
Above-mentioned steps S200 to S207 is executed by system process, the quantity of system process and with no restrictions, i.e. S200 is extremely
Step S207 can be completed jointly by the system process of different number, and after step S207 is finished, message-oriented middleware is sent out
It send to MQ platform, and is added in message queue.If synchronized process (corresponding to the first process in previous embodiment) is idle at this time,
The event that can be then added by message-oriented middleware triggers, and starts to execute synchronous process.
S208, synchronized process obtain the message-oriented middleware of preset quantity from message queue.It is synchronous in order to improve treatment effeciency
Process, which can be configured as, once takes out multiple message-oriented middlewares, i.e., once synchronizes to multiple groups user data.
S209, the characteristic information that synchronized process includes according to message-oriented middleware are searched in Redis caching or in database
Interim table corresponding with this feature information.
S210, synchronized process judge whether the status flag field in the interim table is 0.If status flag field is 0,
It determines that the user data in interim table is not yet synchronized, then executes step S211；If status flag field is 1, it is determined that face
When table in user data be synchronized, if still there is untreated message-oriented middleware, continue to handle, otherwise can be temporary
Stop activity waiting to be triggered again.
S211, synchronized process parse the data field of the interim table to obtain registration information and relevant information, and will
Every terms of information in the registration information and the relevant information is stored into database in corresponding tables of data, so as to by user
Data are synchronized in database.
S212 judges whether to synchronize success.If so, thening follow the steps S213；If it is not, then terminating.In addition, synchronously completing
Afterwards, the every terms of information in the registration information and the relevant information can also be stored further to Redis and be delayed by synchronized process
It deposits in corresponding tables of data, Redis caching was in fact had been written into step S204, guarantee that user's registration is complete
Any function in normal operating front end writes the case where write buffer fails when primary caching is in order to for front registration again here and does one
Secondary leak repairing.
The status flag field of interim table is revised as 1 by S213.
Above-mentioned steps S208 to S213 is synchronized process by the key step of user data synchronization to database.Optionally,
After synchronized process completes the corresponding synchronous working of a message-oriented middleware, which can also be added and disappeared
Take in queue, having consumed queue can be used to carry out quality examination, such as the feature in each task is checked by way of selection
Whether the corresponding data to be stored of information has been stored in database.Cleaning can also be executed to having consumed queue as needed.
In addition, step S208 to S213 is the process that synchronized process synchronizes the corresponding user data of a message-oriented middleware, when
When synchronized process once gets multiple message-oriented middlewares, repeat step S208 to S213 until all message-oriented middleware all by
It is disposed.
In above-mentioned steps, even if step S212 judgement does not synchronize success, synchronized process can also terminate this subtask, therefore
It is likely to occur the case where user data being not yet synchronized does not establish task but in message queue；Furthermore in some unexpected feelings
Under condition, it is also possible to the problems such as message-oriented middleware loss occur, above situation can all cause the user data in caching can not be by
It is synchronized in database.
For this problem, the present embodiment is further provided with retrieval process；Retrieval process can be configured as timing and touch
Hair, also can be configured as triggering when message queue new task number reaches certain amount, after triggering, retrieval process can be retrieved
Status indication is interim table that field is 0 in Redis caching, and by the user data synchronization in these interim tables to database
In.By the way that retrieval process is arranged, the serious forgiveness of method is improved.
In addition, having an adverse effect in order to avoid the ephemeral data in caching is excessive, the present embodiment is also optional to be provided with
Deletion process.Deletion process is similar with retrieval process, can be configured as that clocked flip, also to can be configured as task queue new
Triggering when number of tasks reaches certain amount.On triggering, deletion process can Redis caching in choose creation time away from it is current when
Between more than preset duration (preset duration is configured according to traffic pressure, and traffic pressure hour preset duration can be longer, retain compared with
It is prolonged user data, on the contrary then shorter) interim table and it is deleted from Redis caching.It, can be with if deleting failure
Carry out limited times to retry, not reprocessed if still can not being deleted after retrying, when next deletion process is triggered again into
Row processing.
Fig. 3 is the schematic diagram of the main modular of the device of data storage according to an embodiment of the present invention.
As shown, the device 300 of the data storage provided according to an embodiment of the present invention, comprising:
Cache memory module 301, for storing data to be stored into caching；
Message adding module 302, for message queue to be added in the characteristic information of the data to be stored；
First synchronization module 303, for using the first process to obtain the characteristic information from the message queue, and
Data to be stored corresponding with the characteristic information is searched then to store into database.
Optionally, the data to be stored is equipped with status indication；
First synchronization module 303 is also used to determine the status indication of data to be stored corresponding with the characteristic information
Not synchronize；And after searching data to be stored corresponding with the characteristic information and then storing into database, by the shape
State label is to have synchronized by non-synchronous vacations.
Optionally, described device 300 further include:
Status indication is not synchronize for retrieving the data to be stored in the caching by the second synchronization module 304
The data to be stored store into the database.
Optionally, described device 300 further include:
Removing module 305, it is long in the presence of for being searched in the caching to be greater than duration threshold value and status indication is together
Then the data to be stored of step is deleted from the caching.
Optionally, first synchronization module 303 is also used to, and institute is being obtained from the message queue using the first process
Before stating characteristic information, determining has new characteristic information to be added into the message queue, and determines that first process is idle.
Optionally, described device 300 further include:
Cache memory module 306, for if it is determined that the data to be stored is not successfully stored to the caching, then
The data to be stored is stored into the database.
Optionally, described device 300 further include:
Data Integration module 307, the every terms of information for storing as needed generate structural data to obtain wait store
Data, and when needed save the data to be stored of the structuring into database and/or caching；
The cache memory module 301 is also used to parse the data to be stored to obtain needing the every terms of information that stores,
And the every terms of information is stored respectively in the corresponding data table into caching；
First synchronization module 303 is also used to search data to be stored corresponding with the characteristic information, then parses
The data to be stored is stored into database respectively to obtain the every terms of information for needing to store, and by the every terms of information
In corresponding data table.
Optionally, it is described to it is data cached include registration information and/or relevant information；The registration information includes user
At least one of in name, password, the pet name, mobile phone and mailbox, the relevant information includes handset binding state, mailbox binding shape
At least one of in state, unbundlings user name, grade, source, registion time and registration IP；The caching is that Redis is cached.
From the above it can be seen that the device of the data storage provided according to an embodiment of the present invention, because using
Data to be stored is stored to caching first, is then gradually stored data to be stored to database using distributed process
Technological means reduces the data storage time-consuming for being reflected in user side, improves use on the one hand using the high read or write speed of caching
Family experience, and to avoid data exception under the conditions of high concurrent and the problems such as failing can be stored, reach raising data and has deposited
The technical effect of speed is stored up, on the other hand by the secondary storage structure of setting caching and database, increases data storage
Form improves data storage efficiency by way of this uncoupling, reduces dependence of the data write-in manipulation to database
Property, even if the either side in caching and database goes wrong, another party can also be relied in repair process and is exercised normally
Store function, reached improve system robustness technical effect.
Fig. 4 is shown can be using the exemplary of the device for the method or data storage that the data of the embodiment of the present invention store
System architecture 400.
As shown in figure 4, system architecture 400 may include terminal device 401,402,403, network 404 and server 405.
Network 404 between terminal device 401,402,403 and server 405 to provide the medium of communication link.Network 404 can be with
Including various connection types, such as wired, wireless communication link or fiber optic cables etc..
User can be used terminal device 401,402,403 and be interacted by network 404 with server 405, to receive or send out
Send message etc..Various telecommunication customer end applications, such as the application of shopping class, net can be installed on terminal device 401,402,403
The application of page browsing device, searching class application, instant messaging tools, mailbox client, social platform software etc..
Terminal device 401,402,403 can be the various electronic equipments with display screen and supported web page browsing, packet
Include but be not limited to smart phone, tablet computer, pocket computer on knee and desktop computer etc..
Server 405 can be to provide the server of various services, such as utilize terminal device 401,402,403 to user
The website browsed provides the background server that user's registration is supported.Background server can be to the user's registration data received
It is stored, and user data is fed back into terminal device when needed.
It should be noted that the method for the storage of data provided by the embodiment of the present invention is generally executed by server 405, phase
The device of Ying Di, data storage are generally positioned in server 405.
It should be understood that the number of terminal device, network and server in Fig. 4 is only schematical.According to realization need
It wants, can have any number of terminal device, network and server.
According to an embodiment of the invention, the present invention also provides a kind of electronic equipment and a kind of readable storage medium storing program for executing.
Fig. 5 is adapted for the structural representation of the computer system for the terminal device or server of realizing the embodiment of the present invention
Figure.
Below with reference to Fig. 5, it illustrates the computer systems 500 for the terminal device for being suitable for being used to realize the embodiment of the present invention
Structural schematic diagram.Terminal device shown in Fig. 5 is only an example, function to the embodiment of the present invention and should not use model
Shroud carrys out any restrictions.
As shown in figure 5, computer system 500 includes central processing unit (CPU) 501, it can be read-only according to being stored in
Program in memory (ROM) 502 or be loaded into the program in random access storage device (RAM) 503 from storage section 508 and
Execute various movements appropriate and processing.In RAM 503, also it is stored with system 500 and operates required various programs and data.
CPU 501, ROM 502 and RAM 503 are connected with each other by bus 504.Input/output (I/O) interface 505 is also connected to always
Line 504.
I/O interface 505 is connected to lower component: the importation 506 including keyboard, mouse etc.；It is penetrated including such as cathode
The output par, c 507 of spool (CRT), liquid crystal display (LCD) etc. and loudspeaker etc.；Storage section 508 including hard disk etc.；
And the communications portion 509 of the network interface card including LAN card, modem etc..Communications portion 509 via such as because
The network of spy's net executes communication process.Driver 510 is also connected to I/O interface 505 as needed.Detachable media 511, such as
Disk, CD, magneto-optic disk, semiconductor memory etc. are mounted on as needed on driver 510, in order to read from thereon
Computer program be mounted into storage section 508 as needed.
Particularly, according to an embodiment of the invention, the process of the schematic diagram description of key step may be implemented as above
Computer software programs.For example, the embodiment of the present invention includes a kind of computer program product comprising being carried on computer can
The computer program on medium is read, which includes the program for executing method shown in the schematic diagram of key step
Code.In such embodiments, which can be downloaded and installed from network by communications portion 509, and/
Or it is mounted from detachable media 511.When the computer program is executed by central processing unit (CPU) 501, the present invention is executed
System in the above-mentioned function that limits.
It should be noted that computer-readable medium shown in the present invention can be computer-readable signal media or meter
Calculation machine readable storage medium storing program for executing either the two any combination.Computer readable storage medium for example can be --- but not
Be limited to --- electricity, magnetic, optical, electromagnetic, infrared ray or semiconductor system, device or device, or any above combination.Meter
The more specific example of calculation machine readable storage medium storing program for executing can include but is not limited to: have the electrical connection, just of one or more conducting wires
Taking formula computer disk, hard disk, random access storage device (RAM), read-only memory (ROM), erasable type may be programmed read-only storage
Device (EPROM or flash memory), optical fiber, portable compact disc read-only memory (CD-ROM), light storage device, magnetic memory device,
Or above-mentioned any appropriate combination.In the present invention, computer readable storage medium can be it is any include or storage journey
The tangible medium of sequence, the program can be commanded execution system, device or device use or in connection.And at this
In invention, computer-readable signal media may include in a base band or as carrier wave a part propagate data-signal,
Wherein carry computer-readable program code.The data-signal of this propagation can take various forms, including but unlimited
In electromagnetic signal, optical signal or above-mentioned any appropriate combination.Computer-readable signal media can also be that computer can
Any computer-readable medium other than storage medium is read, which can send, propagates or transmit and be used for
By the use of instruction execution system, device or device or program in connection.Include on computer-readable medium
Program code can transmit with any suitable medium, including but not limited to: wireless, electric wire, optical cable, RF etc. are above-mentioned
Any appropriate combination.
Flow chart and block diagram in attached drawing are illustrated according to the system of various embodiments of the invention, method and computer journey
The architecture, function and operation in the cards of sequence product.In this regard, each box in flowchart or block diagram can generation
A part of one module, program segment or code of table, a part of above-mentioned module, program segment or code include one or more
Executable instruction for implementing the specified logical function.It should also be noted that in some implementations as replacements, institute in box
The function of mark can also occur in a different order than that indicated in the drawings.For example, two boxes succeedingly indicated are practical
On can be basically executed in parallel, they can also be executed in the opposite order sometimes, and this depends on the function involved.Also it wants
It is noted that the combination of each box in block diagram or flow chart and the box in block diagram or flow chart, can use and execute rule
The dedicated hardware based systems of fixed functions or operations is realized, or can use the group of specialized hardware and computer instruction
It closes to realize.
Being described in module involved in the embodiment of the present invention can be realized by way of software, can also be by hard
The mode of part is realized.Described module also can be set in the processor, for example, can be described as: a kind of processor packet
Include cache memory module, message adding module and the first synchronization module.Wherein, the title of these modules is not under certain conditions
Restriction to the module itself is constituted, for example, message adding module is also described as " for by the data to be stored
Message queue is added in characteristic information ".
As on the other hand, the present invention also provides a kind of computer-readable medium, which be can be
Included in equipment described in above-described embodiment；It is also possible to individualism, and without in the supplying equipment.Above-mentioned calculating
Machine readable medium carries one or more program, when said one or multiple programs are executed by the equipment, makes
Obtaining the equipment includes:
Data to be stored is stored into caching；
Message queue is added in the characteristic information of the data to be stored；
The characteristic information is obtained from the message queue using the first process, and is searched and the characteristic information pair
Then the data to be stored answered is stored into database.
Technical solution according to an embodiment of the present invention stores data to be stored because using to caching, then first
Data to be stored is gradually stored to the technological means of database using distributed process, on the one hand utilizes the high read-write speed of caching
Degree reduces the data storage time-consuming for being reflected in user side, improves user experience, and can be to avoid under the conditions of high concurrent
Data exception and storage failure the problems such as, reached improve data rate memory technical effect, on the other hand pass through setting
The secondary storage structure of caching and database increases the form of data storage, improves number by way of this uncoupling
According to storage efficiency, data write-in manipulation is reduced to the dependence of database, even if the either side in caching and database goes out
Existing problem can also rely on another party in repair process and exercise normal store function, reach and improved system robustness
Technical effect.
Above-mentioned specific embodiment, does not constitute a limitation on the scope of protection of the present invention.Those skilled in the art should be bright
It is white, design requirement and other factors are depended on, various modifications, combination, sub-portfolio and substitution can occur.It is any
Made modifications, equivalent substitutions and improvements etc. within the spirit and principles in the present invention, should be included in the scope of the present invention
Within.
Claims (18)
1. a kind of method of data storage characterized by comprising
Data to be stored is stored into caching；
Message queue is added in the characteristic information of the data to be stored；
The characteristic information is obtained from the message queue using the first process, and is searched corresponding with the characteristic information
Then data to be stored is stored into database.
2. the method according to claim 1, wherein the data to be stored is equipped with status indication；It is described
Method further include:
It after the step of obtaining the characteristic information in the message queue, is determined and the characteristic information using the first process
The status indication of corresponding data to be stored is not synchronize；And
After searching then step that data to be stored corresponding with the characteristic information is stored into database, by the state mark
Note is to have synchronized by non-synchronous vacations.
3. according to the method described in claim 2, it is characterized in that, the method also includes:
After data to be stored is stored the step into caching, using described in the second procedure retrieval caching in described in number to be stored
According to the data to be stored by status indication for not synchronization is stored into the database.
4. according to the method described in claim 2, it is characterized in that, the method also includes:
After the step of message queue is added in the characteristic information of the data to be stored, there are durations for lookup in the caching
Greater than duration threshold value and status indication is the data to be stored synchronized and then is deleted from the caching.
5. the method according to claim 1, wherein the method also includes:
Before the step of obtaining the characteristic information in the message queue, determining there is new characteristic information using the first process
It is added into the message queue, and determines that first process is idle.
6. the method according to claim 1, wherein the method also includes:
After data to be stored to be stored to the step into caching, if it is determined that the data to be stored be not successfully stored to
The caching then stores the data to be stored into the database.
7. the method according to claim 1, wherein the method also includes:
Before data to be stored to be stored to the step into caching, the every terms of information that stores as needed generate structural data with
Obtain data to be stored；And
Data to be stored, which is stored the step into caching, includes:
The data to be stored is parsed to obtain the every terms of information for needing to store, and the every terms of information is stored respectively to slow
In the corresponding data table deposited；
Searching then step that data to be stored corresponding with the characteristic information is stored into database includes:
Corresponding with characteristic information data to be stored is searched, the data to be stored is then parsed and is stored with obtaining needs
Every terms of information, and the every terms of information is stored respectively in the corresponding data table into database.
8. the method according to claim 1, wherein it is described to it is data cached include registration information and/or correlation
Information；The registration information includes at least one in user name, password, the pet name, mobile phone and mailbox, and the relevant information includes
At least one of in handset binding state, mailbox binding state, unbundlings user name, grade, source, registion time and registration IP；
The caching is that Redis is cached.
9. a kind of device of data storage characterized by comprising
Cache memory module, for storing data to be stored into caching；
Message adding module, for message queue to be added in the characteristic information of the data to be stored；
First synchronization module, for using the first process to obtain the characteristic information from the message queue, and search with
Then the corresponding data to be stored of the characteristic information is stored into database.
10. device according to claim 9, which is characterized in that the data to be stored is equipped with status indication；
First synchronization module is also used to determine that the status indication of data to be stored corresponding with the characteristic information is not same
Step；And after searching data to be stored corresponding with the characteristic information and then storing into database, by the status indication
It is to have synchronized by non-synchronous vacations.
11. device according to claim 10, which is characterized in that described device further include:
Status indication is described in synchronization for retrieving the data to be stored in the caching by the second synchronization module
Data to be stored is stored into the database.
12. device according to claim 10, which is characterized in that described device further include:
Removing module, in the presence of for being searched in the caching it is long be greater than duration threshold value and status indication be synchronized described in
Then data to be stored is deleted from the caching.
13. device according to claim 9, which is characterized in that first synchronization module is also used to, using first into
For journey before obtaining the characteristic information in the message queue, determination has new characteristic information to be added into the message queue, with
And determine that first process is idle.
14. device according to claim 9, which is characterized in that described device further include:
Cache memory module then will be described for if it is determined that the data to be stored is not successfully stored to the caching
Data to be stored is stored into the database.
15. device according to claim 9, which is characterized in that described device further include:
Data Integration module, the every terms of information for storing as needed generate structural data to obtain data to be stored；
The cache memory module is also used to parse the data to be stored to obtain needing the every terms of information that stores, and by institute
It states in the corresponding data table that every terms of information is stored respectively into caching；
First synchronization module is also used to search data to be stored corresponding with the characteristic information, and then parsing is described wait deposit
Storage data store the corresponding data into database to obtain the every terms of information for needing to store, and by the every terms of information respectively
In table.
16. device according to claim 9, which is characterized in that it is described to it is data cached include registration information and/or correlation
Information；The registration information includes at least one in user name, password, the pet name, mobile phone and mailbox, and the relevant information includes
At least one of in handset binding state, mailbox binding state, unbundlings user name, grade, source, registion time and registration IP；
The caching is that Redis is cached.
17. a kind of electronic equipment characterized by comprising
One or more processors；
Storage device, for storing one or more programs,
When one or more of programs are executed by one or more of processors, so that one or more of processors are real
Now such as method described in any one of claims 1-8.
18. a kind of computer-readable medium, is stored thereon with computer program, which is characterized in that described program is held by processor
Such as method described in any one of claims 1-8 is realized when row.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710451809.XA CN109144992A (en) | 2017-06-15 | 2017-06-15 | A kind of method and apparatus of data storage |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710451809.XA CN109144992A (en) | 2017-06-15 | 2017-06-15 | A kind of method and apparatus of data storage |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109144992A true CN109144992A (en) | 2019-01-04 |
Family
ID=64829837
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710451809.XA Pending CN109144992A (en) | 2017-06-15 | 2017-06-15 | A kind of method and apparatus of data storage |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109144992A (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109873904A (en) * | 2019-03-05 | 2019-06-11 | 平安科技（深圳）有限公司 | User of message status report process method, device and the storage medium of message push |
| CN112579601A (en) * | 2020-12-18 | 2021-03-30 | 深圳赛安特技术服务有限公司 | Data processing and storing method, device and storage medium |
| CN113034715A (en) * | 2021-03-02 | 2021-06-25 | 创优数字科技(广东)有限公司 | Attendance data processing method and device, server and storage medium |
| CN113076290A (en) * | 2021-04-12 | 2021-07-06 | 百果园技术(新加坡)有限公司 | File deletion method, device, equipment, system and storage medium |
| CN114238476A (en) * | 2021-12-15 | 2022-03-25 | 深圳市科漫达智能管理科技有限公司 | Data processing method and device, terminal equipment and storage medium |
| CN114547193A (en) * | 2022-01-29 | 2022-05-27 | 北京声智科技有限公司 | Data processing method, device, system, electronic equipment and storage medium |
| CN114942599A (en) * | 2022-06-13 | 2022-08-26 | 珠海格力电器股份有限公司 | Information processing method, device, equipment and storage medium |
| WO2023124841A1 (en) * | 2021-12-28 | 2023-07-06 | 中兴通讯股份有限公司 | Method for storing feature in database, electronic device and computer readable storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103116634A (en) * | 2012-06-12 | 2013-05-22 | 上海雷腾软件有限公司 | System for supporting high concurrent cache task queue and asynchronous batch operation method thereof |
| US20140095438A1 (en) * | 2012-09-28 | 2014-04-03 | Oracle International Corporation | Tracking row and object database activity into block level heatmaps |
| CN103886079A (en) * | 2014-03-26 | 2014-06-25 | 北京京东尚科信息技术有限公司 | Data processing method and system |
| CN104572838A (en) * | 2014-12-11 | 2015-04-29 | 北京京东尚科信息技术有限公司 | Improved system and method for writing data to database |
| CN105205175A (en) * | 2015-10-15 | 2015-12-30 | 北京农信互联科技有限公司 | Data operation method and system for distributed database cluster |
| CN105956032A (en) * | 2016-04-25 | 2016-09-21 | 百度在线网络技术（北京）有限公司 | Cache data synchronization method, system and apparatus |
| CN105956166A (en) * | 2016-05-19 | 2016-09-21 | 北京京东尚科信息技术有限公司 | Database reading-writing method and database reading-writing apparatus |
| CN106294607A (en) * | 2016-07-29 | 2017-01-04 | 北京奇虎科技有限公司 | Data cached update method and updating device |
-
2017
- 2017-06-15 CN CN201710451809.XA patent/CN109144992A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103116634A (en) * | 2012-06-12 | 2013-05-22 | 上海雷腾软件有限公司 | System for supporting high concurrent cache task queue and asynchronous batch operation method thereof |
| US20140095438A1 (en) * | 2012-09-28 | 2014-04-03 | Oracle International Corporation | Tracking row and object database activity into block level heatmaps |
| CN103886079A (en) * | 2014-03-26 | 2014-06-25 | 北京京东尚科信息技术有限公司 | Data processing method and system |
| CN104572838A (en) * | 2014-12-11 | 2015-04-29 | 北京京东尚科信息技术有限公司 | Improved system and method for writing data to database |
| CN105205175A (en) * | 2015-10-15 | 2015-12-30 | 北京农信互联科技有限公司 | Data operation method and system for distributed database cluster |
| CN105956032A (en) * | 2016-04-25 | 2016-09-21 | 百度在线网络技术（北京）有限公司 | Cache data synchronization method, system and apparatus |
| CN105956166A (en) * | 2016-05-19 | 2016-09-21 | 北京京东尚科信息技术有限公司 | Database reading-writing method and database reading-writing apparatus |
| CN106294607A (en) * | 2016-07-29 | 2017-01-04 | 北京奇虎科技有限公司 | Data cached update method and updating device |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109873904A (en) * | 2019-03-05 | 2019-06-11 | 平安科技（深圳）有限公司 | User of message status report process method, device and the storage medium of message push |
| WO2020177384A1 (en) * | 2019-03-05 | 2020-09-10 | 平安科技（深圳）有限公司 | Method and apparatus for reporting and processing user message status of message pushing, and storage medium |
| CN109873904B (en) * | 2019-03-05 | 2021-08-03 | 平安科技（深圳）有限公司 | User message state reporting processing method, device and storage medium for message pushing |
| CN112579601A (en) * | 2020-12-18 | 2021-03-30 | 深圳赛安特技术服务有限公司 | Data processing and storing method, device and storage medium |
| CN113034715A (en) * | 2021-03-02 | 2021-06-25 | 创优数字科技(广东)有限公司 | Attendance data processing method and device, server and storage medium |
| CN113076290A (en) * | 2021-04-12 | 2021-07-06 | 百果园技术(新加坡)有限公司 | File deletion method, device, equipment, system and storage medium |
| CN113076290B (en) * | 2021-04-12 | 2024-01-30 | 百果园技术(新加坡)有限公司 | File deletion method, device, equipment, system and storage medium |
| CN114238476A (en) * | 2021-12-15 | 2022-03-25 | 深圳市科漫达智能管理科技有限公司 | Data processing method and device, terminal equipment and storage medium |
| WO2023124841A1 (en) * | 2021-12-28 | 2023-07-06 | 中兴通讯股份有限公司 | Method for storing feature in database, electronic device and computer readable storage medium |
| CN114547193A (en) * | 2022-01-29 | 2022-05-27 | 北京声智科技有限公司 | Data processing method, device, system, electronic equipment and storage medium |
| CN114942599A (en) * | 2022-06-13 | 2022-08-26 | 珠海格力电器股份有限公司 | Information processing method, device, equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109144992A (en) | A kind of method and apparatus of data storage | |
| CN109491801B (en) | Micro-service access scheduling method, micro-service access scheduling device, medium and electronic equipment | |
| CN108846753B (en) | Method and apparatus for processing data | |
| CN109447641B (en) | Method and apparatus for transmitting blockchain data to blockchain browser | |
| CN109413127A (en) | A kind of method of data synchronization and device | |
| CN108874513A (en) | Handle method, system, electronic equipment and the computer-readable medium of timed task | |
| CN109032796A (en) | A kind of data processing method and device | |
| CN107515933A (en) | Change method, server, system and the storage medium of source data database table structure | |
| CN109657174A (en) | Method and apparatus for more new data | |
| CN107943846B (en) | Data processing method and device and electronic equipment | |
| US20150106827A1 (en) | Rpc acceleration based on previously memorized flows | |
| CN110019437A (en) | A kind of method and system exporting data | |
| CN110019496A (en) | Data read-write method and system | |
| CN109842621A (en) | A kind of method and terminal reducing token storage quantity | |
| CN109918191A (en) | A kind of method and apparatus of the anti-frequency of service request | |
| CN110019346A (en) | A kind of data processing method and device based on double primary databases | |
| CN110321252A (en) | A kind of method and apparatus of craft services scheduling of resource | |
| CN112948410A (en) | Data processing method, device, equipment and medium | |
| CN116611411A (en) | Business system report generation method, device, equipment and storage medium | |
| CN110782310B (en) | Method, device and system for asynchronously acquiring user attribute information from third-party platform | |
| CN113742376B (en) | A method for synchronizing data, a first server, and a system for synchronizing data | |
| CN108733560A (en) | A kind of test method and device | |
| CN110020373A (en) | The method and apparatus that static page is stored, browsed | |
| CN109947736A (en) | The method and system calculated in real time | |
| CN110309121B (en) | Log processing method and device, computer readable medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190104 |
|
| RJ01 | Rejection of invention patent application after publication |