CN114402313A - Label updating method and device, electronic equipment and storage medium - Google Patents
Label updating method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN114402313A CN114402313A CN201980100120.XA CN201980100120A CN114402313A CN 114402313 A CN114402313 A CN 114402313A CN 201980100120 A CN201980100120 A CN 201980100120A CN 114402313 A CN114402313 A CN 114402313A
- Authority
- CN
- China
- Prior art keywords
- data
- tag data
- buffer queue
- caching
- tag
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract 25
- 230000003139 buffering effect Effects 0.000 claims abstract 6
- 238000012544 monitoring process Methods 0.000 claims 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Memory System Of A Hierarchy Structure (AREA)
Abstract
一种标签更新方法、装置、电子设备及存储介质,该标签更新方法包括:从多个不同的数据源获取待进行更新的标签数据(S110);将获取到的标签数据缓存至指定缓冲队列,所述指定缓冲队列用于缓存待进行更新的标签数据(S120);从所述指定缓冲队列中读取缓存的标签数据,并对读取的标签数据进行更新(S130)。上述方法可以实现多种数据源的标签数据的更新以及标签数据更新时的管理。
A label updating method, device, electronic device and storage medium, the label updating method comprising: acquiring label data to be updated from a plurality of different data sources (S110); buffering the acquired label data in a designated buffer queue, The designated buffer queue is used for buffering tag data to be updated (S120); the cached tag data is read from the designated buffer queue, and the read tag data is updated (S130). The above method can realize the update of tag data of various data sources and the management of the update of tag data.
Description
PCT国内申请,说明书已公开。PCT domestic application, the description has been published.
Claims (20)
- A tag update method, the method comprising:obtaining label data to be updated from a plurality of different data sources;caching the acquired tag data to a designated buffer queue, wherein the designated buffer queue is used for caching the tag data to be updated;and reading the cached tag data from the specified buffer queue, and updating the read tag data.
- The method of claim 1, wherein the caching the obtained tag data into a specified buffer queue comprises:when tag data to be updated from a plurality of data sources are acquired simultaneously, acquiring a first priority of each data source in the plurality of data sources, wherein the first priority is determined according to the real-time level of the tag data of the data source during updating;according to the first priority of each data source, obtaining a cache sequence corresponding to the tag data of each data source in the plurality of data sources, wherein the cache sequence is the sequence of caching the tag data to the specified buffer queue;and sequentially caching the label data of each data source to the appointed buffer queue according to the caching sequence.
- The method according to claim 2, wherein the obtaining, according to the first priority of each data source, a cache sequence corresponding to the tag data of each data source in the plurality of data sources comprises:determining the high-low order of the first priorities corresponding to the plurality of data sources according to the first priority of each data source;and determining the cache sequence corresponding to the tag data of each data source in the plurality of data sources according to the high and low sequences.
- The method according to any one of claims 1 to 3, wherein the caching the obtained tag data to a specified buffer queue includes:when the acquired tag data comprises a plurality of tag data from the same data source, acquiring a second priority corresponding to each tag data in the plurality of tag data, wherein the second priority is determined according to the real-time level of different tag data during updating;determining a caching sequence of the plurality of label data according to a second priority corresponding to each label data, wherein the caching sequence is a sequence of caching the label data to the designated buffering queue;and sequentially caching each tag data to the appointed buffer queue according to the caching sequence.
- The method of claim 4, wherein obtaining the second priority corresponding to each of the plurality of tag data comprises:acquiring the type of each label data in the plurality of label data, wherein the real-time levels of different types of label data are different during updating;and determining a second priority corresponding to each label data according to the type of each label data.
- The method of claim 5, wherein the obtaining the type of each of the plurality of tag data comprises:obtaining the type identification of each label data in the plurality of label data;and determining the type of each label datum according to the type identifier of each label datum.
- The method of claim 4, wherein obtaining the second priority corresponding to each of the plurality of tag data comprises:acquiring a user identifier corresponding to each tag data in the plurality of tag data;and determining a second priority corresponding to each label data according to the user identifier corresponding to each label data.
- The method according to claim 7, wherein the determining the second priority corresponding to each tag data according to the user identifier corresponding to each tag data comprises:determining the real-time level of updating the label corresponding to the user identification according to the user identification corresponding to each label datum;and determining a second priority corresponding to each tag data according to the real-time level.
- The method according to any one of claims 1 to 8, wherein the caching the obtained tag data to a specified buffer queue includes:when the obtained tag data meets a preset condition, caching the obtained tag data to the specified buffer queue and inserting the tag data to a target position in the specified buffer queue, wherein the target position is one position before a set position in the specified buffer queue.
- The method according to claim 9, wherein when the obtained tag data meets a preset condition, the caching the obtained tag data into the specified buffer queue and inserting the obtained tag data into a target position in the specified buffer queue includes:determining the real-time level of the acquired tag data during updating;judging whether the real-time level is greater than a set level;and if the tag data is larger than the set level, caching the acquired tag data to the specified buffer queue and inserting the tag data to a target position in the specified buffer queue.
- The method of claim 10, wherein before the buffering the obtained tag data to the specified buffer queue and inserting the tag data to the target location in the specified buffer queue, the method further comprises:and acquiring a target position in the appointed buffer queue according to the real-time level corresponding to the acquired tag data and the real-time level corresponding to each tag data in the buffer queue, wherein the real-time level corresponding to the tag data at a position behind the target position and adjacent to the target position is lower than the real-time level corresponding to the acquired tag data.
- The method according to any one of claims 1 to 11, wherein the caching the obtained tag data into a specified buffer queue includes:judging whether the current data volume in the appointed buffer queue reaches a first set threshold value;and if the current data volume does not reach a first set threshold value, caching the acquired tag data to a specified buffer queue.
- The method of claim 12, further comprising:if the current data volume reaches a first set threshold, determining the cache duration corresponding to each tag data in the specified buffer queue;acquiring first tag data in the appointed buffer queue, wherein the buffer duration corresponding to the first tag data is longer than a set duration;after the first tag data is cleared from the appointed buffer queue, if the current data volume in the appointed buffer queue does not reach the first set threshold value, the obtained tag data is cached to the appointed buffer queue.
- The method according to claim 12, wherein the caching the obtained tag data into the designated buffer queue if the current data amount in the designated buffer queue does not reach the first set threshold, comprises:if the current data volume in the appointed buffer queue does not reach the first set threshold, judging whether the current data volume reaches a second set threshold, wherein the second set threshold is smaller than the first set threshold;and if the current data volume does not reach the second set threshold value, caching the acquired tag data to the specified buffer queue.
- The method of claim 14, further comprising:and if the current data volume reaches the second set threshold, after the idle resource in the idle state is released, caching the acquired tag data to the appointed buffer queue.
- The method of claims 1-15, further comprising:monitoring the updating speed of the label data in real time;and if the updating speed is lower than the set speed, releasing the idle resources in the idle state at present.
- The method of claims 1-16, further comprising:acquiring label data repeatedly existing in the appointed buffer queue;and deleting the label data which exists repeatedly.
- A tag updating apparatus, the apparatus comprising: a data acquisition module, a data caching module and a data updating module, wherein,the data acquisition module is used for acquiring label data to be updated from a plurality of different data sources;the data caching module is used for caching the acquired tag data to an appointed buffering queue, and the appointed buffering queue is used for caching the tag data to be updated;and the data updating module is used for reading the cached tag data from the specified buffer queue and updating the read tag data.
- An electronic device, comprising:one or more processors;a memory;one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to perform the method of any of claims 1-17.
- A computer-readable storage medium having program code stored therein, the program code being invoked by a processor to perform the method of any one of claims 1 to 17.
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2019/116729 WO2021087990A1 (en) | 2019-11-08 | 2019-11-08 | Tag updating method and device, electronic apparatus, and storage medium |
Publications (1)
Publication Number | Publication Date |
---|---|
CN114402313A true CN114402313A (en) | 2022-04-26 |
Family
ID=75849251
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201980100120.XA Pending CN114402313A (en) | 2019-11-08 | 2019-11-08 | Label updating method and device, electronic equipment and storage medium |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN114402313A (en) |
WO (1) | WO2021087990A1 (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2021115326A1 (en) * | 2019-12-09 | 2021-06-17 | 北京灵汐科技有限公司 | Data processing method and apparatus, electronic device, storage medium, and program product |
CN116033491B (en) * | 2023-03-29 | 2023-07-04 | 至控科技(湖州)创新研究院有限公司 | Data compression cache uploading method and device in real-time positioning system |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105068864A (en) * | 2015-07-24 | 2015-11-18 | 北京京东尚科信息技术有限公司 | Method and system for processing asynchronous message queue |
CN107562804A (en) * | 2017-08-08 | 2018-01-09 | 上海数据交易中心有限公司 | Data buffer service system and method, terminal |
CN107844524A (en) * | 2017-10-12 | 2018-03-27 | 金蝶软件(中国)有限公司 | Data processing method, data processing equipment, computer equipment and storage medium |
CN108900434A (en) * | 2018-07-18 | 2018-11-27 | 北京木瓜移动科技股份有限公司 | Data collection distribution method and device |
CN108933993A (en) * | 2018-07-03 | 2018-12-04 | 平安科技(深圳)有限公司 | Short message buffer queue selection method, device, computer equipment and storage medium |
CN110312156A (en) * | 2018-03-27 | 2019-10-08 | 腾讯科技(深圳)有限公司 | A kind of video cache method, apparatus and readable storage medium storing program for executing |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWI362596B (en) * | 2008-07-23 | 2012-04-21 | Inst Information Industry | Intermediary apparatus, intermediary method, computer program product for storing a data in a storage apparatus, and data storage system comprising the same |
CN105005617B (en) * | 2015-07-21 | 2018-10-12 | 领航动力信息系统有限公司 | A kind of storage method and device of time series data |
CN106469158B (en) * | 2015-08-17 | 2019-10-08 | 杭州海康威视系统技术有限公司 | Method of data synchronization and device |
-
2019
- 2019-11-08 WO PCT/CN2019/116729 patent/WO2021087990A1/en active Application Filing
- 2019-11-08 CN CN201980100120.XA patent/CN114402313A/en active Pending
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105068864A (en) * | 2015-07-24 | 2015-11-18 | 北京京东尚科信息技术有限公司 | Method and system for processing asynchronous message queue |
CN107562804A (en) * | 2017-08-08 | 2018-01-09 | 上海数据交易中心有限公司 | Data buffer service system and method, terminal |
CN107844524A (en) * | 2017-10-12 | 2018-03-27 | 金蝶软件(中国)有限公司 | Data processing method, data processing equipment, computer equipment and storage medium |
CN110312156A (en) * | 2018-03-27 | 2019-10-08 | 腾讯科技(深圳)有限公司 | A kind of video cache method, apparatus and readable storage medium storing program for executing |
CN108933993A (en) * | 2018-07-03 | 2018-12-04 | 平安科技(深圳)有限公司 | Short message buffer queue selection method, device, computer equipment and storage medium |
CN108900434A (en) * | 2018-07-18 | 2018-11-27 | 北京木瓜移动科技股份有限公司 | Data collection distribution method and device |
Also Published As
Publication number | Publication date |
---|---|
WO2021087990A1 (en) | 2021-05-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10133679B2 (en) | Read cache management method and apparatus based on solid state drive | |
JP5425286B2 (en) | How to track memory usage in a data processing system | |
WO2016141735A1 (en) | Cache data determination method and device | |
CN113486037B (en) | Method for updating cache data, manager and cache server | |
WO2011031355A1 (en) | Cache prefill on thread migration | |
WO2018068714A1 (en) | Deduplication processing method, and storage device | |
CN114402313A (en) | Label updating method and device, electronic equipment and storage medium | |
CN116822657B (en) | Method and device for accelerating model training, storage medium and electronic equipment | |
WO2017052595A1 (en) | Variable cache for non-volatile memory | |
CN109981715B (en) | Session management method and device | |
CN113656178B (en) | Data processing method, device, equipment and readable storage medium | |
CN107992271B (en) | Data pre-reading method, apparatus, device and computer-readable storage medium | |
CN109842621A (en) | A kind of method and terminal reducing token storage quantity | |
CN110741346A (en) | Application management method and terminal | |
CN116432778A (en) | Data processing method and device, storage medium and electronic equipment | |
US8335806B2 (en) | Marking algorithm for garbage collection using a rescan map | |
JP6497831B2 (en) | Look-ahead tag to drive out | |
CN106874093B (en) | Method for calculating target crowd based on user portrait, calculation engine and calculation equipment | |
CN116010300A (en) | GPU (graphics processing Unit) caching method and device, electronic equipment and storage medium | |
CN111221468B (en) | Storage block data deleting method and device, electronic equipment and cloud storage system | |
CN110709810A (en) | Junk data cleaning method and equipment | |
CN114365112A (en) | Method and device for updating label data, electronic equipment and storage medium | |
CN112732319B (en) | File upgrading method, device, equipment and storage medium | |
CN110781166B (en) | Data management method and device in storage system | |
TW202447415A (en) | System and method for scheduling requests in storage system and storage system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |