[go: up one dir, main page]

CN114402313A - Label updating method and device, electronic equipment and storage medium - Google Patents

Label updating method and device, electronic equipment and storage medium Download PDF

Info

Publication number
CN114402313A
CN114402313A CN201980100120.XA CN201980100120A CN114402313A CN 114402313 A CN114402313 A CN 114402313A CN 201980100120 A CN201980100120 A CN 201980100120A CN 114402313 A CN114402313 A CN 114402313A
Authority
CN
China
Prior art keywords
data
tag data
buffer queue
caching
tag
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201980100120.XA
Other languages
Chinese (zh)
Inventor
黄江伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Shenzhen Huantai Technology Co Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Shenzhen Huantai Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd, Shenzhen Huantai Technology Co Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Publication of CN114402313A publication Critical patent/CN114402313A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23Updating

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Memory System Of A Hierarchy Structure (AREA)

Abstract

一种标签更新方法、装置、电子设备及存储介质,该标签更新方法包括:从多个不同的数据源获取待进行更新的标签数据(S110);将获取到的标签数据缓存至指定缓冲队列,所述指定缓冲队列用于缓存待进行更新的标签数据(S120);从所述指定缓冲队列中读取缓存的标签数据,并对读取的标签数据进行更新(S130)。上述方法可以实现多种数据源的标签数据的更新以及标签数据更新时的管理。

Figure 201980100120

A label updating method, device, electronic device and storage medium, the label updating method comprising: acquiring label data to be updated from a plurality of different data sources (S110); buffering the acquired label data in a designated buffer queue, The designated buffer queue is used for buffering tag data to be updated (S120); the cached tag data is read from the designated buffer queue, and the read tag data is updated (S130). The above method can realize the update of tag data of various data sources and the management of the update of tag data.

Figure 201980100120

Description

PCT国内申请,说明书已公开。PCT domestic application, the description has been published.

Claims (20)

  1. A tag update method, the method comprising:
    obtaining label data to be updated from a plurality of different data sources;
    caching the acquired tag data to a designated buffer queue, wherein the designated buffer queue is used for caching the tag data to be updated;
    and reading the cached tag data from the specified buffer queue, and updating the read tag data.
  2. The method of claim 1, wherein the caching the obtained tag data into a specified buffer queue comprises:
    when tag data to be updated from a plurality of data sources are acquired simultaneously, acquiring a first priority of each data source in the plurality of data sources, wherein the first priority is determined according to the real-time level of the tag data of the data source during updating;
    according to the first priority of each data source, obtaining a cache sequence corresponding to the tag data of each data source in the plurality of data sources, wherein the cache sequence is the sequence of caching the tag data to the specified buffer queue;
    and sequentially caching the label data of each data source to the appointed buffer queue according to the caching sequence.
  3. The method according to claim 2, wherein the obtaining, according to the first priority of each data source, a cache sequence corresponding to the tag data of each data source in the plurality of data sources comprises:
    determining the high-low order of the first priorities corresponding to the plurality of data sources according to the first priority of each data source;
    and determining the cache sequence corresponding to the tag data of each data source in the plurality of data sources according to the high and low sequences.
  4. The method according to any one of claims 1 to 3, wherein the caching the obtained tag data to a specified buffer queue includes:
    when the acquired tag data comprises a plurality of tag data from the same data source, acquiring a second priority corresponding to each tag data in the plurality of tag data, wherein the second priority is determined according to the real-time level of different tag data during updating;
    determining a caching sequence of the plurality of label data according to a second priority corresponding to each label data, wherein the caching sequence is a sequence of caching the label data to the designated buffering queue;
    and sequentially caching each tag data to the appointed buffer queue according to the caching sequence.
  5. The method of claim 4, wherein obtaining the second priority corresponding to each of the plurality of tag data comprises:
    acquiring the type of each label data in the plurality of label data, wherein the real-time levels of different types of label data are different during updating;
    and determining a second priority corresponding to each label data according to the type of each label data.
  6. The method of claim 5, wherein the obtaining the type of each of the plurality of tag data comprises:
    obtaining the type identification of each label data in the plurality of label data;
    and determining the type of each label datum according to the type identifier of each label datum.
  7. The method of claim 4, wherein obtaining the second priority corresponding to each of the plurality of tag data comprises:
    acquiring a user identifier corresponding to each tag data in the plurality of tag data;
    and determining a second priority corresponding to each label data according to the user identifier corresponding to each label data.
  8. The method according to claim 7, wherein the determining the second priority corresponding to each tag data according to the user identifier corresponding to each tag data comprises:
    determining the real-time level of updating the label corresponding to the user identification according to the user identification corresponding to each label datum;
    and determining a second priority corresponding to each tag data according to the real-time level.
  9. The method according to any one of claims 1 to 8, wherein the caching the obtained tag data to a specified buffer queue includes:
    when the obtained tag data meets a preset condition, caching the obtained tag data to the specified buffer queue and inserting the tag data to a target position in the specified buffer queue, wherein the target position is one position before a set position in the specified buffer queue.
  10. The method according to claim 9, wherein when the obtained tag data meets a preset condition, the caching the obtained tag data into the specified buffer queue and inserting the obtained tag data into a target position in the specified buffer queue includes:
    determining the real-time level of the acquired tag data during updating;
    judging whether the real-time level is greater than a set level;
    and if the tag data is larger than the set level, caching the acquired tag data to the specified buffer queue and inserting the tag data to a target position in the specified buffer queue.
  11. The method of claim 10, wherein before the buffering the obtained tag data to the specified buffer queue and inserting the tag data to the target location in the specified buffer queue, the method further comprises:
    and acquiring a target position in the appointed buffer queue according to the real-time level corresponding to the acquired tag data and the real-time level corresponding to each tag data in the buffer queue, wherein the real-time level corresponding to the tag data at a position behind the target position and adjacent to the target position is lower than the real-time level corresponding to the acquired tag data.
  12. The method according to any one of claims 1 to 11, wherein the caching the obtained tag data into a specified buffer queue includes:
    judging whether the current data volume in the appointed buffer queue reaches a first set threshold value;
    and if the current data volume does not reach a first set threshold value, caching the acquired tag data to a specified buffer queue.
  13. The method of claim 12, further comprising:
    if the current data volume reaches a first set threshold, determining the cache duration corresponding to each tag data in the specified buffer queue;
    acquiring first tag data in the appointed buffer queue, wherein the buffer duration corresponding to the first tag data is longer than a set duration;
    after the first tag data is cleared from the appointed buffer queue, if the current data volume in the appointed buffer queue does not reach the first set threshold value, the obtained tag data is cached to the appointed buffer queue.
  14. The method according to claim 12, wherein the caching the obtained tag data into the designated buffer queue if the current data amount in the designated buffer queue does not reach the first set threshold, comprises:
    if the current data volume in the appointed buffer queue does not reach the first set threshold, judging whether the current data volume reaches a second set threshold, wherein the second set threshold is smaller than the first set threshold;
    and if the current data volume does not reach the second set threshold value, caching the acquired tag data to the specified buffer queue.
  15. The method of claim 14, further comprising:
    and if the current data volume reaches the second set threshold, after the idle resource in the idle state is released, caching the acquired tag data to the appointed buffer queue.
  16. The method of claims 1-15, further comprising:
    monitoring the updating speed of the label data in real time;
    and if the updating speed is lower than the set speed, releasing the idle resources in the idle state at present.
  17. The method of claims 1-16, further comprising:
    acquiring label data repeatedly existing in the appointed buffer queue;
    and deleting the label data which exists repeatedly.
  18. A tag updating apparatus, the apparatus comprising: a data acquisition module, a data caching module and a data updating module, wherein,
    the data acquisition module is used for acquiring label data to be updated from a plurality of different data sources;
    the data caching module is used for caching the acquired tag data to an appointed buffering queue, and the appointed buffering queue is used for caching the tag data to be updated;
    and the data updating module is used for reading the cached tag data from the specified buffer queue and updating the read tag data.
  19. An electronic device, comprising:
    one or more processors;
    a memory;
    one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to perform the method of any of claims 1-17.
  20. A computer-readable storage medium having program code stored therein, the program code being invoked by a processor to perform the method of any one of claims 1 to 17.
CN201980100120.XA 2019-11-08 2019-11-08 Label updating method and device, electronic equipment and storage medium Pending CN114402313A (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/116729 WO2021087990A1 (en) 2019-11-08 2019-11-08 Tag updating method and device, electronic apparatus, and storage medium

Publications (1)

Publication Number Publication Date
CN114402313A true CN114402313A (en) 2022-04-26

Family

ID=75849251

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201980100120.XA Pending CN114402313A (en) 2019-11-08 2019-11-08 Label updating method and device, electronic equipment and storage medium

Country Status (2)

Country Link
CN (1) CN114402313A (en)
WO (1) WO2021087990A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021115326A1 (en) * 2019-12-09 2021-06-17 北京灵汐科技有限公司 Data processing method and apparatus, electronic device, storage medium, and program product
CN116033491B (en) * 2023-03-29 2023-07-04 至控科技(湖州)创新研究院有限公司 Data compression cache uploading method and device in real-time positioning system

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105068864A (en) * 2015-07-24 2015-11-18 北京京东尚科信息技术有限公司 Method and system for processing asynchronous message queue
CN107562804A (en) * 2017-08-08 2018-01-09 上海数据交易中心有限公司 Data buffer service system and method, terminal
CN107844524A (en) * 2017-10-12 2018-03-27 金蝶软件(中国)有限公司 Data processing method, data processing equipment, computer equipment and storage medium
CN108900434A (en) * 2018-07-18 2018-11-27 北京木瓜移动科技股份有限公司 Data collection distribution method and device
CN108933993A (en) * 2018-07-03 2018-12-04 平安科技(深圳)有限公司 Short message buffer queue selection method, device, computer equipment and storage medium
CN110312156A (en) * 2018-03-27 2019-10-08 腾讯科技(深圳)有限公司 A kind of video cache method, apparatus and readable storage medium storing program for executing

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI362596B (en) * 2008-07-23 2012-04-21 Inst Information Industry Intermediary apparatus, intermediary method, computer program product for storing a data in a storage apparatus, and data storage system comprising the same
CN105005617B (en) * 2015-07-21 2018-10-12 领航动力信息系统有限公司 A kind of storage method and device of time series data
CN106469158B (en) * 2015-08-17 2019-10-08 杭州海康威视系统技术有限公司 Method of data synchronization and device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105068864A (en) * 2015-07-24 2015-11-18 北京京东尚科信息技术有限公司 Method and system for processing asynchronous message queue
CN107562804A (en) * 2017-08-08 2018-01-09 上海数据交易中心有限公司 Data buffer service system and method, terminal
CN107844524A (en) * 2017-10-12 2018-03-27 金蝶软件(中国)有限公司 Data processing method, data processing equipment, computer equipment and storage medium
CN110312156A (en) * 2018-03-27 2019-10-08 腾讯科技(深圳)有限公司 A kind of video cache method, apparatus and readable storage medium storing program for executing
CN108933993A (en) * 2018-07-03 2018-12-04 平安科技(深圳)有限公司 Short message buffer queue selection method, device, computer equipment and storage medium
CN108900434A (en) * 2018-07-18 2018-11-27 北京木瓜移动科技股份有限公司 Data collection distribution method and device

Also Published As

Publication number Publication date
WO2021087990A1 (en) 2021-05-14

Similar Documents

Publication Publication Date Title
US10133679B2 (en) Read cache management method and apparatus based on solid state drive
JP5425286B2 (en) How to track memory usage in a data processing system
WO2016141735A1 (en) Cache data determination method and device
CN113486037B (en) Method for updating cache data, manager and cache server
WO2011031355A1 (en) Cache prefill on thread migration
WO2018068714A1 (en) Deduplication processing method, and storage device
CN114402313A (en) Label updating method and device, electronic equipment and storage medium
CN116822657B (en) Method and device for accelerating model training, storage medium and electronic equipment
WO2017052595A1 (en) Variable cache for non-volatile memory
CN109981715B (en) Session management method and device
CN113656178B (en) Data processing method, device, equipment and readable storage medium
CN107992271B (en) Data pre-reading method, apparatus, device and computer-readable storage medium
CN109842621A (en) A kind of method and terminal reducing token storage quantity
CN110741346A (en) Application management method and terminal
CN116432778A (en) Data processing method and device, storage medium and electronic equipment
US8335806B2 (en) Marking algorithm for garbage collection using a rescan map
JP6497831B2 (en) Look-ahead tag to drive out
CN106874093B (en) Method for calculating target crowd based on user portrait, calculation engine and calculation equipment
CN116010300A (en) GPU (graphics processing Unit) caching method and device, electronic equipment and storage medium
CN111221468B (en) Storage block data deleting method and device, electronic equipment and cloud storage system
CN110709810A (en) Junk data cleaning method and equipment
CN114365112A (en) Method and device for updating label data, electronic equipment and storage medium
CN112732319B (en) File upgrading method, device, equipment and storage medium
CN110781166B (en) Data management method and device in storage system
TW202447415A (en) System and method for scheduling requests in storage system and storage system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination