[go: up one dir, main page]

CN116566964B - View data merging method, system, electronic device, medium and program product - Google Patents

View data merging method, system, electronic device, medium and program product Download PDF

Info

Publication number
CN116566964B
CN116566964B CN202310370029.8A CN202310370029A CN116566964B CN 116566964 B CN116566964 B CN 116566964B CN 202310370029 A CN202310370029 A CN 202310370029A CN 116566964 B CN116566964 B CN 116566964B
Authority
CN
China
Prior art keywords
view
data
view data
library
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202310370029.8A
Other languages
Chinese (zh)
Other versions
CN116566964A (en
Inventor
袁沅祥
何光磊
崔鹏
孔帅
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Kuangshi Technology Co Ltd
Original Assignee
Beijing Kuangshi Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Kuangshi Technology Co Ltd filed Critical Beijing Kuangshi Technology Co Ltd
Priority to CN202310370029.8A priority Critical patent/CN116566964B/en
Publication of CN116566964A publication Critical patent/CN116566964A/en
Application granted granted Critical
Publication of CN116566964B publication Critical patent/CN116566964B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/02Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/56Provisioning of proxy services
    • H04L67/565Conversion or adaptation of application format or content
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Transfer Between Computers (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Computer And Data Communications (AREA)

Abstract

本公开提供了一种视图数据合并方法、系统、电子设备、介质及程序产品。该方法应用于视图数据合并组件,可以接收对应同一原始数据的,来源于第一外网视图库或存储复用内网视图库的第一视图数据与第二视图数据;第一外网视图库用于接收第二外网视图库提供的包括外网URL地址的原始数据并向目标内网视图库发送;存储复用内网视图库存储第二外网视图库跨网传输的原始数据并向目标内网视图库提供包括对应内网URL地址的视图数据;视图数据合并组件在数据来源不同时进行视图数据合并,使目标内网视图库获得包括内网URL地址的目标视图数据。本公开中第一外网视图库无需下载原始数据并跨网传输,减小带宽占用;且目标内网视图库无需重复存储原始数据。

The present disclosure provides a view data merging method, system, electronic device, medium and program product. The method is applied to a view data merging component, which can receive first view data and second view data corresponding to the same original data, which are from a first external network view library or a storage reused internal network view library; the first external network view library is used to receive the original data including the external network URL address provided by the second external network view library and send it to the target internal network view library; the storage reused internal network view library stores the original data transmitted across the network by the second external network view library and provides the target internal network view library with the view data including the corresponding internal network URL address; the view data merging component merges the view data when the data sources are different, so that the target internal network view library obtains the target view data including the internal network URL address. In the present disclosure, the first external network view library does not need to download the original data and transmit it across the network, which reduces bandwidth occupancy; and the target internal network view library does not need to repeatedly store the original data.

Description

View data merging method, system, electronic device, medium and program product
Technical Field
The disclosure belongs to the technical field of computers, and in particular relates to a view data merging method, a view data merging system, electronic equipment, a computer readable storage medium and a computer program product.
Background
View data refers to data with structured information, for example, image data, and original information, for example, image data, the structured information refers to key value pairs describing attributes of a face image, such as a picture height, a picture width, image content, and the like, and the original information may include URL (Uniform Resource Locator ) addresses of the image data.
In the cross-network transmission of view data, the external network service system can transmit data streams with different sources to the external network view library, and then the external network view library is transmitted to the internal network view library for storage, so that the internal network service system can access. The video stream of the source monitoring platform, the snapshot stream of the snapshot machine and the like are stored in an external network view library by an external network service system, and view data of a source external network third party view library can be accessed by reading URL addresses without storing corresponding image data.
Because the URL address intranet of the external network is inaccessible after the cross-network transmission, when the external network view library performs the cross-network transmission, the corresponding image data is generally downloaded from the third party view library according to the URL address, and the image data is transmitted to the internal network view library in a cross-network manner. The intranet view library stores the image data and generates an intranet URL address for the intranet service system to access. And the external network third-party view library can store the image data in the internal network third-party view library through cross-network transmission so as to be accessed by a third-party service system of the internal network.
It can be seen that in the above-mentioned view data storage process, the external network view library needs to acquire image data from the external network third party view library through the external network URL address, and transmit and store the image data into the internal network view library across networks, and the internal network view library generates the internal network URL address of the image data. And the image data transmitted by the external network third party view library in a cross-network manner is also stored in the internal network third party view library, so that the image data with the same URL address in the internal network are repeatedly stored, and the problem of storage resource waste exists. And the external network view library needs to download image data from the third party view library according to the URL address and then transmit the image data across the network, so that network bandwidth is occupied, computer hardware resources are consumed, and network resource waste is caused.
Disclosure of Invention
The disclosure aims to provide a view data merging method, a view data merging system, electronic equipment, a computer readable storage medium and a computer program product, which can save intranet storage resources and improve data transmission efficiency.
In order to solve the above technical problems, the present disclosure is implemented as follows:
the method can comprise the steps of receiving first view data and second view data, transmitting the first view data and the second view data in a URL format, enabling data sources of the first view data and the second view data to comprise a first external network view database or a storage multiplexing intranet view database, enabling the first external network view database to be used for receiving view data containing an external network URL address corresponding to original data provided by the second external network view database, transmitting the external network URL address to a target intranet view database through the view data, storing the multiplexing intranet view database to be used for storing the view data containing the original data transmitted by the second external network view database through the cross-network, transmitting the intranet URL address generated by storing the original data to the target intranet view database through the view data, enabling the first view data and the second view data to be combined under the condition that the first view data and the second view data correspond to the same original data, enabling the target intranet URL address to be obtained through cross-network transmission of the view data, and enabling the target intranet URL address to be obtained to correspond to the original URL address of the second view data, and obtaining the target intranet address corresponding to the multiplexing intranet address.
Optionally, under the condition that the data sources of the first view data and the second view data are different, merging the first view data and the second view data to enable the target intranet view database to obtain the target view data, wherein the method comprises the step of merging the extranet structural information of the first view data with the data sources of the second view data and intranet URL addresses under the condition that the data sources of the first view data are the first extranet view database and the data sources of the second view data are the storage multiplexing intranet view database to enable the target intranet view database to obtain the target view data.
Optionally, receiving first view data and second view data, wherein the first view data and the second view data are sent to a target intranet view database, the data sources of the first view data are a first extranet view database, the first view data comprise extranet structural information and extranet URL addresses, the first view data are written into the target intranet view database, the second view data corresponding to the same original data are received on the basis of the received first view data, the data sources of the second view data are storage multiplexing intranet view databases, the second view data comprise intranet URL addresses, and under the condition that the data sources of the first view data and the second view data are different, the first view data and the second view data are combined to enable the target intranet view database to obtain target view data, the first view data and the second view data comprise the extranet structural information, the second view data and the URL addresses, the data sources of the first view data and the extranet URL addresses are updated in the target intranet view database, and the target view data comprise the extranet structural information, the data sources of the second view data and the URL addresses.
The method comprises the steps of receiving first view data and second view data sent to a target intranet view database, wherein the first view data comprise intranet URL addresses, writing the first view data into a local memory of the view data merging component, receiving second view data corresponding to the same original data on the basis of the received first view data, wherein the data sources of the second view data are first extranet view database, the second view data comprise extranet structured information and extranet URL addresses, merging the first view data and the second view data under the condition that the data sources of the first view data and the second view data are different, so that the target intranet view database obtains target view data.
The method comprises the steps of receiving first view data sent to a target intranet view database, wherein the first view data and second view data are received, the first view data are received and sent to the target intranet view database, the data sources of the first view data are first extranet view database, the first view data comprise extranet structural information and extranet URL addresses, the first view data are written into a local memory of the view data merging component, second view data corresponding to the same original data are received on the basis of the received first view data, the data sources of the second view data are storage multiplexing intranet view database, the second view data comprise intranet URL addresses, under the condition that the data sources of the first view data and the second view data are different, merging the first view data and the second view data to enable the target intranet view database to obtain target view data, and the method comprises the steps of determining that the data sources are different, adopting the data sources of the second view data and the intranet URL addresses in the local memory, updating the data sources of the first view data and the extranet URL addresses, obtaining the target view data comprises storing multiplexing intranet view data, and the target URL address information, and the target URL information is sent to the target intranet data.
The system is characterized by comprising a first external network view library and a second external network view library which are deployed on an external network, a target internal network view library and a view data merging component which are deployed on an internal network, wherein the first external network view library is used for receiving view data which is provided by the second external network view library and contains an external network URL address corresponding to original data, and transmitting the external network URL address to the target internal network view library through the view data, the second external network view library is used for providing view data which contains the external network URL address corresponding to the original data to the first external network view library, and transmitting the view data containing the original data to the storage multiplexing internal network view library through the network, the storage multiplexing internal network view library is used for storing the view data which contains the original data and is transmitted to the target internal network view library through the network, the view data merging component is used for receiving the view data and obtaining the source of the same original data when the first external network view URL address is different from the first external network view database, and the second external network view URL address is obtained from the target internal network view database, and the target URL address is obtained from the second external network view database.
Optionally, the view data merge component is deployed on a target intranet view library.
Optionally, the view data merging component and the target intranet view library are deployed independently.
In a third aspect, the present disclosure provides an electronic device comprising a processor, a memory and a program or instruction stored on the memory and executable on the processor, which program or instruction when executed by the processor implements the steps of the view data merging method as in the first aspect.
In a fourth aspect, the present disclosure provides a computer readable storage medium having stored thereon a program or instructions which when executed by a processor perform the steps of the view data merging method as in the first aspect.
In a fifth aspect, the present disclosure provides a chip comprising a processor and a communication interface, the communication interface being coupled to the processor for running a program or instructions implementing the steps of the view data merging method as in the first aspect.
In a sixth aspect, the present disclosure provides a computer program product which, when run on an electronic device, causes the electronic device to perform steps as implementing the view data merging method as in the first aspect.
The view data merging method is applied to a view data merging component, and can receive first view data and second view data, wherein the first view data and the second view data are transmitted in a URL format, data sources of the first view data and the second view data can comprise a first external network view database or a storage multiplexing internal network view database, the first external network view database is used for providing view data containing an external network URL address corresponding to original data by the second external network view database, the external network URL address is transmitted to a target internal network view database in a cross-network mode through the view data, the storage multiplexing internal network view database is used for storing view data containing original data transmitted by the second external network view database in the cross-network mode, and an internal network URL address generated by the storage original data is transmitted to the target internal network view database through the view data, the first view data and the second view data correspond to the same original data, and under the condition that the data sources are different, the first view data and the second view data can be merged, so that the target internal network view database obtains the target data, and the target internal network view database comprises the internal network view data corresponding to the original URL address of the target internal network view database. In the method, the first external network view library does not need to download original data from the second external network view library through the external network URL address, and sends the original data to the target internal network view library through the view data, but transmits the view data containing the external network URL address to the target internal network view library in a URL format in a cross-network manner, so that the bandwidth pressure of the cross-network transmission can be reduced, the consumption of computer hardware resources and the network resource burden are reduced, the target internal network view library can merge based on the view data, and when the same original data corresponds to different data sources, the internal network URL address for storing the original data provided by the multiplexing internal network view library can be obtained, thereby accessing the storing multiplexing internal network view library for obtaining, and the original data is not required to be repeatedly stored in the target internal network view library, and the storage resources are also effectively saved.
Drawings
FIG. 1 is a schematic diagram of an existing view data storage network architecture provided by an embodiment of the present disclosure;
FIG. 2 is one of the step flowcharts of the view data merging method provided in the embodiments of the present disclosure;
FIG. 3 is a second flowchart illustrating a method for merging view data according to an embodiment of the present disclosure;
FIG. 4 is a third flowchart illustrating steps of a view data merging method according to an embodiment of the present disclosure;
FIG. 5 is a fourth flowchart illustrating steps of a view data merging method according to an embodiment of the present disclosure;
FIG. 6 is a fifth flowchart illustrating steps of a view data merging method according to an embodiment of the present disclosure;
FIG. 7a is one of the architectural diagrams of the view data merge system provided in the embodiments of the present disclosure;
FIG. 7b is a second schematic diagram of a view data merging system according to an embodiment of the disclosure;
FIG. 8 is a block diagram of a view data storage device provided by an embodiment of the present disclosure;
fig. 9 is a schematic structural diagram of an electronic device according to an embodiment of the disclosure;
Fig. 10 is a hardware schematic of an electronic device according to an embodiment of the disclosure.
Detailed Description
The following description of the technical solutions in the embodiments of the present disclosure will be made clearly and completely with reference to the accompanying drawings in the embodiments of the present disclosure, and it is apparent that the described embodiments are some embodiments of the present disclosure, but not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art without inventive effort, based on the embodiments in this disclosure are intended to be within the scope of this disclosure.
The terms first, second and the like in the description and in the claims, are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged, where appropriate, such that embodiments of the disclosure may be practiced in sequences other than those illustrated and described herein, and that the objects identified by "first," "second," etc. are generally of the same type and are not limited to the number of objects, e.g., the first object may be one or more. Furthermore, in the description and claims, "and/or" means at least one of the connected objects, and the character "/", generally means that the associated object is an "or" relationship.
It should be noted that, the obtained data in the present disclosure, including related data such as original data and view data, are all accessed, collected, stored and applied to subsequent analysis processing under the condition that the user or the party to which the related data belongs agrees and authorizes after explicitly informing the user or the party to which the related data belongs of the information such as collection content, data use, processing mode, etc., and may provide a way to access, correct and delete the data to the user or the party to which the related data belongs, and cancel the agreeing and authorizing method.
Some terms are described in this disclosure as follows:
View data is data describing original data, typically including structured information, original information, of the original data. The original information may be data itself, such as BASE64 code, character string, etc. of the original data, the original information may also be a storage path of the original data, such as URL address of the original data, and the structured information may be a key value pair describing the original information, such as data length, picture width, etc. Taking the original data stored in the view library T as an example, the storage format is as follows:
{ "ID": "00001", "Width":100, "Height", "Data": "BASE64 string" }
Wherein, "Width" and "Height" are structured information of the original Data, and "Data" is BASE64 string "is original information of the original Data. The view data can also include an "ID" 00001 "which is a unique identification of the original data.
When the original data is stored in the view library T, the URL address of the original data in the network where the view library T is located may be obtained, so that the view library may provide the view data corresponding to the original data as follows:
{ "ID": "00001", "Width":100 "," Height "," Storage Path ":" URL address "," User-identification ": [ T ] }
Wherein, "Storage Path" means "URL address" which refers to a Storage Path of original data, the Storage Path is obtained when "BASE64 character string" is stored in a view library T, and "User-Identify" means that a data source is the view library T, and corresponding nodes can be added to the "User-Identify" in Path sequence every time the view data passes through a node in the data transmission process.
Fig. 1 is a schematic diagram of an existing view data storage network architecture provided by an embodiment of the present disclosure, as shown in fig. 1, and divided by a network boundary X, an external network includes an external network service system M101, an external network view library V102, and an external network third party view library T103, and an internal network includes an internal network view library V '104, an internal network third party view library T '105, an internal network service system M '106, and an internal network third party service system P107. The external network third party view library T103 stores "BASE64 string 1" of the original data 00001, and provides view data of the original data to the external network service system M101, as follows:
{ "ID": "00001", "Width":100 "," Height "," Storage Path ":" URL address "," User-identification ": [ T ] }
The external network service system M101 may receive the above view data provided by the external network third party view library T103, and perform feature extraction, clustering, and file aggregation on the video stream, the image, the view data, and the like, to obtain external network structured information corresponding to the original data, where the external network structured information may be changed after the computing process of the external network service system when the structured information is already in the view data. Further, the extranet service system M may send corresponding view data to the extranet view database V102 as follows:
{ "ID": "00001", "Width":100 "," Height "," StoragePath ":" URL address "," User-identification ": [ T, M ] }
The external network service system M101 adds M at the position of User-Identify in the view data of the original data 00001 provided by the external network third party view library T103, wherein Width 100 is external network structural information determined by the external network service system M, and the view data is transmitted in a URL format.
{ "ID": "00002", "Width":50 "," Height ": 10", "Data": "BASE64 string 2", "User-identification": [ M ] }
The original data "00002" is an image captured by other platforms, "Width" is 50, "Height" is 10 is external network structural information determined by the external network service system M, and the view data is transmitted in the BASE64 format.
The extranet view gallery V102 may send the original data "00001" and view data corresponding to "00002" to the intranet view gallery V'104 via cross-network transmission. Because the intranet view library V '104 cannot access the extranet third-party view library T103, the extranet view library V102 may obtain the "URL address" from the view data of the original data "00001", obtain the "BASE64 string" of the original data "00001" from the third-party view library T103 according to the "URL address", and then transmit the view data of the original data "00001" to the intranet view library V'104 in the format of BASE64, as follows:
{ "ID": "00001", "Width":100 "," Height "," Data ":" BASE64 string "," User-identification ": [ T, M, V ] }
The intranet view gallery V '104 can acquire and store the original data "00001" and the original data "00002" from the view data, so as to obtain "URL addresses" of the original data "00001" and the original data "00002" to push to the intranet service system M' 106.
But on the basis, the external network third-party view library T103 also transmits the locally stored original data "00002" to the internal network third-party view library T '105 through cross-network transmission, so that the internal network third-party view T '105 can store the original data "00002" and provide the original data "00002" to the internal network third-party service system P107 for storing the "URL address" in the internal network third-party view library T ' 105.
It can be seen that in the existing scheme, before cross-network transmission is performed on the view data including the URL address, the external network view library V102 needs to acquire corresponding original data based on the URL address, perform cross-network transmission on the original data, occupy network bandwidth, consume computer hardware resources, and repeatedly store the original data "00002" in the internal network, the internal network view library V '104 and the internal network third party view library T'105, thereby wasting storage resources.
The embodiment of the disclosure provides a view data merging method, in which an external network view library V102 can carry out cross-network transmission based on view data containing a URL address, bandwidth occupation is reduced, loss of computer hardware resources is reduced, and an internal network view library V '104 can multiplex original data stored in an internal network third party view library T'105, so that storage resource waste caused by repeated storage is avoided.
The view data merging method provided by the embodiment of the present disclosure is described in detail below by means of specific embodiments and application scenarios thereof with reference to the accompanying drawings.
Fig. 2 is one of the step flowcharts of the view data merging method provided in the embodiment of the present disclosure. The method can be applied to view data merging components. As shown in fig. 2, the method may include the following steps 201 to 202.
Step 201, receiving first view data and second view data, transmitting the first view data and the second view data in a URL format, wherein the data sources of the first view data and the second view data comprise a first external network view library or a storage multiplexing internal network view library, the first external network view library is used for receiving view data which is provided by the second external network view library and contains an external network URL address corresponding to original data, transmitting the external network URL address to a target internal network view library through the view data in a cross-network mode, the storage multiplexing internal network view library is used for storing view data which is transmitted by the second external network view library and contains the original data, and transmitting the internal network URL address generated by storing the original data to the target internal network view library through the view data, and the first view data and the second view data correspond to the same original data.
In the embodiment of the disclosure, the network boundary division may include an external network and an internal network, where the external network includes a first external network view gallery and a second external network view gallery, and the internal network includes a target internal network view gallery and a storage multiplexing internal network view gallery. The first external network view library may be a view database corresponding to a service of my in the external network, the second external network view library may be a view database corresponding to a service of a third party in the external network, the target internal network view library may be a view database corresponding to a service of my in the internal network, and the storage multiplexing internal network view library may be a view database corresponding to a service of a third party in the internal network. In a conventional scheme, the second extranet view library can provide view data including an extranet URL address for the first extranet view library, the first extranet view library obtains corresponding original data from the second extranet view library according to the extranet URL address, the original data is transmitted to the target intranet view library through a cross-network, and the target intranet view library stores the original data to obtain the intranet URL address so as to enable the my business in the intranet to be called based on the business requirement of the third party business. However, the second extranet view gallery also transmits view data containing original data to the storage multiplexing intranet view gallery in a cross-network manner, so that the storage multiplexing intranet view gallery stores the original data to obtain another intranet URL address, so that the service requirement of a third party service in the intranet can be invoked. It can be seen that in the conventional scheme, the same original data is repeatedly stored in the intranet, so that storage resources are wasted greatly.
In the embodiment of the disclosure, the second external network view library can also provide view data containing an external network URL address corresponding to original data for the first external network view library, at this time, the first external network view library can transmit the view data containing the external network URL address corresponding to the original data to the target internal network view library in a cross-network manner, the original data is not required to be downloaded from the second external network view library based on the external network URL address, and the view data containing the original data is not required to be transmitted to the target internal network view library, so that the data transmission pressure can be reduced, the second external network view library can also transmit the view data containing the original data to the storage multiplexing internal network view library in a cross-network manner, at this time, the storage multiplexing internal network view library can store the original data to obtain an internal network URL address, and transmit the view data containing the internal network URL address to the target internal network view library, so that the target internal network view library calls the original data from the storage multiplexing internal network view library based on the internal network URL address, and the original data is not required to be stored locally to obtain the internal network URL address, and storage resources are effectively saved. The data type of the original data can be selected according to actual service requirements, such as images, texts and the like.
In the embodiment of the disclosure, the view data merging component may receive the first view data and the second view data corresponding to the same original data. The data sources of the first view data and the second view data may be a first external network view library or a storage multiplexing internal network view library, that is, the first view data may be sent by the first external network view library, or may be sent by the storage multiplexing internal network view library, and the second view data may be sent by the first external network view library, or may be sent by the storage multiplexing internal network view library, and according to different data sources, the information contained in the view data may also be different, for example, the information may include an external network URL address, an internal network URL address, etc., or the original data may be extracted, calculated, etc. through the characteristics of an external network service system during the transmission process, so that the corresponding view data may include external network structured information, etc.
Meanwhile, the second view library directly sends the view data containing the original data to the storage multiplexing intranet view library through cross-network transmission, and the view data does not pass through other nodes, so that the difference between the view data received by the first extranet view library and the structure information in the view data sent by the second extranet view library can be caused, and therefore the view data provided by the first extranet view library and the view data provided by the storage multiplexing intranet view library can be combined by adopting the view data combining component, so that the target view data meeting the actual service requirement can be obtained.
The view data merging component can be a logic module, a micro-service, a pluggable component and the like, and can receive view data sent from the first external network view library or the storage multiplexing internal network view library to the target internal network view library, store, merge and write the view data into the target internal network view library so as to be called by the target internal network view library based on service requirements. The view data merging component can be deployed in the target intranet view library, and can also be independently deployed relative to the target intranet view library on the basis of establishing communication connection, so that before the view data sent by the first external network view library or the storage multiplexing intranet view library is written into the target intranet view library, the view data merging component can analyze, merge, write and the like the received video data, and the embodiment of the disclosure is not particularly limited.
In the embodiment of the disclosure, the first external network view library, the storage multiplexing internal network view library, the target internal network view library, and the like are only used for distinguishing functions realized by different view libraries in a network architecture, corresponding data storage and processing technologies can be selected between view libraries based on service requirements, and the number of view libraries for realizing the same functions can be one or more, for example, in an internal network, there can be one storage multiplexing internal network view library for providing original data corresponding to an internal network URL address for the target internal network view library, and there can also be a plurality of storage multiplexing internal network view libraries for providing different original data corresponding to an internal network URL address for the target internal network view library.
Step 202, under the condition that the data sources of the first view data and the second view data are different, merging the first view data and the second view data to enable a target intranet view database to obtain target view data, wherein the target view data comprise intranet URL addresses, and the intranet URL addresses are used for accessing the storage multiplexing intranet view database to obtain corresponding original data.
In the embodiment of the disclosure, when the data sources of the first view data and the second view data are different, one of the first view data and the second view data can be considered to be sent by the first external network view library, and the other one of the first view data and the second view data can be further combined by the storage multiplexing internal network view library, so that the obtained target view data contains the internal network URL address provided by the storage multiplexing internal network view library, and the target internal network view library accesses the corresponding storage multiplexing internal network view library based on the internal network URL address to obtain the original data. The data source may be determined based on "User-identity" in the first view data and the second view data, or may be determined according to other agreed rules, and may include a first external network view library or a storage multiplexing internal network view library, so that the target view data includes both external network information of the original data meeting the service call requirement and an internal network URL address for call.
Fig. 3 is a second flowchart of a step of a view data merging method according to an embodiment of the disclosure. The method may be applied to a view data merging component, as shown in fig. 3, and may include the following steps 301 to 302.
Step 301, receiving first view data and second view data, transmitting the first view data and the second view data in URL format, wherein the data sources of the first view data and the second view data comprise a first external network view library or a storage multiplexing internal network view library, the first external network view library is used for receiving view data which is provided by the second external network view library and contains an external network URL address corresponding to original data, transmitting the external network URL address to a target internal network view library through the view data, the storage multiplexing internal network view library is used for storing view data which is transmitted by the second external network view library through the cross network and contains the original data, and transmitting the internal network URL address generated by storing the original data to the target internal network view library through the view data, and the first view data and the second view data correspond to the same original data.
In the embodiment of the disclosure, step 301 may correspond to the related description of step 101, and is not repeated here.
In the embodiment of the disclosure, different original data can be marked by adopting the data identifier, and the data identifier is an ID (identity) uniquely indicating the original data in the view data, so that the view data merging component can determine the first view data and the second view data corresponding to the same original data in the received view data through the data identifier. The view data merging component may wait for the first external network view library and the storage multiplexing internal network view library to send the view data, or may query the other view library for the view data corresponding to the same original data after receiving the view data sent by any one of the two view libraries, i.e., the first external network view library and the storage multiplexing internal network view library, which is not particularly limited in the embodiment of the present disclosure.
In the embodiment of the present disclosure, when the original data is an image, the original data may include face image data, body image data, locomotive image data, and the like, and the types of view data may be different according to the acquisition mode, the acquisition scene, and the service requirement.
In addition, in the intranet, besides the target intranet view libraries, a plurality of view libraries may be stored with different original data, and according to the actual requirement of the intranet service system for providing service, the storage multiplexing view libraries with the original data required by the service stored in the plurality of view libraries may be subscribed. On the basis, the target intranet view library can trigger pushing of the intranet service system when receiving view data sent by the storage multiplexing view library, so that the intranet service system can acquire related view data required by providing services.
It should be noted that, in the embodiments of the present disclosure, the first view data, the second view data, and the like refer to view data transmitted in URL format, that is, when the view data merging component receives view data transmitted in URL format, it further determines whether to store, merge, write into the target intranet view library, and the like, in addition, the view data merging component may also receive other view data including original data, where the other view data may correspond to original data collected by a snapshot machine and monitored by an external network service system, and the original data is not stored in an intranet, so that the target intranet view library may directly store in the local area to obtain a corresponding intranet URL address, and trigger pushing other view data corresponding to the original data to the service system, so that the service system may obtain corresponding original data from the target intranet view library.
Step 302, when the data source of the first view data is a first external network view database and the data source of the second view data is a storage multiplexing internal network view database, merging the external network structural information of the first view data with the data source of the second view data and the internal network URL address, so that the target internal network view database obtains the target view data.
In the embodiment of the disclosure, in order to implement storage multiplexing of original data, it is necessary to make the target intranet view gallery obtain an intranet URL address where the storage multiplexing intranet view gallery stores the original data, so that the target intranet view gallery accesses the storage multiplexing intranet view gallery based on the intranet URL address to obtain the original data of the service requirement. Therefore, when the view data merging component continuously receives the view data corresponding to the same original data, the data source of the first view data can be a first external network view library, the data source of the second view data can be a storage multiplexing internal network view library under the condition that the data sources of the two view data are different, and at this time, the receiving sequence of the first view data and the second view data is not limited, so that the different data sources can be distinguished.
Further, the external network structured information can be obtained from the first view data provided by the first external network view library, the intranet URL address of the original data can be obtained from the second view data provided by the storage multiplexing intranet view library, and the view data merging component can merge the data sources of the external network structured information, the intranet URL address and the second view data, so that the target intranet view library obtains the target view data. In the embodiment of the disclosure, the external network structured information calculated by the original data in the external network transmission, the feature extraction, the analysis and the like can be obtained from the view data provided by the first external network view library, and after the first view data and the second view data are combined on the basis to obtain the target view data, the target internal network view library can access the storage multiplexing internal network view library by adopting the internal network URL address in the target view data to obtain the original data without downloading and storing the original data locally, thereby realizing the storage multiplexing of the original data.
In an alternative embodiment of the present disclosure, the view data merging component may further receive the first view data and the second view data according to the receiving order of the view data corresponding to the same original data, and the data sources of the first view data and the second view data are not limited, so that the combination of the data sources may be different, and the corresponding operation flow may be adopted for different situations.
Fig. 4 is a third flowchart of a step of a view data merging method according to an embodiment of the disclosure. The method may be applied to a view data merging component, as shown in fig. 4, and may include the following steps 401 to 404.
Step 401, receiving first view data sent to a target intranet view database, where a data source of the first view data is a first extranet view database, and the first view data includes extranet structural information and an extranet URL address.
In this embodiment of the present disclosure, the view data merging component may receive view data sent to the target intranet view library, and when it is determined that the same original data receives the view data for the first time, the view data may be determined as first view data, and if a data source of the first view data is a first extranet view library, the first view data includes extranet service system performing feature extraction on the original data corresponding to the first view data, and external network structural information obtained by calculation and analysis, and an extranet URL address where the original data is stored in an external network.
Further, the view data merging component may record the first view data to determine that the corresponding original data has received the view data once, may store the original data "ID" included in the first view data as a key of the first view data, and the value may include information such as a data source (User-identifier), a data Storage Path (Storage Path), and the like of the first view data. In the embodiment of the disclosure, the data source is a first extranet view library, and the data storage path is an extranet URL address.
Step 402, writing the first view data into a target intranet view library.
In the embodiment of the disclosure, the view data merging component may write the first view data into the target intranet view library. At the moment, the view data merging group price can be deployed on the target intranet view library, and can also be independently deployed with the target intranet view library. For the same original data, the process is to write view data into the target intranet view library for the first time.
Step 403, receiving second view data corresponding to the same original data based on the received first view data, where a data source of the second view data is a storage multiplexing intranet view library, and the second view data includes an intranet URL address.
In the embodiment of the disclosure, the view data merging component may determine, when view data is received for the same original data for a second time, second view data, where the view data of the second view data may be a storage multiplexing intranet view database, and then the second view data includes an intranet URL address of the original data in the storage multiplexing intranet view database. Specifically, after receiving a view data later, the view data merging component may obtain an "ID" of the view data, and determine that the view data is second view data when the "ID" matches a key in the local memory. In the embodiment of the disclosure, the data source of the second view data is a storage multiplexing intranet view database, and includes intranet URL addresses of the original data stored in the storage multiplexing intranet view database.
Step 404, determining that the data sources are different, and updating the data source and the external network URL address of the first view data by using the data source and the internal network URL address of the second view data in the target internal network view library to obtain target view data, wherein the target view data comprises external network structural information, the data source and the internal network URL address of the second view data.
Based on steps 401 to 403, it may be determined that the data sources of the first view data and the second view data are different, and the view data merging component may update the data source of the first view data and the extranet URL address by using the data source of the second view data and the intranet URL address in the target intranet view database, so as to obtain the target view data that includes the extranet URL address, the extranet structural information and the data source as the storage multiplexing intranet view database after merging. For the same original data, the process is to write view data into the view library in the target intranet for the second time. When the target intranet view library subscribes to the storage multiplexing intranet view library based on service requirements, the data source based on the target view data is the storage multiplexing intranet view library, and the target intranet view library can trigger pushing to an intranet service system based on the target view data.
Fig. 5 is a fourth flowchart illustrating a step of a view data merging method according to an embodiment of the present disclosure. The method can be applied to a view data merging component, wherein the view data merging component and the target intranet view library are respectively and independently deployed, and as shown in fig. 5, the method can comprise the following steps 501 to 505.
Step 501, receiving first view data sent to a target intranet view database, where the data source of the first view data is a first extranet view database, and the first view data includes extranet structural information and an extranet URL address.
In the embodiment of the disclosure, step 501 may correspond to the related description of step 401, and is not repeated here.
Step 502, writing the first view data into a local memory of the view data merging component.
In the embodiment of the disclosure, the first view data may be written into the local memory of the view data merging component, so as to avoid transmission pressure possibly caused by writing into the target intranet view library for multiple times. At this time, the view data merging component and the target intranet view library are respectively and independently deployed. The local memory may be implemented by using a built-in database, for example, a dis database may be built in the view data merging component, where the dis (Remote Dictionary Server, remote dictionary service) is a memory Key-Value database, and one skilled in the art may select other databases based on application requirements, operating conditions, and the like, which is not particularly limited in the embodiments of the present disclosure.
Step 503, on the basis of the received first view data, receiving second view data corresponding to the same original data, where the data source of the second view data is a storage multiplexing intranet view library, and the second view data includes an intranet URL address.
In the embodiment of the disclosure, step 503 may correspond to the related description of step 403, and is not repeated here.
Step 504, determining that the data sources are different, and updating the data source and the extranet URL address of the first view data by using the data source and the intranet URL address of the second view data in the local memory to obtain the target view data, wherein the target view data includes the extranet structural information, the data source and the intranet URL address of the second view data.
And 505, sending the target view data to a target intranet view library.
Based on steps 501 to 503, it may be determined that the sources of the first view data and the second view data are different, and the view data merging component may update the data source and the extranet URL address of the first view data with the data source and the intranet URL address of the second view data in the local memory, so as to obtain the target view data that includes the extranet URL address, the extranet structural information and the data source after merging. Furthermore, the target view data can be sent to the target intranet view database, and the target view data is only required to be written once aiming at the same original data, so that the read-write and storage pressure of the target intranet view database caused by frequent writing can be avoided. The data source of the target view data is a storage multiplexing intranet view library, and when the target intranet view library subscribes to the storage multiplexing intranet view library based on service requirements, the target intranet view library can trigger pushing to an intranet service system based on the target view data.
Fig. 6 is a fifth step flowchart of a view data merging method according to an embodiment of the present disclosure. The method can be applied to a view data merging component, where the view data merging component and the target intranet view library are deployed separately, as shown in fig. 6, and the method can include the following steps 601 to 605.
Step 601, receiving first view data sent to a target intranet view database, wherein a data source of the first view data is a storage multiplexing intranet view database, and the first view data comprises intranet URL addresses.
In the embodiment of the disclosure, when determining that the same original data receives the view data for the first time, the view data merging component may determine the view data as first view data, and if a data source of the first view data is a storage multiplexing intranet view database, the first view data includes an intranet URL address of the original data in the storage multiplexing intranet view database.
Step 602, writing the first view data into a local memory of the view data merging component.
In the embodiment of the disclosure, since the data source of the first view data is the storage multiplexing intranet view gallery, when the target intranet view gallery subscribes to the storage multiplexing intranet view gallery based on the service requirement, in order to avoid triggering pushing the first view data after the first view data is written into the target intranet view gallery, the first view data may be written into the local memory of the view data merging component, and then waiting for subsequent receiving of the second view data.
In an optional embodiment of the disclosure, the view data merging component may be deployed in a target intranet view gallery, and the first view data may be written into the target intranet view gallery, and the second view data sources may not be merged at the same time to obtain the target view data. At this time, content which is not pushed to the same original data before the target view data is obtained by merging may be set in a rule for triggering pushing.
Step 603, on the basis of the received first view data, receiving second view data corresponding to the same original data, where the data source of the second view data is a first extranet view library, and the second view data includes extranet structural information and an extranet URL address.
In this embodiment of the present disclosure, the view data merging component may determine, when view data is received for the same original data for the second time, second view data, where the view data of the second view data may be a first extranet view library, and the second view data includes extranet structural information obtained by performing feature extraction and calculation analysis on the original data corresponding to the second view data by using an extranet service system, where the original data is stored in an extranet URL address.
Step 604, determining that the data sources are different, and updating the data source and the extranet URL address of the second view data by using the data source and the intranet URL address of the first view data in the local memory to obtain the target view data, wherein the target view data comprises the extranet structural information, the data source and the intranet URL address of the first view data.
Step 605, sending the target view data to the target intranet view library.
Based on steps 601 to 603, it may be determined that the sources of the first view data and the second view data are different, and the view data merging component may update the data source and the extranet URL address of the second view data with the data source and the intranet URL address of the first view data in the local memory, so as to obtain the target view data that includes the extranet URL address, the extranet structural information and the data source after merging as the storage multiplexing intranet view database. Further, the target view data may be sent to a target intranet view library. The data source of the target view data is a storage multiplexing intranet view library, and when the target intranet view library subscribes to the storage multiplexing intranet view library based on service requirements, the target intranet view library can trigger pushing to an intranet service system based on the target view data.
In the embodiment of the present disclosure, the case that the data sources of the first view data and the second view data corresponding to the original data are the same may also occur, as shown in the following steps A1 to A2:
and A1, under the condition that the data sources of the first view data and the second view data are the first external network view library, not merging the view data, and continuously waiting for receiving the view data corresponding to the original data.
In the embodiment of the disclosure, when the data sources of the first view data and the second view data are both the first external network view libraries, it is indicated that there may be a single first external network view library in the external network that repeatedly transmits view data of the same original data, or that there are more than two first external network view libraries that have view data of the same original data. In this case, there may be a failure such as a network transmission failure, a view storage abnormality, or the like, the view data merging component may not process the first view data, the second view data, and continue to wait for the reception of the subsequent view data. Furthermore, the abnormal condition can be reminded, so that the system can be checked, and possible faults are avoided to influence the processing and transmission efficiency of view data.
And A2, under the condition that the data sources of the first view data and the second view data are the storage multiplexing intranet view libraries, data combination is not carried out, or the original data are repeatedly stored in more than two storage taking intranet view libraries, the access sequence of the target intranet view libraries can be defined for more than two storage multiplexing intranet view libraries, or one access object of the target intranet view libraries is defined in more than two storage multiplexing intranet view libraries, and the view data corresponding to the original data are continuously waited to be received.
In the embodiment of the disclosure, there may be a case where the data sources of the first view data and the second view data corresponding to the original data are both storage multiplexing intranet view libraries, which means that there may be a single storage multiplexing intranet view library in the intranet to repeatedly send view data of the same original data, or there may be more than two storage multiplexing intranet view libraries with view data of the same original data. In this case, there may be a failure, such as a network transmission failure, an abnormal storage of views, or there may be more than two available storage multiplexing intranet views. At this time, the view data merging component may not process the first view data and the second view data and continue to wait for receiving the subsequent view data, or may define an access object serving as a target intranet view library in more than two available storage multiplexing intranet view libraries, or define an access sequence of the target intranet view library to different storage multiplexing intranet view libraries. On this basis, the view data merging component may not perform other operations and continue to wait for receiving the view data corresponding to the original data. When other view data corresponding to the original data is received and the data source is the first external network view library, view data combination can be performed based on the access object, the access sequence and the like, so that after the target intranet view library obtains the target view data, the original data is obtained from the access object appointed in the multiple storage multiplexing intranet view libraries, or the access sequence is based on the access sequence when the original data is obtained each time, the original data is obtained from the storage multiplexing intranet view library of the corresponding rank.
In an alternative method embodiment of the present disclosure, the view data merging component may clear the first view data, the second view data, and the like that are completely merged from the local memory, or may clear view data that has not been merged for a waiting period longer than a waiting period from the local memory, so as to avoid reducing occupation of storage capacity by redundant data, and improve data read-write efficiency, thereby improving efficiency of view data analysis, merging, updating, and writing. In practical applications, each piece of view data may include "ID", "User-identification", etc., where "ID" occupies 48 bytes, "User-identification" occupies 20 bytes, and "User-identification" occupies 256 bytes, according to the definition of view data, each piece of view data may occupy 324 bytes. Taking 3000 ten thousand pieces of view data received every day and taking 7 days as an example of a waiting period, under the condition that any view data combination is not completed in the waiting period, the memory is occupied at most by 63GB, the storage requirement is small, the view data to be processed can be placed in a local memory for convenient reading and writing, and the view data processing efficiency is effectively improved.
The view data merging method provided by the embodiment of the disclosure is applied to a view data merging component, and can be used for receiving first view data and second view data, wherein the first view data and the second view data are transmitted in a URL format, the data sources of the first view data and the second view data can comprise a first external network view database or a storage multiplexing internal network view database, the first external network view database is used for providing view data containing an external network URL address corresponding to original data by the second external network view database, the external network URL address is transmitted to a target internal network view database in a cross-network manner through the view data, the storage multiplexing internal network view database is used for storing view data containing original data transmitted by the second external network view database in the cross-network manner, and the internal network URL address generated by the storage of the original data is transmitted to the target internal network view database through the view data, and the first view data and the second view data correspond to the same original data, under the condition that the data sources are different, the first view data and the second view data can be merged to enable the target internal network view database to obtain target data, and the target data comprises the target internal network view database and the target internal network URL address corresponding to the original URL address. In the method, the first external network view library does not need to download original data from the second external network view library through the external network URL address, and sends the original data to the target internal network view library through the view data, but transmits the view data containing the external network URL address to the target internal network view library in a URL format in a cross-network manner, so that the bandwidth pressure of the cross-network transmission can be reduced, the consumption of computer hardware resources and the network resource burden are reduced, the target internal network view library can merge based on the view data, and when the same original data corresponds to different data sources, the internal network URL address for storing the original data provided by the multiplexing internal network view library can be obtained, thereby accessing the storing multiplexing internal network view library for obtaining, and the original data is not required to be repeatedly stored in the target internal network view library, and the storage resources are also effectively saved.
Fig. 7a is one of schematic architecture diagrams of a view data merging system provided in An embodiment of the present disclosure, where, as shown in fig. 7a, the network architecture is divided by a network boundary X, and includes a first external network view library 701 and a second external network view library 702 deployed on An external network, a storage multiplexing internal network view library 703 deployed on An internal network, a target internal network view library 704, and a view data merging component 705; wherein, the the storage multiplexing intranet view library 403 is subscribed to by the target intranet view library 402 by the view library A1 A2, A3, & A' are formed.
The first extranet view library 701 is configured to receive the view data provided by the second extranet view library 702 and including the extranet URL address corresponding to the original data, and transmit the extranet URL address to the target intranet view library 704 across the internet through the view data.
The second extranet view library 702 is configured to provide the first extranet view library 701 with view data including the URL address of the extranet corresponding to the original data, and transmit the view data including the original data to the storage multiplexing intranet view library 703 across networks.
The storage multiplexing intranet view library 703 is used for storing view data including original data transmitted by the second extranet view library 702 through cross-network, and sending an intranet URL address generated by storing the original data to the target intranet view library 704 through the view data;
The view data merging component 705 is configured to receive view data sent to the target intranet view gallery 704, and when receiving first view data and second view data corresponding to the same original data and having different data sources, merge the first view data and the second view data, so that the target intranet view gallery 704 obtains the target view data, where the target view data includes an intranet URL address, and the intranet URL address is used to access the storage multiplexing intranet view gallery 703 to obtain the corresponding original data.
In the embodiment of the disclosure, as shown in fig. 7a, in the network architecture shown in fig. 7a, the view data merging component 705 may receive the first external network view library 701, store the view data transmitted by the multiplexed internal network view library 703 to the target internal network view library 704 in URL format, determine the first view data and the second view data corresponding to the same original data in the received view data, further, when the data sources in the first view data and the second view data are different, the view data merging component may merge the first view data and the second view data, obtain the external network structured information from the view data whose data source is the first external network view library 701, obtain the data source and the internal network URL address from the view data whose data source is the multiplexed internal network view library 703, and then merge the target internal network view library to obtain the target view data containing the internal network URL address of the original data, and access the multiplexed internal network view library based on the internal network URL address to obtain the corresponding original data, and the view data merging system shown in fig. 7a and the view data merging system and the method which can be used for executing the previous fig. 2 to 4 are not repeated.
In an alternative embodiment of the present disclosure, the view data merge component 405 is configured on the target intranet view repository 402.
In the embodiment of the disclosure, in the case that the view data merging component 705 is disposed on the target intranet view database 704, the view data merging component 705 may first receive first view data, write the first view data into the target intranet view database, and when receiving second view data of the same original data object, merge the first view data and the second view data in the target intranet view database 704 so that the target intranet view database 702 obtains the target view data, where in the process, the target intranet view database 704 is written twice in a total in a merging of the target view data.
In an alternative embodiment of the present disclosure, the view data merging component and the target intranet view library are deployed separately.
Fig. 7b is a second schematic diagram of an architecture of a view data merging system according to an embodiment of the disclosure, as shown in fig. 7b, the view data merging component 705 and the target intranet view library 704 may be deployed separately. At this time, the view data merging component 705 may first receive the first view data, write the first view data into the local memory of the view data merging component, and when receiving the second view data of the same original data object, merge the first view data and the second view data in the local memory, and send the target view data obtained by merging to the target intranet view database 704, so that the target intranet view database 704 obtains the target view data, where the target intranet view database 704 is written once in a merging of the target view data.
It should be noted that, in the overall architecture, fig. 7a and b only schematically illustrate a part of the network architecture that is improved by implementing the present disclosure. In practical applications, for implementing other network architecture parts required for image acquisition, analysis, storage, view data transmission, etc., reference may be made to the content and related description shown in fig. 1.
In an alternative embodiment of the present disclosure, the first extranet gallery may acquire view data from other sources in addition to the second extranet gallery, where the original information may be an original string, a base64 encoding of the original image, or other form of encoding, such as a base64 encoding of an image frame in a surveillance video stream that is not stored in the second extranet gallery. At this time, the first extranet view gallery may send view data from other sources to the second extranet view gallery, and then the second extranet view gallery may store the view data from other sources to obtain an extranet URL address corresponding to the original data in the view data, and the further second extranet view gallery may provide the view data corresponding to the original data to the first extranet view gallery through the extranet service system, including the extranet URL address stored in the second extranet view gallery by the original data.
Further, the first external network view library can send the view data to the target internal network view library in a URL format, so that the target internal network view library does not need to store original data, any source data can be obtained from the storage multiplexing internal network view library, the storage pressure of the target internal network view library is thoroughly relieved, and the data transmission efficiency is further effectively improved. In the method, the first external network view library can also send the original data to be transmitted across the network to the second external network view library, so that all view data can be sent to the target internal network view library in a URL format, bandwidth occupation and computer hardware resource consumption are further reduced, and based on the view data merging method shown in the figures 2-4, the second external network view library can transmit the stored original data across the network to the storage multiplexing internal network view library, so that the storage multiplexing internal network view library can provide fifth view data to the target internal network view library, wherein the fifth view data comprises an internal network URL address stored in the storage multiplexing internal network view library by the original data, and the internal network view library is obtained by the target internal network view library. Therefore, the target content view library does not need to store original data locally, the storage resources are released, and the data reading and writing efficiency is improved.
Taking the network architecture shown in fig. 1 as an example, the external network view gallery V102 may be used as a first external network view gallery, the external network third party view gallery T103 may be used as a second external network view gallery, the internal network view gallery V '104 is used as a target internal network view gallery, and the internal network third party view gallery T'105 is used as a storage multiplexing internal network view gallery.
When receiving the view data, the extranet view database V102 transmits the view data in URL format, where the URL includes an extranet URL address of the original data, which indicates that the view data is provided by the extranet third party view database T103, and the extranet third party view database T103 stores the original data corresponding to the view data. Meanwhile, the external network third party view library T103 also transmits the original data to the internal network third party view library T'105 across the network.
Further, the external network view gallery V102 may send the view data to the internal network view gallery V '104, where the internal network view gallery V'104 is configured with a view data merging component, and the internal network view gallery V '104 may obtain the original data from the internal network third party view gallery T'105 based on the view data merging method shown in fig. 2 and 3.
Optionally, when the external network view gallery V102 receives view data, if the view data is transmitted in the Base64 format, the view data may be sent to the external network third party view gallery T103, so that the external network third party view gallery T103 stores the Base64 character string of the original data, and provides the view data including the URL address corresponding to the Base64 character string to the external network view gallery V102.
Fig. 8 is a schematic structural diagram of a view data storage component 800 provided in an embodiment of the present disclosure. As shown in fig. 8, the assembly may include:
A view data receiving module 801, configured to receive first view data and second view data; the system comprises a first view database, a second view database, a storage multiplexing intranet view database, a target intranet view database, a first external network view database, a second external network view database, a first internal network view database, a second internal network view database, a first external network view database and a second internal network view database, wherein the first view data and the second view data are transmitted in a URL format, and the data sources of the first view data and the second view data comprise a first external network view database or a storage multiplexing intranet view database;
The view data merging module 802 is configured to merge the first view data and the second view data under a condition that data sources of the first view data and the second view data are different, so that the target intranet view database obtains target view data, where the target view data includes an intranet URL address, and the intranet URL address is used for accessing the storage multiplexing intranet view database to obtain corresponding original data.
In an optional device embodiment of the present disclosure, the view data merging module 802 is specifically configured to merge the external network structured information of the first view data with the data source of the second view data and the intranet URL address, so that the target intranet view database obtains the target view data when the data source of the first view data is the first external network view database and the data source of the second view data is the storage multiplexing intranet view database.
In an optional embodiment of the present disclosure, the view data receiving module 801 is specifically configured to receive first view data sent to a target intranet view database, where the first view data is a first extranet view database, the first view data includes extranet structural information and an extranet URL address, write the first view data into the target intranet view database, receive second view data corresponding to the same original data based on the received first view data, where the second view data is a storage multiplexing intranet view database, and the second view data includes the intranet URL address.
The view data merging module 802 is specifically configured to determine that the data sources are different, update the data source and the extranet URL address of the first view data by using the data source and the intranet URL address of the second view data in the target intranet view database, and obtain the target view data, where the target view data includes the extranet structured information, the data source and the intranet URL address of the second view data.
In an optional embodiment of the disclosure, the view data merging component and the target intranet view library are respectively and independently deployed, the view data receiving module 801 is specifically configured to receive first view data sent to the target intranet view library, a data source of the first view data is a storage multiplexing intranet view library, the first view data includes an intranet URL address, the first view data is written into a local memory of the view data merging component, on the basis of the received first view data, second view data corresponding to the same original data is received, and a data source of the second view data is a first extranet view library, where the second view data includes extranet structural information and an extranet URL address.
The view data merging module 802 is specifically configured to determine that the data sources are different, update the data source and the extranet URL address of the second view data by using the data source and the intranet URL address of the first view data in the local memory, obtain the target view data, where the target view data includes the extranet structural information, the data source and the intranet URL address of the first view data, and send the target view data to the target intranet view library.
In an optional embodiment of the disclosure, the view data receiving module 801 is specifically configured to receive first view data sent to a target intranet view database, where a data source of the first view data is a first extranet view database, the first view data includes extranet structural information and an extranet URL address, write the first view data into a local memory of the view data merging component, receive second view data corresponding to the same original data on the basis of the received first view data, and the second view data is a storage multiplexing intranet view database, where the second view data includes an intranet URL address.
The view data merging module 802 is specifically configured to determine that the data sources are different, update the data source and the extranet URL address of the first view data with the data source and the intranet URL address of the second view data in the local memory, obtain the target view data, where the target view data includes the extranet structured information, the data source and the intranet URL address of the second view data, and send the target view data to the target intranet view library.
The view data merging component provided by the disclosure can receive first view data and second view data, wherein the first view data and the second view data are transmitted in a URL format, the data sources of the first view data and the second view data can comprise a first external network view database or a storage multiplexing internal network view database, the first external network view database is used for providing view data containing an external network URL address corresponding to original data by the second external network view database, the external network URL address is transmitted to a target internal network view database in a cross-network mode through the view data, the storage multiplexing internal network view database is used for storing view data containing the original data transmitted by the second external network view database in the cross-network mode, and an internal network URL address generated by the storage of the original data is transmitted to the target internal network view database through the view data, the first view data and the second view data correspond to the same original data, under the condition that the data sources are different, the first view data and the second view data can be merged to enable the target internal network view database to obtain the target view data, and the target view data comprise the target internal network view URL address, and the target internal network view database can access the original data through the storage multiplexing internal network view URL. In the method, the first external network view library does not need to download original data from the second external network view library through the external network URL address, and sends the original data to the target internal network view library through the view data, but transmits the view data containing the external network URL address to the target internal network view library in a URL format in a cross-network manner, so that the bandwidth pressure of the cross-network transmission can be reduced, the consumption of computer hardware resources and the network resource burden are reduced, the target internal network view library can merge based on the view data, and when the same original data corresponds to different data sources, the internal network URL address for storing the original data provided by the multiplexing internal network view library can be obtained, thereby accessing the storing multiplexing internal network view library for obtaining, and the original data is not required to be repeatedly stored in the target internal network view library, and the storage resources are also effectively saved.
Fig. 9 is a schematic structural diagram of an electronic device 900 according to an embodiment of the present disclosure, as shown in fig. 9, the electronic device 900 may include a processor 901, a memory 902, and a program or an instruction stored in the memory 902 and capable of running on the processor 901, where the program or the instruction implements each process of the embodiment of the view data merging method when executed by the processor 901, and the process may achieve the same technical effect, and for avoiding repetition, a detailed description is omitted herein.
It should be noted that the electronic device 900 shown in fig. 9 is only an example, and should not impose any limitation on the functions and the application scope of the embodiments of the present disclosure.
Fig. 10 is a hardware schematic diagram of an electronic device 1000 provided in an embodiment of the present disclosure, and as shown in fig. 10, the electronic device 1000 includes a central processing unit (Central Processing Unit, CPU) 1001, which can perform various appropriate actions and processes according to a program stored in a ROM (Read Only Memory) 1002 or a program loaded from a storage portion 1008 into a RAM (Random Access Memory ) 1003. In the RAM 1003, various programs and data required for system operation are also stored. The CPU 1001, ROM 1002, and RAM 1003 are connected to each other by a bus 1004. An I/O (Input/Output) interface 1005 is also connected to bus 1004.
Connected to the I/O interface 1005 are an input section 1006 including a keyboard, a mouse, and the like, an output section 1007 including a CRT (Cathode Ray Tube), an LCD (Liquid CRYSTAL DISPLAY), and a speaker, and the like, a storage section 1008 including a hard disk, and the like, and a communication section 1009 including a network interface card such as a LAN (Local Area Network) card, a modem, and the like. The communication section 1009 performs communication processing via a network such as the internet. The drive 1010 is also connected to the I/O interface 1005 as needed. A removable medium 1011, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like, is installed as needed in the drive 1010, so that a computer program read out therefrom is installed as needed in the storage section 1008.
In particular, according to embodiments of the present disclosure, the processes described below with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method shown in the flowcharts. In such an embodiment, the computer program may be downloaded and installed from a network via the communication portion 1009, and/or installed from the removable medium 1011. When the computer program is executed by the central processing unit (CPU 1001), various functions defined in the system of the present application are executed.
The embodiment of the present disclosure further provides a readable storage medium, where a program or an instruction is stored, where the program or the instruction, when executed by a processor, implements each process of the embodiment of the view data merging method, and the same technical effect can be achieved, and in order to avoid repetition, will not be described herein.
The processor is a processor in the electronic device in the above embodiment. A readable storage medium includes a computer readable storage medium such as ROM, RAM, magnetic or optical disk, etc.
The embodiment of the disclosure further provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to run a program or an instruction, to implement each process of the embodiment of the view data merging method, and achieve the same technical effect, so that repetition is avoided, and no further description is given here.
It should be understood that the chips referred to in the embodiments of the present disclosure may also be referred to as system-on-chip chips, chip systems, or system-on-chip chips, etc.
The embodiments of the present disclosure provide a computer program product including instructions, which when executed on a computer, cause the computer to perform the steps of the view data merging method described above, and achieve the same technical effects, and are not repeated herein.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Furthermore, it should be noted that the scope of the methods and apparatus in the embodiments of the present disclosure is not limited to performing the functions in the order shown or discussed, but may also include performing the functions in a substantially simultaneous manner or in an opposite order depending on the functions involved, e.g., the described methods may be performed in an order different from that described, and various steps may also be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present disclosure may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk), including several instructions for causing a terminal (which may be a mobile phone, a computer, an electronic device, an air conditioner, or a network device, etc.) to perform the method of the embodiments of the present disclosure.
The embodiments of the present disclosure have been described above with reference to the accompanying drawings, but the present disclosure is not limited to the above-described embodiments, which are merely illustrative and not restrictive, and many forms may be made by those of ordinary skill in the art without departing from the spirit of the disclosure and the scope of the claims, which are all within the protection of the present disclosure.

Claims (10)

1. A view data merging method, wherein the method is applied to a view data merging component, the method comprising:
The method comprises the steps of receiving first view data and second view data, wherein the first view data and the second view data are transmitted in a URL format, a data source of the first view data and the second view data comprises a first external network view library or a storage multiplexing internal network view library, the first external network view library is used for receiving view data which is provided by the second external network view library and contains an external network URL address corresponding to original data, and transmitting the external network URL address to a target internal network view library in a cross-network manner through the view data;
And under the condition that the data sources of the first view data and the second view data are different, merging the first view data and the second view data to enable the target intranet view database to obtain target view data, wherein the target view data comprise intranet URL addresses, and the intranet URL addresses are used for accessing the storage multiplexing intranet view database to obtain the corresponding original data.
2. The method according to claim 1, wherein merging the first view data and the second view data to obtain the target view data from the target intranet view library when the data sources of the first view data and the second view data are different, includes:
And under the condition that the data source of the first view data is the first external network view library and the data source of the second view data is the storage multiplexing internal network view library, combining the external network structural information of the first view data with the data source of the second view data and the internal network URL address so as to enable the target internal network view library to obtain target view data.
3. The method of claim 1, wherein receiving the first view data and the second view data comprises:
Receiving the first view data sent to the target intranet view library, wherein the data source of the first view data is the first extranet view library, and the first view data comprises extranet structural information and an extranet URL address;
Writing the first view data into the target intranet view library;
Receiving second view data corresponding to the same original data on the basis of the received first view data, wherein the data source of the second view data is a storage multiplexing intranet view library, and the second view data comprises intranet URL addresses;
And merging the first view data and the second view data to enable the target intranet view database to obtain target view data under the condition that the data sources of the first view data and the second view data are different, wherein the method comprises the following steps:
And determining that the data sources are different, and updating the data sources and the external network URL addresses of the first view data by adopting the data sources and the internal network URL addresses of the second view data in the target internal network view library to obtain target view data, wherein the target view data comprises the external network structured information, the data sources and the internal network URL addresses of the second view data.
4. The method of claim 1, wherein the view data merge component is deployed separately from the target intranet view library, the receiving the first view data and the second view data comprising:
receiving the first view data sent to the target intranet view database, wherein the data source of the first view data is the storage multiplexing intranet view database, and the first view data comprises intranet URL addresses;
writing the first view data into a local memory of the view data merging component;
Receiving second view data corresponding to the same original data on the basis of the received first view data, wherein the data source of the second view data is the first extranet view library, and the second view data comprises extranet structural information and an extranet URL address;
And merging the first view data and the second view data to enable the target intranet view database to obtain target view data under the condition that the data sources of the first view data and the second view data are different, wherein the method comprises the following steps:
Determining that the data sources are different, and updating the data sources of the second view data and the external network URL address by adopting the data sources of the first view data and the internal network URL address in the local memory to obtain target view data, wherein the target view data comprises the external network structured information, the data sources of the first view data and the internal network URL address;
and sending the target view data to the target intranet view library.
5. The method of claim 1, wherein the view data merge component is deployed separately from the target intranet view library, the receiving the first view data and the second view data comprising:
Receiving the first view data sent to the target intranet view library, wherein the data source of the first view data is the first extranet view library, and the first view data comprises extranet structural information and an extranet URL address;
writing the first view data into a local memory of the view data merging component;
Receiving second view data corresponding to the same original data on the basis of the received first view data, wherein the data source of the second view data is a storage multiplexing intranet view library, and the second view data comprises intranet URL addresses;
And merging the first view data and the second view data to enable the target intranet view database to obtain target view data under the condition that the data sources of the first view data and the second view data are different, wherein the method comprises the following steps:
Determining that the data sources are different, and updating the data sources of the first view data and the external network URL address by adopting the data sources of the second view data and the internal network URL address in the local memory to obtain target view data, wherein the target view data comprises the external network structured information, the data sources of the second view data and the internal network URL address;
and sending the target view data to the target intranet view library.
6. The view data storage system is characterized by comprising a first external network view library and a second external network view library which are deployed on an external network, and a target internal network view library, a storage multiplexing internal network view library and a view data merging component which are deployed on an internal network;
the first external network view library is used for receiving view data which is provided by the second external network view library and contains an external network URL address corresponding to the original data, and transmitting the external network URL address to the target internal network view library in a cross-network manner through the view data;
The second extranet view library is used for providing view data containing the external net URL address corresponding to the original data for the first extranet view library and transmitting the view data containing the original data to the storage multiplexing intranet view library in a cross-network manner;
The storage multiplexing intranet view library is used for storing view data which is transmitted by the second extranet view library through a cross-network and contains the original data, and sending an intranet URL address generated by storing the original data to the target intranet view library through the view data;
The view data merging component is used for receiving view data, merging the first view data and the second view data when receiving the first view data and the second view data which correspond to the same original data and have different data sources, so that the target intranet view database obtains target view data, wherein the target view data comprises intranet URL addresses, and the intranet URL addresses are used for accessing the storage multiplexing intranet view database to obtain the corresponding original data.
7. The system of claim 6, wherein the view data merge component is deployed on the target intranet view library, or,
And the view data merging component and the target intranet view library are respectively and independently deployed.
8. An electronic device, the electronic device comprising:
Processor, and
A memory for storing executable instructions of the processor;
wherein the processor is configured to perform the view data merging method of any of claims 1-5 via execution of the executable instructions.
9. A computer readable storage medium having stored thereon a computer program, wherein the computer program when executed by a processor implements the view data merging method according to any of claims 1-5.
10. A computer program product, characterized in that the computer program product, when run on an electronic device, causes the electronic device to perform the view data merging method according to any of claims 1-5.
CN202310370029.8A 2023-04-07 2023-04-07 View data merging method, system, electronic device, medium and program product Active CN116566964B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310370029.8A CN116566964B (en) 2023-04-07 2023-04-07 View data merging method, system, electronic device, medium and program product

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310370029.8A CN116566964B (en) 2023-04-07 2023-04-07 View data merging method, system, electronic device, medium and program product

Publications (2)

Publication Number Publication Date
CN116566964A CN116566964A (en) 2023-08-08
CN116566964B true CN116566964B (en) 2025-07-11

Family

ID=87497344

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310370029.8A Active CN116566964B (en) 2023-04-07 2023-04-07 View data merging method, system, electronic device, medium and program product

Country Status (1)

Country Link
CN (1) CN116566964B (en)

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201266950Y (en) * 2008-09-10 2009-07-01 北京科东电力控制系统有限责任公司 Web service application system for user network service facing electric power market transaction

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9244987B2 (en) * 2012-05-31 2016-01-26 Cellco Partnership ETL data transit method and system
US10122539B2 (en) * 2016-04-13 2018-11-06 Facebook, Inc. URL replication for live broadcast streaming
CN113239015B (en) * 2021-05-27 2022-12-13 广东好太太智能家居有限公司 Data migration method, system and storage medium
CN115529305B (en) * 2021-06-25 2025-08-01 腾讯科技(深圳)有限公司 File processing method, device, computer equipment and storage medium

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201266950Y (en) * 2008-09-10 2009-07-01 北京科东电力控制系统有限责任公司 Web service application system for user network service facing electric power market transaction

Also Published As

Publication number Publication date
CN116566964A (en) 2023-08-08

Similar Documents

Publication Publication Date Title
US11775343B1 (en) Duty cycle estimation for job assignment
CN111625452B (en) Flow playback method and system
US10908977B1 (en) Efficient message queuing service
CN110858172B (en) A method and device for generating automatic test code
CN111339073A (en) Real-time data processing method and device, electronic equipment and readable storage medium
CN113760674A (en) Information generation method and device, electronic equipment and computer readable medium
US11301475B1 (en) Transmission handling of analytics query response
CN115145964B (en) A time series data integration method, device, equipment and medium
CN113191889A (en) Wind control configuration method, configuration system, electronic device and readable storage medium
CN113612832A (en) Streaming data distribution method and system
CN117632445B (en) Request processing method and device, task execution method and device
CN113360210A (en) Data reconciliation method and device, computer equipment and storage medium
CN114168607B (en) Global serial number generation methods, apparatus, devices, media, and products
CN118535411A (en) A business session data tracking method, device and related equipment
CN116566964B (en) View data merging method, system, electronic device, medium and program product
CN117972096B (en) Method and system for processing interaction message of social platform
CN111026945B (en) Multi-platform crawler scheduling method, device and storage medium
CN113778350A (en) Log printing method and device
CN113220296B (en) Android system interaction method and device
CN114911762A (en) A data file processing method, device, server and storage medium
CN112395521B (en) Page processing method, page processing device, electronic equipment and computer readable storage medium
CN115455097A (en) Risk control data processing method, system, computer equipment and storage medium
CN114764324A (en) Enterprise resource planning system and integration method thereof
CN117493113B (en) Data reporting method, device, computer equipment and storage medium
CN113360417B (en) Test method, session modifier, electronic device and medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant