CN115422169B - Data warehouse construction method and device based on commercial advertisement scene - Google Patents
Data warehouse construction method and device based on commercial advertisement scene Download PDFInfo
- Publication number
- CN115422169B CN115422169B CN202211372840.1A CN202211372840A CN115422169B CN 115422169 B CN115422169 B CN 115422169B CN 202211372840 A CN202211372840 A CN 202211372840A CN 115422169 B CN115422169 B CN 115422169B
- Authority
- CN
- China
- Prior art keywords
- business
- layer
- data
- service
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000010276 construction Methods 0.000 title claims abstract description 21
- 238000000034 method Methods 0.000 claims abstract description 103
- 230000008569 process Effects 0.000 claims abstract description 86
- 230000009471 action Effects 0.000 claims abstract description 18
- 238000004422 calculation algorithm Methods 0.000 claims abstract description 8
- 238000011835 investigation Methods 0.000 claims abstract 3
- 238000004590 computer program Methods 0.000 claims description 10
- 239000011159 matrix material Substances 0.000 claims description 6
- 230000006399 behavior Effects 0.000 claims description 3
- 230000004927 fusion Effects 0.000 claims 2
- 230000000739 chaotic effect Effects 0.000 abstract description 3
- 238000011160 research Methods 0.000 description 16
- 235000019580 granularity Nutrition 0.000 description 13
- 238000004458 analytical method Methods 0.000 description 9
- 238000013461 design Methods 0.000 description 8
- 230000006870 function Effects 0.000 description 6
- 238000012545 processing Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 230000003203 everyday effect Effects 0.000 description 5
- 230000009467 reduction Effects 0.000 description 5
- 230000004913 activation Effects 0.000 description 2
- 230000003542 behavioural effect Effects 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 230000014759 maintenance of location Effects 0.000 description 2
- 230000002776 aggregation Effects 0.000 description 1
- 238000004220 aggregation Methods 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 238000013523 data management Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000009792 diffusion process Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000002360 explosive Substances 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 230000005012 migration Effects 0.000 description 1
- 238000013508 migration Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 210000002435 tendon Anatomy 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/211—Schema design and management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2282—Tablespace storage structures; Management thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/283—Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0241—Advertisements
- G06Q30/0251—Targeted advertisements
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Business, Economics & Management (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- Finance (AREA)
- Accounting & Taxation (AREA)
- Development Economics (AREA)
- Strategic Management (AREA)
- Entrepreneurship & Innovation (AREA)
- Software Systems (AREA)
- Game Theory and Decision Science (AREA)
- Economics (AREA)
- Marketing (AREA)
- General Business, Economics & Management (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
Description
技术领域technical field
本发明涉及计算机数据管理技术领域,具体涉及一种基于商业广告场景的数据仓库构建方法及装置。The invention relates to the technical field of computer data management, in particular to a method and device for constructing a data warehouse based on a commercial advertisement scene.
背景技术Background technique
目前,随着移动互联网的快速发展,一种新生事物-移动广告应运而生,它以其精准性、即时性、互动性、扩散性、整合性和可测性等优点而得到广告商的青睐,从而得以快速发展。与此同时,也就有了移动广告平台的产生,移动广告平台是一个平台或中介,连接着应用开发者和广告主。在平台上,开发者提供应用,广告主提供广告,而移动广告平台就会提供相应手机系统的 SDK。开发者下载 SDK,通过使用 SDK 中的工具,可将广告嵌入应用中,并将这些应用通过其他渠道上传到移动互联网,最终用户下载应用,浏览或点击广告后,广告主就会根据相应的计费方式付费给开发者。At present, with the rapid development of the mobile Internet, a new thing - mobile advertising has emerged, which is favored by advertisers for its accuracy, immediacy, interactivity, diffusion, integration and measurability. , so as to develop rapidly. At the same time, there is also the emergence of a mobile advertising platform, which is a platform or intermediary that connects application developers and advertisers. On the platform, developers provide applications, advertisers provide advertisements, and mobile advertising platforms provide SDKs for corresponding mobile phone systems. Developers download the SDK, and by using the tools in the SDK, they can embed advertisements into applications, and upload these applications to the mobile Internet through other channels. After end users download applications, browse or click on advertisements, advertisers will Fees are paid to developers.
数据分析这个部分主要是对现有的移动广告平台在运营中产生的数据进行分析,并产生报表供相关人员查看。根据查看报表数据的人员的不同,主要可分为三个方面,一是从开发者角度做的报表统计,对于开发者来讲,他们主要想知道在平台投放的各个应用每天收入了多少钱;二是从广告主角度做的报表统计,对于广告主来讲,他们主要想知道他们的广告每天在平台展示了多少次,被点击了多少次,他们因此付给了开发者多少的费用;三是从决策者角度做的报表统计,对于公司的决策者来说,他们主要关心平台每天增加了多少广告主和开发者,每天活跃的应用有多少,每天展示和点击的广告有多少,哪种类型的广告被点击的最多,哪款应用的用户最多等等。由此可知,对于不同的用户,系统需要从不同的维度对这些大量的异构的数据进行多层次的分析,如果用数据仓库,那么随着数据的快速增长,传统的数据仓库正面临着信息爆炸的新挑战。如此巨大的数据单纯靠传统数据仓库架构来分析将是非常耗时的,并难以高效管理这些数据。The part of data analysis is mainly to analyze the data generated in the operation of the existing mobile advertising platform, and generate reports for relevant personnel to view. According to the different personnel who view the report data, it can be mainly divided into three aspects. One is the report statistics from the perspective of developers. For developers, they mainly want to know how much money is earned by each application launched on the platform every day; The second is report statistics from the perspective of advertisers. For advertisers, they mainly want to know how many times their advertisements are displayed on the platform every day, how many times they are clicked, and how much they have paid to developers; It is a report statistics from the perspective of decision makers. For the decision makers of the company, they mainly care about how many advertisers and developers are added to the platform every day, how many applications are active every day, how many ads are displayed and clicked every day, which Which types of ads are clicked the most, which app has the most users, and so on. It can be seen that for different users, the system needs to perform multi-level analysis on these large amounts of heterogeneous data from different dimensions. If a data warehouse is used, then with the rapid growth of data, the traditional data warehouse is facing information Explosive new challenges. It will be very time-consuming to analyze such a huge amount of data purely by traditional data warehouse architecture, and it is difficult to manage these data efficiently.
发明内容Contents of the invention
针对所述缺陷,本发明实施例公开了一种基于商业广告场景的数据仓库构建方法及装置,其可以高效管理庞大复杂的广告业务数据。In view of the above defects, the embodiment of the present invention discloses a data warehouse construction method and device based on a commercial advertisement scene, which can efficiently manage huge and complex advertisement business data.
本发明实施例第一方面公开了基于商业广告场景的数据仓库构建方法,包括:The first aspect of the embodiment of the present invention discloses a data warehouse construction method based on a commercial advertisement scene, including:
对目标业务进行调研以获取不同目标业务所分别对应的业务流程;Conduct research on the target business to obtain the business processes corresponding to different target businesses;
根据所述业务流程确定每一个目标业务中的业务事件或者业务动作,以获取对应的业务过程;Determine the business event or business action in each target business according to the business process, so as to obtain the corresponding business process;
建立目标业务的数据仓库,所述数据仓库至少包括维表、明细表和汇总表,所述维表用于统一目标业务的计算算法以及确定目标业务的关联表格,所述明细表用于记录每一个目标业务对应的业务过程,所述汇总表用于记录目标业务的主题域和数据域。Establish a data warehouse for the target business, the data warehouse includes at least a dimension table, a detailed table and a summary table, the dimension table is used to unify the calculation algorithm of the target business and determine the associated table of the target business, and the detailed table is used to record each A business process corresponding to a target business, the summary table is used to record the subject domain and data domain of the target business.
作为一种可选的实施方式,在本发明实施例第一方面中,所述数据仓库包括ODS层级、DW层级、DMA层级、DMT层级和DA层级,所述ODS层级为原始数据的接入层,所述DW层级用于存储目标业务的业务过程,所述DMA层级用于对数据进行融合汇总,所述DMT层级用于对目标业务主题进行汇总,所述DA层级用于响应个性化数据需求。As an optional implementation, in the first aspect of the embodiment of the present invention, the data warehouse includes ODS level, DW level, DMA level, DMT level and DA level, and the ODS level is the access layer of raw data , the DW level is used to store the business process of the target business, the DMA level is used to integrate and summarize data, the DMT level is used to summarize target business topics, and the DA level is used to respond to personalized data requirements .
作为一种可选的实施方式,在本发明实施例第一方面中,所述数据仓库的ODS层级、DW层级、DMA层级、DMT层级和DA层级之间按照预设规则进行调用。As an optional implementation, in the first aspect of the embodiment of the present invention, the ODS level, DW level, DMA level, DMT level and DA level of the data warehouse are called according to preset rules.
作为一种可选的实施方式,在本发明实施例第一方面中,所述根据所述业务流程确定每一个目标业务中的业务事件或者业务动作,以获取对应的业务过程,包括:As an optional implementation manner, in the first aspect of the embodiments of the present invention, the determining the business event or business action in each target business according to the business process to obtain the corresponding business process includes:
根据业务流程确定对应的目标业务的业务操作节点,所述业务操作节点包括业务事件和业务动作;Determine the corresponding business operation node of the target business according to the business process, and the business operation node includes business events and business actions;
整理所述业务事件和业务动作,提取必要业务操作节点,并按照所述必要业务操作节点在所述业务流程中的次序生成对应的业务过程。Organize the business events and business actions, extract necessary business operation nodes, and generate corresponding business processes according to the order of the necessary business operation nodes in the business process.
作为一种可选的实施方式,在本发明实施例第一方面中,将所述业务过程进行抽象集合形成目标业务的数据域。As an optional implementation manner, in the first aspect of the embodiments of the present invention, the business processes are abstracted and assembled to form the data domain of the target business.
作为一种可选的实施方式,在本发明实施例第一方面中,采集目标业务的主体内容以获得所述目标业务对应的业务主题,生成目标业务的主题域。As an optional implementation manner, in the first aspect of the embodiments of the present invention, the subject content of the target business is collected to obtain a business theme corresponding to the target business, and a subject field of the target business is generated.
作为一种可选的实施方式,在本发明实施例第一方面中,还包括:As an optional implementation manner, in the first aspect of the embodiment of the present invention, it also includes:
基于目标业务的所述数据域和所述主题域生成所述目标业务的行为域总线矩阵。A behavioral domain bus matrix of the target business is generated based on the data domain and the subject domain of the target business.
本发明实施例第二方面公开一种基于商业广告场景的数据仓库构建装置,包括:The second aspect of the embodiment of the present invention discloses a data warehouse construction device based on a commercial advertisement scene, including:
业务调研模块:用于对目标业务进行调研以获取不同目标业务所分别对应的业务流程;Business research module: used to conduct research on the target business to obtain the business processes corresponding to different target businesses;
过程获取模块:用于根据所述业务流程确定每一个目标业务中的业务事件或者业务动作,以获取对应的业务过程;Process acquisition module: used to determine the business event or business action in each target business according to the business process, so as to obtain the corresponding business process;
仓库创建模块:用于建立目标业务的数据仓库,所述数据仓库至少包括维表、明细表和汇总表,所述维表用于统一目标业务的计算算法以及确定目标业务的关联表格,所述明细表用于记录每一个目标业务对应的业务过程,所述汇总表用于记录目标业务的主题域和数据域。Warehouse creation module: used to establish a data warehouse for the target business, the data warehouse at least includes a dimension table, a detailed table and a summary table, the dimension table is used to unify the calculation algorithm of the target business and determine the associated table of the target business, the The detailed table is used to record the business process corresponding to each target business, and the summary table is used to record the subject field and data field of the target business.
作为一种可选的实施方式,在本发明实施例第二方面中,所述数据仓库包括ODS层级、DW层级、DMA层级、DMT层级和DA层级,所述ODS层级为原始数据的接入层,所述DW层级用于存储目标业务的业务过程,所述DMA层级用于对数据进行融合汇总,所述DMT层级用于对目标业务主题进行汇总,所述DA层级用于响应个性化数据需求。As an optional implementation, in the second aspect of the embodiment of the present invention, the data warehouse includes ODS level, DW level, DMA level, DMT level and DA level, and the ODS level is the access layer of raw data , the DW level is used to store the business process of the target business, the DMA level is used to integrate and summarize data, the DMT level is used to summarize target business topics, and the DA level is used to respond to personalized data requirements .
作为一种可选的实施方式,在本发明实施例第二方面中,所述数据仓库的ODS层级、DW层级、DMA层级、DMT层级和DA层级之间按照预设规则进行调用。As an optional implementation, in the second aspect of the embodiment of the present invention, the ODS level, DW level, DMA level, DMT level and DA level of the data warehouse are called according to preset rules.
作为一种可选的实施方式,在本发明实施例第二方面中,所述根据所述业务流程确定每一个目标业务中的业务事件或者业务动作,以获取对应的业务过程,包括:As an optional implementation manner, in the second aspect of the embodiments of the present invention, determining the business event or business action in each target business according to the business process to obtain the corresponding business process includes:
根据业务流程确定对应的目标业务的业务操作节点,所述业务操作节点包括业务事件和业务动作;Determine the corresponding business operation node of the target business according to the business process, and the business operation node includes business events and business actions;
整理所述业务事件和业务动作,提取必要业务操作节点,并按照所述必要业务操作节点在所述业务流程中的次序生成对应的业务过程。Organize the business events and business actions, extract necessary business operation nodes, and generate corresponding business processes according to the order of the necessary business operation nodes in the business process.
作为一种可选的实施方式,在本发明实施例第二方面中,将所述业务过程进行抽象集合形成目标业务的数据域。As an optional implementation manner, in the second aspect of the embodiments of the present invention, the business processes are abstracted and assembled to form the data domain of the target business.
作为一种可选的实施方式,在本发明实施例第二方面中,采集目标业务的主体内容以获得所述目标业务对应的业务主题,生成目标业务的主题域。As an optional implementation manner, in the second aspect of the embodiments of the present invention, the subject content of the target business is collected to obtain the business theme corresponding to the target business, and the subject field of the target business is generated.
作为一种可选的实施方式,在本发明实施例第二方面中,还包括:As an optional implementation manner, in the second aspect of the embodiment of the present invention, it also includes:
基于目标业务的所述数据域和所述主题域生成所述目标业务的行为域总线矩阵。A behavioral domain bus matrix of the target business is generated based on the data domain and the subject domain of the target business.
本发明实施例第三方面公开一种电子设备,包括:存储有可执行程序代码的存储器;与所述存储器耦合的处理器;所述处理器调用所述存储器中存储的所述可执行程序代码,用于执行本发明实施例第一方面公开的基于商业广告场景的数据仓库构建方法。The third aspect of the embodiments of the present invention discloses an electronic device, including: a memory storing executable program code; a processor coupled to the memory; the processor calls the executable program code stored in the memory , which is used to implement the commercial advertisement scene-based data warehouse construction method disclosed in the first aspect of the embodiment of the present invention.
本发明实施例第四方面公开一种计算机可读存储介质,其存储计算机程序,其中,所述计算机程序使得计算机执行本发明实施例第一方面公开的基于商业广告场景的数据仓库构建方法。The fourth aspect of the embodiment of the present invention discloses a computer-readable storage medium storing a computer program, wherein the computer program causes the computer to execute the method for constructing a data warehouse based on a commercial advertisement scene disclosed in the first aspect of the embodiment of the present invention.
与现有技术相比,本发明实施例具有以下有益效果:Compared with the prior art, the embodiments of the present invention have the following beneficial effects:
本发明实施例公开的基于商业广告场景的数据仓库构建方法充分考虑移动商业广告数据杂乱、数据量大、格式混乱等特点,通过获取业务流程,并据此获取对应的业务过程,然后建立数据仓库,实施例可以高效管理广告业务数据。The data warehouse construction method based on the commercial advertisement scene disclosed in the embodiment of the present invention fully considers the characteristics of mobile commercial advertisements such as messy data, large data volume, and chaotic formats, and establishes a data warehouse by obtaining the business process and corresponding business process accordingly , the embodiment can efficiently manage advertising service data.
附图说明Description of drawings
为了更清楚地说明本发明实施例中的技术方案,下面将对实施例中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following will briefly introduce the accompanying drawings that need to be used in the embodiments. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For Those of ordinary skill in the art can also obtain other drawings based on these drawings without making creative efforts.
图1是本发明实施例公开的基于商业广告场景的数据仓库构建方法的流程示意图;Fig. 1 is a schematic flow diagram of a data warehouse construction method based on a commercial advertisement scene disclosed in an embodiment of the present invention;
图2是本发明实施例提供的一种基于商业广告场景的数据仓库构建装置的结构示意图;Fig. 2 is a schematic structural diagram of a data warehouse construction device based on a commercial advertisement scene provided by an embodiment of the present invention;
图3是本发明实施例提供的一种电子设备的结构示意图;Fig. 3 is a schematic structural diagram of an electronic device provided by an embodiment of the present invention;
图4是本发明实施例提供的层级调用流向图。FIG. 4 is a flow chart of hierarchical calls provided by the embodiment of the present invention.
具体实施方式Detailed ways
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.
需要说明的是,本发明的说明书和权利要求书中的术语“第一”、“第二”、“第三”、“第四”等是用于区别不同的对象,而不是用于描述特定顺序。本发明实施例的术语“包括”和“具有”以及他们的任何变形,意图在于覆盖不排他的包含,示例性地,包含了一系列步骤或单元的过程、方法、系统、产品或设备不必限于清楚地列出的那些步骤或单元,而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。It should be noted that the terms "first", "second", "third", and "fourth" in the specification and claims of the present invention are used to distinguish different objects, rather than to describe specific order. The terms "comprising" and "having" and any variations thereof in the embodiments of the present invention are intended to cover a non-exclusive inclusion. For example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to Those steps or elements are not explicitly listed, but may include other steps or elements not explicitly listed or inherent to the process, method, product or apparatus.
本发明实施例公开了基于商业广告场景的数据仓库构建方法、装置、电子设备及存储介质,充分考虑移动商业广告数据杂乱、数据量大、格式混乱等特点,通过获取业务流程,并据此获取对应的业务过程,然后建立数据仓库,实施例可以高效管理广告业务数据。The embodiment of the present invention discloses a data warehouse construction method, device, electronic equipment, and storage medium based on a commercial advertisement scene, and fully considers the characteristics of mobile commercial advertisement data messy, large data volume, and chaotic format. Corresponding business processes, and then establish a data warehouse, the embodiment can efficiently manage advertising business data.
实施例一Embodiment one
请参阅图1,图1是本发明实施例公开的基于商业广告场景的数据仓库构建方法的流程示意图。其中,本发明实施例所描述的方法的执行主体为由软件或/和硬件组成的执行主体,该执行主体可以通过有线或/和无线方式接收相关信息,并可以发送一定的指令。当然,其还可以具有一定的处理功能和存储功能。该执行主体可以控制多个设备,例如远程的物理服务器或云服务器以及相关软件,也可以是对某处安置的设备进行相关操作的本地主机或服务器以及相关软件等。在一些场景中,还可以控制多个存储设备,存储设备可以与设备放置于同一地方或不同地方。如图1所示,该基于基于商业广告场景的数据仓库构建方法包括以下步骤:Please refer to FIG. 1 . FIG. 1 is a schematic flowchart of a method for constructing a data warehouse based on a commercial advertisement scenario disclosed in an embodiment of the present invention. Wherein, the execution subject of the method described in the embodiment of the present invention is an execution subject composed of software or/and hardware, and the execution subject can receive relevant information through wired or/and wireless means, and can send certain instructions. Of course, it may also have certain processing functions and storage functions. The execution subject can control multiple devices, such as a remote physical server or cloud server and related software, or a local host or server and related software that perform related operations on devices placed somewhere. In some scenarios, multiple storage devices can also be controlled, and the storage device and the device can be placed in the same place or in a different place. As shown in Figure 1, the data warehouse construction method based on the commercial advertisement scenario includes the following steps:
101、对目标业务进行调研以获取不同目标业务所分别对应的业务流程。101. Conduct research on target businesses to obtain business processes corresponding to different target businesses.
实施例根据业务线情况可分为业务调研和需求调研,包括构建大数据的数据仓库和两种需求调研途径,并梳理出业务的整体业务架构和整体数据框架。其中,业务调研是构建大数据数据仓库的前提,需要了解各个业务线的业务有什么异同,以及各个业务线可以细分为哪几个业务模块,每个业务模块具有的业务流程是怎样的。而需求调研的凸筋包括两种,一是与相关的工作人员了解数据诉求,二是对报表系统中现有的报表进行研究分析。基于调研结果输出调研包括,梳理出业务线的整体业务架构、各个业务模块之间的联系与信息流动的流程;梳理出业务线的整体数据框架、各个业务模块中的主要业务功能和数据类型。The embodiment can be divided into business research and demand research according to the business line situation, including building a big data data warehouse and two demand research approaches, and sorting out the overall business structure and overall data framework of the business. Among them, business research is the premise of building a big data data warehouse. It is necessary to understand the similarities and differences of the business of each business line, as well as which business modules each business line can be subdivided into, and what is the business process of each business module. There are two types of convex tendons in demand research, one is to understand the data demands with relevant staff, and the other is to conduct research and analysis on the existing reports in the report system. Based on the research results, the output research includes sorting out the overall business structure of the business line, the connection between various business modules and the flow of information flow; sorting out the overall data framework of the business line, the main business functions and data types in each business module.
102、根据所述业务流程确定每一个目标业务中的业务事件或者业务动作,以获取对应的业务过程。102. Determine a business event or business action in each target business according to the business process, so as to obtain a corresponding business process.
实施例结合业务线调研报告,确定业务模块/项目以及每个模块中的事件或者动作,抽象出业务过程。例如,商业化数仓业务过程包括有曝光、请求、点击、下载、计费、充值、消费、激活、留存、注册、登录、安装等,则整合为商业化广告的项目对应的业务过程包括曝光、请求、点击、下载、计费、充值、消费、激活、留存、注册、登录、安装。The embodiment combines business line research reports to determine business modules/items and events or actions in each module, and abstracts business processes. For example, the commercial data warehouse business process includes exposure, request, click, download, billing, recharge, consumption, activation, retention, registration, login, installation, etc., and the business process corresponding to the project integrated into commercial advertising includes exposure , request, click, download, billing, recharge, consumption, activation, retention, registration, login, installation.
实施例中,本步骤具体是根据业务流程确定对应的目标业务的业务操作节点,所述业务操作节点包括业务事件和业务动作;整理所述业务事件和业务动作,提取必要业务操作节点,并按照所述必要业务操作节点在所述业务流程中的次序生成对应的业务过程。In the embodiment, this step is specifically to determine the business operation node of the corresponding target business according to the business process, the business operation node includes business events and business actions; organize the business events and business actions, extract the necessary business operation nodes, and follow the The order of the necessary business operation nodes in the business process generates a corresponding business process.
其中,将所述业务过程进行抽象集合形成目标业务的数据域。采集目标业务的主体内容以获得所述目标业务对应的业务主题,生成目标业务的主题域。Wherein, the business process is abstracted and assembled to form the data domain of the target business. The main content of the target business is collected to obtain the business theme corresponding to the target business, and the subject field of the target business is generated.
数据域的划分原则是面向业务数据,将业务过程或者维度进行抽象的几何,需要长期维护,不轻易变换和频繁修改,数据域必须具有扩展性,新增业务能不影响的扩展或者新增,把业务相近、粒度兼容的维度和度量值进行抽象整合。示例性的,如下表所示,对移动商业广告业务线进行数据域划分:The principle of dividing the data domain is to face the business data, and abstract the business process or dimension. It needs long-term maintenance, and it is not easy to change and modify frequently. The data domain must be scalable, and the new business can be expanded or added without affecting it. Abstract and integrate dimensions and metrics that are similar in business and compatible in granularity. Exemplarily, as shown in the following table, data domains are divided for the mobile commercial advertisement business line:
主题域的划分原则是面向数据应用分析,针对具体的业务分析主体,如商品分析、订单分析,数据具备一定的相关性或者业务相近,突出分析的主题。The principle of subject domain division is data application analysis, for specific business analysis subjects, such as commodity analysis, order analysis, data with certain relevance or similar business, highlighting the subject of analysis.
示例性的,如下表示出的移动商业广告业务线的主题域划分:Exemplarily, the subject domain division of the mobile commercial advertisement business line is shown in the following table:
在此基础上,实施例还包括基于目标业务的所述数据域和所述主题域生成所述目标业务的行为域总线矩阵。On this basis, the embodiment further includes generating a behavior domain bus matrix of the target business based on the data domain and the subject domain of the target business.
实施例明确每个数据域下有哪些业务过程后,即可构建总线矩阵。明确业务过程与哪些维度相关,并定义每个数据域下的业务过程和维度。The embodiment specifies the business processes under each data domain, and then the bus matrix can be constructed. Clarify which dimensions the business process is related to, and define the business process and dimensions under each data domain.
示例性的,下表示出了某业务线的行为域总线矩阵:As an example, the following table shows the behavior domain bus matrix of a business line:
103、建立目标业务的数据仓库,所述数据仓库至少包括维表、明细表和汇总表,所述维表用于统一目标业务的计算算法以及确定目标业务的关联表格,所述明细表用于记录每一个目标业务对应的业务过程,所述汇总表用于记录目标业务的主题域和数据域。103. Establish a data warehouse for the target business. The data warehouse includes at least a dimension table, a detailed table, and a summary table. The dimension table is used to unify the calculation algorithm of the target business and determine the associated table of the target business. The detailed table is used for The business process corresponding to each target business is recorded, and the summary table is used to record the subject domain and data domain of the target business.
实施例中,数据仓库包括ODS层级、DW层级、DMA层级、DMT层级和DA层级,所述ODS层级为原始数据的接入层,所述DW层级用于存储目标业务的业务过程,所述DMA层级用于对数据进行融合汇总,所述DMT层级用于对目标业务主题进行汇总,所述DA层级用于响应个性化数据需求。并且,数据仓库的ODS层级、DW层级、DMA层级、DMT层级和DA层级之间按照预设规则进行调用。In an embodiment, the data warehouse includes an ODS level, a DW level, a DMA level, a DMT level and a DA level, the ODS level is the access level of the original data, the DW level is used to store the business process of the target business, and the DMA level The level is used to integrate and summarize data, the DMT level is used to summarize target business topics, and the DA level is used to respond to personalized data requirements. Moreover, the ODS level, DW level, DMA level, DMT level and DA level of the data warehouse are called according to preset rules.
实施例的创建数据仓库也即是创建模型,或者的创建不同的表格。主要包括维度及属性的规范定义,维表、明细事实表和汇总事实表的模型设计。其中,维表设计是基于维度建模理念,建立数据维表,以降低数据计算口径和算法不统一的风险。维表设计结合业务,确定维表使用范围,完成维度的初步定义,并保证维度的一致性。确定主维表,主维表通常是ODS表,直接与业务系统同步,确定相关维表,确定哪些表和主维表存在关联关系,并选择其中的某些表用于生成维度属性,确定维度属性,从主维表以及相关维表中选择维度属性或生成新的维度属性。实施例的维表设计原则是优先使用公共维表,维表设计考虑复用性和一致性,维度属性尽量覆盖业务的数据统计、分析、探查等需求,维度属性除编码字段外,还应尽可能包含文字性描述字段,避免过于频繁的更新维表的数据。The creation of the data warehouse in the embodiment is also the creation of the model, or the creation of different tables. It mainly includes the standard definition of dimensions and attributes, and the model design of dimension tables, detailed fact tables and summary fact tables. Among them, the dimension table design is based on the concept of dimensional modeling, and the data dimension table is established to reduce the risk of inconsistent data calculation caliber and algorithm. Dimension table design is combined with business to determine the scope of use of dimension tables, complete the preliminary definition of dimensions, and ensure the consistency of dimensions. Determine the main dimension table. The main dimension table is usually an ODS table, which is directly synchronized with the business system, determines the related dimension tables, determines which tables are associated with the main dimension table, and selects some of the tables to generate dimension attributes to determine the dimension Attributes, select dimension attributes from the main dimension table and related dimension tables or generate new dimension attributes. The dimension table design principle of the embodiment is to give priority to the use of public dimension tables. Dimension table design considers reusability and consistency. Dimension attributes cover business data statistics, analysis, and exploration as much as possible. It may contain textual description fields to avoid updating the data of the dimension table too frequently.
明细表作为数据仓库维度建模的核心,紧紧围绕着业务过程进行设计。结合业务数据情况,可以为每个业务过程建立一个事实表,也可以将多个相近或者相似的业务过程建立一个事实表。针对业务过程确定一个粒度,就确定了事实表中每一行所表达的细节层次。保证所有的事实按照同样的细节层次记录。如果有字段可以表达这个粒度,可以定义为事实表的主键。应该尽量选择最细级别的粒度,以确保事实表的应用具有最大的灵活性。选定好业务过程并且确定粒度后,就可以确定维度信息,选择能够描述清楚业务过程的维度信息。选定好业务过程并且确定粒度后,就可以确定维度信息,选择能够描述清楚业务过程的维度信息。事实表应该包含与业务过程描述有关的所有事实,且事实的粒度要与所确定的事实表的粒度一致。确定需要哪些相关维度,进行维度冗余。在事实表中存储各种类型的常用维度信息,减少下游用户使用时关联多个表的操作,减少计算开销,提高使用效率。明细表的设计原则是尽可能包含所有与业务过程相关的事实、只选择与业务过程相关的事实、在同一个事实表中,不能包含多种不同粒度的事实。事实表中所有事实的粒度需要与表声明的粒度保持一致、事实的单位要保持一致、对事实的 null值要做统一处理。As the core of the dimensional modeling of the data warehouse, the detailed table is designed around the business process. Combined with the business data situation, a fact table can be established for each business process, or a fact table can be created for multiple similar or similar business processes. Identifying a granularity for the business process determines the level of detail expressed by each row in the fact table. Ensure that all facts are documented with the same level of detail. If there is a field that can express this granularity, it can be defined as the primary key of the fact table. The finest level of granularity should be chosen as much as possible to ensure maximum flexibility in the application of the fact table. After the business process is selected and the granularity is determined, the dimension information can be determined, and the dimension information that can describe the business process clearly can be selected. After the business process is selected and the granularity is determined, the dimension information can be determined, and the dimension information that can describe the business process clearly can be selected. The fact table should contain all the facts related to the description of the business process, and the granularity of the facts should be consistent with the granularity of the determined fact table. Determine which related dimensions are needed for dimension redundancy. Store various types of commonly used dimension information in the fact table, reduce the operation of associating multiple tables when used by downstream users, reduce computing overhead, and improve usage efficiency. The design principle of the detailed table is to include all the facts related to the business process as much as possible, and only select the facts related to the business process. In the same fact table, facts of different granularities cannot be included. The granularity of all facts in the fact table needs to be consistent with the granularity of the table declaration, the unit of the fact must be consistent, and the null value of the fact must be handled uniformly.
汇总表以分析的主题对象作为建模驱动,基于上层的应用和产品的指标需求构建公共粒度的汇总表。其设计步骤是确定汇总的主题域/数据域、确定汇总的维度、确定汇总的事实。汇总表的设计原则是数据公用性,维度和事实尽可能覆盖相关业务使用数据的场景、尽量不要在同一个表中存储不同粒度的汇总数据,如有必要,可用分区存储、模型复用性,尽可能多地覆盖下游使用数据的场景、指标加工范围尽量不包含复合型指标。The summary table takes the subject object of analysis as the modeling drive, and builds a public granularity summary table based on the upper-level application and product indicator requirements. Its design steps are to determine the subject domain/data domain of the summary, determine the dimension of the summary, and determine the fact of the summary. The design principle of the summary table is data commonality. Dimensions and facts cover relevant business use data scenarios as much as possible. Try not to store summary data of different granularities in the same table. If necessary, partition storage and model reusability can be used. Cover as many downstream use data scenarios as possible, and the scope of index processing does not include composite indicators as much as possible.
实施例中,还包括层级的调用,参见图4,预设规则可以包括DW层深度不大于2;DMA层深度不大于2;DMT层深度不大于1,不允许层级回流调用,应用层优先调用DMA/DMT数据集市汇总层,已经存在DMA/DMT层数据,不允许应用层跨过从ODS/DW层重复加工数据。公共层团队应该积极了解应用层数据的建设要求,将公用的数据沉淀到DM层,为其他团队提供数据服务。应用层团队也需积极配合公共层团队进行持续的DM层建设的改造和迁移。必须避免出现过度的ODS层引用和不合理的数据复制和子集合冗余。In the embodiment, it also includes layer calls. See Figure 4. The preset rules can include that the depth of the DW layer is not greater than 2; the depth of the DMA layer is not greater than 2; the depth of the DMT layer is not greater than 1. Layer reflow calls are not allowed, and the application layer calls preferentially The DMA/DMT data mart summary layer already has DMA/DMT layer data, and the application layer is not allowed to repeatedly process data from the ODS/DW layer. The public layer team should actively understand the construction requirements of the application layer data, deposit the public data to the DM layer, and provide data services for other teams. The application layer team also needs to actively cooperate with the public layer team to carry out continuous transformation and migration of DM layer construction. Excessive ODS layer references and unreasonable data duplication and sub-collection redundancy must be avoided.
并且还有退维处理,退维是指在模型物理实现中将各维度的常用属性退化到事实表中,以大大提高对事实表的过滤查询、统计聚合等操作的效率,下游层级模型使用的维度属性数据下沉本层模型中进行,在这里指 DW/DMA/DMT/DA层模型中的维度属性下沉,将维度属性从上一层级下沉到1-n层级模型表。其中,DW层降维是将下游DMA/DMT/DA层常规且稳定的维度下沉在该层进行存放,方便使用,减少重复关联维表,需考虑数据回溯计算成本因素,易变动的维度不建议退到该层。DMT层降维是将下游DA层的维度属性退到该层,将能够关联使用的维度尽可能下沉到该层,解决易变动维度问题,灵活应用,DIM降维是将维表做扁平化处理,维度打横,扁平化处理就是将能够整合的维度全部以字段的形式放到一个模型表里,包含易变动维度。And there is also dimension reduction processing. Dimension reduction refers to degenerating the common attributes of each dimension into the fact table in the physical implementation of the model, so as to greatly improve the efficiency of filtering query, statistical aggregation and other operations on the fact table. The downstream hierarchical model uses Dimension attribute data sinking is carried out in the model of this layer. Here, it refers to the sinking of dimension attributes in the DW/DMA/DMT/DA layer model, and sinks the dimension attributes from the upper layer to the 1-n layer model table. Among them, the DW layer dimensionality reduction is to sink the conventional and stable dimensions of the downstream DMA/DMT/DA layer into this layer for storage, which is convenient to use and reduces repeated associated dimension tables. It is recommended to retreat to this layer. Dimensionality reduction in the DMT layer is to return the dimension attributes of the downstream DA layer to this layer, and sink the dimensions that can be used in association to this layer as much as possible, so as to solve the problem of variable dimensions and apply them flexibly. DIM dimensionality reduction is to flatten the dimension table Processing, dimension horizontalization, and flattening are to put all the dimensions that can be integrated into a model table in the form of fields, including variable dimensions.
示例性的,广告曝光、点击、计费表comm_dw.dw_ssp_expo_click_hi,将广告(dim_ad_marketing_ad_info_hf)、广告位(comm_dim.dim_ad_pst_info_h)、创意(comm_dim.dim_adad_info_h)、广告组(dim_ad_marketing_ad_group_info_hf)、计划(dim_ad_plan_info_hf)、广告主(dim_ad_advertiser_info_h)的稳定维度属性(媒体ID,广告付费形式、广告组ID、OCPC转换目标、计划ID、广告推广形式、广告位类型等)退化到明细表。Exemplary, ad exposure, click, billing table comm_dw.dw_ssp_expo_click_hi, ad (dim_ad_marketing_ad_info_hf), ad slot (comm_dim.dim_ad_pst_info_h), creative (comm_dim.dim_adad_info_h), ad group (dim_ad_marketing_ad_group_info_ hf), plan (dim_ad_plan_info_hf), advertiser (dim_ad_advertiser_info_h)'s stable dimension attributes (media ID, advertising payment form, ad group ID, OCPC conversion goal, plan ID, advertising promotion form, ad slot type, etc.) degenerate into a detailed table.
实施例二Embodiment two
请参阅图2,图2是本发明实施例公开的基于商业广告场景的数据仓库构建装置的结构示意图。如图2所示,该基于商业广告场景的数据仓库构建装置可以包括:业务调研模块201、过程获取模块202、仓库创建模块203,其中,业务调研模块201:用于对目标业务进行调研以获取不同目标业务所分别对应的业务流程;过程获取模块202:用于根据所述业务流程确定每一个目标业务中的业务事件或者业务动作,以获取对应的业务过程;仓库创建模块203:用于建立目标业务的数据仓库,所述数据仓库至少包括维表、明细表和汇总表,所述维表用于统一目标业务的计算算法以及确定目标业务的关联表格,所述明细表用于记录每一个目标业务对应的业务过程,所述汇总表用于记录目标业务的主题域和数据域。Please refer to FIG. 2 . FIG. 2 is a schematic structural diagram of a data warehouse construction device based on a commercial advertisement scene disclosed in an embodiment of the present invention. As shown in Figure 2, the data warehouse construction device based on the commercial advertisement scene may include: a
实施例中,数据仓库包括ODS层级、DW层级、DMA层级、DMT层级和DA层级,所述ODS层级为原始数据的接入层,所述DW层级用于存储目标业务的业务过程,所述DMA层级用于对数据进行融合汇总,所述DMT层级用于对目标业务主题进行汇总,所述DA层级用于响应个性化数据需求。数据仓库的ODS层级、DW层级、DMA层级、DMT层级和DA层级之间按照预设规则进行调用。In an embodiment, the data warehouse includes an ODS level, a DW level, a DMA level, a DMT level and a DA level, the ODS level is the access level of the original data, the DW level is used to store the business process of the target business, and the DMA level The level is used to integrate and summarize data, the DMT level is used to summarize target business topics, and the DA level is used to respond to personalized data requirements. The ODS level, DW level, DMA level, DMT level and DA level of the data warehouse are called according to preset rules.
本实施例与实施例一的技术手段及技术效果本质相同,在此不再赘述。The technical means and technical effects of this embodiment are essentially the same as those of Embodiment 1, and will not be repeated here.
实施例三Embodiment three
请参阅图3,图3是本发明实施例公开的一种电子设备的结构示意图。电子设备可以是计算机以及服务器等,当然,在一定情况下,还可以是手机、平板电脑以及监控终端等智能设备,以及具有处理功能的图像采集装置。如图3所示,该电子设备可以包括:Please refer to FIG. 3 . FIG. 3 is a schematic structural diagram of an electronic device disclosed in an embodiment of the present invention. Electronic equipment can be computers and servers, etc. Of course, under certain circumstances, it can also be smart equipment such as mobile phones, tablet computers, and monitoring terminals, as well as image acquisition devices with processing functions. As shown in Figure 3, the electronic equipment may include:
存储有可执行程序代码的存储器301;A
与存储器301耦合的处理器302;a
其中,处理器302调用存储器301中存储的可执行程序代码,执行实施例一中的基于商业广告场景的数据仓库构建方法中的部分或全部步骤。Wherein, the
本发明实施例公开一种计算机可读存储介质,其存储计算机程序,其中,该计算机程序使得计算机执行实施例一中的基于商业广告场景的数据仓库构建方法中的部分或全部步骤。The embodiment of the present invention discloses a computer-readable storage medium, which stores a computer program, wherein the computer program causes the computer to execute some or all of the steps in the method for constructing a data warehouse based on a commercial advertisement scene in Embodiment 1.
本发明实施例还公开一种计算机程序产品,其中,当计算机程序产品在计算机上运行时,使得计算机执行实施例一中的基于商业广告场景的数据仓库构建方法中的部分或全部步骤。The embodiment of the present invention also discloses a computer program product, wherein when the computer program product is run on a computer, the computer is made to execute some or all of the steps in the method for constructing a data warehouse based on a commercial advertisement scene in the first embodiment.
本发明实施例还公开一种应用发布平台,其中,应用发布平台用于发布计算机程序产品,其中,当计算机程序产品在计算机上运行时,使得计算机执行实施例一中的基于商业广告场景的数据仓库构建方法中的部分或全部步骤。The embodiment of the present invention also discloses an application distribution platform, wherein the application distribution platform is used to distribute computer program products, wherein, when the computer program products run on the computer, the computer executes the data based on the commercial advertisement scene in the first embodiment Some or all of the steps in a warehouse build method.
在本发明的各种实施例中,应理解,所述各过程的序号的大小并不意味着执行顺序的必然先后,各过程的执行顺序应以其功能和内在逻辑确定,而不应对本发明实施例的实施过程构成任何限定。In various embodiments of the present invention, it should be understood that the sequence numbers of the processes described above do not imply the necessary order of execution, and the execution order of each process should be determined by its functions and internal logic, rather than by the present invention. The implementation of the examples constitutes no limitation.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物单元,即可位于一个地方,或者也可以分布到多个网络单元上。可根据实际的需要选择其中的部分或全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, located in one place, or distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
另外,在本发明各实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。所述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The integrated units can be implemented in the form of hardware or in the form of software functional units.
所述集成的单元若以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可获取的存储器中。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或者部分,可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储器中,包括若干请求用以使得一台计算机设备(可以为个人计算机、服务器或者网络设备等,具体可以是计算机设备中的处理器)执行本发明的各个实施例所述方法的部分或全部步骤。If the integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer-accessible memory. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product, and the computer software product is stored in a memory , including several requests to make a computer device (which may be a personal computer, a server, or a network device, etc., specifically, a processor in the computer device) execute part or all of the steps of the method described in each embodiment of the present invention.
在本发明所提供的实施例中,应理解,“与A对应的B”表示B与A相关联,根据A可以确定B。但还应理解,根据A确定B并不意味着仅仅根据A确定B,还可以根据A和/或其他信息确定B。In the embodiments provided by the present invention, it should be understood that "B corresponding to A" means that B is associated with A, and B can be determined according to A. However, it should also be understood that determining B based on A does not mean determining B only based on A, and B can also be determined based on A and/or other information.
本领域普通技术人员可以理解所述实施例的各种方法中的部分或全部步骤是可以通过程序来指令相关的硬件来完成,该程序可以存储于一计算机可读存储介质中,存储介质包括只读存储器(Read-Only Memory,ROM)、随机存储器(Random Access Memory,RAM)、可编程只读存储器(Programmable Read-only Memory,PROM)、可擦除可编程只读存储器(Erasable Programmable Read-Only Memory,EPROM)、一次可编程只读存储器(One-time Programmable Read-Only Memory,OTPROM)、电子抹除式可复写只读存储器(Electrically-Erasable Programmable Read-Only Memory,EEPROM)、只读光盘(CompactDisc Read-Only Memory,CD-ROM)或其他光盘存储器、磁盘存储器、磁带存储器、或者能够用于携带或存储数据的计算机可读的任何其他介质。Those skilled in the art can understand that some or all of the steps in the various methods of the embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium, and the storage medium includes only Read-Only Memory (ROM), Random Access Memory (RAM), Programmable Read-only Memory (PROM), Erasable Programmable Read-Only Memory (Erasable Programmable Read-Only Memory, EPROM), One-time Programmable Read-Only Memory (OTPROM), Electrically-Erasable Programmable Read-Only Memory (EEPROM), CD-ROM ( CompactDisc Read-Only Memory, CD-ROM) or other optical disk storage, magnetic disk storage, tape storage, or any other computer-readable medium that can be used to carry or store data.
以上对本发明实施例公开的基于商业广告场景的数据仓库构建方法、装置、电子设备及存储介质进行了详细介绍,本文中应用了具体个例对本发明的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本发明的方法及其核心思想;同时,对于本领域的一般技术人员,依据本发明的思想,在具体实施方式及应用范围上均会有改变之处,综上所述,本说明书内容不应理解为对本发明的限制。The above is a detailed introduction to the data warehouse construction method, device, electronic equipment and storage medium based on the commercial advertisement scene disclosed in the embodiment of the present invention. In this paper, specific examples are used to illustrate the principle and implementation of the present invention. The above embodiments The description is only used to help understand the method of the present invention and its core idea; at the same time, for those of ordinary skill in the art, according to the idea of the present invention, there will be changes in the specific implementation and scope of application. In summary, As stated above, the content of this specification should not be construed as limiting the present invention.
Claims (6)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202211372840.1A CN115422169B (en) | 2022-11-04 | 2022-11-04 | Data warehouse construction method and device based on commercial advertisement scene |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202211372840.1A CN115422169B (en) | 2022-11-04 | 2022-11-04 | Data warehouse construction method and device based on commercial advertisement scene |
Publications (2)
Publication Number | Publication Date |
---|---|
CN115422169A CN115422169A (en) | 2022-12-02 |
CN115422169B true CN115422169B (en) | 2023-07-14 |
Family
ID=84207677
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202211372840.1A Active CN115422169B (en) | 2022-11-04 | 2022-11-04 | Data warehouse construction method and device based on commercial advertisement scene |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN115422169B (en) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116629718B (en) * | 2023-07-24 | 2023-09-29 | 清华四川能源互联网研究院 | An industrial data traceback method, device, electronic equipment and storage medium |
CN117763059B (en) * | 2023-12-27 | 2024-10-22 | 江苏金融租赁股份有限公司 | Model construction method and system for data warehouse and data mart |
CN118051503A (en) * | 2024-04-16 | 2024-05-17 | 长城信息股份有限公司 | Data warehouse construction method and device based on index system |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112783887A (en) * | 2019-11-07 | 2021-05-11 | 北京沃东天骏信息技术有限公司 | Data processing method and device based on data warehouse |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070021992A1 (en) * | 2005-07-19 | 2007-01-25 | Srinivas Konakalla | Method and system for generating a business intelligence system based on individual life cycles within a business process |
CN109669934B (en) * | 2018-12-11 | 2023-08-01 | 江苏瑞中数据股份有限公司 | A data warehouse system suitable for electric power customer service business and its construction method |
CN111008197A (en) * | 2019-11-20 | 2020-04-14 | 王锦志 | Data center design method for power marketing service system |
CN111460045A (en) * | 2020-03-02 | 2020-07-28 | 心医国际数字医疗系统(大连)有限公司 | Modeling method, model, computer equipment and storage medium for data warehouse construction |
CN112860659B (en) * | 2021-01-18 | 2023-09-01 | 北京奇艺世纪科技有限公司 | Data warehouse construction method, device, equipment and storage medium |
-
2022
- 2022-11-04 CN CN202211372840.1A patent/CN115422169B/en active Active
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112783887A (en) * | 2019-11-07 | 2021-05-11 | 北京沃东天骏信息技术有限公司 | Data processing method and device based on data warehouse |
Non-Patent Citations (1)
Title |
---|
一个数据仓库建模工具的设计与实现;王海峰等;《计算机工程》(第13期);220-222 * |
Also Published As
Publication number | Publication date |
---|---|
CN115422169A (en) | 2022-12-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN115422169B (en) | Data warehouse construction method and device based on commercial advertisement scene | |
US10853847B2 (en) | Methods and systems for near real-time lookalike audience expansion in ads targeting | |
CN113609374B (en) | Data processing method, device, equipment and storage medium based on content push | |
CN109784973B (en) | Advertisement putting method and device based on big data analysis and electronic equipment | |
CN110147882B (en) | Neural network model training method, crowd diffusion method, device and equipment | |
CN109684330A (en) | User's portrait base construction method, device, computer equipment and storage medium | |
US12148027B2 (en) | Data processing method and apparatus, device, and readable storage medium | |
CN102708130A (en) | Scalable engine that computes user micro-segments for offer matching | |
WO2018161940A1 (en) | Method and device for pushing media file, data storage medium, and electronic apparatus | |
US10182104B1 (en) | Automatic propagation of resource attributes in a provider network according to propagation criteria | |
CN115544183B (en) | Data visualization method, device, computer equipment and storage medium | |
CN112734502A (en) | Testing method and device for multimedia information directional delivery and electronic equipment | |
CN114820080A (en) | User grouping method, system, device and medium based on crowd flow | |
CN112862598A (en) | Channel information management method and device, electronic equipment and medium | |
CN112785324B (en) | Information processing method, information processing apparatus, electronic device, and medium | |
CN115062215A (en) | Method, device and storage medium for recommending multimedia content | |
CN108416610B (en) | User history feedback information forming method and advertisement putting frequency control method | |
CN116841505A (en) | Index generation method, device, computer equipment and storage medium | |
CN114637903A (en) | A public opinion data collection system for directional target data expansion | |
CN114357280A (en) | Information pushing method and device, electronic equipment and computer readable medium | |
CN115630170B (en) | Document recommendation method, system, terminal and storage medium | |
CN118193251A (en) | A business support and control platform based on Web framework technology | |
CN111127077A (en) | Recommendation method and device based on stream computing | |
CN116303645A (en) | Method, device, equipment and storage medium for quickly locating interpersonal relationship paths | |
CN112579075B (en) | Method and device for reconstructing homogeneous system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |