CN108519967B - Chart visualization method and device, terminal and storage medium - Google Patents

Abstract

The embodiment of the invention discloses a chart visualization method, a chart visualization device, a terminal and a storage medium. The method comprises the following steps: responding to the fetching instruction, connecting a data source and acquiring metadata; providing a corresponding chart field template according to the chart type selected by the user, so that the user can configure the chart field attribute in the chart field template according to the metadata; responding to a chart generation instruction, and sending a data processing program matched with a chart type selected by a user to a connected data source, wherein the data processing program is used for operating data to be processed in the data source according to a field attribute configured by the user; and receiving the operation result of the data processing program, and rendering the operation result to obtain a chart. The embodiment of the invention solves the problem of low visualization development efficiency caused by connecting the data source and loading the data, realizes that the data can not be loaded to the local in the chart visualization process, completes the operation on the data source, improves the chart visualization efficiency and improves the user experience.

Description

Chart visualization method, device, terminal and storage medium

technical field

Embodiments of the present invention relate to big data processing, and in particular, to a chart visualization method, device, terminal, and storage medium.

Background technique

Data chart visualization refers to the process of representing data in large data sets in the form of graphical images and using data analysis and development tools to discover unknown information in them.

At present, the chart visualization tools include: Excel, tableau, Infogram, piktochart, Baidu Tushuo, NetEase Youshu, echart, etc. They are divided into two categories according to whether they can connect to the database: one is mainly open source or online editing, without connecting to the database, importing Or paste the summary data in excel format for visual display, which is simple and easy to operate; the other type is mainly based on business chart visualization software, which connects to the database, loads the data into memory or local, supports simple summary, and conducts visual display, with powerful functions.

However, the first type of chart visualization tool does not support database connection, so it cannot automatically update data. The amount of data is small and can only be used as an offline tool, which is not conducive to the modular integration of development tools of the data platform. The second type of commercial tools can be connected to the database, but the data needs to be loaded into the memory or hard disk of the server or client before the development of the data report. low efficiency.

SUMMARY OF THE INVENTION

Embodiments of the present invention provide a chart visualization method, device, terminal, and storage medium, so as to solve the problem in the prior art that the connection between data sources and development efficiency cannot be taken into account.

In a first aspect, an embodiment of the present invention provides a chart visualization method, which includes:

In response to the fetch instruction, connect to the data source and obtain metadata, where the metadata is field data of the data to be processed in the data source;

Provide a corresponding chart field template according to the chart type selected by the user, so that the user can configure chart field properties in the chart field template according to the metadata;

In response to the chart generation instruction, a data processing program matching the chart type selected by the user is sent to the connected data source, and the data processing program is used to perform processing in the data source according to the field attributes configured by the user. data operation;

A running result of the data processing program is received, and a graph is obtained by rendering the running result.

In a second aspect, an embodiment of the present invention further provides a chart visualization device, the device comprising:

a metadata acquisition module, used to connect a data source and acquire metadata in response to a fetch instruction, where the metadata is field data of the data to be processed;

a template display module, configured to provide a corresponding chart field template according to the chart type selected by the user, so that the user can configure chart field properties in the chart field template according to the metadata;

The program sending module is used for sending a data processing program matching the chart type selected by the user to the connected data source in response to the chart generation instruction, and the data processing program is configured to perform operations on the data to be processed in the data source;

The chart rendering module receives the running result of the data processing program, and renders the running result to obtain a chart.

In a third aspect, an embodiment of the present invention further provides a terminal, where the terminal includes:

one or more processors;

a storage device for storing one or more programs;

When the one or more programs are executed by the one or more processors, the one or more processors implement the chart visualization method according to any one of the embodiments of the present invention.

In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, implements the chart visualization method according to any one of the embodiments of the present invention.

The embodiment of the present invention connects a data source and provides users with templates of various chart types, sends a data processing program to the data source, performs data operations according to the user's configuration of the template chart field attributes, receives the operation results and renders them to obtain a visualized chart , which solves the problem of low efficiency of visualization development caused by connecting data sources and loading data, realizing that in the process of visualization of diagrams, data can not be loaded locally, using metadata to complete configuration diagrams, and completing operations in data sources, improving the efficiency of diagram visualization, Improved user experience.

Description of drawings

FIG. 1 is a flowchart of a chart visualization method in Embodiment 1 of the present invention;

2 is a schematic structural diagram of a chart visualization device in Embodiment 2 of the present invention;

FIG. 3 is a schematic structural diagram of a terminal in Embodiment 3 of the present invention.

Detailed ways

The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention, but not to limit the present invention. In addition, it should be noted that, for the convenience of description, the drawings only show some but not all structures related to the present invention.

Example 1

1 is a flowchart of a chart visualization method provided in Embodiment 1 of the present invention. This embodiment is applicable to the situation of statistical analysis of data. The method can be executed by a chart visualization device, which can be configured in a user terminal, for example. As shown in Figure 1, the method specifically includes:

S110. In response to the fetch instruction, connect to a data source and obtain metadata, where the metadata is field data of the data to be processed in the data source.

Among them, the data source is the database. In the embodiment of the present invention, multiple types of databases can be supported, such as MySQL, ES, Kylin, Hbase, etc. Specifically, MySQL is a relational database, and ES (ElasticSearch) is a distributed database. Full-text retrieval framework, Kylin is an open source distributed analysis engine that provides SQL query interface and multi-dimensional analysis (OLAP) on top of Hadoop/Spark to support ultra-large-scale data, HBase is a column-oriented NoSQL database. The metadata is the field data of the data to be processed in the data source, that is, the data describing the data, and may specifically be the field name (header information) of the data table to describe the content represented by the data.

When users use chart visualization products for data processing and analysis and display data with visual charts, they must first select the target data source to obtain metadata. Specifically, the acquisition of the metadata is based on a pre-edited number fetching program in a database query language, preferably SQL (Structured Query Language, structured query language). SQL language is a database query and programming language used to access data and query, update and manage relational database systems; it is also an extension of database script files. The SQL language is a high-level non-procedural programming language that allows users to work on high-level data structures. It does not require the user to specify the storage method of the data, nor does it require the user to know the specific data storage method, so different database systems with completely different underlying structures can use the same structured query language as the interface for data input and management.

Further, when connecting to the data source, send the SQL program statement to the data source, and verify whether the connection to the data source is successful, if it fails, it will prompt the data source connection failure; if the connection is successful, run SQL in the data source, and then return the success identifier and corresponding metadata.

S120. Provide a corresponding chart field template according to the chart type selected by the user, so that the user can configure chart field properties in the chart field template according to the metadata.

Among them, chart types include line charts, column charts, bar charts, combination charts, pie charts, area charts, bubble charts, scatter charts, radar charts, funnel charts, and multi-header tables. All charts are configured with different chart field templates, which have different chart configuration items, and simplify some parameter configuration items to improve the usability of the product. Chart field properties include at least one of the following: chart display name, field name, dimension, measure, graph type, whether to display by default, decimal point, line type, or color.

Specifically, after the user selects a type of chart, a corresponding template is provided for the user according to the user's selection, for the user to configure the chart field properties in the chart field template according to the metadata.

S130. In response to the chart generation instruction, send a data processing program that matches the chart type selected by the user to the connected data source, where the data processing program is used for processing the data in the data source according to the field attribute configured by the user. The data to be processed is processed.

Specifically, when the user configures the field properties of the chart, they will choose to generate the final visual chart, and the terminal will send the SQL statement-based data processing program that matches the chart type to the data source to perform data operations without first The data to be processed is loaded into the local memory in the data operation.

Further, before sending the data processing program matching the chart type selected by the user to the connected data source, the method further includes: verifying whether the chart field attributes configured by the user meet the requirements of the chart field template; If the verification is successful, the operation of generating the chart is executed; if the verification is unsuccessful, an error message is returned to prompt the user to reconfigure the chart field property.

Among them, whether it meets the requirements of the chart field template is mainly considered from two aspects. First, whether the required items in the chart configuration items are filled in; second, whether the filled field attributes meet the filling rules. Exemplarily, if the field name is not filled in the chart configuration template, the configured object data cannot be determined, and the verification will not pass.

S140. Receive the running result of the data processing program, and render the running result to obtain a graph.

Specifically, the running result of the data processing program is the data to be displayed by the visual chart, and the final visual chart can be obtained by rendering the data according to the chart field attributes configured by the user in the chart field template.

In the technical solution of this embodiment, by connecting the data source and providing the user with templates of various chart types, the data processing program is sent to the data source to perform data operation according to the user's configuration of the field attributes of the template chart, and the result of the operation is received and rendered. The visual chart solves the problem of low efficiency of visual development caused by connecting data sources and loading data. It realizes that the data can not be loaded locally during the visualization of the chart, and the metadata is used to complete the configuration chart, complete the operation in the data source, and improve the chart. Visualization efficiency improves user experience.

Embodiment 2

FIG. 2 is a schematic structural diagram of a chart visualization apparatus according to Embodiment 2 of the present invention, and this embodiment is applicable to the situation of data statistical analysis. As shown in FIG. 2 , the apparatus includes: a metadata acquisition module 210 , a template display module 220 , a program sending module 230 and a chart rendering module 240 .

Among them, the metadata obtaining module 210 is used to connect the data source and obtain the metadata in response to the fetching instruction, the metadata is the field data of the data to be processed; the template display module 220 is used for according to the chart type selected by the user A corresponding chart field template is provided for the user to configure the chart field properties in the chart field template according to the metadata; the program sending module 230 is configured to send the chart type selected by the user in response to the chart generation instruction The matching data processing program is connected to the connected data source, and the data processing program is used to perform operations on the data to be processed in the data source according to the field attributes configured by the user; the chart rendering module 240 receives the data of the data processing program. Running results, rendering the running results to obtain a graph.

In the technical solution of this embodiment, the metadata acquisition module 210 and the template display module 220 are used to connect the data source and provide users with templates of various chart types, and the program sending module 230 sends the data processing program to the data source according to the user's preference for the template chart fields. The attribute configuration performs data operation, and the graph rendering module 240 receives the operation result and renders it to obtain a visualized graph, which solves the problem of low visualization development efficiency caused by connecting the data source and loading data, and realizes that the graph visualization process does not need to load data into the graph. Locally, the configuration chart is completed by using metadata, and the operation is completed in the data source, which improves the visualization efficiency of the chart and improves the user experience.

Further, the chart visualization device also includes:

The first verification module is used to verify whether the chart field properties configured by the user meet the requirements of the chart field template before sending the data processing program matching the chart type selected by the user to the connected data source.

Further, the chart visualization device also includes:

The second verification module is used to verify whether the connection to the data source is successful before obtaining the metadata.

Further, the chart field attribute includes at least one of the following: chart display name, dimension, measure, graphic type, whether to display by default, decimal point, line type or color.

The chart visualization apparatus provided by the embodiment of the present invention can execute the chart visualization method provided by any embodiment of the present invention, and has functional modules and beneficial effects corresponding to the execution method.

Embodiment 3

FIG. 3 is a schematic structural diagram of a terminal in Embodiment 3 of the present invention. Figure 3 shows a block diagram of an exemplary terminal 312 suitable for use in implementing embodiments of the present invention. The terminal 312 shown in FIG. 3 is only an example, and should not impose any limitations on the functions and scope of use of the embodiments of the present invention.

As shown in FIG. 3, terminal 312 takes the form of a general-purpose computing device. Components of terminal 312 may include, but are not limited to, one or more processors or processing units 316, system memory 328, and a bus 318 that connects various system components including system memory 328 and processing unit 316.

The bus 318 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, a graphics acceleration port, a processor, or a local bus using any of a variety of bus structures. By way of example, these architectures include, but are not limited to, Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MAC) bus, Enhanced ISA bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect ( PCI) bus.

Terminal 312 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by terminal 312, including volatile and non-volatile media, removable and non-removable media.

System memory 328 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 330 and/or cache memory 332 . Terminal 312 may further include other removable/non-removable, volatile/non-volatile computer system storage media. For example only, storage system 334 may be used to read and write to non-removable, non-volatile magnetic media (not shown in FIG. 3, commonly referred to as a "hard drive"). Although not shown in Figure 3, a disk drive may be provided for reading and writing to removable non-volatile magnetic disks (eg "floppy disks"), as well as removable non-volatile optical disks (eg CD-ROM, DVD-ROM) or other optical media) to read and write optical drives. In these cases, each drive may be connected to bus 318 through one or more data media interfaces. Memory 328 may include at least one program product having a set (eg, at least one) of program modules configured to perform the functions of various embodiments of the present invention.

A program/utility 330 having a set (at least one) of program modules 342, which may be stored, for example, in memory 328, such program modules 342 including, but not limited to, an operating system, one or more application programs, other program modules, and program data , each or some combination of these examples may include an implementation of a network environment. Program modules 342 generally perform the functions and/or methods of the described embodiments of the present invention.

Terminal 312 may also communicate with one or more external devices 314 (eg, a keyboard, pointing device, display 324, etc.), may also communicate with one or more devices that enable a user to interact with the terminal 312, and/or communicate with the terminal 312. Terminal 312 can communicate with any device (eg, network card, modem, etc.) that communicates with one or more other computing devices. Such communication may take place through input/output (I/O) interface 322 . Also, the terminal 312 may communicate with one or more networks (eg, a local area network (LAN), a wide area network (WAN), and/or a public network such as the Internet) through a network adapter 320 . As shown, network adapter 320 communicates with other modules of terminal 312 via bus 318 . It should be understood that, although not shown in FIG. 3, other hardware and/or software modules may be used in conjunction with terminal 312, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives and data backup storage systems.

The processing unit 316 executes various functional applications and data processing by running the program stored in the system memory 328, for example, implements the chart visualization method provided by the embodiment of the present invention, and the method mainly includes:

In response to the fetch instruction, connect to the data source and obtain metadata, where the metadata is field data of the data to be processed in the data source;

Provide a corresponding chart field template according to the chart type selected by the user, so that the user can configure chart field properties in the chart field template according to the metadata;

In response to the chart generation instruction, a data processing program matching the chart type selected by the user is sent to the connected data source, and the data processing program is used to perform processing in the data source according to the field attributes configured by the user. data operation;

A running result of the data processing program is received, and a graph is obtained by rendering the running result.

Embodiment 4

Embodiment 4 of the present invention further provides a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, implements the chart visualization method provided by the embodiment of the present invention, and the method mainly includes:

In response to the fetch instruction, connect to the data source and obtain metadata, where the metadata is field data of the data to be processed in the data source;

Provide a corresponding chart field template according to the chart type selected by the user, so that the user can configure chart field properties in the chart field template according to the metadata;

In response to the chart generation instruction, a data processing program matching the chart type selected by the user is sent to the connected data source, and the data processing program is used to perform processing in the data source according to the field attributes configured by the user. data operation;

A running result of the data processing program is received, and a graph is obtained by rendering the running result.

The computer storage medium in the embodiments of the present invention may adopt any combination of one or more computer-readable mediums. The computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium. The computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or a combination of any of the above. More specific examples (a non-exhaustive list) of computer readable storage media include: electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), Erasable programmable read only memory (EPROM or flash memory), optical fiber, portable compact disk read only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing. In this document, a computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

A computer-readable signal medium may include a propagated data signal in baseband or as part of a carrier wave, with computer-readable program code embodied thereon. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. A computer-readable signal medium can also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device .

Program code embodied on a computer readable medium may be transmitted using any suitable medium, including - but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

Computer program code for carrying out operations of the present invention may be written in one or more programming languages, including object-oriented programming languages—such as Java, Smalltalk, C++, but also conventional Procedural programming language - such as "as" or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a local area network (LAN) or wide area network (WAN) domain, or may be connected to an external computer (eg, using an Internet service provider through Internet connection).

Note that the above are only preferred embodiments of the present invention and applied technical principles. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the protection scope of the present invention. Therefore, although the present invention has been described in detail through the above embodiments, the present invention is not limited to the above embodiments, and can also include more other equivalent embodiments without departing from the concept of the present invention. The scope is determined by the scope of the appended claims.

Claims (6)

1. a chart visualization method, is characterized in that, comprises: In response to the fetch instruction, connect to the data source and obtain metadata, where the metadata is field data of the data to be processed in the data source; Provide a corresponding chart field template according to the chart type selected by the user, so that the user can configure chart field properties in the chart field template according to the metadata; In response to the chart generation instruction, a data processing program matching the chart type selected by the user is sent to the connected data source, and the data processing program is used to perform processing in the data source according to the field attributes configured by the user. data operation; Receive the running result of the data processing program, and render the running result to obtain a graph; Before sending a data handler matching the user-selected chart type to the connected data source, the method further includes: Verify that the chart field properties configured by the user meet the requirements of the chart field template; If the verification is successful, the operation of generating the chart is performed; If the verification is unsuccessful, an error message is returned to prompt the user to reconfigure the properties of the chart field; Among them, whether it meets the requirements of the chart field template is mainly considered from two aspects. First, whether the required items in the chart configuration items are filled in; second, whether the filled field attributes meet the filling rules; The chart field attribute includes at least one of the following: chart display name, dimension, measure, graphic type, whether to display by default, decimal point, line type or color scheme. 2. The method according to claim 1, wherein, before obtaining the metadata, the method further comprises: Verify that the connection to the data source is successful. 3. A chart visualization device, characterized in that, comprising: a metadata acquisition module, used to connect a data source and acquire metadata in response to a fetch instruction, where the metadata is field data of the data to be processed; a template display module, configured to provide a corresponding chart field template according to the chart type selected by the user, so that the user can configure chart field properties in the chart field template according to the metadata; The program sending module is used for sending a data processing program matching the chart type selected by the user to the connected data source in response to the chart generation instruction, and the data processing program is configured to perform operations on the data to be processed in the data source; A chart rendering module, receiving the running result of the data processing program, and rendering the running result to obtain a chart; The device also includes: a first verification module, configured to verify whether the chart field properties configured by the user meet the requirements of the chart field template before sending the data processing program matching the chart type selected by the user to the connected data source; Among them, whether it meets the requirements of the chart field template is mainly considered from two aspects. First, whether the required items in the chart configuration items are filled in; second, whether the filled field attributes meet the filling rules; The chart field attribute includes at least one of the following: chart display name, dimension, measure, graphic type, whether to display by default, decimal point, line type or color scheme. 4. The apparatus according to claim 3, wherein the apparatus further comprises: The second verification module is used to verify whether the connection to the data source is successful before obtaining the metadata. 5. A terminal, wherein the terminal comprises: one or more processors; a storage device for storing one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors are caused to implement the chart visualization method according to any one of claims 1-2. 6. A computer-readable storage medium on which a computer program is stored, characterized in that, when the program is executed by a processor, the chart visualization method according to any one of claims 1-2 is implemented.

Images