CN111898161B - Method, system, device and medium for managing authority of HUE - Google Patents

Abstract

The invention discloses a HUE authority management method, which comprises the following steps: respectively detecting and judging whether user rights are created in the HUE and the resource management system; in response to the user permission created in the HUE and the resource management system, clearing the user permission in the HUE, backing up the user permission in the resource management system and clearing the user permission; reestablishing the user authority by using the backed-up user authority in the resource management system, and recording the reestablished user authority information into a log; and responding to trigger permission synchronization, synchronizing the user permission information in the log to the HUE so as to create new user permission in the HUE according to the user permission information in the log. The invention also discloses a system, a computer device and a readable storage medium. The scheme provided by the invention can remove the dependency relationship of the current HUE service on Zookeeper, HDFS, YARN, hive, HBase, oozie and Spark components, and improve the autonomy of HUE cluster authority.

Description

A rights management method, system, device and medium of HUE

technical field

The present invention relates to the field of HUE, and in particular to a method, system, device and storage medium for rights management of HUE.

Background technique

Currently, the user management system of HUE is fully synchronized and open source. User permissions depend on the maintenance of the HUE UI user management system, and also need to be authorized in the Ranger security component. There are no restrictions on resources, which causes two major inconveniences: the user resource permissions of each component cannot be used in the HUE user management system, and the user resource permissions of the current user resource management system can only be used by opening the client separately, which is extremely inconvenient. It also adds a lot of operating costs to companies using big data platforms.

Contents of the invention

In view of this, in order to overcome at least one aspect of the above problems, an embodiment of the present invention proposes a HUE rights management method, including the following steps:

Detect and judge whether user permissions have been created in HUE and in the resource management system respectively;

Responding to the creation of user rights in the HUE and in the resource management system, clear the user rights in the HUE, and clear the user rights in the resource management system after backup;

Using the backup user authority to recreate the user authority in the resource management system, and record the recreated user authority information to a log;

In response to triggering permission synchronization, synchronizing the user permission information in the log to the HUE, so as to create a new user permission in the HUE according to the user permission information in the log.

In some embodiments, also include:

Judging whether the user information table after creating a new user authority in the HUE is consistent with the user information table after recreating user authority with the backup user authority in the resource management system;

In response to the inconsistency, determine the cause of the inconsistency according to the system log of the HUE, and recreate a new user permission in the HUE according to the user permission information in the log.

In some embodiments, determining the cause of the inconsistency according to the system log of the HUE and re-creating a new user permission in the HUE according to the user permission information in the log, further comprising:

In response to the inconsistency caused by the HUE obtaining the user authority information in the log of the resource management system, deleting the new user authority created in the HUE, and re-applying the user authority information in the resource management system log Sync to the HUE.

In some embodiments, also include:

In response to an inconsistency caused by the HUE switching a new user information table, delete the new user authority created in the HUE, and create a new user authority in the HUE again according to the user authority information in the log.

In some embodiments, also include:

In response to agreement, it is verified in the HUE whether the newly created user rights are the same as the resource management system.

In some embodiments, also include:

In response to changing the user authority in the resource management system, record the changed user authority information in a log;

In response to triggering permission synchronization, synchronizing the user permission information in the log to the HUE, so as to change the corresponding user permission in the HUE according to the user permission information in the log.

In some embodiments, clearing the user rights in the HUE further includes:

Back up the user rights in the HUE.

Based on the same inventive concept, according to another aspect of the present invention, an embodiment of the present invention also provides a HUE rights management system, including:

A detection module, the detection module is configured to respectively detect and determine whether user rights are created in the HUE and in the resource management system;

an initialization module, the initialization module is configured to clear the user permissions in the HUE in response to user permissions created in the HUE and in the resource management system, and set the Clear permissions after backing up;

A recording module, the recording module is configured to use the backup user authority to recreate user authority in the resource management system, and record the recreated user authority information to a log;

A synchronization module configured to, in response to triggering permission synchronization, synchronize the user permission information in the log to the HUE, so as to create a new user permission in the HUE according to the user permission information in the log .

Based on the same inventive concept, according to another aspect of the present invention, an embodiment of the present invention also provides a computer device, including:

at least one processor; and

A memory, the memory stores a computer program that can run on the processor, wherein the processor executes the steps of any one of the HUE rights management methods described above when executing the program.

Based on the same inventive concept, according to another aspect of the present invention, an embodiment of the present invention also provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor Execute the steps of any one of the HUE rights management methods described above.

The present invention has one of the following beneficial technical effects: the solution provided by the present invention can remove the dependencies of current HUE services on Zookeeper, HDFS, YARN, Hive, HBase, Oozie, Spark and other components, and improve the autonomous selectivity, flexibility and convenience of HUE cluster deployment Reliability, reducing HUE version update and verification costs after secondary development, while saving cluster deployment time costs and cluster operation and maintenance costs.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention, and those skilled in the art can obtain other embodiments according to these drawings without any creative effort.

Fig. 1 is the structural connection diagram of HUE and DataSpace provided by the embodiment of the present invention;

FIG. 2 is a schematic flow chart of the HUE rights management method provided by the embodiment of the present invention;

FIG. 3 is a schematic structural diagram of an HUE rights management system provided by an embodiment of the present invention;

FIG. 4 is a schematic structural diagram of a computer device provided by an embodiment of the present invention;

FIG. 5 is a schematic structural diagram of a computer-readable storage medium provided by an embodiment of the present invention.

detailed description

In order to make the object, technical solution and advantages of the present invention clearer, the embodiments of the present invention will be further described in detail below in conjunction with specific embodiments and with reference to the accompanying drawings.

It should be noted that all expressions using "first" and "second" in the embodiments of the present invention are to distinguish two entities with the same name but different parameters or parameters that are not the same, see "first" and "second" It is only for the convenience of expression, and should not be construed as a limitation on the embodiments of the present invention, which will not be described one by one in the subsequent embodiments.

It should be noted that, in the embodiment of the present invention, the resource management system may be DataSpace. As shown in FIG. 1 , DataSpace is a simple and easy-to-use big data cluster resource management system. Users can create their own data space through the visual interface or Rest API, realize the isolation of data resources and computing resources of data in the space, and support the sharing of data resources in the space. Hue is oriented towards operations such as data query, processing, and analysis, and provides users with a graphical operation interface for related components. By using Hue, users can perform interactive data analysis and processing with the Hadoop cluster on the web console, such as operating data on HDFS, running MapReduce Job, etc., which greatly reduces the threshold for using related components. Through the solution proposed by the present invention, the users on DataSpace can be synchronized to HUE, that is, only the corresponding users or tenants need to be created on DataSpace, and the same users or tenants can have the same permissions in HUE.

According to one aspect of the present invention, an embodiment of the present invention proposes a HUE rights management method, as shown in FIG. 2 , which may include steps:

S1, respectively detecting and judging whether user permissions have been created in the HUE and in the resource management system;

S2. Responding to the fact that user rights have been created in both the HUE and the resource management system, clear the user rights in the HUE, and clear the user rights in the resource management system after backing up;

S3, using the backup user authority to recreate the user authority in the resource management system, and record the recreated user authority information in a log;

S4. In response to triggering permission synchronization, synchronize the user permission information in the log to the HUE, so as to create a new user permission in the HUE according to the user permission information in the log.

The solution provided by the present invention can remove the dependencies of the current HUE service on Zookeeper, HDFS, YARN, Hive, HBase, Oozie, and Spark components, improve the autonomous selectivity and flexibility and convenience of HUE cluster deployment, and reduce the HUE version update and secondary development. Verification cost, while saving cluster deployment time cost and cluster operation and maintenance cost.

In some embodiments, the purpose of clearing the original user rights in the HUE is to prevent the original user rights from interfering with the synchronization process.

In some embodiments, step S2, clearing the user rights in the HUE, further includes:

Back up the user rights in the HUE.

In some embodiments, the method also includes:

Judging whether the user information table after creating a new user authority in the HUE is consistent with the user information table after recreating user authority with the backup user authority in the resource management system;

In response to the inconsistency, determine the cause of the inconsistency according to the system log of the HUE, and recreate a new user permission in the HUE according to the user permission information in the log.

Specifically, when using the user authority data in the read log in HUE, back up the content of the user information table in MYSQL according to the date, and change the original user information table according to the user authority data in the log. After the change is completed, the The HUE switches the user information table to complete user information data synchronization. Then determine whether the user information table after creating a new user authority in the HUE is consistent with the user information table after recreating user authority with the backup user authority in the resource management system, if inconsistent, it can be determined according to the system of the HUE The log determines the cause of the inconsistency and recreates a new user permission in the HUE according to the user permission information in the log.

In some embodiments, determining the cause of the inconsistency according to the system log of the HUE and re-creating a new user permission in the HUE according to the user permission information in the log, further comprising:

In response to the inconsistency caused by the HUE obtaining the user authority information in the log of the resource management system, deleting the new user authority created in the HUE, and re-applying the user authority information in the resource management system log Sync to the HUE.

Specifically, if there is a problem with HUE obtaining the user authority information in the log of the resource management system, it is necessary to delete the new user authority created in the HUE, that is, to clear all the user authority information created in the HUE User rights, and synchronize the user rights information in the log of the resource management system to the HUE again.

In some embodiments, also include:

In response to an inconsistency caused by the HUE switching a new user information table, delete the new user authority created in the HUE, and create a new user authority in the HUE again according to the user authority information in the log.

Specifically, if the inconsistency is caused by the fact that the HUE itself is switching new user information, you can first delete the user authority information that has been synchronized, and then create a new user in the HUE again based on the user authority information in the log authority.

In some embodiments, also include:

In response to agreement, it is verified in the HUE whether the newly created user rights are the same as the resource management system.

Specifically, if they are consistent, it means that the permission synchronization is successful; if they are inconsistent, it is necessary to delete the user permission information in the HUE, and then perform the synchronization of the user permission information again.

In some embodiments, also include:

In response to changing the user authority in the resource management system, record the changed user authority information in a log;

In response to triggering permission synchronization, synchronizing the user permission information in the log to the HUE, so as to change the corresponding user permission in the HUE according to the user permission information in the log.

Specifically, every time the resource management system changes the user resource permission data, it will be synchronized to the Edit.log log in real time. (Edit.log size) or manually (by the operation and maintenance personnel) to update the Edit.log data user data change information to the HUE user management system. For example, HUE can be triggered to obtain Edit.log every 10 minutes; HUE can also be triggered to obtain Edit.log when the size of Edit.log reaches 10M; or the operation and maintenance personnel can click one-key synchronization to trigger once immediately HUE gets Edit.log. The above three items do not affect each other. If the trigger threshold is reached first, it will be triggered immediately. After triggering, all timing and quantitative calculations will be cleared and recalculated.

In some embodiments, the memory module can be used to monitor and read any user information change records in the resource management system in real time and generate an Edit.log log for the HUE to obtain. The memory module backs up Edit.log to multiple memory sticks for faster reading by HUE and ensures high availability of Edit.log. And when synchronization is triggered, the user information table of the resource management system at that time is backed up for verification after data synchronization.

The solution provided by the present invention can remove the dependencies of the current HUE service on Zookeeper, HDFS, YARN, Hive, HBase, Oozie, and Spark components, improve the autonomous selectivity and flexibility and convenience of HUE cluster deployment, and reduce the HUE version update and secondary development. Verification cost, while saving cluster deployment time cost and cluster operation and maintenance cost.

Based on the same inventive concept, according to another aspect of the present invention, an embodiment of the present invention also provides a HUE rights management system 400, as shown in FIG. 3 , including:

A detection module 401, the detection module 401 is configured to respectively detect and judge whether user rights are created in the HUE and in the resource management system;

An initialization module 402, the initialization module 402 is configured to clear the user permissions in the HUE and set the Clear the user permissions after backup;

A recording module 403, the recording module 403 is configured to use the backup user authority to recreate the user authority in the resource management system, and record the recreated user authority information to a log;

A synchronization module 404, the synchronization module 404 is configured to, in response to triggering permission synchronization, synchronize the user permission information in the log to the HUE, so as to create a new user permission information in the log according to the user permission information in the HUE User rights.

In some embodiments, a judging module is also included, and the judging module is configured to:

Judging whether the user information table after creating a new user authority in the HUE is consistent with the user information table after recreating user authority with the backup user authority in the resource management system;

In response to the inconsistency, determine the cause of the inconsistency according to the system log of the HUE, and recreate a new user permission in the HUE according to the user permission information in the log.

In some embodiments, the judging module is further configured to:

In response to the inconsistency caused by the HUE obtaining the user authority information in the log of the resource management system, deleting the new user authority created in the HUE, and re-applying the user authority information in the resource management system log Sync to the HUE.

In some embodiments, the judging module is further configured to:

In response to an inconsistency caused by the HUE switching a new user information table, delete the new user authority created in the HUE, and create a new user authority in the HUE again according to the user authority information in the log.

In some embodiments, the judging module is further configured to:

In response to agreement, it is verified in the HUE whether the newly created user rights are the same as the resource management system.

In some embodiments, it also includes a change module, the change module is configured to:

In response to changing the user authority in the resource management system, record the changed user authority information in a log;

In response to triggering permission synchronization, synchronizing the user permission information in the log to the HUE, so as to change the corresponding user permission in the HUE according to the user permission information in the log.

In some embodiments, the initialization module 402 is further configured to:

Back up the user rights in the HUE.

Based on the same inventive concept, according to another aspect of the present invention, as shown in FIG. 4 , an embodiment of the present invention also provides a computer device 501, including:

at least one processor 520; and

A memory 510, the memory 510 stores a computer program 511 that can run on the processor, and the processor 520 executes the steps of any one of the above HUE rights management methods when executing the program.

Based on the same inventive concept, according to another aspect of the present invention, as shown in FIG. When the program instruction 610 is executed by the processor, the steps of any one of the above HUE rights management methods are executed.

Finally, it should be noted that those skilled in the art can understand that all or part of the processes in the methods of the above embodiments can be implemented through computer programs to instruct related hardware, and the programs can be stored in a computer-readable storage medium. When the program is executed, it may include the procedures of the embodiments of the above-mentioned methods.

In addition, it should be appreciated that a computer-readable storage medium (eg, memory) herein can be either volatile memory or nonvolatile memory, or can include both volatile memory and nonvolatile memory.

Those of skill would also appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described generally in terms of their functionality. Whether such functionality is implemented as software or as hardware depends upon the particular application and design constraints imposed on the overall system. Those skilled in the art may implement the functions in various ways for each specific application, but such implementation decisions should not be interpreted as causing a departure from the scope disclosed in the embodiments of the present invention.

The above are the exemplary embodiments disclosed in the present invention, but it should be noted that various changes and modifications can be made without departing from the scope of the disclosed embodiments of the present invention defined in the claims. The functions, steps and/or actions of the method claims in accordance with the disclosed embodiments described herein need not be performed in any particular order. In addition, although the elements disclosed in the embodiments of the present invention may be described or required in an individual form, they may also be understood as a plurality unless explicitly limited to a singular number.

It should be understood that as used herein, the singular form "a" and "an" are intended to include the plural forms as well, unless the context clearly supports an exception. It should also be understood that "and/or" as used herein is meant to include any and all possible combinations of one or more of the associated listed items.

The serial numbers of the embodiments disclosed in the above-mentioned embodiments of the present invention are only for description, and do not represent the advantages and disadvantages of the embodiments.

Those of ordinary skill in the art can understand that all or part of the steps for implementing the above-mentioned embodiments can be completed by hardware, or can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium. The above-mentioned The storage medium can be read-only memory, magnetic disk or optical disk and so on.

Those of ordinary skill in the art should understand that: the discussion of any of the above embodiments is exemplary only, and is not intended to imply that the scope (including claims) disclosed by the embodiments of the present invention is limited to these examples; under the idea of the embodiments of the present invention , the technical features in the above embodiments or different embodiments can also be combined, and there are many other changes in different aspects of the above embodiments of the present invention, which are not provided in details for the sake of brevity. Therefore, within the spirit and principle of the embodiments of the present invention, any omissions, modifications, equivalent replacements, improvements, etc., shall be included in the protection scope of the embodiments of the present invention.

Claims (7)

1. A rights management method of HUE, is characterized in that, comprises the following steps: Detect and judge whether user permissions have been created in HUE and in the resource management system respectively; Responding to the creation of user rights in the HUE and in the resource management system, clear the user rights in the HUE, and clear the user rights in the resource management system after backup; Using the backup user authority to recreate the user authority in the resource management system, and record the recreated user authority information to a log; In response to triggering permission synchronization, synchronizing the user permission information in the log to the HUE, so as to create a new user permission in the HUE according to the user permission information in the log; Judging whether the user information table after creating a new user authority in the HUE is consistent with the user information table after recreating user authority with the backup user authority in the resource management system; In response to the inconsistency, determine the cause of the inconsistency according to the system log of the HUE and re-create a new user authority in the HUE according to the user authority information in the log; Determine the cause of the inconsistency according to the system log of the HUE and create a new user authority in the HUE according to the user authority information in the log, further comprising: In response to the inconsistency caused by the HUE obtaining the user authority information in the log of the resource management system, deleting the new user authority created in the HUE, and re-applying the user authority information in the resource management system log Sync to said HUE; In response to an inconsistency caused by the HUE switching a new user information table, delete the new user authority created in the HUE, and create a new user authority in the HUE again according to the user authority information in the log. 2. The method of claim 1, further comprising: In response to agreement, it is verified in the HUE whether the newly created user rights are the same as the resource management system. 3. The method of claim 1, further comprising: In response to changing the user authority in the resource management system, record the changed user authority information in a log; In response to triggering permission synchronization, synchronizing the user permission information in the log to the HUE, so as to change the corresponding user permission in the HUE according to the user permission information in the log. 4. The method according to claim 1, wherein clearing the user authority in the HUE further comprises: Back up the user rights in the HUE. 5. A rights management system of HUE, characterized in that, comprising: A detection module, the detection module is configured to respectively detect and determine whether user rights are created in the HUE and in the resource management system; an initialization module, the initialization module is configured to clear the user permissions in the HUE in response to user permissions created in the HUE and in the resource management system, and set the Clear permissions after backing up; A recording module, the recording module is configured to use the backup user authority to recreate user authority in the resource management system, and record the recreated user authority information to a log; A synchronization module configured to, in response to triggering permission synchronization, synchronize the user permission information in the log to the HUE, so as to create a new user permission in the HUE according to the user permission information in the log ; Also includes a judging module, the judging module is configured to: Judging whether the user information table after creating a new user authority in the HUE is consistent with the user information table after recreating user authority with the backup user authority in the resource management system; In response to the inconsistency, determine the reason for the inconsistency according to the system log of the HUE and create a new user authority in the HUE according to the user authority information in the log; In response to the inconsistency caused by the HUE obtaining the user authority information in the log of the resource management system, deleting the new user authority created in the HUE, and re-applying the user authority information in the resource management system log Sync to said HUE; In response to the inconsistency caused by the HUE switching a new user information table, delete the new user authority created in the HUE, and create a new user authority in the HUE again according to the user authority information in the log. 6. A computer device comprising: at least one processor; and A memory, the memory stores a computer program operable on the processor, wherein the processor executes the steps of the method according to any one of claims 1-4 when executing the program. 7. A computer-readable storage medium, the computer-readable storage medium is stored with a computer program, characterized in that, when the computer program is executed by a processor, the method according to any one of claims 1-4 is executed step.

Images