CN114745338A - Flow control method, flow control device, storage medium and server - Google Patents

Abstract

The application discloses a flow control method, a flow control device, a storage medium and a server, which respond to a data access request and acquire a flow control quota of each storage space and a user flow control quota corresponding to a data access end; controlling each service node to respectively record the generated flow data of each storage space and the generated flow data of the user; and controlling each service node to perform flow control on the data access end according to the flow data of each storage space, the flow data of the user, the flow control quota of each storage space and the flow control quota of the user. According to the method and the device, the flow control quota is configured for the user level and each storage space level of the data access end at the same time, and when the data access end is subjected to flow control, the flow generated by each storage space and all the flows generated under the user account are considered at the same time and are compared with the flow control quotas corresponding to the storage space and the user account, so that the data access end can be subjected to unified flow control of multiple levels finally, and more accurate and stable flow control is realized.

Description

Flow control method, device, storage medium and server

technical field

The present application relates to the field of computer technologies, and in particular, to a flow control method, device, storage medium, and server.

Background technique

With the development of modern information technology, the data access requirements of various Internet users are also increasing. The storage capacity and reading and writing capabilities of local servers are poor, and it is not easy to expand and optimize. In order to meet users' data access needs, and strengthen The overall stability of the data reading and writing module, distributed system services are gradually applied in people's daily life, and the distributed system connects multiple service nodes at the same time to respond to the access needs of multiple users. When the data traffic of some users is too large, it may be This affects the normal data operations of other users, and even affects the normal use of distributed systems.

SUMMARY OF THE INVENTION

The present application provides a flow control method, device, storage medium and server, which can solve the technical problems of inaccurate flow control and system instability in the related art.

In a first aspect, an embodiment of the present application provides a flow control method, which is applied to a data accessed end, where at least two storage spaces corresponding to the data access end are set in the data accessed end, and the method includes:

Responding to the data access request, allocating at least one service node for the data access request, and obtaining the storage space flow control quota and user flow control quota of each storage space corresponding to the data access terminal;

Controlling each service node to separately record each storage space traffic data and user traffic data generated when the data access terminal performs data access based on the data access request;

Each service node is controlled to perform flow control on the data access terminal according to each storage space flow data, the user flow data, each storage space flow control quota and the user flow control quota.

In a second aspect, an embodiment of the present application provides a flow control device, which is applied to a data accessed end, wherein the data accessed end is provided with at least two storage spaces corresponding to the data access end, and the device includes:

a request-response module, configured to respond to the data access request, allocate at least one service node for the data access request, and obtain the storage space flow control quota and user flow control quota of each storage space corresponding to the data access end;

a traffic recording module, configured to control each service node to record the respective storage space traffic data and user traffic data generated when the data access terminal performs data access based on the data access request;

The flow control module is configured to control each service node to perform flow control on the data access terminal according to each storage space flow data, the user flow data, each storage space flow control quota and the user flow control quota.

In a third aspect, an embodiment of the present application provides a computer storage medium, where the computer storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor and executing the steps of the above method.

In a fourth aspect, an embodiment of the present application provides a server, including a memory, a processor, and a computer program stored in the memory and running on the processor, the computer program being adapted to be loaded by the processor and execute the above method. step.

The beneficial effects brought by the technical solutions provided by some embodiments of the present application include at least:

The present application provides a flow control method, which responds to a data access request, allocates at least one service node for the data access request, and obtains the storage space flow control quota and user flow control quota of each storage space corresponding to the data access terminal; controls each service node Record each storage space flow data and user flow data generated when the data access terminal performs data access based on data access requests respectively; control each service node according to each storage space flow data, user flow data, each storage space flow control quota and user flow control Quota to control the flow of data access. In this application, corresponding flow control quotas are configured for both the user level of the data access terminal and each storage space level, and the traffic generated by each storage space and the user account are also considered when the flow control is performed on the data access terminal. All traffic generated under the system is compared with their corresponding flow control quotas, so that the user-level traffic and the traffic of each storage space can be controlled at the same time, and finally, multiple levels of unified flow control can be performed on the data access end to achieve better flow control. Precise and stable flow control.

Description of drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the accompanying drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are only These are some embodiments of the present application, and for those skilled in the art, other drawings can also be obtained from these drawings without creative effort.

FIG. 1 is an exemplary system architecture diagram of a flow control method provided by an embodiment of the present application;

2 is a schematic flowchart of a flow control method provided by an embodiment of the present application;

3 is a flowchart structure diagram of a flow control method provided by an embodiment of the present application;

4 is a schematic flowchart of a flow control method provided by an embodiment of the present application;

FIG. 5 is a schematic flowchart of a flow control method provided by an embodiment of the present application;

FIG. 6 is a control flowchart of a distributed cache component provided by an embodiment of the present application;

FIG. 7 is a flow control structural diagram of an upload interface provided by an embodiment of the present application;

FIG. 8 is a schematic diagram of flow control of bandwidth data according to an embodiment of the present application;

FIG. 9 is a structural block diagram of a flow control device provided by an embodiment of the present application;

FIG. 10 is a schematic structural diagram of a server according to an embodiment of the present application.

Detailed ways

In order to make the features and advantages of the present application more obvious and understandable, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments It is only a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative efforts shall fall within the protection scope of this application.

Where the following description refers to the drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the illustrative examples below are not intended to represent all implementations consistent with this application. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present application, as recited in the appended claims.

With the vigorous development of Internet information technology, the data access needs of enterprises and individual users are constantly increasing. Among them, the demand for data access is the largest, and cloud storage service (Cloud storage) is a data access service emerging with the demand for massive storage, that is, storing data in multiple virtual servers usually hosted by a third party, Instead of a dedicated server, it is simple, reliable, and massively secure to meet the needs of data storage. From the perspective of cloud storage services, although cloud storage services provide users with the storage capacity of massive data, the read and write capabilities of the system are always quantifiably limited, and it is not easy to expand and optimize. Therefore, in order to ensure the overall stability of the cloud storage service and prevent the abnormal traffic of some users from affecting other users, or even triggering a chain reaction affecting the entire system, it is necessary to control the abnormal traffic of users according to the processing capacity of the system. Flow control is a common basic concept in network transmission, which is mainly used to adjust the speed at which the sender transmits data. Similarly, in the cloud storage service system, the flow control method is used to limit and shape the access traffic, which can ensure that the system can provide the maximum service capability. Generally, the system will process abnormal traffic by denying service beyond the expected access. .

Among the common current limiting methods, it can be roughly divided into stand-alone current limiting and distributed current limiting. Single-server current limiting means that each service node is independent of each other in terms of current limiting strategies and does not affect each other. Each service node may have different current limiting strategies; while distributed current limiting adopts a scalable system structure and uses multiple storage servers. Share the computing load, solve the bottleneck problem of unstable overall system flow in the traditional single-machine current limiting system, and improve the reliability, availability and scalability of the current limiting system. Centralized cache middleware is introduced, which can sense each service node in the system. However, for the time-sensitive current limiting strategy, the time consistency between the service node and the cache middleware needs to be considered, and the timeout of accessing the cache middleware also needs to be considered.

Because in the cloud storage system, a user's account generally has multiple storage spaces, and from the perspective of the current main distributed current limiting methods, the current limiting services in each distributed system usually affect the user's storage space. The space is configured with flow control quotas, or directly allocates the total quota shared by all storage spaces to users. However, the specific use of storage space and flow control quotas by users cannot be predicted in the system. Therefore, a single storage space level or a single storage space Configuring flow control quotas based on user levels will make the current limiting policy unsuitable for a large number of users with diverse traffic usage conditions, and it will not be possible to precisely control the overall system traffic, which will block users and cause the system to become unstable.

Therefore, the embodiment of the present application provides a flow control method. By configuring the user flow control quota of the data access end and the flow control quota of each storage space at the same time, according to whether the flow data of the storage space meets the storage space flow control quota, and the user uses a total of Whether the flow data meets the user flow control quota is used to determine the flow control strategy for the data access terminal, which can solve the above technical problems of inaccurate flow control and overall system instability.

Please refer to FIG. 1. FIG. 1 is an exemplary system architecture diagram of a traffic control method provided by an embodiment of the present application.

As shown in FIG. 1 , the system architecture may include a data access terminal 101 , a network 102 and a server 103 . The network 102 is a medium for providing a communication link between the data access terminal 101 and the server 103 . The network 102 may include various types of wired communication links or wireless communication links, for example: wired communication links include fiber optic, twisted pair or coaxial cables, wireless communication links include Bluetooth communication links, wireless fidelity ( Wireless-Fidelity, Wi-Fi) communication link or microwave communication link, etc.

The data access terminal 101 can interact with the server 103 through the network 102 to receive messages from the server 103 or send messages to the server 103, or the data access terminal 101 can interact with the server 103 through the network 102 to receive messages sent by other users to the server 103. message or data. The data access terminal 101 may be hardware or software. When the data access terminal 101 is hardware, it can be various electronic devices, including but not limited to smart watches, smart phones, tablet computers, laptop computers, and desktop computers. When the data access terminal 101 is software, it can be installed in the electronic devices listed above, which can be implemented as multiple software or software modules (for example, used to provide distributed services), or can be implemented as a single software or software module, which is not specifically limited here.

The server 103 may be a business server that provides various services. It should be noted that the server 103 may be hardware or software. When the server 103 is hardware, it may be implemented as a distributed server cluster composed of multiple servers, or may be implemented as a single server. When the server 103 is software, it may be implemented as multiple software or software modules (for example, used to provide distributed services), or may be implemented as a single software or software module, which is not specifically limited herein.

It should be understood that the numbers of data access terminals, networks and servers in FIG. 1 are only illustrative, and may be any number of data access terminals, networks and servers according to implementation requirements.

Please refer to FIG. 2 , which is a schematic flowchart of a flow control method provided by an embodiment of the present application. The execution body of the embodiment of the present application may be a server that executes the flow control method, a processor in the server that executes the flow control method, or a flow control service in the server that executes the flow control method. For the convenience of description, the following describes the specific execution process of the flow control method by taking the execution subject being the processor in the server as an example.

As shown in Figure 2, the flow control method is applied to the data accessed end, and the data accessed end is provided with at least two storage spaces corresponding to the data access end, and the flow control method may at least include:

S201. In response to the data access request, allocate at least one service node for the data access request, and obtain the storage space flow control quota and user flow control quota of each storage space corresponding to the data access end.

Optionally, when a user fulfills a demand through a network service that contains a large amount of data information, such as a website, storage service, resource database, etc. in the Internet, the user terminal, as the data access terminal, will send a large number of data access requests to the server of the target service, When these data access requests reach the data access end, corresponding traffic will be generated. In order to ensure the stable operation of the data access end, the generated traffic needs to be controlled so that it will not affect the load capacity and computing power of the data access end.

Optionally, when the flow usage control is performed on the user, the available flow control quota can be pre-configured for the user, and in order to meet the usage requirements of the user, there are usually at least two storage spaces at the user level of a data access end, and Each storage space can have a corresponding traffic usage quota. When configuring a flow control quota, if you directly configure a flow control quota for each storage space on the data access end, each storage space can only use its own flow control quota and cannot be used in other storage spaces. When the traffic of the space is small, a larger proportion of the quota is used. If the quota of each storage space is small, the user's usage needs cannot be met. When the quota of each storage space is large, the overall flow control quota of the user will be higher. The system will affect the system, and the user's usage of each storage space cannot be predicted in advance, so it is not convenient to configure the most appropriate quota for each storage space.

Optionally, based on this, considering that the flow control quota that can be used by all storage spaces of the user is also limited, you can configure the flow control quota at the user level while configuring the flow control quota for each storage space. , so that it controls the flow of the data sender from the two levels of each storage space and the user, thereby realizing the sharing of the flow control quota of each storage space under the same user. Before performing flow control, you need to configure the flow control quota first. You can configure the user flow control quota of all users and the flow control quota of each storage space in the service and registration components.

Further, when configuring the user flow control quota and the flow control quota of each storage space, since there is a user flow control quota to limit the overall flow of the data access end, the flow control quota of each storage space can be appropriately larger. Specifically, it can be configured The user flow control quota is greater than any one storage space flow control quota, and the user flow control quota is less than the sum of all storage space flow control quotas. For example, when the data access end corresponds to storage space A and storage space B, the user flow control quota can be configured to 10, the flow control quota of storage space A to 5, and the flow control quota of storage space B to 6. The access request occupies 5 flow control quotas in storage space A, then only 5 flow control quotas in storage space B can be used at this time. The flow control quota compares the overall generated traffic, so as to implement traffic control at the storage space and user levels. It should be noted that the numerical values used for examples in the examples only represent the size relationship of the corresponding quotas, and do not represent actual meanings and actual units.

Optionally, when the system is used to provide services to users, users can obtain their own flow control quotas for using the service by registering an account, and for ease of configuration, the initial flow control quotas configured under each user account are the same, and Users can modify the flow control quota under the account by upgrading and other operations to obtain the flow control quota that meets their own needs. The use priority of the flow control quota obtained through user operations is higher than the initial flow control quota configured by default.

Optionally, after configuring the storage space flow control quota and user flow control quota of all users in the service and registration components, in order to facilitate the data access end to receive a data access request, directly based on the flow control quota to the data access end. For flow control, you can set the data access terminal to obtain and save the storage space flow control quota and user flow control quota corresponding to all users from the service and registration components at preset intervals. In a feasible embodiment, an S3 service (Simple Storage Service, S3) component can be selected as the data accessed end, and the S3 service component can provide users with access services, compatible with the S3 protocol interface, and users can use The SDK of the S3 protocol is convenient for data storage operations.

For the convenience of description, please refer to FIG. 3 , which is a flowchart structure diagram of a flow control method provided by an embodiment of the present application. As shown in FIG. 3 , the flow structure diagram includes a data access terminal 310 , a service and registration component 320 , an S3 service component 330 , a storage space flow control module 340 , and a user flow control module 350 .

Wherein, the S3 service component 330 periodically obtains the storage space flow control quota and user flow control quota corresponding to all users from the service and registration component 320 and saves them in the local memory of the S3 service component 330, then when the data access terminal 310 sends When the data access request is sent to the data access end, that is, the S3 service component 330, the S3 service component 330 first responds to the data access request, and then controls the storage space flow corresponding to the data access end 310 through the storage space flow control module 340, and through the storage space flow control module 340. The user flow control module 350 performs user flow control corresponding to the data access terminal 310 .

Optionally, in order to serve multiple requests from users at the same time, multiple service nodes are set in the data access end, and then at least one service node can be allocated for the data access request. The more service nodes, the more the data access end can respond to at the same time. The more data access requests, and the number of service nodes can be expanded, it is easy to adjust according to the user volume and request volume. Therefore, an available service node can be found first, and all data access requests of the same data access terminal can be allocated to each service node. At the same time, according to the data access terminal identifier corresponding to the data access request, the data access terminal can directly obtain each storage space flow control quota and user flow control quota corresponding to the data access terminal locally, so as to facilitate the subsequent flow control quota and generated Traffic controls the flow of data access terminals.

It should be noted that for all service nodes, a very small data packet will be periodically sent to each service node as a heartbeat signal to request each service node to return a heartbeat when it can work normally. If the service node returns a heartbeat longer than the preset time If the threshold value or the heartbeat cannot be returned, it is considered that the service node cannot continue to respond to data access requests, and the service node is regarded as an unavailable service node in the service node directory, so as to avoid continuing to distribute data access requests for it, resulting in abnormal data access requests. implement.

S202: Control each service node to respectively record each storage space traffic data and user traffic data generated when the data access terminal performs data access based on the data access request.

Optionally, when each service node is controlled to receive a data access request, it can calculate, based on various attributes corresponding to each data access request, each storage space traffic data and user traffic generated when the data access terminal performs data access based on the data access request. data and record each traffic data separately, wherein the sum of all storage space traffic data is equal to user traffic data. Each service node can record traffic data and related attributes of the traffic data, for example, the storage space, interface, type, etc. corresponding to the traffic data can be recorded, which is convenient for each service node to judge various traffic conditions based on various attributes of the traffic data. And according to different situations to implement different flow control strategies.

Optionally, in order to perform traffic control, after each service node records each storage space traffic data and user traffic data respectively, it is also necessary to update the corresponding traffic control quota according to the traffic data, and update the traffic control quota to use the corresponding data traffic. The flow control balance will be used for the processing of subsequent access requests in this round of flow control process.

Further, in order to facilitate the subsequent flow control, each service node can directly judge the flow control conditions according to the flow data generated by the node, and can also judge the flow control conditions based on the flow data recorded by all service nodes. A middleware can be used to record the traffic data of all service nodes, and each service node obtains the unified traffic data of all service nodes, which is convenient for subsequent analysis of the traffic situation of the data access terminal based on the overall traffic data.

S203: Control each service node to perform flow control on the data access terminal according to each storage space flow data, user flow data, each storage space flow control quota and user flow control quota.

Optionally, after controlling each service node to record the generated storage space flow data and user flow data respectively, it is possible to determine whether the current flow usage is based on the pre-obtained storage space flow control quota and user flow control quota. Determine the flow control on the data access side.

Specifically, each storage space has a corresponding flow control quota and the flow data generated by this data access request, and the user has a corresponding flow control quota and the flow data generated by this data access request, then when making a flow control judgment, you can Flow control conditions are formulated for each storage space and user respectively. When the storage space flow control quota is not enough to support its corresponding storage space flow data, it is considered that the first flow control condition is met, and each service node is controlled to perform the first flow control on the data access terminal. Flow control; when each storage space flow data and its corresponding storage space flow control quota do not meet the first flow control condition, and the user flow control quota is not sufficient to support the user flow data, it is considered that the user flow data and the user flow control quota satisfy the second flow control If the control conditions are met, each service node is controlled to perform second flow control on the data access terminal. In this way, the flow control of each storage space level is set as the first flow control, and the flow control of the user level is set as the second flow control when the first flow control of each storage space level is not triggered, which realizes the control of all storage spaces under each storage space. The sharing and unified control of user flow control quota, such flow control results will be more accurate and stable, which not only improves the system stability, but also improves the service experience of users.

In the embodiment of the present application, a flow control method is provided, which responds to a data access request, allocates at least one service node for the data access request, and obtains each storage space flow control quota and user flow control quota corresponding to the data access end; The service node records the storage space flow data and user flow data generated when the data access terminal performs data access based on the data access request. Flow control quota, which controls the flow of data access terminals. Because in the embodiment of the present application, corresponding flow control quotas are configured for both the user level of the data access end and each storage space level, and when the data access end is flow controlled, the traffic generated by each storage space and the All traffic generated under the user account is compared with their corresponding flow control quotas, so that the user-level traffic and the traffic of each storage space can be controlled at the same time, and finally, multiple levels of unified flow control can be performed on the data access end. Achieve more precise and stable flow control.

Please refer to FIG. 4 , which is a schematic flowchart of a flow control method provided by an embodiment of the present application.

As shown in FIG. 4 , the flow control method may at least include:

S401. In response to the data access request, allocate at least one service node for the data access request, and obtain each storage space flow control quota and user flow control quota corresponding to the data access end.

Regarding step S401, please refer to the detailed description in step S201, which will not be repeated here.

S402. Allocate the concurrent quota of each storage space and the concurrent quota of the user corresponding to the data access terminal to each service node, and obtain the concurrent quota of each storage space node corresponding to each service node and the concurrent quota of each user node.

Optionally, it can be known from the introduction of the above embodiment that in order to respond to as many data access requests as possible at the same time, multiple service nodes are allocated for data access requests, and in order to balance the processing pressure of each service node, data from the same The data access requests of the access end are evenly distributed to the service nodes to ensure that the number of data access requests received by each service node is the same, thereby ensuring that the processing pressure of each service node is stable.

Optionally, there are various types of traffic generated by data access requests, including concurrent traffic. Multiple data access requests sent by the same data access terminal at the same time are concurrent requests. When data access requests are evenly distributed to each service node , the same number of concurrent data access requests will be made on each service node at the same time. In order to ensure that each service node can normally process the received concurrent data access request, and does not affect each service node to continue to respond to other data access requests, When configuring the user's storage space flow control quota and user flow control quota, you can configure the storage space concurrent quota in the storage space flow control quota and the user concurrency quota in the user flow control quota, so that each service node can According to the concurrent quota of each storage space and the concurrent quota of users, it is judged whether the concurrent traffic of the received data access request meets the normal working conditions.

Further, since the concurrent data access requests are evenly distributed to each service node, the concurrent storage space quota and user concurrent quota corresponding to the data access terminal can also be equally distributed to each service node, so as to obtain each storage space corresponding to each service node. The concurrent quota of space nodes and the concurrent quota of each user node, so that each service node can directly judge the traffic situation of data access requests according to the concurrent traffic generated by this node and the corresponding flow control quota of this node.

S403: Control each service node to separately record the concurrent data of each storage space and the concurrent data of users generated when the data access terminal performs data access based on the data access request.

Optionally, after each service node obtains the corresponding concurrent quota of each storage space node and the concurrent quota of each user node, it can control each service node, when receiving the concurrent data access request allocated to this node, to process the generated data for each storage space node. Space concurrent data and user concurrent data are recorded separately.

Optionally, since most data access requests will involve multiple threads, for example, generally modifying the value of a code will have three threads: read, modify, and write back. During the processing of these threads, other threads may appear. The requested thread suddenly occupies resources, so that the original request cannot get the correct result. At this time, the concurrent data of each data access request can be calculated based on the atomic variable. The atomic variable can read, modify, and write back the value of a variable. It becomes an uninterruptible operation. Based on this, atomic operations can be used to make only one thread operate on a request. Threads will not be switched during atomic operations. Thread switching is either before the atomic operation or after the atomic operation. After completion, the concurrent data in each service node is an integer value, and there will be no intermediate processing state, thereby avoiding resource competition when the resources of each service node are not interoperable, and finally achieving stable concurrent resource acquisition and release.

S404. When the concurrent data of any storage space is greater than the concurrent quota of its corresponding storage space node, control each service node to reject and return the data access request to the data access terminal; when the concurrent data of each storage space is less than or equal to its corresponding storage space When the node concurrency quota is set, and the concurrent data of any user is greater than its corresponding user node concurrency quota, each service node is controlled to reject and return the data access request to the data access terminal.

Optionally, after each service node obtains the corresponding concurrent quota of each storage space node and each user node, and records the generated concurrent data of each storage space and user concurrent data, it can control each service node based on the corresponding data of this node. The concurrent data of each storage space, the concurrent quota of each storage space node, the concurrent data of users, and the concurrent quota of user nodes are used to judge the traffic situation at the storage space level and the traffic situation at the user level.

Optionally, when the concurrent data recorded by each service node is greater than the corresponding concurrent quota, it is considered that the concurrent number of data access requests of the current user exceeds the user's quota, and each service node will implement flow control on the data access terminal. When the concurrent data of any storage space is greater than the concurrent quota of its corresponding storage space node, control each service node to reject and return the data access request to the data access terminal; when the concurrent data of each storage space is less than or equal to its corresponding storage space When the node concurrency quota is set, and the concurrent data of any user is greater than its corresponding user node concurrency quota, each service node is controlled to reject and return the data access request to the data access terminal. In this way, the concurrent traffic of the data access terminal can be precisely controlled from each service node, which ensures the high concurrency stability of the system.

It is understandable that when the concurrent flow information generated by the data access request of the data access end triggers concurrent flow control, and each service node rejects and returns the data access request to the data access end, it can no longer respond to the data access request and follow-up processing. , but generates corresponding rejection information, and sends the rejection information, the access request and the data carried by the access request to the data access terminal, where the rejection information can be used to prompt the data access terminal to pay attention to the flow control situation, so that the data access terminal can verify the data Access requests for adjustments and subsequent request actions.

In the embodiment of the present application, a flow control method is provided. First, data access requests are equally distributed to each service node, and each storage space concurrent quota and user concurrent quota are equally distributed to each service node. The concurrent data corresponding to the data access request and the concurrent quota allocated to the node, the concurrent resources of the node are acquired and released based on the calculation method of atomic variables, and the accuracy of the two levels based on the storage space level and the user level is realized. Concurrent flow control ensures the overall availability of the system with high concurrency and enhances the stability of the system operation.

Please refer to FIG. 5 , which is a schematic flowchart of a flow control method provided by an embodiment of the present application.

As shown in Figure 5, the flow control method may include at least:

S501. In response to the data access request, assign at least one service node to the data access request, and obtain each storage space flow control quota and user flow control quota corresponding to the data access end.

Regarding step S501, please refer to the detailed description in step S201, which will not be repeated here.

S502. Within a preset time window, control each service node to separately record each storage space bandwidth data and user bandwidth data generated when the data access terminal performs data access based on the data access request.

Optionally, there are various types of traffic generated by data access requests, including bandwidth traffic, the "highest data rate" that can pass from a certain point in the network to another point in a unit time, that is, in a unit of time. The amount of data that can be transmitted within a time period, the bandwidth and traffic size of the data access request on the data access side will directly affect the processing time of the request. Excessive bandwidth will cause more processing resources to be occupied for a long time, and too small bandwidth will The usage requirements of the data access end cannot be met. Therefore, when configuring the flow control quota of each storage space on the data access end, you can configure the corresponding storage space bandwidth quota. When configuring the user flow control quota, configure the user bandwidth quota to consider data access. The bandwidth traffic generated by the request, and the abnormal bandwidth traffic is controlled.

Optionally, the bandwidth traffic is not directly related to the number of requests. Calculating the bandwidth traffic at the time when each request arrives will result in very frequent calculations. Therefore, the calculation of the bandwidth traffic is generally performed within a preset time window, so that the The bandwidth quota within this time window is allowed to be shared by data access request allocation. Further, within a preset time window, each service node can be controlled to record the respective storage space bandwidth data and user bandwidth data generated when the data access terminal performs data access based on the data access request. The setting of the preset time window may be specifically set according to the data access terminal and the volume of the data access request. For example, 10 seconds may be used as a time window, which is not limited in this application.

Further, since the bandwidth traffic data generated by different data access requests will be different, the direct analysis of the bandwidth traffic of this node by each service node will lead to incomplete or chaotic utilization of bandwidth resources at the data access end. When each service node records bandwidth data, a distributed cache component can be used. The distributed cache component can support all service nodes to record the traffic data generated by themselves into the distributed cache component, and perform unified calculation on this type of traffic data. , to realize the overall analysis of the traffic data generated by all data access requests received in all service nodes. It should be noted that there is no storage space bandwidth quota and user bandwidth quota for all users in the distributed cache component. When each service node records the bandwidth traffic generated by a data access terminal for the first time, it will correspond to the data access terminal. The bandwidth quota of each storage space and the user bandwidth quota are stored in the distributed cache component, which is convenient for the distributed cache component to record and compare the used traffic quota.

For convenience of description, please refer to FIG. 6 , which is a control flowchart of a distributed cache component provided by an embodiment of the present application. As shown in FIG. 6 , each service node 610 records each storage space bandwidth data and user bandwidth data to the distributed cache component 620 , and then each service node 610 can learn the data access requests received by other service nodes in the distributed cache component 620 The generated bandwidth data is convenient for subsequent service nodes 610 to perform flow control on the data access terminal according to the overall bandwidth usage of all data access requests.

Optionally, the distributed cache component can have various specific choices. In a feasible implementation manner, Redis (Remote Dictionary Server, remote data service) can be selected as the distributed cache component for application. Redis supports master-slave synchronization, data It can be synchronized from the master server to any number of slave servers, which can improve website throughput, improve website operation efficiency and reduce the pressure on database access.

In addition, the traffic generated by data access requests has a greater impact on the computing pressure of the system, including the request per second (Query Per Second, QPS), which is a measure of how much traffic a specific query server handles within a specified time. Therefore, the QPS traffic generated by data access requests also needs to be counted on all data access requests within a preset time period to achieve a better measure. Based on this, you can refer to bandwidth quotas and bandwidth data records. method, when configuring the flow control quota of each storage space on the data access end, you can configure the corresponding request quota per second of each storage space, and when configuring the user flow control quota, configure the user request quota per second, and control each service node to allocate each storage space. The per-second request quota and the user's per-second request quota are stored in the distributed cache component, and the generated data requested per second by each storage space and the time when the user requests data per second are recorded in the distributed cache component.

S503: Control each service node to deduct each storage space bandwidth quota based on each storage space bandwidth data to obtain the remaining amount of each storage space bandwidth, and deduct the user bandwidth quota based on each user bandwidth data to obtain the remaining amount of user bandwidth.

Optionally, after each service node records each storage space bandwidth data and user bandwidth data to the distributed cache component respectively, it can control each service node to perform a calculation of each storage space bandwidth quota based on each storage space bandwidth data stored in the distributed cache component. Deduction to obtain the remaining amount of bandwidth of each storage space, and use the remaining amount of bandwidth of each storage space as the benchmark for the next service node deduction within this time window; and control each service node to deduct the user bandwidth quota based on the bandwidth data of each user , obtain the remaining amount of user bandwidth, and use the remaining amount of user bandwidth as the benchmark for the next service node deduction within this time window.

Optionally, it can be known from the above embodiment that the process of recording the requested data per second for data access requests by each service node is the same as that of recording bandwidth data. The data requested per second of the storage space is deducted from the request quota per second of each storage space to obtain the remaining amount of requests per second of each storage space, and the remaining amount of requests per second of each storage space is used as the deduction of the next service node within this time window. Benchmark; and control each service node to deduct the user’s per-second request quota based on the per-second request data of each user, obtain the user’s per-second request balance, and use the user’s per-second request balance as the next service node deduction within this time window. reduced benchmark.

Further, each time the service node records and deducts traffic data in the distributed cache component, it will initiate an access and request to the distributed cache component, so in order to reduce the access pressure to the distributed cache component, you can The access terminal identifier prefetches a part of the flow control quota of each storage space and the user flow control quota from the distributed cache component to the local memory, and the traffic data generated by the service node will preferentially use the prefetched local flow control quota resources. After the flow control quota resource is used up, the flow data is recorded in the distributed cache component to reduce the access pressure and processing pressure of the distributed cache component. When the response of the distributed cache component times out due to uncontrollable reasons such as network and traffic, the flow control quota of each storage space and user flow control quota of the data access end are equally distributed to each service node, and each service node performs stand-alone current limiting. , and control the flow according to the flow data and quota of this node.

Specifically, when the data access end initiates a data access request, it performs specific access processing by calling the service node as an interface. Due to the limited load capacity of the data access end, the service node receives the request as the data access end and generates a large number of For the interface of traffic, in order to ensure that the traffic entering the service node will not cause excessive system pressure and drag down the overall system of the data accessed end, it is also necessary to control the flow of various interfaces used by users. Interfaces with different functions include various types of interfaces. For example, different functional interfaces include upload interfaces, download interfaces, etc. The upload interfaces include ordinary upload interfaces, copy upload interfaces, slice upload interfaces, form upload interfaces, and other types of upload interfaces. , corresponding to different upload methods.

Optionally, in order to facilitate the description of this application, the upload function interface and the interfaces of different upload methods are used for description, and the current limiting methods of other function interfaces are the same, and will not be described again. In the usual upload interface speed limit, the quota speed limit can only be implemented for different types of upload interfaces respectively, and the quota sharing under the unified function interface cannot be realized. Therefore, when configuring the flow control quota, you can configure it for the user. Each storage space interface quota and user interface quota, and the current interface quota of each storage space and the unified interface quota of each storage space are configured in the interface quota of each storage space, and the current interface quota of the user and the unified interface quota of the user are configured in the user interface quota. The relationship between the current interface quota at the user and storage space level and the unified interface quota is: the unified interface quota is greater than any current interface quota, and the sum of the current interface quotas is greater than the unified interface quota, and the traffic control policy of the interface is also different from that of the user. The unified control of the cup and storage levels is the same. When the traffic data of each current interface is greater than the corresponding current interface flow control quota, flow control is performed; the current interface traffic data is not greater than the corresponding current interface flow control quota, and the unified interface traffic data is greater than the unified interface flow control quota. When the interface flow control quota is set, flow control is performed.

Further, in the specific traffic data recording process, each service node is controlled to deduct each storage space interface quota in each storage space bandwidth quota based on each storage space interface data in each storage space bandwidth data, and obtain each storage space. Interface surplus; control each service node to deduct the user interface quota in the user bandwidth quota based on the user interface data in the user bandwidth data to obtain the user interface surplus. Among them, the deduction process in each storage space is to first deduct the current interface flow control quota of the storage space, and then deduct the unified interface flow control quota of the storage space; the deduction process in the user level is to first deduct the user's current interface flow control quota , and then deduct the user's unified interface flow control quota.

Please refer to FIG. 7. FIG. 7 is a flow control structural diagram of an upload interface provided by an embodiment of the present application. As shown in FIG. 7 , after the data access request flow data 710 is received, in the process of the storage space flow control unit 720 performing the storage space flow control, within the storage space level, the storage space current interface flow control unit 730 first performs the The current interface quota detection of the storage space, when it is confirmed that it meets the current interface traffic, enters the storage space unified interface flow control unit 740 to perform storage space unified interface quota detection, and after confirming that it meets the current interface traffic, inside the user level, the user flow control unit In 750, the user's current interface flow control unit 760 performs the user's current interface quota detection, and when it is confirmed that it meets the current interface traffic, it enters the user's unified interface flow control unit 770 to perform the user's unified interface quota detection, and after confirming that it meets the current interface traffic, Respond to data access requests for the current interface.

S504. When the remaining amount of any storage space bandwidth is less than zero, control each service node to perform bandwidth control on the data access terminal; when the remaining amount of each storage space bandwidth is greater than or equal to zero, and the remaining amount of user bandwidth is less than zero, control each service node. Bandwidth control on the data access side.

Optionally, when each service node is controlled to deduct the flow control quota in the distributed cache component, when the remaining bandwidth of any storage space is less than zero, each service node is controlled to perform bandwidth control on the data access terminal; If the remaining amount of bandwidth is greater than or equal to zero, and the remaining amount of user bandwidth is less than zero, each service node is controlled to perform bandwidth control on the data access terminal.

Specifically, when bandwidth control is performed on the data access terminal, the common bandwidth control method will perform disconnection processing when the bandwidth cannot pass its quota, and directly terminate the transmission process, which will cause the user's data access request to fail directly. In turn, reconnection is continuously initiated, increasing the load pressure on the accessed end of the data. However, in the embodiment of the present application, considering the fluency when the user uses the bandwidth for data transmission, the bandwidth can be continuously controlled. Based on the Flow Control mechanism of the TCP (Transmission Communication Protocol) protocol, during the data transmission process, if the data transmission If the speed is slow, there will be queues at the transport layer, and the data packets that are still in the transmission process will be stored in the receive buffer. Therefore, the space of the receive buffer will become smaller. At this time, the receiving end sends The ACK (Acknowledge character) returned to the sender will indicate the remaining size of the receiving buffer, so as to control the sender to adaptively increase or decrease the data at the beginning of transmission to avoid packet loss.

Optionally, in the specific bandwidth control process, each service node can be controlled to send a gradually decreasing ACK to the data access terminal when the data access terminal gradually fills the bandwidth quota of the current time window to remind the data access terminal. Reduce the data sent within this time window, suspend the response to the data access request for the data access end, and determine the overflow access request that has not yet responded to the data access request, and respond to the overflow data access request in the next time window to achieve continuous bandwidth. flow control.

Please refer to FIG. 8. FIG. 8 is a schematic diagram of flow control of bandwidth data according to an embodiment of the present application. As shown in Figure 8, in the timeline, the bandwidth quota of a single time window divided is abstractly represented as 4 rectangles, and the data access request has used all 4 bandwidth quotas in the current time window, then the remaining The bandwidth data below is delayed until the next time window for processing, and so on, until the bandwidth quota of the time window can meet the remaining bandwidth data of the data access request, then the data access request response is deemed successful. For example, the bandwidth data is 15 rectangular data access requests will be processed through 3 full time windows and 1 3/4 time window.

Understandably, when performing flow control on the data requested per second at the data access end, if the number of requests per second is too large, the service node will be unable to continue to work directly, then control each service node to deduct the flow control quota in the distributed cache component. , when the remaining amount of requests per second of any storage space is less than zero, control each service node to reject and return the data access request to the data access terminal; when the remaining amount of requests per second of each storage space is greater than or equal to zero, and the user requests the remaining amount per second If it is less than zero, control each service node to reject and return the data access request to the data access terminal.

In the embodiment of the present application, a flow control method is provided, in which a storage space bandwidth quota, a storage space request quota per second, a user bandwidth quota, and a user per second request quota are configured in a configuration center, a distributed cache component is introduced, and each service node Record storage space bandwidth data, storage space request data per second, user bandwidth data, and user request data per second in the distributed cache component respectively, and perform quota deduction in the distributed cache component. Amount to realize the flow control judgment, among which, at the storage space and user levels, the current interface flow control and the unified interface flow control are respectively carried out, which effectively solves the problem that the storage space and user speed cannot be limited at the same time, and also effectively solves the problem that the storage space and user cannot be limited at the same time. The problem of unified flow control of the interface, and the continuous bandwidth speed limit is realized to improve the user experience.

Please refer to FIG. 9 , which is a structural block diagram of a flow control apparatus provided by an embodiment of the present application. As shown in FIG. 9, the flow control device 900 includes:

The request response module 910 is configured to respond to the data access request, allocate at least one service node for the data access request, and obtain the storage space flow control quota and user flow control quota of each storage space corresponding to the data access terminal;

The traffic recording module 920 is configured to control each service node to record the respective storage space traffic data and user traffic data generated when the data access terminal performs data access based on the data access request;

The flow control module 930 is configured to control each service node to perform flow control on the data access terminal according to each storage space flow data, user flow data, each storage space flow control quota and user flow control quota.

Optionally, the user flow control quota is greater than any one storage space flow control quota, and the user flow control quota is less than the sum of all storage space flow control quotas.

Optionally, the flow control module 930 is further configured to control each service node to perform first flow control on the data access terminal when any storage space flow data and its corresponding storage space flow control quota satisfy the first flow control condition; when When each storage space flow data and its corresponding storage space flow control quota do not meet the first flow control condition, and the user flow data and user flow control quota meet the second flow control condition, each service node is controlled to perform the second flow on the data access terminal. control.

Optionally, the number of data access requests allocated to each service node is the same, and the storage space flow control quota includes a storage space concurrent quota, and the user flow control quota includes a user concurrent quota; the flow control apparatus 900 further includes: a quota allocation module. , which is used to evenly distribute the concurrent quota of each storage space and the concurrent quota of users corresponding to the data access end to each service node, and obtain the concurrent quota of each storage space node corresponding to each service node and the concurrent quota of each user node.

Optionally, the traffic recording module 920 is further configured to control each service node to separately record the concurrent data of each storage space and the concurrent data of users generated when the data access terminal performs data access based on the data access request.

Optionally, the flow control module 930 is further configured to control each service node to reject and return the data access request to the data access end when the concurrent data of any storage space is greater than the concurrent quota of its corresponding storage space node; When the concurrent data is less than or equal to the concurrent quota of its corresponding storage space node, and the concurrent data of any user is greater than the concurrent quota of its corresponding user node, each service node is controlled to reject and return the data access request to the data access terminal.

Optionally, the storage space flow control quota includes storage space bandwidth quota, and the user flow control quota includes user bandwidth quota; the flow recording module 920 is further configured to control each service node to record data access terminals respectively within a preset time window. Each storage space bandwidth data and user bandwidth data generated during data access based on data access requests; control each service node to deduct each storage space bandwidth quota based on each storage space bandwidth data to obtain the remaining amount of each storage space bandwidth, and based on Each user's bandwidth data is deducted from the user's bandwidth quota to obtain the remaining amount of the user's bandwidth.

Optionally, the traffic recording module 920 is further configured to control each service node to deduct each storage space interface quota in each storage space bandwidth quota based on each storage space interface data in each storage space bandwidth data, and obtain each storage space. Interface surplus; control each service node to deduct the user interface quota in the user bandwidth quota based on the user interface data in the user bandwidth data to obtain the user interface surplus.

Optionally, the flow control module 930 is further configured to control each service node to perform bandwidth control on the data access terminal when the remaining amount of any storage space bandwidth is less than zero; when the remaining amount of each storage space bandwidth is greater than or equal to zero, and the user bandwidth If the remaining amount is less than zero, each service node is controlled to perform bandwidth control on the data access terminal.

Optionally, the flow control module 930 is further configured to control each service node to suspend responding to the data access request to the data access terminal, determine that the overflow access request has not been responded to in the data access request, and respond to the overflow data access request in the next time window.

In an embodiment of the present application, a flow control device is provided, wherein a request response module is used to respond to a data access request, allocate at least one service node for the data access request, and obtain each storage space flow control quota corresponding to the data access end and the user flow control quota; the flow recording module is used to control each service node to record the storage space flow data and user flow data generated when the data access terminal performs data access based on the data access request; the flow control module is used to control each service. The node performs flow control on the data access end according to the flow data of each storage space, the user flow data, the flow control quota of each storage space and the user flow control quota. In this application, corresponding flow control quotas are configured for both the user level of the data access terminal and each storage space level, and the traffic generated by each storage space and the user account are also considered when the flow control is performed on the data access terminal. All traffic generated under the system is compared with their corresponding flow control quotas, so that the user-level traffic and the traffic of each storage space can be controlled at the same time, and finally, multiple levels of unified flow control can be performed on the data access end to achieve better flow control. Precise and stable flow control.

Embodiments of the present application further provide a computer storage medium, where the computer storage medium can store a plurality of instructions, and the instructions are suitable for being loaded by a processor and executing the steps of the method in any one of the foregoing embodiments.

Referring to FIG. 10, FIG. 10 is a schematic structural diagram of a server according to an embodiment of the present application. As shown in FIG. 10 , the server 1000 may include: at least one server processor 1001 , at least one network interface 1004 , user interface 1003 , memory 1005 , and at least one communication bus 1002 .

Among them, the communication bus 1002 is used to realize the connection and communication between these components.

The user interface 1003 may include a display screen (Display) and a camera (Camera), and the optional user interface 1003 may also include a standard wired interface and a wireless interface.

Wherein, the network interface 1004 may optionally include a standard wired interface and a wireless interface (eg, a WI-FI interface).

The server processor 1001 may include one or more processing cores. The server processor 1001 uses various interfaces and lines to connect various parts of the entire server 1000, and executes by running or executing the instructions, programs, code sets or instruction sets stored in the memory 1005, and calling the data stored in the memory 1005. Various functions of the server 1000 and processing data. Optionally, the server processor 1001 may use at least one of a digital signal processing (Digital Signal Processing, DSP), a Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA), and a Programmable Logic Array (Programmable Logic Array, PLA). A hardware form is implemented. The server processor 1001 may integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU), a modem, and the like. Among them, the CPU mainly handles the operating system, user interface, and application programs; the GPU is used to render and draw the content that needs to be displayed on the display screen; the modem is used to handle wireless communication. It can be understood that, the above-mentioned modem may not be integrated into the server processor 1001, and is implemented by a single chip.

The memory 1005 may include random access memory (Random Access Memory, RAM), or may include read-only memory (Read-Only Memory, ROM). Optionally, the memory 1005 includes a non-transitory computer-readable storage medium. Memory 1005 may be used to store instructions, programs, codes, sets of codes, or sets of instructions. The memory 1005 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), Instructions and the like used to implement the above method embodiments; the storage data area may store the data and the like involved in the above method embodiments. Optionally, the memory 1005 may also be at least one storage device located away from the aforementioned server processor 1001 . As shown in FIG. 10 , the memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module and a flow control program.

In the server 1000 shown in FIG. 10 , the user interface 1003 is mainly used to provide an input interface for the user and obtain the data input by the user; and the server processor 1001 can be used to call the flow control program stored in the memory 1005 and execute the specific execution Do the following:

Responding to the data access request, assigning at least one service node to the data access request, and obtaining the storage space flow control quota and user flow control quota of each storage space corresponding to the data access terminal;

Controlling each service node to separately record each storage space traffic data and user traffic data generated when the data access terminal performs data access based on the data access request;

Control each service node to perform flow control on the data access terminal according to each storage space flow data, user flow data, each storage space flow control quota and user flow control quota.

In some embodiments, the user flow control quota is greater than any one storage space flow control quota, and the user flow control quota is smaller than the sum of all storage space flow control quotas.

In some embodiments, when the server processor 1001 executes and controls each service node to perform flow control on the data access terminal according to each storage space flow data, user flow data, each storage space flow control quota, and user flow control quota, the specific execution is: The following steps: when any storage space flow data and its corresponding storage space flow control quota satisfy the first flow control condition, control each service node to perform first flow control on the data access terminal; when each storage space flow data and its corresponding storage space flow control When the spatial flow control quota does not meet the first flow control condition, and the user flow data and the user flow control quota meet the second flow control condition, each service node is controlled to perform second flow control on the data access terminal.

In some embodiments, the number of data access requests allocated to each service node is the same, the storage space flow control quota includes storage space concurrency quota, and the user flow control quota includes user concurrency quota; the server processor 1001 executes the data acquisition process. After each storage space flow control quota corresponding to the access end and the user flow control quota, the following steps are also specifically performed: Allocate the concurrent storage space quotas and user concurrent quotas corresponding to the data access end to each service node, and obtain the corresponding service nodes. Concurrent quota of each storage space node and concurrent quota of each user node.

In some embodiments, the server processor 1001 specifically executes the following steps when executing the control of each service node to record the respective storage space traffic data and user traffic data generated when the data access terminal performs data access based on the data access request. The nodes respectively record the concurrent data of each storage space and the concurrent data of users generated when the data access terminal performs data access based on the data access request.

In some embodiments, when the server processor 1001 controls each service node to perform the first flow control on the data access terminal when any storage space flow data and its corresponding storage space flow control quota satisfy the first flow control condition, The following steps are specifically performed: when the concurrent data of any storage space is greater than the concurrent quota of its corresponding storage space node, control each service node to reject and return the data access request to the data access end; the server processor 1001 is executing when each storage space traffic When the data and its corresponding storage space flow control quota do not meet the first flow control condition, and the user traffic data and the user flow control quota meet the second flow control condition, each service node is controlled to perform the second flow control on the data access terminal, specifically: Perform the following steps: when the concurrent data of each storage space is less than or equal to the concurrent quota of its corresponding storage space node, and the concurrent data of any user is greater than the concurrent quota of its corresponding user node, control each service node to reject and return the data access request to data access.

In some embodiments, the storage space flow control quota includes a storage space bandwidth quota, and the user flow control quota includes a user bandwidth quota; the server processor 1001 records that the data access terminal performs data access based on the data access request when executing the control of each service node. When each storage space traffic data and user traffic data are generated at the same time, the following steps are specifically performed: within a preset time window, control each service node to separately record each storage space bandwidth data generated when the data access terminal performs data access based on the data access request. and user bandwidth data; control each service node to deduct each storage space bandwidth quota based on each storage space bandwidth data to obtain the remaining amount of each storage space bandwidth, and deduct the user bandwidth quota based on each user bandwidth data to obtain the user bandwidth remaining amount.

In some embodiments, the server processor 1001 specifically executes the following steps when executing and controlling each service node to deduct each storage space bandwidth quota based on each storage space bandwidth data to obtain the remaining amount of each storage space bandwidth: controlling each service node Based on each storage space interface data in each storage space bandwidth data, deduct each storage space interface quota in each storage space bandwidth quota to obtain the remaining amount of each storage space interface; When the user bandwidth quota is deducted to obtain the remaining amount of user bandwidth, the following steps are specifically performed: control each service node to deduct the user interface quota in the user bandwidth quota based on the user interface data in the user bandwidth data, and obtain the user interface remaining amount.

In some embodiments, when the server processor 1001 controls each service node to perform the first flow control on the data access terminal when any storage space flow data and its corresponding storage space flow control quota satisfy the first flow control condition, The following steps are specifically performed: when the remaining amount of any storage space bandwidth is less than zero, control each service node to perform bandwidth control on the data access end; When the first flow control condition is met, and the user flow data and the user flow control quota meet the second flow control condition, then each service node is controlled to perform the second flow control on the data access terminal, and the following steps are specifically performed: when the bandwidth of each storage space remains If the amount is greater than or equal to zero, and the remaining amount of user bandwidth is less than zero, each service node is controlled to perform bandwidth control on the data access terminal.

In some embodiments, when the server processor 1001 controls each service node to perform bandwidth control on the data access terminal, the server processor 1001 specifically performs the following steps: controlling each service node to suspend responding to the data access request on the data access terminal, and determining that the data access request is in the The overflow access request has not been responded to, and the overflow data access request will be responded to in the next time window.

In the several embodiments provided in this application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the device embodiments described above are only illustrative. For example, the division of modules is only a logical function division. In actual implementation, there may be other division methods, for example, multiple modules or components may be combined or integrated. to another system, or some features can be ignored, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or modules, and may be in electrical, mechanical or other forms.

Modules described as separate components may or may not be physically separated, and components shown as modules may or may not be physical modules, that is, they may be located in one place, or may be distributed to multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional module in each embodiment of the present application may be integrated into one processing module, or each module may exist physically alone, or two or more modules may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware, and can also be implemented in the form of software function modules.

The integrated modules, if implemented in the form of software functional modules and sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the present application can be embodied in the form of software products in essence, or the parts that contribute to the prior art, or all or part of the technical solutions, and the computer software products are stored in a storage medium , including several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods in the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, Read-Only Memory (ROM, Read-Only Memory), Random Access Memory (RAM, Random Access Memory), magnetic disk or optical disk and other media that can store program codes .

It should be noted that, for the convenience of description, the foregoing method embodiments are described as a series of action combinations, but those skilled in the art should know that the present application is not limited by the described action sequence. Because in accordance with the present application, certain steps may be performed in other orders or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily all necessary for the present application.

In the above-mentioned embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference may be made to the relevant descriptions of other embodiments.

The above is a description of a flow control method, device, storage medium and server provided by this application. For those skilled in the art, according to the ideas of the embodiments of this application, there will be changes in the specific implementation and application scope. In conclusion, the content of this specification should not be construed as a limitation on this application.

Claims (13)

1. A flow control method is applied to a data access terminal, wherein at least two storage spaces corresponding to the data access terminal are arranged in the data access terminal, and the method comprises the following steps:

responding to a data access request, distributing at least one service node for the data access request, and acquiring a storage space flow control quota and a user flow control quota of each storage space corresponding to a data access end;

controlling each service node to respectively record each storage space flow data and user flow data generated when the data access terminal accesses data based on the data access request;

and controlling each service node to perform flow control on the data access end according to the flow data of each storage space, the flow data of the user, the flow control quota of each storage space and the flow control quota of the user.

2. The method of claim 1, wherein the user flow control quota is greater than any one of the storage space flow control quotas, and the user flow control quota is less than a sum of all storage space flow control quotas.

3. The method according to claim 1, wherein the controlling each service node to perform flow control on the data access end according to each storage space flow data, the user flow data, each storage space flow control quota, and the user flow control quota, includes:

when any storage space flow data and the corresponding storage space flow control quota meet a first flow control condition, controlling each service node to perform first flow control on the data access terminal;

and when the storage space flow control quota corresponding to each piece of storage space flow data does not meet a first flow control condition and the user flow control quota meet a second flow control condition, controlling each service node to perform second flow control on the data access terminal.

4. The method according to claim 3, wherein the number of the data access requests allocated to each service node is the same, and the storage space flow control quota includes a storage space concurrent quota, and the user flow control quota includes a user concurrent quota;

after the obtaining of the storage space flow control quota and the user flow control quota of each storage space corresponding to the data access end, the method further includes:

and uniformly distributing the storage space concurrent quota corresponding to the data access end and the user concurrent quota to each service node to obtain the storage space node concurrent quota corresponding to each service node and the user node concurrent quota.

5. The method according to claim 4, wherein the controlling each service node to record each storage space traffic data and user traffic data generated when the data access terminal performs data access based on the data access request respectively comprises:

and controlling each service node to respectively record the storage space concurrent data and the user concurrent data generated when the data access terminal accesses data based on the data access request.

6. The method according to claim 5, wherein when any storage space traffic data and the storage space flow control quota corresponding to the storage space traffic data satisfy a first flow control condition, controlling each service node to perform first traffic control on the data access terminal includes:

when the concurrent data of any storage space is larger than the concurrent quota of the corresponding storage space node, controlling each service node to generate refusal and return the data access request to the data access end;

when the storage space flow control quota corresponding to each piece of storage space flow data does not satisfy a first flow control condition and the user flow control quota satisfy a second flow control condition, controlling each service node to perform second flow control on the data access terminal, including:

and when the concurrent data of each storage space is less than or equal to the concurrent quota of the corresponding storage space node, and any user concurrent data is greater than the concurrent quota of the corresponding user node, controlling each service node to reject and return the data access request to the data access end.

7. The method of claim 3, wherein the storage space flow control quota comprises a storage space bandwidth quota, and the user flow control quota comprises a user bandwidth quota;

the controlling each service node respectively records each storage space traffic data and user traffic data generated when the data access terminal performs data access based on the data access request, and the method comprises the following steps:

in a preset time window, controlling each service node to respectively record each storage space bandwidth data and user bandwidth data generated when the data access terminal accesses data based on the data access request;

and controlling each service node to deduct the bandwidth quota of each storage space based on the bandwidth data of each storage space to obtain the bandwidth surplus of each storage space, and deducting the bandwidth quota of each user based on the bandwidth data of each user to obtain the bandwidth surplus of each user.

8. The method of claim 7, wherein the controlling each service node to deduct each storage space bandwidth quota based on each storage space bandwidth data to obtain each storage space bandwidth surplus comprises:

controlling each service node to deduct and subtract each storage space interface quota in each storage space bandwidth quota based on each storage space interface data in each storage space bandwidth data to obtain each storage space interface surplus;

the deducting the user bandwidth quota based on each user bandwidth data to obtain the user bandwidth surplus, including:

and controlling each service node to deduct the user interface quota in the user bandwidth quota based on each user interface data in each user bandwidth data to obtain the remaining user interface quota.

9. The method according to claim 7, wherein when any storage space traffic data and the storage space flow control quota corresponding to the storage space traffic data satisfy a first flow control condition, controlling each service node to perform first traffic control on the data access terminal includes:

when the surplus of the bandwidth of any storage space is less than zero, controlling each service node to perform bandwidth control on the data access terminal;

when the storage space flow control quota corresponding to each piece of storage space flow data does not satisfy a first flow control condition and the user flow control quota satisfy a second flow control condition, controlling each service node to perform second flow control on the data access terminal, including:

and when the residual bandwidth of each storage space is greater than or equal to zero and the residual bandwidth of the user is less than zero, controlling each service node to perform bandwidth control on the data access terminal.

10. The method of claim 9, wherein controlling each service node to perform bandwidth control on the data access terminal comprises:

and controlling each service node to suspend responding to the data access request to the data access terminal, determining that an overflow access request is not responded in the data access request, and responding to the overflow data access request in the next time window.

11. A flow control device is applied to a data access terminal, wherein at least two storage spaces corresponding to the data access terminal are arranged in the data access terminal, and the device comprises:

the request response module is used for responding to a data access request, distributing at least one service node for the data access request, and acquiring a storage space flow control quota and a user flow control quota of each storage space corresponding to a data access end;

the flow recording module is used for controlling each service node to respectively record each storage space flow data and user flow data generated when the data access terminal accesses data based on the data access request;

and the flow control module is used for controlling each service node to control the flow of the data access end according to the flow data of each storage space, the flow data of the user, the flow control quota of each storage space and the flow control quota of the user.

12. A computer storage medium storing a plurality of instructions adapted to be loaded by a processor and to perform the steps of the method according to any of claims 1 to 10.

13. A server comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps of the method according to any one of claims 1 to 10 when executing the program.

Images