[go: up one dir, main page]

CN117896371A - Cloud storage quota speed limit downloading method and device - Google Patents

Cloud storage quota speed limit downloading method and device Download PDF

Info

Publication number
CN117896371A
CN117896371A CN202311797715.XA CN202311797715A CN117896371A CN 117896371 A CN117896371 A CN 117896371A CN 202311797715 A CN202311797715 A CN 202311797715A CN 117896371 A CN117896371 A CN 117896371A
Authority
CN
China
Prior art keywords
downloading
threshold
download
data
write
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311797715.XA
Other languages
Chinese (zh)
Inventor
张辉
林纲
姚振兴
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fujian Centerm Information Co Ltd
Original Assignee
Fujian Centerm Information Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fujian Centerm Information Co Ltd filed Critical Fujian Centerm Information Co Ltd
Priority to CN202311797715.XA priority Critical patent/CN117896371A/en
Publication of CN117896371A publication Critical patent/CN117896371A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/06Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1097Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

本发明公开一种云存储配额限速下载方法及装置,包括:接收下载请求,并根据下载请求进行数据读写;获取预设的数据量阈值以及传输速率阈值,并根据数据量阈值以及传输速率阈值计算得到下载时间阈值;实时获取当前数据读写量,并判断当前数据读写量是否达到数据量阈值,若是,获取数据读写时长;判断数据读写时长是否小于下载时间阈值,若是,停止数据读写直至达到下载时间阈值后再次执行数据读写;若否,则将当前数据读写量调整至数据量阈值后再次执行数据读写。由于传输速率阈值为定值每个用户能够使用的传输速率是固定的,从而避免不同用户之间资源抢占的问题;同时,实时调整当前数据读写的速度,提高用户体验的同时避免用户占用额外资源。

The present invention discloses a cloud storage quota speed-limited download method and device, including: receiving a download request, and performing data reading and writing according to the download request; obtaining a preset data volume threshold and a transmission rate threshold, and calculating a download time threshold according to the data volume threshold and the transmission rate threshold; obtaining the current data reading and writing volume in real time, and judging whether the current data reading and writing volume reaches the data volume threshold, if so, obtaining the data reading and writing duration; judging whether the data reading and writing duration is less than the download time threshold, if so, stopping the data reading and writing until the download time threshold is reached and then performing the data reading and writing again; if not, adjusting the current data reading and writing volume to the data volume threshold and then performing the data reading and writing again. Since the transmission rate threshold is a fixed value, the transmission rate that each user can use is fixed, thereby avoiding the problem of resource preemption between different users; at the same time, adjusting the speed of the current data reading and writing in real time, improving the user experience while avoiding users occupying extra resources.

Description

一种云存储配额限速下载方法及装置A cloud storage quota speed-limited download method and device

技术领域Technical Field

本发明涉及流量控制技术领域,特别是涉及一种云存储配额限速下载方法及装置。The present invention relates to the technical field of flow control, and in particular to a cloud storage quota speed-limited downloading method and device.

背景技术Background technique

随着云计算的不断发展,用户可以在互联网上存储和管理数字化文件。通过云盘用户可以将个人或企业文件上传到远程服务器,然后通过互联网随时随地访问和共享这些文件。云盘提供了便捷、安全和可靠的文件存储和管理解决方案,用户可以通过电脑、手机或其他设备访问、编辑、下载自己文件。With the continuous development of cloud computing, users can store and manage digital files on the Internet. Through cloud disks, users can upload personal or corporate files to remote servers, and then access and share these files anytime and anywhere through the Internet. Cloud disks provide a convenient, secure and reliable file storage and management solution. Users can access, edit and download their own files through computers, mobile phones or other devices.

然而,若没有对用户进行配额和限制带宽下载,用户可能会大量下载资源,导致资源的浪费。特别是对于热门的资源,很容易被大量下载,而其他用户可能无法及时获取到资源。同时,某些用户可能会滥用资源,通过大量下载来占用带宽,导致其他用户无法正常访问或下载资源,降低了服务的公平性。如果大量用户在同一时间段内进行高频率的下载操作,可能会导致网络拥堵,影响其他用户的网络体验。无限制下载可能会给恶意用户提供方便,他们可以利用这个漏洞进行大规模的恶意下载,从而对系统造成危害或滥用资源。并且,无限制下载会给云存储提供商带来更高的成本,例如流量带宽费用的增加,以及服务器运维的压力。因此,限制用户的下载速度和下载次数能够平衡资源的分配,维护网络的稳定性和公平性。However, if there is no quota and bandwidth limit for users to download, users may download a large amount of resources, resulting in a waste of resources. Especially for popular resources, it is easy to be downloaded in large quantities, and other users may not be able to obtain the resources in time. At the same time, some users may abuse resources and occupy bandwidth by downloading a large amount, causing other users to be unable to access or download resources normally, reducing the fairness of the service. If a large number of users perform high-frequency download operations in the same time period, it may cause network congestion and affect the network experience of other users. Unrestricted downloading may provide convenience for malicious users, who can exploit this vulnerability to carry out large-scale malicious downloads, thereby causing harm to the system or abusing resources. In addition, unlimited downloading will bring higher costs to cloud storage providers, such as increased traffic bandwidth fees and pressure on server operation and maintenance. Therefore, limiting users' download speed and number of downloads can balance the allocation of resources and maintain the stability and fairness of the network.

现有技术中,通常采用静态带宽分配的方式:通过Nginx网关进行统一限速。Nginx是一个高性能的HTTP和反向代理web服务器,其提供限流限速的功能配置,实现对用户请求的限速。但其无法针对指定用户,其提供的限速方案是单个请求,用户可以通过发起多个请求同时传输文件,即依旧存在网络资源占用的问题。如需要对限速配置进行修改,则需要手动修改nginx配置文件。而修改nginx.conf配置文件存在风险,如果nginx采用集群部署,则需要对每一台nginx服务器的配置文件进行修改,费时费力。In the prior art, static bandwidth allocation is usually adopted: unified speed limit is performed through the Nginx gateway. Nginx is a high-performance HTTP and reverse proxy web server, which provides flow and speed limit function configuration to achieve speed limit for user requests. However, it cannot target specific users. The speed limit solution it provides is a single request. Users can transfer files at the same time by initiating multiple requests, which means that there is still a problem of network resource occupation. If you need to modify the speed limit configuration, you need to manually modify the nginx configuration file. However, there are risks in modifying the nginx.conf configuration file. If nginx is deployed in a cluster, you need to modify the configuration file of each nginx server, which is time-consuming and labor-intensive.

因此目前的系统没有有效的机制来限制用户的带宽使用,或者仅通过单个终端进行速度限制,导致在高流量期间,部分用户可能会占用过多的带宽资源,从而影响其他用户的服务质量。并且这种现象可能导致服务的不稳定甚至中断,严重损害了用户的体验。同时,通过客户端的方式对单个用户的下载任务数量进行限制,不能有效对所有客户端进行下载任务数的限制。即一个用户可以同时启动多个客户端,进行大量的下载任务,绕过下载任务管理模块和带宽管理模块的限制,消耗大量的系统资源。这不仅可能导致系统的性能下降,也可能对其他用户的使用造成不利影响。Therefore, the current system has no effective mechanism to limit the bandwidth usage of users, or only limits the speed through a single terminal, resulting in some users occupying too much bandwidth resources during high traffic periods, thereby affecting the service quality of other users. And this phenomenon may cause service instability or even interruption, seriously damaging the user experience. At the same time, limiting the number of download tasks for a single user through the client cannot effectively limit the number of download tasks for all clients. That is, a user can start multiple clients at the same time and perform a large number of download tasks, bypassing the restrictions of the download task management module and the bandwidth management module, and consuming a large amount of system resources. This may not only cause the performance of the system to deteriorate, but may also have an adverse impact on the use of other users.

发明内容Summary of the invention

本发明所要解决的技术问题是:提供一种云存储配额限速下载方法及装置,以解决现有云存储系统中的带宽随机抢占的问题。The technical problem to be solved by the present invention is to provide a cloud storage quota speed-limited download method and device to solve the problem of random bandwidth preemption in the existing cloud storage system.

为了解决上述技术问题,本发明采用的技术方案为:In order to solve the above technical problems, the technical solution adopted by the present invention is:

一种云存储配额限速下载方法,包括:A cloud storage quota speed-limited download method, comprising:

接收下载请求,并根据所述下载请求进行数据读写;Receive a download request, and read and write data according to the download request;

获取预设的数据量阈值以及传输速率阈值,并根据所述数据量阈值以及传输速率阈值计算得到下载时间阈值;Obtaining a preset data volume threshold and a transmission rate threshold, and calculating a download time threshold based on the data volume threshold and the transmission rate threshold;

实时获取当前数据读写量,并判断所述当前数据读写量是否达到所述数据量阈值,若是,获取数据读写时长;Obtain the current data read/write volume in real time, and determine whether the current data read/write volume reaches the data volume threshold, and if so, obtain the data read/write duration;

判断所述数据读写时长是否小于所述下载时间阈值,若是,停止数据读写直至达到所述下载时间阈值后再次执行数据读写;Determine whether the data reading and writing duration is less than the download time threshold, and if so, stop data reading and writing until the download time threshold is reached and then execute data reading and writing again;

若否,则将所述当前数据读写量调整至所述数据量阈值后再次执行数据读写。If not, the current data read/write amount is adjusted to the data amount threshold and then data read/write is performed again.

为了解决上述技术问题,本发明采用的另一技术方案为:In order to solve the above technical problems, another technical solution adopted by the present invention is:

一种云存储配额限速下载装置,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,所述处理器执行所述计算机程序时实现如下步骤:A cloud storage quota speed-limited download device includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the following steps are implemented:

接收下载请求,并根据所述下载请求进行数据读写;Receive a download request, and read and write data according to the download request;

获取预设的数据量阈值以及传输速率阈值,并根据所述数据量阈值以及传输速率阈值计算得到下载时间阈值;Obtaining a preset data volume threshold and a transmission rate threshold, and calculating a download time threshold based on the data volume threshold and the transmission rate threshold;

实时获取当前数据读写量,并判断所述当前数据读写量是否达到所述数据量阈值,若是,获取数据读写时长;Obtain the current data read/write volume in real time, and determine whether the current data read/write volume reaches the data volume threshold, and if so, obtain the data read/write duration;

判断所述数据读写时长是否小于所述下载时间阈值,若是,停止数据读写直至达到所述下载时间阈值后再次执行数据读写;Determine whether the data reading and writing duration is less than the download time threshold, and if so, stop data reading and writing until the download time threshold is reached and then execute data reading and writing again;

若否,则将所述当前数据读写量调整至所述数据量阈值后再次执行数据读写。If not, the current data read/write amount is adjusted to the data amount threshold and then data read/write is performed again.

本发明的有益效果在于:通过在接收下载请求后获取预设的数据量阈值以及传输速率阈值,并根据数据量阈值以及传输速率阈值计算得到下载时间阈值,由于传输速率阈值为定值,即每个用户能够使用的传输速率是固定的,从而避免不同用户之间资源抢占的问题;同时,通过将当前数据读写时间与相应的下载时间阈值进行对比,当数据读写的速度过快时停止数据读写即延长了下一次数据读写的时间,而当数据读写的速度过慢时将当前数据读写量调整至数据量阈值即加快了下一次数据读写的时间,实现实时调整当前数据读写的速度,提高用户体验的同时避免用户占用额外资源。The beneficial effects of the present invention are as follows: by obtaining a preset data volume threshold and a transmission rate threshold after receiving a download request, and calculating a download time threshold based on the data volume threshold and the transmission rate threshold, since the transmission rate threshold is a constant, that is, the transmission rate that each user can use is fixed, the problem of resource preemption between different users is avoided; at the same time, by comparing the current data reading and writing time with the corresponding download time threshold, when the data reading and writing speed is too fast, the data reading and writing is stopped, which extends the time of the next data reading and writing, and when the data reading and writing speed is too slow, the current data reading and writing amount is adjusted to the data volume threshold, which speeds up the time of the next data reading and writing, thereby realizing real-time adjustment of the current data reading and writing speed, improving the user experience while avoiding users from occupying additional resources.

附图说明BRIEF DESCRIPTION OF THE DRAWINGS

图1为本发明实施例中的一种云存储配额限速下载方法的步骤流程图;FIG1 is a flowchart of a method for downloading with a cloud storage quota and speed limit according to an embodiment of the present invention;

图2为本发明实施例中的一种云存储配额限速下载方法的系统流程图;FIG2 is a system flow chart of a cloud storage quota speed-limited download method according to an embodiment of the present invention;

图3为本发明实施例中的一种云存储配额限速下载装置的结构示意图。FIG3 is a schematic diagram of the structure of a cloud storage quota speed-limited download device according to an embodiment of the present invention.

具体实施方式Detailed ways

为详细说明本发明的技术内容、所实现目的及效果,以下结合实施方式并配合附图予以说明。In order to explain the technical content, achieved objectives and effects of the present invention in detail, the following is an explanation in combination with the implementation modes and the accompanying drawings.

请参照图1,一种云存储配额限速下载方法,包括:Referring to FIG. 1 , a method for downloading with a cloud storage quota and speed limit includes:

接收下载请求,并根据所述下载请求进行数据读写;Receive a download request, and read and write data according to the download request;

获取预设的数据量阈值以及传输速率阈值,并根据所述数据量阈值以及传输速率阈值计算得到下载时间阈值;Obtaining a preset data volume threshold and a transmission rate threshold, and calculating a download time threshold based on the data volume threshold and the transmission rate threshold;

实时获取当前数据读写量,并判断所述当前数据读写量是否达到所述数据量阈值,若是,获取数据读写时长;Obtain the current data read/write volume in real time, and determine whether the current data read/write volume reaches the data volume threshold, and if so, obtain the data read/write duration;

判断所述数据读写时长是否小于所述下载时间阈值,若是,停止数据读写直至达到所述下载时间阈值后再次执行数据读写;Determine whether the data reading and writing duration is less than the download time threshold, and if so, stop data reading and writing until the download time threshold is reached and then execute data reading and writing again;

若否,则将所述当前数据读写量调整至所述数据量阈值后再次执行数据读写。If not, the current data read/write amount is adjusted to the data amount threshold and then data read/write is performed again.

由上述描述可知,本发明的有益效果在于:通过在接收下载请求后获取预设的数据量阈值以及传输速率阈值,并根据数据量阈值以及传输速率阈值计算得到下载时间阈值,由于传输速率阈值为定值,即每个用户能够使用的传输速率是固定的,从而避免不同用户之间资源抢占的问题;同时,通过将当前数据读写时间与相应的下载时间阈值进行对比,当数据读写的速度过快时停止数据读写即延长了下一次数据读写的时间,而当数据读写的速度过慢时将当前数据读写量调整至数据量阈值即加快了下一次数据读写的时间,实现实时调整当前数据读写的速度,提高用户体验的同时避免用户占用额外资源。From the above description, it can be seen that the beneficial effects of the present invention are: by obtaining a preset data volume threshold and a transmission rate threshold after receiving a download request, and calculating a download time threshold based on the data volume threshold and the transmission rate threshold, since the transmission rate threshold is a constant, that is, the transmission rate that each user can use is fixed, thereby avoiding the problem of resource preemption between different users; at the same time, by comparing the current data reading and writing time with the corresponding download time threshold, when the data reading and writing speed is too fast, the data reading and writing is stopped, which extends the time for the next data reading and writing, and when the data reading and writing speed is too slow, the current data reading and writing amount is adjusted to the data volume threshold, which speeds up the time for the next data reading and writing, thereby realizing real-time adjustment of the current data reading and writing speed, improving the user experience while avoiding users occupying additional resources.

进一步地,所述根据所述数据量阈值以及传输速率阈值计算得到下载时间阈值包括:Further, the download time threshold calculated according to the data volume threshold and the transmission rate threshold includes:

获取所述下载请求中包含的任务数量;Obtain the number of tasks included in the download request;

根据所述任务数量以及传输速率阈值得到任务平均下载速率;Obtaining an average download rate of the tasks according to the number of tasks and the transmission rate threshold;

根据所述任务平均下载速率以及数据量阈值得到每一任务的所述下载时间阈值。The download time threshold of each task is obtained according to the task average download rate and the data volume threshold.

由上述描述可知,根据下载请求中包含的任务数量以及传输速率阈值得到任务平均下载速率,通过为每一任务分配相应的最大下载速率,使得各个任务能够同时进行处理。From the above description, it can be seen that the average download rate of the tasks is obtained according to the number of tasks included in the download request and the transmission rate threshold, and each task can be processed simultaneously by allocating a corresponding maximum download rate to each task.

进一步地,还包括:Furthermore, it also includes:

实时判断所述任务数量是否减少,若是,则更新所述任务数量;Determine in real time whether the number of tasks is reduced, and if so, update the number of tasks;

根据更新的所述任务数量更新所述下载时间阈值。The download time threshold is updated according to the updated task quantity.

由上述描述可知,当出现任务下载完成、任务取消以及任务中断等情况使得任务数量减少时,通过实时获取当前任务数量并更新每一任务相应的下载时间阈值,从而能够根据更新的下载时间阈值实时调整每一任务的最大下载速率,提高任务处理效率。From the above description, it can be seen that when the number of tasks is reduced due to task download completion, task cancellation, and task interruption, the current number of tasks is obtained in real time and the corresponding download time threshold of each task is updated. The maximum download rate of each task can be adjusted in real time according to the updated download time threshold, thereby improving task processing efficiency.

进一步地,所述接收下载请求,并根据所述下载请求进行数据读写还包括:Further, the receiving a download request and reading and writing data according to the download request further includes:

获取当前令牌桶的令牌数量;Get the number of tokens in the current token bucket;

判断所述下载请求的所需令牌数是否大于所述令牌数量,若是,则判断所述下载请求是否符合令牌透支条件,若符合,则将执行所述下载请求。It is determined whether the number of tokens required for the download request is greater than the number of tokens. If so, it is determined whether the download request meets the token overdraft condition. If so, the download request is executed.

由上述描述可知,在接收下载请求时,若当前下载请求的所需令牌数大于令牌桶的令牌数量时,将符合令牌透支条件的下载请求通过透支令牌的方式进行执行,能够有效解决因令牌数量不足而导致限流的问题,提高系统处理请求的效率。From the above description, it can be seen that when receiving a download request, if the number of tokens required for the current download request is greater than the number of tokens in the token bucket, the download request that meets the token overdraft conditions will be executed by overdrafting tokens, which can effectively solve the problem of current limiting caused by insufficient number of tokens and improve the efficiency of the system in processing requests.

进一步地,所述判断所述下载请求是否符合令牌透支条件,还包括:Furthermore, the determining whether the download request meets the token overdraft condition further includes:

若否,则直至所述令牌数量所述所需令牌数等于所述令牌数量后,执行所述下载请求;或直至所述下载请求符合所述令牌透支条件后,执行所述下载请求。If not, the download request is executed until the number of tokens and the required number of tokens are equal to the number of tokens; or the download request is executed until the download request meets the token overdraft condition.

由上述描述可知,当下载请求当前不满足令牌透支条件时,可以通过等待令牌数量恢复或符合令牌透支条件时,再执行所述下载请求,能够提高系统处理请求的效率。From the above description, it can be seen that when a download request does not currently meet the token overdraft condition, the download request can be executed by waiting for the token quantity to be restored or meet the token overdraft condition, thereby improving the efficiency of the system in processing requests.

本发明另一实施例提供了一种云存储配额限速下载装置,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,所述处理器执行所述计算机程序时实现如下步骤:Another embodiment of the present invention provides a cloud storage quota speed-limited download device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the following steps when executing the computer program:

接收下载请求,并根据所述下载请求进行数据读写;Receive a download request, and read and write data according to the download request;

获取预设的数据量阈值以及传输速率阈值,并根据所述数据量阈值以及传输速率阈值计算得到下载时间阈值;Obtaining a preset data volume threshold and a transmission rate threshold, and calculating a download time threshold based on the data volume threshold and the transmission rate threshold;

实时获取当前数据读写量,并判断所述当前数据读写量是否达到所述数据量阈值,若是,获取数据读写时长;Obtain the current data read/write volume in real time, and determine whether the current data read/write volume reaches the data volume threshold, and if so, obtain the data read/write duration;

判断所述数据读写时长是否小于所述下载时间阈值,若是,停止数据读写直至达到所述下载时间阈值后再次执行数据读写;Determine whether the data reading and writing duration is less than the download time threshold, and if so, stop data reading and writing until the download time threshold is reached and then execute data reading and writing again;

若否,则将所述当前数据读写量调整至所述数据量阈值后再次执行数据读写。If not, the current data read/write amount is adjusted to the data amount threshold and then data read/write is performed again.

由上述描述可知,通过在接收下载请求后获取预设的数据量阈值以及传输速率阈值,并根据数据量阈值以及传输速率阈值计算得到下载时间阈值,由于传输速率阈值为定值,即每个用户能够使用的传输速率是固定的,从而避免不同用户之间资源抢占的问题;同时,通过将当前数据读写时间与相应的下载时间阈值进行对比,当数据读写的速度过快时停止数据读写即延长了下一次数据读写的时间,而当数据读写的速度过慢时将当前数据读写量调整至数据量阈值即加快了下一次数据读写的时间,实现实时调整当前数据读写的速度,提高用户体验的同时避免用户占用额外资源。From the above description, it can be seen that by obtaining the preset data volume threshold and transmission rate threshold after receiving the download request, and calculating the download time threshold based on the data volume threshold and the transmission rate threshold, since the transmission rate threshold is a constant, that is, the transmission rate that each user can use is fixed, the problem of resource preemption between different users is avoided; at the same time, by comparing the current data reading and writing time with the corresponding download time threshold, when the data reading and writing speed is too fast, the data reading and writing is stopped, which extends the time of the next data reading and writing, and when the data reading and writing speed is too slow, the current data reading and writing amount is adjusted to the data volume threshold, which speeds up the time of the next data reading and writing, thereby realizing real-time adjustment of the current data reading and writing speed, improving the user experience while avoiding users occupying extra resources.

进一步地,所述根据所述数据量阈值以及传输速率阈值计算得到下载时间阈值包括:Further, the download time threshold calculated according to the data volume threshold and the transmission rate threshold includes:

获取所述下载请求中包含的任务数量;Obtain the number of tasks included in the download request;

根据所述任务数量以及传输速率阈值得到任务平均下载速率;Obtaining an average download rate of the tasks according to the number of tasks and the transmission rate threshold;

根据所述任务平均下载速率以及数据量阈值得到每一任务的所述下载时间阈值。The download time threshold of each task is obtained according to the task average download rate and the data volume threshold.

由上述描述可知,根据下载请求中包含的任务数量以及传输速率阈值得到任务平均下载速率,通过为每一任务分配相应的最大下载速率,使得各个任务能够同时进行处理。From the above description, it can be seen that the average download rate of the tasks is obtained according to the number of tasks included in the download request and the transmission rate threshold, and each task can be processed simultaneously by allocating a corresponding maximum download rate to each task.

进一步地,还包括:Furthermore, it also includes:

实时判断所述任务数量是否减少,若是,则更新所述任务数量;Determine in real time whether the number of tasks is reduced, and if so, update the number of tasks;

根据更新的所述任务数量更新所述下载时间阈值。The download time threshold is updated according to the updated task quantity.

由上述描述可知,当出现任务下载完成、任务取消以及任务中断等情况使得任务数量减少时,通过实时获取当前任务数量并更新每一任务相应的下载时间阈值,从而能够根据更新的下载时间阈值实时调整每一任务的最大下载速率,提高任务处理效率。From the above description, it can be seen that when the number of tasks is reduced due to task download completion, task cancellation, and task interruption, the current number of tasks is obtained in real time and the corresponding download time threshold of each task is updated. The maximum download rate of each task can be adjusted in real time according to the updated download time threshold, thereby improving task processing efficiency.

进一步地,所述接收下载请求,并根据所述下载请求进行数据读写还包括:Further, the receiving a download request and reading and writing data according to the download request further includes:

获取当前令牌桶的令牌数量;Get the number of tokens in the current token bucket;

判断所述下载请求的所需令牌数是否大于所述令牌数量,若是,则判断所述下载请求是否符合令牌透支条件,若符合,则将执行所述下载请求。It is determined whether the number of tokens required for the download request is greater than the number of tokens. If so, it is determined whether the download request meets the token overdraft condition. If so, the download request is executed.

由上述描述可知,在接收下载请求时,若当前下载请求的所需令牌数大于令牌桶的令牌数量时,将符合令牌透支条件的下载请求通过透支令牌的方式进行执行,能够有效解决因令牌数量不足而导致限流的问题,提高系统处理请求的效率。From the above description, it can be seen that when receiving a download request, if the number of tokens required for the current download request is greater than the number of tokens in the token bucket, the download request that meets the token overdraft conditions will be executed by overdrafting tokens, which can effectively solve the problem of current limiting caused by insufficient number of tokens and improve the efficiency of the system in processing requests.

进一步地,所述判断所述下载请求是否符合令牌透支条件,还包括:Furthermore, the determining whether the download request meets the token overdraft condition further includes:

若否,则直至所述令牌数量所述所需令牌数等于所述令牌数量后,执行所述下载请求;或直至所述下载请求符合所述令牌透支条件后,执行所述下载请求。If not, the download request is executed until the number of tokens and the required number of tokens are equal to the number of tokens; or the download request is executed until the download request meets the token overdraft condition.

由上述描述可知,当下载请求当前不满足令牌透支条件时,可以通过等待令牌数量恢复或符合令牌透支条件时,再执行所述下载请求,提高系统处理请求的效率。From the above description, it can be seen that when a download request does not currently meet the token overdraft condition, the download request can be executed by waiting for the token quantity to be restored or meet the token overdraft condition, thereby improving the efficiency of the system in processing requests.

本发明提供的云存储配额限速下载方法及装置能够应用于云存储等资源分配的场景,实现对用户下载任务数的有效控制,防止系统资源的过度占用,以下通过具体实施方式进行说明:The cloud storage quota speed-limited download method and device provided by the present invention can be applied to scenarios of resource allocation such as cloud storage, to achieve effective control of the number of user download tasks, and to prevent excessive occupation of system resources. The following is an explanation through specific implementation methods:

实施例一Embodiment 1

请参照图1以及图2,一种云存储配额限速下载方法,包括:Referring to FIG. 1 and FIG. 2 , a cloud storage quota speed-limited download method includes:

S1、接收下载请求,并根据所述下载请求进行数据读写;S1. Receive a download request, and read and write data according to the download request;

S2、获取预设的数据量阈值以及传输速率阈值,并根据所述数据量阈值以及传输速率阈值计算得到下载时间阈值;如定义一个数据块(chunk),单位为bytes,该数据块的大小即为所述数据量阈值,同时定义一个用户允许的最大速率maxRate,单位为KB/s,该最大速率即为所述传输速率阈值;其中,下载时间阈值根据所述下载请求中包含的任务数量进行调整,具体步骤如下:S2. Obtain a preset data volume threshold and a transmission rate threshold, and calculate a download time threshold based on the data volume threshold and the transmission rate threshold; for example, define a data block (chunk) in bytes, the size of which is the data volume threshold, and define a maximum rate maxRate allowed by the user in KB/s, which is the transmission rate threshold; wherein the download time threshold is adjusted according to the number of tasks included in the download request, and the specific steps are as follows:

S21、获取所述下载请求中包含的任务数量;S21, obtaining the number of tasks included in the download request;

S22、根据所述任务数量以及传输速率阈值得到任务平均下载速率;如任务数量用n表示,任务平均下载速率用bytesWillBeSentOrReceive-chunkSize表示,则bytesWillBeSentOrReceive-chunkSize=maxRate/n;S22. Obtain an average download rate of the tasks according to the number of tasks and the transmission rate threshold; if the number of tasks is represented by n and the average download rate of the tasks is represented by bytesWillBeSentOrReceive-chunkSize, then bytesWillBeSentOrReceive-chunkSize=maxRate/n;

S23、根据所述任务平均下载速率以及数据量阈值得到每一任务的所述下载时间阈值;具体的:根据上述步骤中定义的数据块以及任务平均下载速率,可以得到通过一个数据块大小的字节流所需要的时间,即得到所述下载时间阈值,用timeCostPerChunk表示;同时,需要实时判断所述任务数量是否减少或增加,若是,则更新所述任务数量,如有一个任务下载完成、取消下载或中断时,即当前任务数量更新为n-1,并根据更新的所述任务数量更新所述下载时间阈值;同理,当任务增加时更新任务数量以及所述下载时间阈值;S23, according to the task average download rate and data volume threshold, obtain the download time threshold of each task; specifically: according to the data block defined in the above steps and the task average download rate, the time required to pass a byte stream of the size of a data block can be obtained, that is, the download time threshold is obtained, which is represented by timeCostPerChunk; at the same time, it is necessary to determine in real time whether the number of tasks is reduced or increased, if so, update the number of tasks, such as when a task is downloaded, canceled or interrupted, the current number of tasks is updated to n-1, and the download time threshold is updated according to the updated number of tasks; similarly, when the number of tasks increases, the number of tasks and the download time threshold are updated;

S3、实时获取当前数据读写量,并判断所述当前数据读写量是否达到所述数据量阈值,若是,获取数据读写时长;如在任务执行过程中读取/写入字节时,获取已经读取/写入的字节量作为所述当前数据读写量(bytesWillBeSentOrReceive);当所述当前数据读写量达到一个上述数据块的大小时,检查期间消耗的时间即得到所述数据读写时长(nowNanoTime-lastPieceSentOrReceiveTick);S3, real-time acquisition of the current data read/write volume, and determination of whether the current data read/write volume reaches the data volume threshold, if so, acquisition of the data read/write duration; such as when reading/writing bytes during task execution, acquisition of the bytes that have been read/written as the current data read/write volume (bytesWillBeSentOrReceive); when the current data read/write volume reaches the size of one of the above data blocks, the time consumed during the inspection is used to obtain the data read/write duration (nowNanoTime-lastPieceSentOrReceiveTick);

S4、判断所述数据读写时长是否小于所述下载时间阈值,若是,则执行S5;若否,则执行S6;S4, determining whether the data read and write time is less than the download time threshold, if so, executing S5; if not, executing S6;

S5、停止数据读写直至达到所述下载时间阈值后再次执行数据读写;即当所述数据读写时长小于所述下载时间阈值时,表示期间消耗的时间小于下载时间阈值,说明当前的传输速率已经超过了任务平均下载速率,因此,通过停止数据读写对任务进行休眠来限制流量;S5, stop data reading and writing until the download time threshold is reached and then execute data reading and writing again; that is, when the data reading and writing duration is less than the download time threshold, it means that the time consumed during the period is less than the download time threshold, indicating that the current transmission rate has exceeded the task average download rate, therefore, the task is put to sleep by stopping data reading and writing to limit the flow;

S6、若否,则将所述当前数据读写量调整至所述数据量阈值后再次执行数据读写;即当数据读写时长大于所述下载时间阈值时,表明当前的传输速率未达到任务平均下载速率,则令bytesWillBeSentOrReceive=bytesWillBeSentOrReceive-chunkSize(即当前数据读写量=任务平均下载速率);同时,当任务休眠完成后,也通过上述的方式调整下次数据读写的速率,并且在后续的数据读写过程中实时监控当前数据读写的速率,并进行调整。S6. If not, then adjust the current data reading and writing amount to the data amount threshold and then execute data reading and writing again; that is, when the data reading and writing duration is greater than the download time threshold, it indicates that the current transmission rate has not reached the task average download rate, then set bytesWillBeSentOrReceive = bytesWillBeSentOrReceive-chunkSize (that is, current data reading and writing amount = task average download rate); at the same time, when the task is dormant, the rate of the next data reading and writing is also adjusted in the above manner, and the current data reading and writing rate is monitored in real time during the subsequent data reading and writing process, and adjusted.

实施例二Embodiment 2

本实施例与实施例一的不同在于:通过调整令牌的分配方式对执行下载请求的方式进行控制;现有技术中令牌桶通常是以稳定的速度产生令牌,如以每秒产生r个令牌的令牌桶;若每个请求到达时,需要消耗n个令牌,此时令牌桶内剩余的令牌数为m;当在t0时刻下一个请求到达时,若当m<n,则该请求需要等待(n-m)/r秒后才能被处理;而当m>n时,该请求将直接被放行。假设在令牌桶内的令牌数m=5*n+1的时间点t1同时来了6个请求;此时,6个请求中会有5个请求将不分顺序的被直接放行,剩余一个请求需要等待(n-1)/r秒后才能被处理,即造成突发容限。因此,只有在令牌桶内的令牌数量m在被消耗到一定水平之后,即m∈[0,n)时才能对未来的请求实行限流,将此时刻的流量状态定义为"平均流量水平"。若令牌桶内没有剩余令牌即m=0时,每一个消耗n令牌的请求就需要n/r秒的时间等待令牌生产,即"平均流量水平"为:r/n,单位为:QPS请求/秒;从而通过令牌生产效率影响请求的等待时间,进而影响流量的QPS。The difference between this embodiment and the first embodiment is that: the way of executing the download request is controlled by adjusting the allocation mode of the token; in the prior art, the token bucket usually generates tokens at a stable speed, such as a token bucket that generates r tokens per second; if each request arrives, it needs to consume n tokens, and the number of tokens remaining in the token bucket is m; when the next request arrives at time t 0 , if m<n, the request needs to wait (nm)/r seconds before it can be processed; and when m>n, the request will be directly released. Assume that 6 requests come at the same time at time t 1 when the number of tokens in the token bucket is m=5*n+1; at this time, 5 of the 6 requests will be directly released regardless of the order, and the remaining request needs to wait (n-1)/r seconds before it can be processed, which causes burst tolerance. Therefore, only when the number of tokens m in the token bucket is consumed to a certain level, that is, m∈[0,n), can future requests be limited, and the traffic state at this moment is defined as "average traffic level". If there are no remaining tokens in the token bucket, that is, m=0, each request that consumes n tokens will need n/r seconds to wait for token production, that is, the "average traffic level" is: r/n, and the unit is: QPS requests/second; thus, the token production efficiency affects the waiting time of the request, and then affects the QPS of the traffic.

然而,对于一个r=1的令牌桶在于某一时刻,令牌桶内只有5个令牌,而此时到达的请求是一个需要消耗100个令牌的请求,则该请求需要等待95秒后才能被执行。即使当前系统处于空闲状态系统也无法对该请求进行处理,导致系统需要在95秒后面临和后续请求并发执行的窘境,降低的系统处理请求的效率;本实施例中允许请求在申请令牌时进行"透支",不论当前剩余多少令牌,请求就会被放行,而等待令牌桶产生足够令牌的时间则由后续的请求承担。However, for a token bucket with r=1, at a certain moment, there are only 5 tokens in the token bucket, and the request that arrives at this time is a request that consumes 100 tokens, then the request needs to wait 95 seconds before it can be executed. Even if the current system is in an idle state, the system cannot process the request, resulting in the system facing the dilemma of concurrent execution with subsequent requests after 95 seconds, which reduces the efficiency of the system in processing requests; in this embodiment, requests are allowed to "overdraw" when applying for tokens. No matter how many tokens are currently remaining, the request will be released, and the time to wait for the token bucket to generate enough tokens will be borne by subsequent requests.

针对上述问题,本实施例提供了一种令牌的分配方式,具体的:In view of the above problems, this embodiment provides a token allocation method, specifically:

在执行实施例一中的步骤S1时,还包括:When executing step S1 in the first embodiment, the method further includes:

S11、获取当前令牌桶的令牌数量;S11, obtain the number of tokens in the current token bucket;

S12、判断所述下载请求的所需令牌数是否大于所述令牌数量,若是,则执行S13;若否,则执行S14;S12, determining whether the number of tokens required for the download request is greater than the number of tokens, if so, executing S13; if not, executing S14;

S13、判断所述下载请求是否符合令牌透支条件,若符合,则将执行所述下载请求;即当符合令牌透支条件后允许该请求在申请令牌时进行“透支”,不论当前令牌桶内剩余多少令牌,该请求都会被放行;其中,可以设置允许透支的令牌数以及连续透支的次数,当所述下载请求满足允许透支的令牌数以及连续透支的次数时,执行透支操作;而等待令牌桶产生足够令牌的时间则由后续的请求承担;其中,对于一个请求,假设上一个请求透支的令牌数为c,则当前请求等待的时间满足公式:WaitTime=c/r;同时,当令牌桶处于闲置状态时,可以通过resync方法补充令牌。S13. Determine whether the download request meets the token overdraft condition. If so, execute the download request; that is, when the token overdraft condition is met, the request is allowed to "overdraw" when applying for the token, and the request will be released regardless of how many tokens are left in the current token bucket; wherein, the number of tokens allowed to be overdrawn and the number of consecutive overdrafts can be set, and when the download request meets the number of tokens allowed to be overdrawn and the number of consecutive overdrafts, the overdraft operation is performed; and the time waiting for the token bucket to generate enough tokens is borne by subsequent requests; wherein, for a request, assuming that the number of tokens overdrawn by the previous request is c, the waiting time of the current request satisfies the formula: WaitTime=c/r; at the same time, when the token bucket is in an idle state, tokens can be replenished through the resync method.

S14、直至所述令牌数量所述所需令牌数等于所述令牌数量后,执行所述下载请求;或直至所述下载请求符合所述令牌透支条件后,执行所述下载请求;同时,在用户下载过程中记录用户的操作行为记录;使得后续可以通过后台记录查询用户操作行为,防止记录被窜改以及避免数据泄露。S14. Execute the download request until the required number of tokens is equal to the number of tokens; or execute the download request until the download request meets the token overdraft condition; at the same time, record the user's operation behavior during the user download process; so that the user's operation behavior can be queried through the background record later, to prevent the record from being tampered with and avoid data leakage.

实施例三Embodiment 3

请参照图3,一种云存储配额限速下载装置,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,所述处理器执行所述计算机程序时实现如下步骤:Referring to FIG. 3 , a cloud storage quota speed-limited download device includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the following steps are implemented:

S1、接收下载请求,并根据所述下载请求进行数据读写,具体的:S1. Receive a download request and read and write data according to the download request. Specifically:

S11、获取当前令牌桶的令牌数量;S11, obtain the number of tokens in the current token bucket;

S12、判断所述下载请求的所需令牌数是否大于所述令牌数量,若是,执行S13;若否,则执行S14;S12, determining whether the number of tokens required for the download request is greater than the number of tokens, if so, executing S13; if not, executing S14;

S13、判断所述下载请求是否符合令牌透支条件,若符合,则将执行所述下载请求;S13, determining whether the download request meets the token overdraft condition, and if so, executing the download request;

S14、直至所述令牌数量所述所需令牌数等于所述令牌数量后,执行所述下载请求;或直至所述下载请求符合所述令牌透支条件后,执行所述下载请求。S14. Execute the download request until the number of tokens and the required number of tokens are equal to the number of tokens; or execute the download request until the download request meets the token overdraft condition.

S2、获取预设的数据量阈值以及传输速率阈值,并根据所述数据量阈值以及传输速率阈值计算得到下载时间阈值,具体的:S2. Obtain a preset data volume threshold and a transmission rate threshold, and calculate a download time threshold according to the data volume threshold and the transmission rate threshold. Specifically:

S21、获取所述下载请求中包含的任务数量;S21, obtaining the number of tasks included in the download request;

S22、根据所述任务数量以及传输速率阈值得到任务平均下载速率;S22, obtaining an average download rate of the tasks according to the number of tasks and the transmission rate threshold;

S23、根据所述任务平均下载速率以及数据量阈值得到每一任务的所述下载时间阈值;同时,实时判断所述任务数量是否减少或增加,若是,则更新所述任务数量;根据更新的所述任务数量更新所述下载时间阈值。S23. Obtain the download time threshold of each task according to the average download rate of the task and the data volume threshold; at the same time, determine in real time whether the number of tasks decreases or increases, and if so, update the number of tasks; and update the download time threshold according to the updated number of tasks.

S3、实时获取当前数据读写量,并判断所述当前数据读写量是否达到所述数据量阈值,若是,获取数据读写时长;S3, obtaining the current data read/write volume in real time, and determining whether the current data read/write volume reaches the data volume threshold, and if so, obtaining the data read/write duration;

S4、判断所述数据读写时长是否小于所述下载时间阈值,若是,则执行S5;若否,则执行S6;S4, determining whether the data read and write time is less than the download time threshold, if so, executing S5; if not, executing S6;

S5、停止数据读写直至达到所述下载时间阈值后再次执行数据读写;S5, stop reading and writing data until the download time threshold is reached and then execute data reading and writing again;

S6、则将所述当前数据读写量调整至所述数据量阈值后再次执行数据读写。S6, adjusting the current data reading and writing amount to the data amount threshold and then performing data reading and writing again.

综上所述,本发明提供的一种云存储配额限速下载方法及装置,通过在接收下载请求后获取预设的数据量阈值以及传输速率阈值,并根据数据量阈值以及传输速率阈值计算得到下载时间阈值,由于传输速率阈值为定值,即每个用户能够使用的传输速率是固定的,对单个用户下载速率进行有效控制,能够防止系统资源的过度占用,避免不同用户之间资源抢占的问题以及系统因资源耗尽而崩溃,从而提高了系统的稳定性和可靠性;同时,通过将当前数据读写时间与相应的下载时间阈值进行对比,当数据读写的速度过快时停止数据读写即延长了下一次数据读写的时间,而当数据读写的速度过慢时将当前数据读写量调整至数据量阈值即加快了下一次数据读写的时间,实现实时调整当前数据读写的速度,提高用户体验的同时避免用户占用额外资源。In summary, the present invention provides a cloud storage quota speed-limited download method and device, which obtains a preset data volume threshold and a transmission rate threshold after receiving a download request, and calculates a download time threshold based on the data volume threshold and the transmission rate threshold. Since the transmission rate threshold is a fixed value, that is, the transmission rate that each user can use is fixed, the download rate of a single user is effectively controlled, which can prevent excessive occupation of system resources, avoid the problem of resource preemption between different users and the system crash due to resource exhaustion, thereby improving the stability and reliability of the system; at the same time, by comparing the current data reading and writing time with the corresponding download time threshold, when the data reading and writing speed is too fast, the data reading and writing is stopped, which prolongs the time of the next data reading and writing, and when the data reading and writing speed is too slow, the current data reading and writing amount is adjusted to the data volume threshold, which speeds up the time of the next data reading and writing, thereby realizing real-time adjustment of the current data reading and writing speed, improving the user experience while avoiding users occupying extra resources.

以上所述仅为本发明的实施例,并非因此限制本发明的专利范围,凡是利用本发明说明书及附图内容所作的等同变换,或直接或间接运用在相关的技术领域,均同理包括在本发明的专利保护范围内。The above descriptions are merely embodiments of the present invention and are not intended to limit the patent scope of the present invention. Any equivalent transformations made using the contents of the present invention's specification and drawings, or directly or indirectly applied in related technical fields, are also included in the patent protection scope of the present invention.

Claims (10)

1. The cloud storage quota speed limit downloading method is characterized by comprising the following steps of:
receiving a downloading request, and reading and writing data according to the downloading request;
acquiring a preset data volume threshold and a transmission rate threshold, and calculating a downloading time threshold according to the data volume threshold and the transmission rate threshold;
acquiring current data read-write quantity in real time, judging whether the current data read-write quantity reaches the data quantity threshold value, and if so, acquiring data read-write time length;
judging whether the data read-write time length is smaller than the downloading time threshold value, if so, stopping data read-write until the downloading time threshold value is reached, and executing data read-write again;
if not, the current data read-write quantity is adjusted to the data quantity threshold value, and then the data read-write is executed again.
2. The cloud storage quota speed limit downloading method according to claim 1, wherein the calculating the downloading time threshold according to the data amount threshold and the transmission rate threshold comprises:
acquiring the number of tasks contained in the downloading request;
obtaining the average download rate of the tasks according to the number of the tasks and the transmission rate threshold;
and obtaining the downloading time threshold of each task according to the average downloading rate of the tasks and the data quantity threshold.
3. The cloud storage quota speed limit downloading method as in claim 2, further comprising:
judging whether the number of the tasks is reduced in real time, if so, updating the number of the tasks;
and updating the downloading time threshold according to the updated task number.
4. The cloud storage quota speed limit downloading method according to claim 1, wherein the receiving a downloading request and performing data reading and writing according to the downloading request further comprises:
obtaining the number of tokens of a current token bucket;
judging whether the number of tokens required by the downloading request is larger than the number of tokens, if yes, judging whether the downloading request meets the token overdraft condition, and if yes, executing the downloading request.
5. The cloud storage quota speed limit downloading method as in claim 4, wherein said determining whether said download request meets a token overdraft condition further comprises:
if not, executing the downloading request until the number of tokens is equal to the number of tokens; or executing the downloading request until the downloading request meets the token overdraft condition.
6. The cloud storage quota speed limit downloading device comprises a memory, a processor and a computer program stored on the memory and capable of running on the processor, and is characterized in that the processor realizes the following steps when executing the computer program:
receiving a downloading request, and reading and writing data according to the downloading request;
acquiring a preset data volume threshold and a transmission rate threshold, and calculating a downloading time threshold according to the data volume threshold and the transmission rate threshold;
acquiring current data read-write quantity in real time, judging whether the current data read-write quantity reaches the data quantity threshold value, and if so, acquiring data read-write time length;
judging whether the data read-write time length is smaller than the downloading time threshold value, if so, stopping data read-write until the downloading time threshold value is reached, and executing data read-write again;
if not, the current data read-write quantity is adjusted to the data quantity threshold value, and then the data read-write is executed again.
7. The cloud storage quota speed limit downloading apparatus as in claim 6, wherein said calculating a download time threshold from said data volume threshold and said transmission rate threshold comprises:
acquiring the number of tasks contained in the downloading request;
obtaining the average download rate of the tasks according to the number of the tasks and the transmission rate threshold;
and obtaining the downloading time threshold of each task according to the average downloading rate of the tasks and the data quantity threshold.
8. The cloud storage quota speed limit downloading apparatus as in claim 7, further comprising:
judging whether the number of the tasks is reduced in real time, if so, updating the number of the tasks;
and updating the downloading time threshold according to the updated task number.
9. The cloud storage quota speed limit downloading apparatus as in claim 6, wherein said receiving a download request and reading and writing data according to said download request further comprises:
obtaining the number of tokens of a current token bucket;
judging whether the number of tokens required by the downloading request is larger than the number of tokens, if yes, judging whether the downloading request meets the token overdraft condition, and if yes, executing the downloading request.
10. The cloud storage quota speed limit downloading apparatus as in claim 9, wherein said determining whether said download request meets a token overdraft condition further comprises:
if not, executing the downloading request until the number of tokens is equal to the number of tokens; or executing the downloading request until the downloading request meets the token overdraft condition.
CN202311797715.XA 2023-12-25 2023-12-25 Cloud storage quota speed limit downloading method and device Pending CN117896371A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311797715.XA CN117896371A (en) 2023-12-25 2023-12-25 Cloud storage quota speed limit downloading method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311797715.XA CN117896371A (en) 2023-12-25 2023-12-25 Cloud storage quota speed limit downloading method and device

Publications (1)

Publication Number Publication Date
CN117896371A true CN117896371A (en) 2024-04-16

Family

ID=90640445

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311797715.XA Pending CN117896371A (en) 2023-12-25 2023-12-25 Cloud storage quota speed limit downloading method and device

Country Status (1)

Country Link
CN (1) CN117896371A (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103490930A (en) * 2013-09-26 2014-01-01 上海大学 Bandwidth management method
CN105991699A (en) * 2015-02-06 2016-10-05 北京中搜网络技术股份有限公司 Distributed downloading system of Internet crawlers
CN108989272A (en) * 2017-06-07 2018-12-11 北京视联动力国际信息技术有限公司 A kind of data processing method, device and electronic equipment
US11252234B1 (en) * 2020-12-17 2022-02-15 Red Hat, Inc. Containerized gateways and exports for distributed file systems

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103490930A (en) * 2013-09-26 2014-01-01 上海大学 Bandwidth management method
CN105991699A (en) * 2015-02-06 2016-10-05 北京中搜网络技术股份有限公司 Distributed downloading system of Internet crawlers
CN108989272A (en) * 2017-06-07 2018-12-11 北京视联动力国际信息技术有限公司 A kind of data processing method, device and electronic equipment
US11252234B1 (en) * 2020-12-17 2022-02-15 Red Hat, Inc. Containerized gateways and exports for distributed file systems

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
高正九: ""基于HDFS的云存储系统的设计与实现"", 《中国优秀硕士学位论文全文数据库》, no. 10, 15 October 2014 (2014-10-15), pages 21 - 30 *

Similar Documents

Publication Publication Date Title
US8239564B2 (en) Dynamic throttling based on network conditions
CN113381944B (en) System current limiting method, apparatus, electronic device, medium, and program product
US7437428B1 (en) System and method for transferring data over a network
US6920110B2 (en) System and method for transferring data over a network
US8953453B1 (en) System and method for throttling service requests using work-based tokens
CN110519183B (en) Node speed limiting method and device, electronic equipment and storage medium
US20150199281A1 (en) Apparatus and method for meeting performance metrics for users in file systems
WO2017124972A1 (en) Resource cache management method and system and apparatus
WO2012106571A2 (en) Overhead management for event tracing
WO2022057391A1 (en) Cache memory adjustment method, apparatus, and computer device
JP2018110387A (en) Method and system for buffer-based bandwidth measurement and adaptive data transmission in a real-time live environment
US9699103B2 (en) Method and system for flow controlling
CN113315810B (en) Online audio playing method and equipment
WO2020155956A1 (en) First-frame equalization current-limiting method and apparatus, computer device and readable storage medium
US11005776B2 (en) Resource allocation using restore credits
CN106657182B (en) Cloud file processing method and device
CN116366638A (en) Data transmission method, device, electronic device and storage medium
CN111064700B (en) Cloud game download method, device and system
CN115858184A (en) A kind of RDMA memory management method, device, equipment and medium
CN115080657B (en) A method, system and device for allocating operation tokens for distributed storage
CN117896371A (en) Cloud storage quota speed limit downloading method and device
CN118626171A (en) A method, device and system for loading resource files
WO2024222510A1 (en) Cloud virtual machine hibernation method and device, and readable medium
CN113810461B (en) Bandwidth control method, device and equipment and readable storage medium
CN101202741A (en) Method for dynamically adjusting task request number

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination