CN102122303A - Method for data migration, service system and sever equipment - Google Patents
Method for data migration, service system and sever equipment Download PDFInfo
- Publication number
- CN102122303A CN102122303A CN 201110061863 CN201110061863A CN102122303A CN 102122303 A CN102122303 A CN 102122303A CN 201110061863 CN201110061863 CN 201110061863 CN 201110061863 A CN201110061863 A CN 201110061863A CN 102122303 A CN102122303 A CN 102122303A
- Authority
- CN
- China
- Prior art keywords
- data
- storage device
- level storage
- attention
- degree
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Debugging And Monitoring (AREA)
Abstract
本发明公开了一种进行数据迁移的方法及服务系统及服务器设备，根据数据的被关注度将所述数据在不同存取速度级别的存储设备间迁移。采用本发明的方案可以实现文件存储的自动优化，将数据在不同存取速度级别的存储设备间迁移，将热点数据及时迁移到存取速度高的存储设备，将非热点数据及时迁移到存取速度低的存储设备，使用户可以对热点数据进行更快速的存取操作，提高存储设备的利用率和系统服务质量。
The invention discloses a data migration method, service system and server equipment, which migrate the data between storage devices of different access speed levels according to the attention degree of the data. The scheme of the present invention can realize automatic optimization of file storage, migrate data between storage devices with different access speed levels, migrate hot data to storage devices with high access speed in time, and migrate non-hot data to storage devices in time The low-speed storage device enables users to perform faster access operations on hot data, improving the utilization rate of storage devices and system service quality.
Description
技术领域technical field
本发明涉及一种计算机应用技术领域，尤其涉及一种进行数据迁移的方法及服务系统及服务器设备。The invention relates to the field of computer application technology, in particular to a data migration method, service system and server equipment.
背景技术Background technique
传统网络上承载的数据内容以网页为主。通常，服务器端(网站)根据网站的容量需求，布置合适的网络服务器和存储设备，不同的网络用户访问该网站，下载相关网页。随着互联网上用户的不断增加，网站的访问量剧增，使网站的网络设备和存储设备不堪负重。对此，各厂商采用服务器镜像技术，在用户相对集中的地方放上缓存设备，作为对原始服务器的镜像服务器，用户访问原来的服务器时，被网络重定向到离用户最近的镜像服务器，从而提高了网络用户的访问质量和访问速度。The data content carried on the traditional network is mainly web pages. Usually, the server side (website) arranges appropriate network servers and storage devices according to the capacity requirements of the website, and different network users visit the website and download relevant webpages. With the continuous increase of users on the Internet, the number of visits to the website increases sharply, which makes the network equipment and storage equipment of the website overwhelmed. In this regard, each manufacturer adopts server mirroring technology, and puts cache devices in places where users are relatively concentrated, as a mirror server for the original server. When users access the original server, they are redirected by the network to the mirror server closest to the user, thereby improving It improves the access quality and access speed of network users.
随着网络的发展，网络可用带宽越来越宽，互联网上用户上传的文件和图片也迅速增多。这些内容具有数量多、热度集中、新鲜度易于更新的特点，因此需要更多的网络开销和网络存储设备，单纯采用镜像的方式远远不能满足这种网络应用。如何提高存储设备的利用率和系统服务质量是需要解决的技术问题。With the development of the network, the available bandwidth of the network is getting wider and wider, and the files and pictures uploaded by users on the Internet are also increasing rapidly. These contents have the characteristics of large quantity, concentrated popularity, and easy update of freshness, so more network overhead and network storage devices are required, and the pure mirroring method is far from satisfying this kind of network application. How to improve the utilization rate of storage devices and system service quality is a technical problem that needs to be solved.
发明内容Contents of the invention
本发明要解决的技术问题是提供一种进行数据迁移的方法及服务系统及服务器设备，为提高存储设备的利用率和系统服务质量提供解决方案。The technical problem to be solved by the present invention is to provide a method for data migration, a service system and server equipment, so as to provide solutions for improving the utilization rate of storage equipment and system service quality.
为了解决上述技术问题，本发明提供了一种进行数据迁移的方法，包括：根据数据的被关注度将所述数据在不同存取速度级别的存储设备间迁移。In order to solve the above technical problem, the present invention provides a method for data migration, including: migrating the data between storage devices of different access speed levels according to the attention degree of the data.
进一步地，上述方法还可以具有以下特点：Further, the above method may also have the following characteristics:
所述存储设备包括第一级存储设备和第二级存储设备；所述第一级存储设备的存取速度级别高于所述第二级存储设备的存取速度级别。The storage device includes a first-level storage device and a second-level storage device; the access speed level of the first-level storage device is higher than that of the second-level storage device.
进一步地，上述方法还可以具有以下特点：Further, the above method may also have the following characteristics:
根据数据的被关注度将所述数据在不同存取速度级别的存储设备间迁移的步骤包括：所述数据位于第二级存储设备时，检测到所述数据的被关注度大于基准被关注度，则将所述数据从所述第二级存储设备迁移到所述第一级存储设备；所述数据位于第一级存储设备时，检测到所述数据的被关注度小于或等于基准被关注度，则将所述数据从所述第一级存储设备迁移到所述第二级存储设备。The step of migrating the data between storage devices of different access speed levels according to the attention degree of the data includes: when the data is located in the second-level storage device, it is detected that the attention degree of the data is greater than the reference attention degree , then migrate the data from the second-level storage device to the first-level storage device; when the data is located in the first-level storage device, it is detected that the attention degree of the data is less than or equal to the reference attention degree degree, the data is migrated from the first-level storage device to the second-level storage device.
进一步地，上述方法还可以具有以下特点：Further, the above method may also have the following characteristics:
根据数据的被关注度以及新鲜度将所述数据在不同存取速度级别的存储设备间迁移；所述数据位于第二级存储设备时，检测到所述数据的被关注度大于基准被关注度并且新鲜度大于基准新鲜度时，将所述数据从所述第二级存储设备迁移到所述第一级存储设备；所述数据位于第一级存储设备时，检测到所述数据的被关注度小于或等于基准被关注度并且新鲜度小于或等于基准新鲜度时，将所述数据从所述第一级存储设备迁移到所述第二级存储设备。Migrate the data between storage devices of different access speed levels according to the degree of attention and freshness of the data; when the data is located in the second-level storage device, it is detected that the degree of attention of the data is greater than the reference degree of attention And when the freshness is greater than the reference freshness, the data is migrated from the second-level storage device to the first-level storage device; when the data is located in the first-level storage device, it is detected that the data is concerned When the degree of attention is less than or equal to the reference degree and the freshness is less than or equal to the reference freshness, the data is migrated from the first-level storage device to the second-level storage device.
进一步地，上述方法还可以具有以下特点：Further, the above method may also have the following characteristics:
所述数据的被关注度是以检测时刻为终点的检测时长内所述数据的被访问次数，或者是以检测时刻为终点的检测时长内所述数据的被访问次数与检测时长的比值。The degree of attention of the data is the number of times the data is accessed within the detection time period ending at the detection time, or the ratio of the number of times the data is accessed to the detection time period within the detection time period ending at the detection time point.
进一步地，上述方法还可以具有以下特点：Further, the above method may also have the following characteristics:
所述数据的新鲜度为固定系数与检测时刻与所述数据的创建时间的差值的比值，或者，为参考测试有效期时长与检测时刻与所述数据的创建时间的差值的比值。The freshness of the data is the ratio of the fixed coefficient to the difference between the detection moment and the creation time of the data, or the ratio of the validity period of the reference test to the difference between the detection moment and the creation time of the data.
进一步地，上述方法还可以具有以下特点：Further, the above method may also have the following characteristics:
设置参考测试有效期时长为固定值，或者，计算多个与所述数据属于相同类型的数据的测试有效期时长，将计算结果的平均值作为所述数据的参考测试有效期时长；计算数据的测试有效期时长的步骤包括：以所述数据的创建时间为起点，预设时间点为终点，依次统计固定时长间隔内的被访问数，将被访问数均大于预设门限的连续时间段的时长作为所述数据的测试有效期时长。Set the reference test validity period to a fixed value, or calculate the test validity period of multiple data belonging to the same type as the data, and use the average value of the calculation results as the reference test validity period of the data; calculate the test validity period of the data The steps include: taking the creation time of the data as the starting point and the preset time point as the end point, sequentially counting the number of visits within a fixed time interval, and taking the duration of the continuous time period in which the number of visits is greater than the preset threshold as the The test validity period of the data.
进一步地，上述方法还可以具有以下特点：Further, the above method may also have the following characteristics:
根据对多个与所述数据属于相同类型的数据进行统计获得所述基准被关注度和基准新鲜度。The base degree of attention and the base freshness are obtained by performing statistics on a plurality of data belonging to the same type as the data.
为了解决上述技术问题，本发明还提供了一种进行数据迁移的服务系统，所述服务系统包括服务器设备、第一级存储设备和第二级存储设备；所述第一级存储设备的存取速度级别高于所述第二级存储设备的存取速度级别；所述服务器设备，用于根据数据的被关注度以及新鲜度将所述数据在不同存取速度级别的存储设备间迁移；在所述数据位于第二级存储设备时，检测到所述数据的被关注度大于基准被关注度并且新鲜度大于基准新鲜度时，将所述数据从所述第二级存储设备迁移到所述第一级存储设备；在所述数据位于第一级存储设备时，检测到所述数据的被关注度小于或等于基准被关注度并且新鲜度小于或等于基准新鲜度时，将所述数据从所述第一级存储设备迁移到所述第二级存储设备。In order to solve the above-mentioned technical problems, the present invention also provides a service system for data migration, the service system includes a server device, a first-level storage device, and a second-level storage device; the access of the first-level storage device The speed level is higher than the access speed level of the second-level storage device; the server device is used to migrate the data between storage devices of different access speed levels according to the degree of attention and freshness of the data; When the data is located in the second-level storage device, when it is detected that the attention degree of the data is greater than the reference degree of attention and the freshness is greater than the reference freshness, the data is migrated from the second-level storage device to the First-level storage device; when the data is located in the first-level storage device, when it is detected that the attention degree of the data is less than or equal to the reference degree of attention and the freshness is less than or equal to the reference freshness, the data is removed from the The first-level storage device is migrated to the second-level storage device.
为了解决上述技术问题，本发明还提供了一种进行数据迁移的服务器设备；所述服务器设备，用于根据数据的被关注度将所述数据在不同存取速度级别的存储设备间迁移；在所述数据位于第二级存储设备时，检测到所述数据的被关注度大于基准被关注度，则将所述数据从所述第二级存储设备迁移到所述第一级存储设备；在所述数据位于第一级存储设备时，检测到所述数据的被关注度小于或等于基准被关注度，则将所述数据从所述第一级存储设备迁移到所述第二级存储设备；所述第一级存储设备的存取速度级别高于所述第二级存储设备的存取速度级别。In order to solve the above technical problems, the present invention also provides a server device for data migration; the server device is used to migrate the data between storage devices of different access speed levels according to the attention degree of the data; When the data is located in the second-level storage device, it is detected that the degree of attention of the data is greater than the reference degree of attention, then migrating the data from the second-level storage device to the first-level storage device; When the data is located in the first-level storage device, it is detected that the attention degree of the data is less than or equal to the reference attention degree, and then the data is migrated from the first-level storage device to the second-level storage device ; The access speed level of the first level storage device is higher than the access speed level of the second level storage device.
采用本发明的方案可以实现文件存储的自动优化，将数据在不同存取速度级别的存储设备间迁移，将热点数据及时迁移到存取速度高的存储设备，将非热点数据及时迁移到存取速度低的存储设备，使用户可以对热点数据进行更快速的存取操作，提高存储设备的利用率和系统服务质量。The scheme of the present invention can realize automatic optimization of file storage, migrate data between storage devices with different access speed levels, migrate hot data to storage devices with high access speed in time, and migrate non-hot data to storage devices in time The low-speed storage device enables users to perform faster access operations on hot data, improving the utilization rate of storage devices and system service quality.
附图说明Description of drawings
图1是具体实施例一中进行数据迁移的方法示意图；Fig. 1 is a schematic diagram of a method for data migration in a specific embodiment;
图2是实施例中进行数据迁移的方法及服务系统的结构图。Fig. 2 is a structural diagram of a method for data migration and a service system in an embodiment.
具体实施方式Detailed ways
进行数据迁移的方法包括：根据数据的被关注度将所述数据在不同存取速度级别的存储设备间迁移。The method for data migration includes: migrating the data between storage devices of different access speed levels according to the attention degree of the data.
存储设备包括第一级存储设备和第二级存储设备；第一级存储设备的存取速度级别高于第二级存储设备的存取速度级别。The storage device includes a first-level storage device and a second-level storage device; the access speed level of the first-level storage device is higher than that of the second-level storage device.
第一级存储设备为光纤硬盘组成的阵列或SAS(Serial Attached SCSI，简称SAS)硬盘；所述第二级存储设备为电子集成驱动器IDE(Integrated DriveElectronics，简称IDE)硬盘或串行高级技术附件(Serial Advanced TechnologyAttachment，简称SATA)磁盘。The first-level storage device is an array of optical fiber hard disks or SAS (Serial Attached SCSI, referred to as SAS) hard disk; the second-level storage device is an electronic integrated drive IDE (Integrated Drive Electronics, referred to as IDE) hard disk or serial advanced technology accessories ( Serial Advanced Technology Attachment, referred to as SATA) disk.
实施例一Embodiment one
根据数据的被关注度将所述数据在不同存取速度级别的存储设备间迁移的步骤包括：具体的，所述数据位于第二级存储设备时，检测到所述数据的被关注度大于基准被关注度，则将所述数据从所述第二级存储设备迁移到所述第一级存储设备；所述数据位于第一级存储设备时，检测到所述数据的被关注度小于或等于基准被关注度，则将所述数据从所述第一级存储设备迁移到所述第二级存储设备。The step of migrating the data between storage devices of different access speed levels according to the degree of attention of the data includes: specifically, when the data is located in the second-level storage device, it is detected that the degree of attention of the data is greater than a reference degree of attention, then migrate the data from the second-level storage device to the first-level storage device; when the data is in the first-level storage device, it is detected that the degree of attention of the data is less than or equal to If the benchmark attention degree is used, the data is migrated from the first-level storage device to the second-level storage device.
所述数据的被关注度是以检测时刻为终点的检测时长内所述数据的被访问次数，或者是以检测时刻为终点的检测时长内所述数据的被访问次数与检测时长的比值。The degree of attention of the data is the number of times the data is accessed within the detection time period ending at the detection time, or the ratio of the number of times the data is accessed to the detection time period within the detection time period ending at the detection time point.
根据对多个与所述数据属于相同类型的数据进行统计获得所述基准被关注度。基准被关注度可以采用概率统计的方法获得。或者将多个测试数据的平均基准被关注度作为基准被关注度。The benchmark degree of attention is obtained by performing statistics on a plurality of data belonging to the same type as the data. The benchmark degree of attention can be obtained by the method of probability and statistics. Alternatively, the average benchmark degree of attention of multiple test data is used as the benchmark degree of attention.
设置测试有效期时长(T)的概念。某数据的检测时刻与其创建时刻的差值大于参考测试有效期时长时，其关注度为0。计算多个与所述数据属于相同类型的数据的测试有效期时长，将计算结果的平均值作为所述数据的参考测试有效期时长。Set the concept of test validity period (T). When the difference between the detection time of a certain data and its creation time is greater than the validity period of the reference test, its attention degree is 0. Calculating the validity period of a plurality of tests of data belonging to the same type as the data, and using the average value of the calculation results as the reference test validity period of the data.
一般文件数据随着时间推移其被访问次数逐渐增加，到一定时间会将会达到峰值，然后访问用户数会下降，一般可呈现正态分布。计算数据的测试有效期时长的步骤可以包括：以所述数据的创建时间为起点，预设时间点为终点，依次统计固定时长间隔内的被访问数，将被访问数均大于预设门限(此门限值可以为0)的连续时间段的时长作为所述数据的测试有效期时长。Generally, the number of times file data is accessed gradually increases over time, and will reach a peak after a certain period of time, and then the number of access users will decrease, generally showing a normal distribution. The step of calculating the test validity period of the data may include: taking the creation time of the data as the starting point and the preset time point as the end point, counting the number of visits in the fixed time interval in turn, and the number of visits is greater than the preset threshold (this The duration of the continuous time period in which the threshold value can be 0) is used as the test validity period of the data.
实施例二Embodiment two
根据数据的被关注度以及新鲜度将所述数据在不同存取速度级别的存储设备间迁移；具体的，所述数据位于第二级存储设备时，检测到所述数据的被关注度大于基准被关注度并且新鲜度大于基准新鲜度时，将所述数据从所述第二级存储设备迁移到所述第一级存储设备；所述数据位于第一级存储设备时，检测到所述数据的被关注度小于或等于基准被关注度并且新鲜度小于或等于基准新鲜度时，将所述数据从所述第一级存储设备迁移到所述第二级存储设备。Migrate the data between storage devices of different access speed levels according to the degree of attention and freshness of the data; specifically, when the data is located in the second-level storage device, it is detected that the degree of attention of the data is greater than the reference When the degree of attention is paid and the freshness is greater than the reference freshness, the data is migrated from the second-level storage device to the first-level storage device; when the data is located in the first-level storage device, the data is detected When the degree of attention is less than or equal to the reference degree of attention and the freshness is less than or equal to the reference freshness, the data is migrated from the first-level storage device to the second-level storage device.
所述数据的被关注度是以检测时刻为终点的检测时长内所述数据的被访问次数，或者是以检测时刻为终点的检测时长内所述数据的被访问次数与检测时长的比值。The degree of attention of the data is the number of times the data is accessed within the detection time period ending at the detection time, or the ratio of the number of times the data is accessed to the detection time period within the detection time period ending at the detection time point.
所述数据的新鲜度为固定系数与检测时刻与所述数据的创建时间的差值的比值。The freshness of the data is the ratio of a fixed coefficient to the difference between the detection moment and the creation time of the data.
或者，所述数据的新鲜度为参考测试有效期时长(T)与检测时刻与所述数据的创建时间的差值的比值。设置参考测试有效期时长为固定值(例如一天)。或者，计算多个与所述数据属于相同类型的数据的测试有效期时长，将计算结果的平均值作为所述数据的参考测试有效期时长。Alternatively, the freshness of the data is the ratio of the validity period (T) of the reference test to the difference between the detection moment and the creation time of the data. Set the validity period of the reference test to a fixed value (for example, one day). Or, calculate the test validity period of multiple data belonging to the same type as the data, and use the average value of the calculation results as the reference test validity period of the data.
一般文件数据随着时间推移其被访问次数逐渐增加，到一定时间会将会达到峰值，然后访问用户数会下降，一般可呈现正态分布。计算数据的测试有效期时长的步骤可以包括：以所述数据的创建时间为起点，预设时间点为终点，依次统计固定时长间隔内的被访问数，将被访问数均大于预设门限(此门限值可以为0)的连续时间段的时长作为所述数据的测试有效期时长。某数据的检测时刻与其创建时刻的差值大于参考测试有效期时长时，其新鲜度为0。Generally, the number of times file data is accessed gradually increases over time, and will reach a peak after a certain period of time, and then the number of access users will decrease, generally showing a normal distribution. The step of calculating the test validity period of the data may include: taking the creation time of the data as the starting point and the preset time point as the end point, counting the number of visits in the fixed time interval in turn, and the number of visits is greater than the preset threshold (this The duration of the continuous time period in which the threshold value can be 0) is used as the test validity period of the data. When the difference between the detection time of a certain data and its creation time is greater than the validity period of the reference test, its freshness is 0.
根据对多个与所述数据属于相同类型的数据进行统计获得所述基准被关注度和基准新鲜度。基准被关注度和基准新鲜度可以采用概率统计的方法获得。或者将多个测试数据的平均基准被关注度作为基准被关注度；将多个测试数据的平均基准被新鲜度作为基准新鲜度。The base degree of attention and the base freshness are obtained by performing statistics on a plurality of data belonging to the same type as the data. The benchmark degree of attention and the benchmark freshness can be obtained by the method of probability statistics. Alternatively, the average benchmark degree of attention of multiple test data is used as the benchmark degree of attention; the average degree of benchmark freshness of multiple test data is used as the benchmark freshness.
本方法中的检测可以是定时检测，或者收到用户请后进行检测，或者是实时的周期性的检测。例如，可以自数据创建之时起，以定时检测间隔(例如2分钟)对数据的被关注度进行检测，或者同时对数据的被关注度和新鲜度进行检测。还可以根据数据的属性和统计出的经验值计算最优定时检测间隔。The detection in this method may be timing detection, or detection after receiving the user's request, or real-time periodic detection. For example, the attention degree of data may be detected at a regular detection interval (for example, 2 minutes) since the data is created, or the attention degree and freshness of data may be detected at the same time. The optimal timing detection interval can also be calculated according to the attributes of the data and the statistical empirical values.
本文中的数据的类型可由系统划分，例如多媒体数据，或者，将多媒体数据细分为文本数据、音频数据、视频数据、图片数据等。The types of data herein may be divided by system, such as multimedia data, or the multimedia data may be subdivided into text data, audio data, video data, picture data, and the like.
下面结合具体实施例详细说明本发明。The present invention will be described in detail below in conjunction with specific embodiments.
如图1所示，将位于低存取速度级别的存储设备的文件数据进行数据迁移的方法包括以下步骤：As shown in Figure 1, the method for data migration of file data of a storage device at a low access speed level includes the following steps:
步骤1，启动检测定时器(定时器对应的检测时长为2小时)；Step 1, start the detection timer (the detection duration corresponding to the timer is 2 hours);
步骤2，检测定时器到时，读取系统当前时间与待测文件数据的创建时间，判断两者差值是否大于参考测试有效期时长(例如一天)，如果是，设置此待测文件数据的被关注度和新鲜度为0，检测结束；否则，执行步骤3；Step 2, when the detection timer expires, read the current time of the system and the creation time of the file data to be tested, and judge whether the difference between the two is greater than the validity period of the reference test (for example, one day), if so, set the file data to be tested If the attention degree and freshness are 0, the detection ends; otherwise, go to step 3;
步骤3，计算待测文件数据的被关注度，即以检测时刻为终点的检测时长内所述数据的被访问次数与检测时长(2小时)的比值；Step 3, calculating the attention degree of the file data to be tested, that is, the ratio of the number of times the data is accessed to the detection duration (2 hours) within the detection duration with the detection time as the end point;
步骤4，计算待测文件数据的新鲜度，即参考测试有效期时长(T)与检测时刻与所述数据的创建时间的差值的比值；Step 4, calculating the freshness of the file data to be tested, that is, the ratio of the reference test validity period (T) to the difference between the detection moment and the creation time of the data;
步骤5，判断待测文件数据的被关注度是否大于基准被关注度以及待测文件数据的新鲜度是否大于基准新鲜度，如果是，执行步骤6；否则执行步骤7；Step 5, judging whether the attention degree of the file data to be tested is greater than the reference degree of attention and whether the freshness of the file data to be tested is greater than the reference freshness, if yes, perform step 6; otherwise, perform step 7;
步骤6，将此待测文件数据迁移到高存取速度级别的存储设备；Step 6, migrate the data of the file to be tested to a storage device with a high access speed level;
步骤7，将此待测文件继续存储在原设备，结束。Step 7, continue to store the file to be tested in the original device, and end.
进行数据迁移的服务系统可采用上述方法的原理。如图2所示，所述服务系统包括服务器设备、第一级存储设备和第二级存储设备；所述第一级存储设备的存取速度级别高于所述第二级存储设备的存取速度级别。The service system for data migration can adopt the principle of the above method. As shown in Figure 2, the service system includes a server device, a first-level storage device, and a second-level storage device; the access speed level of the first-level storage device is higher than that of the second-level storage device Speed level.
所述服务器设备，用于根据数据的被关注度以及新鲜度将所述数据在不同存取速度级别的存储设备间迁移；在所述数据位于第二级存储设备时，检测到所述数据的被关注度大于基准被关注度并且新鲜度大于基准新鲜度时，将所述数据从所述第二级存储设备迁移到所述第一级存储设备；在所述数据位于第一级存储设备时，检测到所述数据的被关注度小于或等于基准被关注度并且新鲜度小于或等于基准新鲜度时，将所述数据从所述第一级存储设备迁移到所述第二级存储设备。The server device is configured to migrate the data between storage devices of different access speed levels according to the degree of attention and freshness of the data; when the data is located in the second-level storage device, the When the attention degree is greater than the reference degree of attention and the freshness is greater than the reference freshness, the data is migrated from the second-level storage device to the first-level storage device; when the data is located in the first-level storage device When it is detected that the degree of attention of the data is less than or equal to the reference degree of attention and the freshness is less than or equal to the reference freshness, the data is migrated from the first-level storage device to the second-level storage device.
服务器设备在进行数据迁移中使用其它具体算法与上述方法中描述的相同，此处不再赘述。Other specific algorithms used by the server device in data migration are the same as those described in the above method, and will not be repeated here.
采用本发明的方案可以实现文件存储的自动优化，将数据在不同存取速度级别的存储设备间迁移，将热点数据及时迁移到存取速度高的存储设备，将非热点数据及时迁移到存取速度低的存储设备，使用户可以对热点数据进行更快速的存取操作，提高存储设备的利用率和系统服务质量。The scheme of the present invention can realize automatic optimization of file storage, migrate data between storage devices with different access speed levels, migrate hot data to storage devices with high access speed in time, and migrate non-hot data to storage devices in time The low-speed storage device enables users to perform faster access operations on hot data, improving the utilization rate of storage devices and system service quality.
需要说明的是，在不冲突的情况下，本申请中的实施例及实施例中的特征可以相互任意组合。It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined arbitrarily with each other.
当然，本发明还可有其他多种实施例，在不背离本发明精神及其实质的情况下，熟悉本领域的技术人员可根据本发明作出各种相应的改变和变形，但这些相应的改变和变形都应属于本发明所附的权利要求的保护范围。Certainly, the present invention also can have other multiple embodiments, without departing from the spirit and essence of the present invention, those skilled in the art can make various corresponding changes and deformations according to the present invention, but these corresponding changes All changes and modifications should belong to the scope of protection of the appended claims of the present invention.
本领域普通技术人员可以理解上述方法中的全部或部分步骤可通过程序来指令相关硬件完成，所述程序可以存储于计算机可读存储介质中，如只读存储器、磁盘或光盘等。可选地，上述实施例的全部或部分步骤也可以使用一个或多个集成电路来实现。相应地，上述实施例中的各模块/单元可以采用硬件的形式实现，也可以采用软件功能模块的形式实现。本发明不限制于任何特定形式的硬件和软件的结合。Those skilled in the art can understand that all or part of the steps in the above method can be completed by instructing relevant hardware through a program, and the program can be stored in a computer-readable storage medium, such as a read-only memory, a magnetic disk or an optical disk, and the like. Optionally, all or part of the steps in the foregoing embodiments may also be implemented using one or more integrated circuits. Correspondingly, each module/unit in the foregoing embodiments may be implemented in the form of hardware, or may be implemented in the form of software function modules. The present invention is not limited to any specific combination of hardware and software.
Claims (10)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201110061863 CN102122303A (en) | 2011-03-15 | 2011-03-15 | Method for data migration, service system and sever equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201110061863 CN102122303A (en) | 2011-03-15 | 2011-03-15 | Method for data migration, service system and sever equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102122303A true CN102122303A (en) | 2011-07-13 |
Family
ID=44250862
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 201110061863 Pending CN102122303A (en) | 2011-03-15 | 2011-03-15 | Method for data migration, service system and sever equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102122303A (en) |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102968278A (en) * | 2012-10-25 | 2013-03-13 | 浪潮电子信息产业股份有限公司 | Method for improving effective availability of storage space |
| CN103077127A (en) * | 2012-12-29 | 2013-05-01 | 深圳先进技术研究院 | Method and device for determining data migration target |
| CN103312776A (en) * | 2013-05-08 | 2013-09-18 | 青岛海信传媒网络技术有限公司 | Method and device for caching contents of videos by edge node server |
| CN105164658A (en) * | 2013-07-31 | 2015-12-16 | 惠普发展公司，有限责任合伙企业 | Generating workload windows |
| CN106302634A (en) * | 2016-07-25 | 2017-01-04 | 乐视控股（北京）有限公司 | A kind of data migration method and system |
| CN106294440A (en) * | 2015-05-27 | 2017-01-04 | 阿里巴巴集团控股有限公司 | The method and apparatus of data real-time migration |
| CN106951179A (en) * | 2016-01-07 | 2017-07-14 | 杭州海康威视数字技术股份有限公司 | A kind of data migration method and device |
| CN107092443A (en) * | 2017-04-28 | 2017-08-25 | 杭州宏杉科技股份有限公司 | Data migration method and device |
| WO2017143957A1 (en) * | 2016-02-26 | 2017-08-31 | 华为技术有限公司 | Data redistribution method and device |
| CN107247727A (en) * | 2017-04-28 | 2017-10-13 | 北京五八信息技术有限公司 | Data migration method and equipment |
| CN108989370A (en) * | 2017-05-31 | 2018-12-11 | 华为软件技术有限公司 | Date storage method, equipment and system in a kind of CDN system |
| WO2021056243A1 (en) * | 2019-09-25 | 2021-04-01 | 华为技术有限公司 | Method and device for managing data in partition table, management node, and storage medium |
| EP4379543A4 (en) * | 2021-08-02 | 2024-11-13 | ZTE Corporation | CLOUD DESKTOP DATA MIGRATION METHOD, SERVICE NODE, MANAGEMENT NODE, SERVER, ELECTRONIC DEVICE AND COMPUTER-READABLE STORAGE MEDIUM |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1604054A (en) * | 2003-09-29 | 2005-04-06 | 刘志明 | Disc buffer substitution algorithm in layered video request |
| CN101201801A (en) * | 2006-12-11 | 2008-06-18 | 南京理工大学 | Hierarchical storage management method for video on demand system |
| CN101794199A (en) * | 2010-03-26 | 2010-08-04 | 山东高效能服务器和存储研究院 | Method for accelerating performance of computer disk based on disk cache |
-
2011
- 2011-03-15 CN CN 201110061863 patent/CN102122303A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1604054A (en) * | 2003-09-29 | 2005-04-06 | 刘志明 | Disc buffer substitution algorithm in layered video request |
| CN101201801A (en) * | 2006-12-11 | 2008-06-18 | 南京理工大学 | Hierarchical storage management method for video on demand system |
| CN101794199A (en) * | 2010-03-26 | 2010-08-04 | 山东高效能服务器和存储研究院 | Method for accelerating performance of computer disk based on disk cache |
Cited By (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102968278A (en) * | 2012-10-25 | 2013-03-13 | 浪潮电子信息产业股份有限公司 | Method for improving effective availability of storage space |
| CN103077127A (en) * | 2012-12-29 | 2013-05-01 | 深圳先进技术研究院 | Method and device for determining data migration target |
| CN103077127B (en) * | 2012-12-29 | 2016-05-11 | 深圳先进技术研究院 | A kind of method and apparatus of specified data migrating objects |
| CN103312776A (en) * | 2013-05-08 | 2013-09-18 | 青岛海信传媒网络技术有限公司 | Method and device for caching contents of videos by edge node server |
| CN105164658A (en) * | 2013-07-31 | 2015-12-16 | 惠普发展公司，有限责任合伙企业 | Generating workload windows |
| CN106294440B (en) * | 2015-05-27 | 2019-06-07 | 阿里巴巴集团控股有限公司 | The method and apparatus of data real-time migration |
| CN106294440A (en) * | 2015-05-27 | 2017-01-04 | 阿里巴巴集团控股有限公司 | The method and apparatus of data real-time migration |
| CN106951179A (en) * | 2016-01-07 | 2017-07-14 | 杭州海康威视数字技术股份有限公司 | A kind of data migration method and device |
| CN106951179B (en) * | 2016-01-07 | 2020-03-27 | 杭州海康威视数字技术股份有限公司 | Data migration method and device |
| WO2017143957A1 (en) * | 2016-02-26 | 2017-08-31 | 华为技术有限公司 | Data redistribution method and device |
| CN106302634A (en) * | 2016-07-25 | 2017-01-04 | 乐视控股（北京）有限公司 | A kind of data migration method and system |
| CN107247727A (en) * | 2017-04-28 | 2017-10-13 | 北京五八信息技术有限公司 | Data migration method and equipment |
| CN107092443A (en) * | 2017-04-28 | 2017-08-25 | 杭州宏杉科技股份有限公司 | Data migration method and device |
| CN107092443B (en) * | 2017-04-28 | 2020-04-07 | 杭州宏杉科技股份有限公司 | Data migration method and device |
| CN108989370A (en) * | 2017-05-31 | 2018-12-11 | 华为软件技术有限公司 | Date storage method, equipment and system in a kind of CDN system |
| CN108989370B (en) * | 2017-05-31 | 2020-11-06 | 华为技术有限公司 | Data storage method, equipment and system in CDN system |
| WO2021056243A1 (en) * | 2019-09-25 | 2021-04-01 | 华为技术有限公司 | Method and device for managing data in partition table, management node, and storage medium |
| CN112840334A (en) * | 2019-09-25 | 2021-05-25 | 华为技术有限公司 | Method, device, management node, and storage medium for managing data in partition table |
| US11768856B2 (en) | 2019-09-25 | 2023-09-26 | Huawei Cloud Computing Technologies Co., Ltd. | Method, apparatus, and management node for managing data in partition table, and storage medium |
| CN112840334B (en) * | 2019-09-25 | 2024-06-11 | 华为云计算技术有限公司 | Method, device, management node and storage medium for managing data of partition table |
| EP4379543A4 (en) * | 2021-08-02 | 2024-11-13 | ZTE Corporation | CLOUD DESKTOP DATA MIGRATION METHOD, SERVICE NODE, MANAGEMENT NODE, SERVER, ELECTRONIC DEVICE AND COMPUTER-READABLE STORAGE MEDIUM |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102122303A (en) | Method for data migration, service system and sever equipment | |
| US9830101B2 (en) | Managing data storage in a set of storage systems using usage counters | |
| US9952850B2 (en) | Automated firmware update with rollback in a data storage system | |
| CN100518088C (en) | A stream media data content management method | |
| CN104978362B (en) | Data migration method, device and the meta data server of distributed file system | |
| US20060143419A1 (en) | Managing disk storage media | |
| CN107302561B (en) | A kind of hot spot data Replica placement method in cloud storage system | |
| AU2016202362A1 (en) | Storing data on storage nodes | |
| CN104199784B (en) | A kind of data migration method and device based on classification storage | |
| CN112286459A (en) | Data processing method, device, equipment and medium | |
| CN103412929A (en) | Mass data storage method | |
| CN107402870B (en) | Method and device for processing log segment in metadata server | |
| CN105224473A (en) | The update method that a kind of solid state hard disc is data cached and device | |
| CN109254958A (en) | Distributed data reading/writing method, equipment and system | |
| CN110858912A (en) | Streaming media caching method and system, caching policy server and streaming service node | |
| US20180025096A1 (en) | Data referring method, information processing apparatus, and storage medium | |
| CN105094700B (en) | The data temperature of bedding storage calculates method and apparatus in cloud storage system | |
| CN107422989A (en) | A kind of more copy read methods of Server SAN systems and storage architecture | |
| CN105574008B (en) | Task scheduling method and device applied to distributed file system | |
| CN105677650B (en) | A kind of data cached storage method and device | |
| CN109101197A (en) | A kind of file stores and accesses method, apparatus, file memory and system | |
| CN105760114B (en) | A parallel file system resource management method, device and system | |
| CN109325001A (en) | Method, device and device for deleting small files based on metadata server | |
| JP2016129003A (en) | Snapshot management method, management device, and snapshot management program | |
| CN1227592C (en) | Method for managing stream media data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20110713 |