WO2017096977A1

WO2017096977A1 - Data backup method, apparatus and system

Info

Publication number: WO2017096977A1
Application number: PCT/CN2016/097951
Authority: WO
Inventors: 谢丰; 曾敬勇
Original assignee: 华为技术有限公司
Priority date: 2015-12-08
Filing date: 2016-09-02
Publication date: 2017-06-15
Also published as: CN106855834A; CN106855834B

Abstract

Provided are a data backup method, apparatus and system, for use in implementing data synchronization between a primary storage library and a secondary storage library. The primary storage library comprises a first storage node (112) and a second storage node (114). The secondary storage library comprises a third storage node (116) and a fourth storage node (118). The third storage node (116) is a backup node of the first storage node (112), and the fourth storage node (118) is a backup node of the second storage node (114). The method comprises: a primary storage library receives a first migration instruction (302), migrates first data from a first storage node (112) and a second storage node (114) according to the first migration instruction (302), sends a second migration instruction (306) to a secondary storage library, and instructs the secondary storage library to migrate the first data from a third storage node (116) and a fourth storage node (118). By means of the method, data synchronization operations between a primary storage library and a secondary storage library are implemented in a case in which a large amount of data is transmitted between the primary storage library and the secondary storage library.

Description

Data backup method, device and system

Technical field

The embodiments of the present invention relate to the field of computers, and in particular, to a data backup method, apparatus, and system.

Background technique

Data disaster recovery refers to the establishment of an off-site data system, which is an available copy of local critical application data. In the event of a disaster in local data and the entire application system, the system maintains at least one copy of the critical business data available in the field. The main technology used is data backup and data replication technology. The processing of data disaster recovery is actually the processing of data replication in different places. The off-site data can be full real-time replication (synchronous replication) with locally produced data, or it can be slightly behind (asynchronous replication) than local data.

Taking the data disaster recovery of the Oracle database as an example, the Oracle database is configured to ensure high availability and high reliability. The primary storage library and the standby storage library are respectively deployed in the two computer rooms in the same city, wherein the backup storage library is a backup of the primary storage database. Data protection technology is used to synchronize data between the primary storage and the standby storage.

The basic process of data synchronization is to transfer data to the standby storage library in the synchronous storage mode or the asynchronous replication mode through the previously configured transmission mode to implement data replication between the primary storage library and the secondary storage library.

For synchronous replication, when the data of the primary repository changes, the primary repository does not perform subsequent data processing until it ensures that the standby repository completely receives the changed data. For asynchronous replication, when the data of the main repository changes, the primary repository will not wait for the remote standby repository to receive the changed data correctly and completely after the local data is updated, and will continue to complete the subsequent data. Update request.

Regardless of synchronous replication or asynchronous replication, in the prior art, when the data of the primary storage library changes, the changed data of the primary storage database is transmitted to the standby storage database through the network by implementing the configured transmission mode, if the primary storage When the data of the library changes greatly, a large amount of network resources are consumed when the data is transmitted through the network.

Summary of the invention

In view of this, the present invention discloses a data backup method, apparatus and system to reduce network resources consumed during data backup.

In a first aspect, the application provides a data backup system, where the system includes a primary storage library and a standby storage library, wherein the first storage controller is used to manage the primary storage library, and the second storage controller is used to manage the backup storage library, the primary storage The library includes a first storage node and a second storage node, the standby storage library includes a third storage node and a fourth storage node, the third storage node stores backup data of the first storage node, and the fourth storage node stores the second storage node. The first storage controller is configured to receive the first migration instruction, where the first migration instruction carries the indication information of the first address of the first data at the first storage node and the first data to be migrated to the second storage node. The indication information of the second address, according to the first migration instruction, migrating the first data stored in the first address of the first storage node to the second address of the second storage node, and sending the second migration to the second storage controller The second migration instruction is used to instruct the second storage controller to migrate the first data from the third storage node to the fourth storage node, and the second migration instruction And the indication information of the third address of the first data in the third storage node and the indication information of the fourth address to be migrated to the fourth storage node; the second storage controller is configured to receive the first storage controller The second migration instruction, and according to the second migration instruction, the first data stored on the third address in the third storage node is migrated to the fourth address of the fourth storage node.

Because the data is updated in the second storage node, the same data update needs to be performed on the fourth storage node. Because the third storage node stores the backup data of the first storage node, the backup storage may be performed according to the data migration instruction. The updating of the data synchronization instructs the second storage controller to migrate the first data from the third storage node to the fourth storage node, thereby avoiding a large amount of data transfer from the second storage node to the fourth storage node, thereby reducing network consumption.

With reference to the first aspect, in a first possible implementation manner of the first aspect, after the first storage controller migrates the first data stored in the first address of the first storage node to the second address of the second storage node, The method is further configured to: determine a fifth address used by the second storage node to save data on the second address of the first data, and send a data update instruction to the second storage controller, where the data update instruction includes the indication information of the sixth address And the second data stored on the fifth address, the data update instruction is used to instruct the second storage controller to write the second data to the sixth address of the fourth storage node; the second storage controller is further configured to: according to the data update instruction, The second data is written to the sixth address of the fourth storage node.

When the system adopts the asynchronous replication method, before the second storage controller migrates the first data from the third storage node to the fourth storage node, the client may enter the first data in the second storage node. When the change operation is performed, when the second storage controller performs data migration, the first data in the second storage node has changed, thereby causing data inconsistency between the second storage node and the fourth storage node, and tracking A change of the first data of the data in the second storage node, and updating the change to the fourth storage node, so that the data in the fourth storage node and the second storage node are consistent.

With reference to the first aspect, or any one of the foregoing possible implementation manners, in a second possible implementation manner of the first aspect, the first storage controller is configured to determine, by the second storage node, the second data for saving the first data. The fifth address of the data change on the address includes: the first storage controller is configured to identify the second address by using the first mark, and the data is changed by using the second mark when the data on the address identified by the first mark changes An address; the first storage controller is configured to determine the fifth address according to the second flag.

Identifying the first data by using the first mark, and identifying the changed position information of the first data by using the second mark, so that the first storage controller quickly determines the location information of the data change, and performs the second storage node and Synchronous update of the fourth storage node.

With reference to the first aspect, or any one of the foregoing possible implementation manners, in a third possible implementation manner of the first aspect, the second storage controller: the first data stored in the third address of the third storage node After being migrated to the fourth address of the fourth storage node, the method is further configured to send a feedback message to the first storage controller, where the feedback message is used to indicate that the migration operation of the first data from the third storage node to the fourth storage node is completed.

In a second aspect, the present application provides a data backup method, where a data storage system includes a primary storage library and a standby storage library, wherein a first storage controller is used to manage a primary storage library, and a second storage controller is used to manage a secondary storage library. The primary storage library includes a first storage node and a second storage node, the secondary storage node includes a third storage node and a fourth storage node, the third storage node stores backup data of the first storage node, and the fourth storage node stores the first storage node. The storage data of the storage node is as follows: the first storage controller receives the first migration instruction, where the first migration instruction carries the indication information of the first address of the first storage node and the first data to be migrated to And indicating information of the second address of the second storage node; the first storage controller migrates the first data stored in the first address of the first storage node to the second address of the second storage node according to the first migration instruction; a storage controller sends a second migration instruction to the second storage controller, where the second migration instruction is used to instruct the second storage controller to The storage node is migrated to the fourth storage node, where the second migration instruction carries the indication information of the third address of the first data in the third storage node and the indication information of the fourth address to be migrated to the fourth storage node. .

With reference to the second aspect, in a first possible implementation manner of the second aspect, after the first storage controller migrates the first data stored in the first address of the first storage node to the second address of the second storage node, The method further includes: the first storage controller determines a fifth address used by the second storage node to save the data at the second address of the first data; the first storage controller sends a data update instruction to the second storage controller, and the data is updated. The instruction includes the indication information of the sixth address and the second data stored on the fifth address, the data update instruction is used to instruct the second storage controller to write the second data to the sixth address of the fourth storage node.

When the system adopts the asynchronous replication method, before the second storage controller migrates the first data from the third storage node to the fourth storage node, the client may perform the change operation on the first data in the second storage node, and secondly When the storage controller performs data migration, the first data in the second storage node has changed, thereby causing data inconsistency between the second storage node and the fourth storage node, by tracking the first data in the second storage node. The change of the first data is updated, and the change is updated to the fourth storage node, so that the data in the fourth storage node and the second storage node are consistent.

With reference to the second aspect, or any one of the foregoing possible implementation manners, in the second possible implementation manner of the second aspect, the first storage controller determines that the second storage node is configured to save the second address of the first data The fifth address of the data change includes: the first storage controller identifies the second address by using the first mark, and uses the second mark to identify the address where the data changes when the data on the address identified by the first mark changes. The first memory controller determines the fifth address based on the second flag.

With the second aspect or the second aspect, the second possible implementation manner is The first storage controller receives a feedback message from the second storage controller, the feedback message being used to indicate completion of the migration operation of the first data from the third storage node to the fourth storage node.

In a third aspect, the application provides a computer readable medium, including computer executed instructions, When the processor of the computer executes the computer to execute the instructions, the computer performs the method of any of the possible implementations of the second aspect or the second aspect.

In a fourth aspect, the present application provides a computing device, including: a processor, a memory, a bus, and a communication interface; the memory is configured to store an execution instruction, the processor is connected to the memory through the bus, when the computing device is running The processor executes the execution instructions stored by the memory to cause the computing device to perform the method of any of the possible implementations of the second aspect or the second aspect.

In a fifth aspect, the application provides a data backup device, where the data storage system includes a primary storage library and a backup storage library, wherein the device is used to manage the primary storage library, and the storage controller is used to manage the standby storage library, and the primary storage library includes a first storage node and a second storage node, the standby storage library includes a third storage node and a fourth storage node, the third storage node stores backup data of the first storage node, and the fourth storage node stores a backup of the second storage node The data device includes: a receiving unit, configured to receive a first migration instruction, where the first migration instruction carries indication information of the first address of the first data at the first storage node and the first data to be migrated to the second storage node The indication information of the second address is used to migrate the first data stored in the first address of the first storage node to the second address of the second storage node according to the first migration instruction, and the sending unit is configured to send The storage controller sends a second migration instruction, where the second migration instruction is used to instruct the storage controller to migrate the first data from the third storage node to the fourth storage Node, a second migration instruction indication information in the third storage node of the third address of the first data and the first data to be migrated to the fourth address information indicative of a fourth storage node.

With reference to the fifth aspect, in a first possible implementation manner of the fifth aspect, the device further includes a determining unit, the migration unit migrating the first data stored in the first address of the first storage node to the second data of the second storage node After the address, the determining unit is configured to determine a fifth address used by the second storage node to save the data on the second address of the first data; the sending unit is further configured to send a data update instruction to the storage controller, where the data update command includes The indication information of the six address and the second data stored on the fifth address, the data update instruction is used to instruct the storage controller to write the second data to the sixth address of the fourth storage node.

When the system adopts the asynchronous replication method, before the second storage controller migrates the first data from the third storage node to the fourth storage node, the client may perform a change operation on the first data in the second storage node. When the second storage controller performs data migration, the first data in the second storage node has changed, thereby causing data inconsistency between the second storage node and the fourth storage node, by tracking the first data in the second storage. A change in the first data in the node and updating the change to the fourth storage node such that the data in the fourth storage node is consistent with the data in the second storage node.

With reference to the fifth aspect, or any one of the foregoing possible implementation manners of the fifth aspect, in the second possible implementation manner of the fifth aspect, the determining unit is configured to determine, by the second storage node, the second address used to save the first data The fifth address of the data change includes: the determining unit is configured to identify the second address by using the first mark, and when the data on the address identified by the first mark changes, use the second mark to identify the address where the data changes; The unit is configured to determine the fifth address based on the second flag.

With reference to the fifth aspect, or any one of the foregoing possible implementation manners of the fifth aspect, in a third possible implementation manner of the fifth aspect, after the sending unit sends the second migration instruction to the storage controller, the receiving unit is further configured to receive the And storing a feedback message of the controller, where the feedback message is used to indicate that the migration operation of the first data from the third storage node to the fourth storage node is completed.

According to the technical solution disclosed in the embodiment of the present invention, when a data migration operation occurs between the first storage node and the second storage node in the main storage library, only the data migration instruction needs to be sent from the primary storage library to the standby storage library, thereby avoiding A large amount of data transfer operation between the second storage node and the fourth storage node, thereby saving network transmission consumption and saving time for data update.

DRAWINGS

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly described below. It is obvious that the drawings in the following description are only some embodiments of the present invention, Those skilled in the art can also obtain other drawings based on these drawings without paying any creative work.

1 is a schematic diagram of a logical structure of a data backup system according to the present invention;

2 is a schematic structural diagram of a hardware of a computing device according to an embodiment of the invention;

3 is a signaling diagram of a data backup method according to an embodiment of the invention;

FIG. 4 is a schematic diagram showing the logical structure of a data backup device according to an embodiment of the invention.

detailed description

The embodiments of the present invention will be described below with reference to the accompanying drawings.

According to the embodiment of the present invention, in order to increase the disaster tolerance performance of the user data, one client is configured with a primary storage library and a standby storage library, wherein the standby storage library is a disaster recovery backup of the primary storage repository, and the storage storage library stores the primary storage library. The backup data of the repository can be used to recover the data of the client when the data of the primary repository is incorrect, thereby increasing the disaster tolerance performance of the user data. In order to ensure that the data of the standby repository is valid, when the data of the primary repository changes, the same update as the primary repository needs to be made to the standby repository.

1 is a schematic diagram of a system logical structure of a data backup system 100 according to the present invention. As shown in FIG. 1, the system 100 includes a client 102, a main storage library 104, and a backup storage library 106, wherein the main storage library 104 includes a a storage controller 108, a first storage node 112, and a second storage node 114. The first storage controller 104 is configured to manage the primary storage library 104. The secondary storage server 106 includes a second storage controller 110 and a third storage node 116. And the fourth storage node 118, the second storage controller 106 is configured to manage the standby storage 106.

The third storage node 116 stores the backup data of the first storage node 112, that is, the third storage node 116 is the backup storage node of the first storage node 112; the fourth storage node 118 stores the backup data of the second storage node 114. That is, the fourth storage node 118 is a backup storage node of the second storage node 114.

The main storage library 104 or the backup storage network 106 may be a network storage architecture such as a storage array or a network attached storage (NAS) or a storage area network (SAN). Each storage node can be a Logical Unit Number (LUN) or a file system. It should be understood that embodiments of the present invention do not limit the representation of the repository and storage nodes.

The client 102 and the first storage controller 108, the first storage controller 108 and the second storage controller 110 can be connected through a network, wherein the network can be the Internet, an intranet, or a local area network (LAN). ), Wireless Local Area Networks (WLANs), Storage Area Networks (SANs), etc., or a combination of the above.

The first storage controller 108 and the second storage controller 110 shown in FIG. 1 can be calculated by the meter shown in FIG. 2. The computing device 200 is implemented.

2 is a simplified logical block diagram of computing device 200. As shown in FIG. 2, computing device 200 includes a processor 202, a memory unit 204, an input/output interface 206, a communication interface 208, a bus 210, and a storage device 212. The processor 202, the memory unit 204, the input/output interface 206, the communication interface 208, and the storage device 212 implement communication connections with each other through the bus 210.

The processor 202 is a control center of the computing device 200 for executing related programs to implement the technical solutions provided by the embodiments of the present invention. Optionally, the processor 202 includes one or more central processing units (CPUs), such as the central processing unit 1 and the central processing unit 2 shown in FIG. Optionally, the computing device 200 can also include multiple processors 202, each of which can be a single core processor (including one CPU) or a multi-core processor (including multiple CPUs). Unless otherwise stated, in the present invention, a component for performing a specific function, for example, the processor 202 or the memory unit 204, may be implemented by configuring a general-purpose component to perform a corresponding function, or may be specifically performed by a specific one. The specific components of the function are implemented, and this application does not limit this. The processor 202 can use a general-purpose central processing unit, a microprocessor, an application specific integrated circuit (ASIC), or one or more integrated circuits for executing related programs to implement the technology provided by the present application. Program.

Processor 202 can be coupled to one or more storage schemes via bus 210. The storage scheme can include a memory unit 204 and a storage device 212. The storage device 212 can be a read only memory (ROM), a static storage device, a dynamic storage device, or a random access memory (RAM). Memory unit 204 can be a random access memory. The memory unit 204 can be integrated with or integrated with the processor 202, or it can be one or more memory units independent of the processor 202.

Program code for execution by the processor 202 or a CPU internal to the processor 202 may be stored in the storage device 212 or the memory unit 204. Optionally, program code (eg, an operating system, application software, backup module, communication module, or storage control module, etc.) stored internal to storage device 212 is copied to memory unit 204 for execution by processor 202.

The storage device 212 can be a physical hard disk or a partition thereof (including a small computing device system interface storage or a global network block device volume), a network storage protocol (including a network file system NFS or other network or cluster file system), a file-based virtual storage device ( Virtual disk mirroring), logical volume-based storage devices. It may include high speed random access memory (RAM), and may also include non-volatile memory, such as one or more disk memories, flash memories, or other non-volatile memory. In a In some embodiments, the storage device may further include a remote memory separate from the one or more processors 202, such as a network disk accessed through a communication interface 208 with a communication network, which may be the Internet, an intranet, Local area networks (LANs), wide area networks (WLANs), storage area networks (SANs), etc., or a combination of the above.

Operating systems (such as Darwin, RTXC, LINUX, UNIX, OS X, WINDOWS, or embedded operating systems such as Vxworks) include controls and management of general system tasks (such as memory management, storage device control, power management, etc.) And various software components and/or drivers that facilitate communication between various hardware and software components.

The input/output interface 206 is for receiving input data and information, and outputting data such as operation results.

Communication interface 208 enables communication between computing device 200 and other devices or communication networks using transceivers such as, but not limited to, transceivers.

Bus 210 may include a path for communicating information between various components of computing device 200, such as processor 202, memory unit 204, input/output interface 206, communication interface 208, and storage device 212. Optionally, the bus 210 can use a wired connection or a wireless communication mode, which is not limited in this application.

It should be noted that although the computing device 200 shown in FIG. 2 only shows the processor 202, the memory unit 204, the input/output interface 206, the communication interface 208, the bus 210, and the storage device 212, in a specific implementation process, the field Those skilled in the art will appreciate that computing device 200 also includes other devices necessary to achieve proper operation.

The computing device 200 can be a general purpose computing device or a special purpose computing device including, but not limited to, a portable computing device, a personal desktop computing device, a web server, a tablet, a cell phone, a personal digital assistant (PDA), or the like, or The above two or more combinations of devices do not limit the specific implementation form of the computing device 200.

Moreover, computing device 200 of FIG. 2 is merely an example of one computing device 200, which may include more or fewer components than those shown in FIG. 2, or have different component configurations. Those skilled in the art will appreciate that computing device 200 may also include hardware devices that implement other additional functions, depending on the particular needs. Those skilled in the art will appreciate that computing device 200 may also only include the components necessary to implement embodiments of the present invention, and does not necessarily include all of the devices shown in FIG. At the same time, the various components shown in Figure 2 can be implemented in hardware, software, or a combination of hardware and software.

The hardware structure shown in FIG. 2 and the above description are applicable to various meters provided by the embodiments of the present invention. The computing device is adapted to perform various data backup methods provided by the embodiments of the present invention.

As shown in FIG. 2, the memory unit 204 of the computing device 200 includes a backup module, and the processor 202 executes the program code of the backup module to implement a data backup operation.

The backup module can be comprised of one or more operational instructions to cause computing device 200 to perform one or more method steps in accordance with the above description. The specific method steps are described in detail in the following sections of this application.

FIG. 3 is a signaling diagram of a data backup method according to an embodiment of the present invention. The data backup system 100 includes a main storage library 104 and a backup storage library 106. The main storage library 104 is configured to store data of the client 102, and the storage repository 106 Is a backup repository of the main repository 104 for storing backup data of the primary repository 104, wherein the first storage controller 108 is configured to manage the primary repository 104, and the second storage controller 110 is configured to manage the backup storage The library 106, the main storage library 104 includes a first storage node 112 and a second storage node 114, the standby storage library 106 includes a third storage node 116 and a fourth storage node 118, and the third storage node 116 is a backup of the first storage node 112. The node stores the backup data of the first storage node 112. The fourth storage node 118 is the backup node of the second storage node 114, and the backup data of the second storage node 114 is saved. When the data migration operation occurs inside the main storage library 104, The embodiment of the present invention is used to implement the same data update in the standby storage library 106. As shown in FIG. 3, the data backup method includes:

302: The primary repository 104 receives the first migration instruction.

More specifically, the first storage controller 108 of the primary repository 104 receives the first migration instruction from the client 102. The client 102 can be any type of computing device, and the main repository 104 stores the data of the client 102. For example, the client 102 can be a cloud management platform of a data center. When a virtual machine migration or the like occurs. The client 102 is to migrate the data volume, that is, to migrate the data from one storage node to another storage node, and the client 102 sends a first migration instruction to the main storage library 104.

The data migration instruction is used to instruct the primary storage library 104 (the first storage controller 108) to migrate the first data in the first storage node 112 to the second storage node 114, and the first migration instruction carries the first data in the first The indication information of the first address of the storage node 110 and the indication information of the second address to be migrated to the second storage node. In the specific implementation process, the indication information of the first address of the first data in the first storage node 112 may be the start address and the address length of the first data in the first storage node 112, and the first data is migrated to the second storage node 114. The indication information of the second address may be the starting address of the first data migration to the second storage node 114.

In the specific implementation process, the indication information of the first address of the first data at the first storage node 112 The indication that the first data is in the first storage node 112 relative to the segment header address, and the indication information that the first data migrates to the second address of the second storage node 114 may also be the first data. The offset from the start address of the second storage node 114 to the first address of the segment.

Specifically, the first migration instruction may further carry the identifier information of the first storage node 112 and the identifier information of the second storage node 114.

It should be understood that the indication information of the first address and the indication information of the first address are used to indicate the original location of the first data in the first storage node 112 and the destination location of the migration to the second storage node 114, respectively. The specific implementation of the indication information is not limited.

304: The primary repository 104 migrates the first data from the first storage node 112 to the second storage node 114 according to the first migration instruction.

More specifically, the first storage controller 108 of the primary repository 104 migrates the first data stored on the first address in the first storage node 112 to the second address of the second storage node.

306: The primary repository 104 sends a second migration instruction to the standby repository 106.

More specifically, the first storage controller 108 of the primary repository 104 transmits the second migration instruction to the second backup controller 110 of the standby repository 106. The second migration instruction is used to instruct the second storage control 110 to migrate the first data from the third storage node 116 to the fourth storage node 118, and the second migration instruction carries the third data in the third storage node 116. The indication information of the address and the indication information of the fourth address to be migrated to the fourth storage node 118.

The storage repository 106 is a backup repository of the primary storage library 104, the third storage node 116 is a backup node of the first storage node 112, and the fourth storage node 118 is a backup node of the first storage node 114. When there is data update in the second storage node 112, the same data update needs to be performed on the fourth storage node 118, because the third storage node 116 stores the backup data of the first storage node 112, in order to avoid the second storage node 114. The data transfer to the fourth storage node 118 may be performed, and the data synchronization of the backup storage library 106 may be updated according to the second migration instruction, and the second storage controller 110 is instructed to migrate the first data from the third storage node 116 to the fourth storage node 116. Storage node 118.

308: The standby repository 106 migrates the first data from the third storage node 116 to the fourth storage node 118 according to the second migration instruction.

More specifically, after receiving the second migration instruction from the first storage controller 108, the second storage controller 110 migrates the first data stored in the third address of the third storage node 116 to the second migration instruction to The fourth address of the fourth storage node 118.

In a specific implementation process, because the third storage node 116 is a backup section of the first storage node 112. Point, the storage address of the two has a mapping relationship, and the indication information of the first address can be used as the indication information of the third address, and the second storage controller 110 maintains the address mapping relationship between the first storage node 112 and the third storage node 116. . The second storage controller 110 may determine the third address of the first data in the third storage node 116 using the indication information of the first address, thereby fetching the first data from the third storage node 116.

Similarly, the fourth storage node 118 is a backup node of the second storage node 114, and the storage addresses of the two storage nodes are in a mapping relationship, and the indication information of the second address can be used as the indication information of the fourth address, and the second storage controller 110 maintains There is an address mapping relationship between the second storage node 114 and the fourth storage node 118. The second storage controller 110 may use the indication information of the second address to determine that the first data migrates to the fourth address in the fourth storage node 118, thereby migrating the first data from the third storage node 116 to the fourth storage node. 118.

In another possible implementation manner, the first storage node controller 108 maintains an address mapping relationship between the first storage node 112 and the third storage node 116, and the first storage controller 108 may determine according to the indication information of the first address. The third address, and the indication information of the third address is carried in the second migration instruction, where the indication information of the third address may be the start address and the address length of the first data at the third storage node 116, more specifically, The offset of the start address of the first data at the third storage node 116 relative to the segment header address and the address length.

Similarly, the first storage node controller 108 can maintain an address mapping relationship between the second storage node 114 and the fourth storage node 118, and the first storage controller 108 can determine the fourth address according to the indication information of the second address, and The second migration instruction carries the indication information of the fourth address, and the indication information of the fourth address may be a starting address for migrating the first data to the fourth storage node 118. More specifically, the first data may be migrated to The offset of the start address of the fourth storage node 118 relative to the first address of the segment.

310: The standby repository 106 sends a feedback message to the primary repository 104.

More specifically, the second storage controller 110 of the standby storage 106 sends a feedback message to the first storage controller 108 of the primary storage library 104, the feedback message indicating that the first data is completed from the third storage node 116 to the fourth. Migration in storage node 118.

If the data backup system adopts the synchronous replication method, the primary storage library 104 does not immediately send a receipt message indicating the completion of the migration to the client 102 after step 304, but after waiting for the execution of steps 306-310, that is, the primary After receiving the feedback message sent by the standby repository 106, the repository 104 sends the receipt message to the client 102 to indicate that the migration operation of the first data is completed.

When the data of the main storage library 104 is changed, the main storage library 104 does not perform subsequent data processing until the backup storage library 106 completes the data synchronization with the main storage library 104, thereby ensuring the standby storage. The strict consistency of the library 106 with the primary repository 104. However, in the synchronous replication method, the data of the primary storage library 104 is unavailable during the time interval between the data storage synchronization operation between the standby storage 106 and the primary storage library 104, thereby causing the client 102 to access the primary storage library 104. The delay of subsequent data operations.

If the data backup system adopts the asynchronous replication method, the primary storage library 104 migrates the first data from the first storage node 112 to the second storage node 114 according to the data migration instruction, that is, after performing step 304, does not wait for the standby storage. The library 104 performs the same data migration, and sends a return message to the client 102 for indicating that the migration of the first data is completed, and then performs the data synchronization operation of steps 306-310.

By using the asynchronous replication method, since the main storage library 104 does not wait for the data synchronization of the standby storage library 106 to complete, the return receipt message is sent to the client 102, thereby reducing the waiting time of the client 102 for data synchronization in the synchronous replication method, so that the main storage library 104 The data in repository 104 quickly becomes available to 102. However, in the time interval in which steps 306 and 308 are performed, the client 102 may perform a change operation on the first data in the second storage node 114, and the synchronous update operation in step 310 is still performed. The first data migrates from the third storage node 116 to the fourth storage node 118, and at this time, the first data in the second storage node 114 has changed, thereby causing the second storage node 114 and the fourth storage node 118 to The data is inconsistent.

In order to solve the problem, after the step 304, the first storage controller 108 is further configured to determine that the second storage node 114 is configured to save address information in which the data in the storage area of the first data changes; The second storage controller 110 sends a data update instruction, where the data update instruction includes address information of the data change and second data after the data change on the address information, the data update instruction is used to indicate the second storage controller 110 Writing the second data to the fourth storage node. That is, the first storage controller 108 is further configured to determine a fifth address used by the second storage node 114 to save data on the second address of the first data, and send a data update instruction to the second storage controller 110, and the data is updated. The instruction includes the indication information of the sixth address and the second data stored on the fifth address, the data update instruction is for instructing the second storage controller 110 to write the second data to the sixth address of the fourth storage node 118. The second storage controller writes the second data to the sixth address of the fourth storage node according to the data update instruction.

Specifically, after performing step 304, the first storage controller 108 identifies the The second storage node is configured to save an address of the storage area of the first data, for example, using a "0" mark to store the storage area of the first data, and when the data on the address identified by the first mark changes, use the first The second tag identifies the address at which the data has changed, for example, using "1" to mark the address at which the data changes. That is, after performing step 304, the first storage controller 108 identifies the second address by using the first mark, and uses the second mark to identify the address where the data changes when the data on the address identified by the first mark changes. The storage controller determines the fifth address based on the second flag.

The second storage controller 110 may migrate the first data from the third storage node 116 to the fourth storage node 118 according to the second migration instruction according to the sequence of receiving the second migration instruction and the data update instruction, respectively, according to the The data update request updates the second data to the fourth storage node.

After receiving the second migration instruction and the data update instruction, the second storage node 110 may further merge the second migration instruction and the data update instruction, thereby writing the second data to the fourth storage node 118, and Data in the first data that does not overlap with the address in the second data is migrated to the fourth storage node 118.

In a specific implementation process, the first storage controller 108 may send the data update instruction to the second storage controller 110 after receiving the feedback message from the second storage controller 110, thereby implementing the second storage node 114 and the fourth. Data synchronization between storage nodes 118.

4 is a schematic diagram of a logical structure of a data backup device 400 according to an embodiment of the present invention. The data backup system includes a primary storage library and a backup storage library. The primary storage library is used to store data of the client, and the backup storage library is a backup of the primary storage library. a storage library, configured to save backup data of the primary storage library, where the device 400 is configured to manage the primary storage library, the storage controller is configured to manage the standby storage database, and the primary storage library includes a first storage node and a second storage node, The storage library includes a third storage node and a fourth storage node, the third storage node is a backup node of the first storage node, and the backup data of the first storage node is saved, and the fourth storage node is a backup node of the second storage node, and is saved. There is a backup data of the second storage node. When a data migration operation occurs in the main storage, the embodiment of the present invention is used to implement the same data update in the standby storage. As shown in FIG. 4, the device 400 includes a receiving unit 402 and a migration unit. 404 and sending unit 406, wherein

The receiving unit 402 is configured to receive a first migration instruction, where the first migration instruction carries the first data The indication information of the first address of the first storage node and the indication information of the second address to be migrated to the second storage node.

In a specific implementation process, the receiving unit 402 can be implemented by the processor 202, the memory unit 204, and the communication interface 208 shown in FIG. More specifically, the communication module in memory unit 204 can be executed by processor 202 to cause communication interface 208 to receive a backup information migration message from the backup server.

The migration unit 404 is configured to migrate the first data stored in the first address in the first storage node to the second address of the second storage node according to the first migration instruction.

In a specific implementation process, the migration unit 404 can be implemented by the processor 202 and the memory unit 204 shown in FIG. 2. More specifically, the storage control module in the memory unit 204 can be executed by the processor 202 to implement a migration operation of the first data from the first storage node to the second storage node.

The sending unit 406 is configured to send, to the storage controller, a second migration instruction, where the second migration instruction is used to instruct the storage controller to migrate the first data from the third storage node to the fourth storage node, where the The second migration instruction carries the indication information of the third address of the first data in the third storage node and the indication information of the fourth address to be migrated to the fourth storage node.

In a specific implementation process, the sending unit 406 can be implemented by the processor 202, the memory unit 204, and the communication interface 208 shown in FIG. 2. More specifically, the communication module and backup module in memory unit 204 can be executed by processor 202 to cause communication interface 208 to send the data migration instruction to the memory controller.

In an implementation manner of the embodiment of the present invention, the backup system uses the asynchronous replication method to implement data replication of the primary storage library and the standby storage database, and the migration unit 404 stores the first storage node in the first address. After the first data is migrated to the second address of the second storage node, the determining unit is configured to determine a fifth address used by the second storage node to save data on the second address of the first data; the sending unit 406 is further configured to send a data update instruction to the storage controller, where the data update instruction includes indication information of a sixth address and second data stored on the fifth address, where the data update instruction is used to instruct the storage controller to The second data is written to the sixth address of the fourth storage node.

Specifically, the determining unit is configured to determine a fifth address used by the second storage node to save data on the second address of the first data, where the determining unit is configured to identify the second address by using the first identifier. For example, the second address of the first data in the second storage node may be marked with "0", and the second standard is used when the data on the address identified by the first mark changes. The address at which the identification data changes is recorded. For example, the position at which the data is changed may be identified by using "1", and the determining unit is configured to determine the fifth address according to the second flag.

After the sending unit 406 sends the second migration instruction to the storage controller, the receiving unit 402 is further configured to receive a feedback message from the storage controller, where the feedback message is used to indicate that the first data is completed from the third storage node. The migration operation to the fourth storage node.

The embodiment of the present invention is an apparatus embodiment of the first storage controller 108 in FIG. 1 , and the feature description of the embodiment of FIG. 1 to FIG. 3 is applicable to the embodiment of the present invention, and details are not described herein again.

In the several embodiments provided by the present application, it should be understood that the disclosed systems, devices, and methods may be implemented in other manners. For example, the device embodiments described above are merely illustrative. For example, the division of the modules is only a logical function division, and may be implemented in another manner, for example, multiple modules or components may be combined or may be Integrate into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or module, and may be electrical, mechanical or otherwise.

The modules described as separate components may or may not be physically separated. The components displayed as modules may or may not be physical modules, that is, may be located in one place, or may be distributed to multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, each functional module in each embodiment of the present invention may be integrated into one processing module, or each module may exist physically separately, or two or more modules may be integrated into one module. The above integrated modules can be implemented in the form of hardware or in the form of hardware plus software function modules.

The above-described integrated modules implemented in the form of software function modules can be stored in a computer readable storage medium. The software functional modules described above are stored in a storage medium and include instructions for causing a computer device (which may be a personal computer, server, or network device, etc.) to perform some of the steps of the methods described in various embodiments of the present invention. The foregoing storage medium includes: a mobile hard disk, a read-only memory (English: Read-Only Memory, ROM for short), a random access memory (English: Random Access Memory, RAM for short), a magnetic disk or an optical disk, and the like. The medium of the code.

Finally, it should be noted that the above embodiments are only for explaining the technical solutions of the present invention, and are not limited thereto; although the present invention has been described in detail with reference to the foregoing embodiments, the It should be understood that the technical solutions described in the foregoing embodiments may be modified, or some of the technical features may be equivalently replaced; and the modifications or substitutions do not deviate from the essence of the corresponding technical solutions. The scope of protection of the technical solution.

Claims

A data backup system, wherein the system includes a primary storage library and a secondary storage library, wherein the first storage controller is configured to manage the primary storage library, and the second storage controller is configured to manage the backup storage library. The primary storage library includes a first storage node and a second storage node, where the secondary storage node includes a third storage node and a fourth storage node, and the third storage node stores backup data of the first storage node. The fourth storage node stores backup data of the second storage node,

The first storage controller is configured to receive a first migration instruction, where the first migration instruction carries indication information of the first address of the first data at the first storage node and the first data to be migrated to the Instructing the second address of the second storage node to migrate the first data stored in the first address of the first storage node to the second storage node according to the first migration instruction a second address, and sending a second migration instruction to the second storage controller, the second migration instruction is used to instruct the second storage controller to migrate the first data from the third storage node Up to the fourth storage node, the second migration instruction carries the indication information of the third address of the first data in the third storage node, and the first data to be migrated to the fourth The indication information of the fourth address of the storage node;

The second storage controller is configured to receive the second migration instruction from the first storage controller, and store the third address in the third storage node according to the second migration instruction. The first data is migrated to a fourth address of the fourth storage node.
The system according to claim 1, wherein said first storage controller migrates said first data stored on said first address in said first storage node to said second storage node After the second address, the method further includes: determining, by the second storage node, a fifth address for changing data on the second address of the first data, and sending a data update instruction to the second storage controller The data update instruction includes indication information of a sixth address and second data stored on the fifth address, where the data update instruction is used to instruct the second storage controller to write the second data Describe a sixth address of the fourth storage node;

The second storage controller is further configured to write the second data to a sixth address of the fourth storage node according to the data update instruction.
The system according to claim 2, wherein the first storage controller is configured to determine a fifth address used by the second storage node to save data on the second address of the first data, including :

The first storage controller is configured to identify the second address by using a first mark, and use the second mark to identify an address where the data changes when the data on the address identified by the first mark changes;

The first storage controller is configured to determine the fifth address according to the second tag.
The system according to any one of claims 1 to 3, wherein the second storage controller migrates the first data stored on the third address in the third storage node to the After the fourth address of the fourth storage node is further used to send a feedback message to the first storage controller, where the feedback message is used to indicate that the first data is completed from the third storage node to the fourth The migration operation of the storage node.
A method for backing up data, characterized in that the data storage system comprises a primary storage library and a standby storage library, wherein the first storage controller is used to manage the primary storage library, and the second storage controller is configured to manage the backup storage library The primary storage library includes a first storage node and a second storage node, the standby storage library includes a third storage node and a fourth storage node, and the third storage node stores backup data of the first storage node The fourth storage node stores backup data of the second storage node, where the method includes:

Receiving, by the first storage controller, a first migration instruction, where the first migration instruction carries indication information that the first data is at a first address of the first storage node, and the first data is to be migrated to the The indication information of the second address of the second storage node;

The first storage controller migrates the first data stored in the first address in the first storage node to a second address of the second storage node according to the first migration instruction;

The first storage controller sends a second migration instruction to the second storage controller, where the second migration instruction is used to instruct the second storage controller to use the first data from the third storage node And migrating to the fourth storage node, where the second migration instruction carries the indication information of the third address of the first data in the third storage node and the first data to be migrated to the first The indication information of the fourth address of the four storage nodes.
The method according to claim 5, wherein the first storage controller migrates the first data stored on the first address in the first storage node to the second storage node After the second address, further includes:

Determining, by the first storage controller, a fifth address used by the second storage node to save data on the second address of the first data;

The first storage controller sends a data update instruction to the second storage controller, the number And the update instruction includes the indication information of the sixth address and the second data stored on the fifth address, where the data update instruction is used to instruct the second storage controller to write the second data into the fourth The sixth address of the storage node.
The method of claim 6, wherein the first storage controller determines a fifth address used by the second storage node to save data on the second address of the first data, including:

The first storage controller identifies the second address by using a first mark, and when the data on the address identified by the first mark changes, the second mark is used to identify an address where the data changes;

The first storage controller determines the fifth address according to the second tag.
The method according to any one of claims 5-7, wherein after the first storage controller sends the second migration instruction to the second storage controller, the method further includes: the first storage controller Receiving a feedback message from the second storage controller, the feedback message being used to indicate a migration operation of the first data from the third storage node to the fourth storage node.
An apparatus for backing up data, characterized in that the data storage system includes a main storage library and a standby storage library, wherein the device is configured to manage the primary storage library, and the storage controller is configured to manage the standby storage library, The main storage library includes a first storage node and a second storage node, the standby storage library includes a third storage node and a fourth storage node, and the third storage node stores backup data of the first storage node, The fourth storage node holds the backup data of the second storage node, and the device includes:

a receiving unit, configured to receive a first migration instruction, where the first migration instruction carries indication information of a first address of the first data at the first storage node and a first data to be migrated to the second The indication information of the second address of the storage node;

a migration unit, configured to migrate the first data stored in the first address in the first storage node to a second address in the second storage node according to the first migration instruction;

a sending unit, configured to send a second migration instruction to the storage controller, where the second migration instruction is used to instruct the storage controller to migrate the first data from the third storage node to the fourth a storage node, where the second migration instruction carries indication information of a third address of the first data in the third storage node and a fourth to migrate the first data to the fourth storage node The indication of the address.
The apparatus according to claim 9, wherein said apparatus further comprises a determining unit, said migration unit storing said first number stored on said first address in said first storage node After the second address of the second storage node is migrated, the determining unit is configured to determine a fifth address used by the second storage node to save data on the second address of the first data;

The sending unit is further configured to send a data update instruction to the storage controller, where the data update instruction includes indication information of a sixth address and second data stored on the fifth address, where the data update instruction is used Instructing the storage controller to write the second data to a sixth address of the fourth storage node.
The device according to claim 10, wherein the determining unit is configured to determine a fifth address used by the second storage node to save data on the second address of the first data, including:

The determining unit is configured to identify the second address by using a first mark, and use the second mark to identify an address where the data changes when the data on the address identified by the first mark changes;

The determining unit is configured to determine the fifth address according to the second tag.
The device according to any one of claims 9 to 11, wherein after the sending unit sends the second migration instruction to the storage controller, the receiving unit is further configured to receive the storage controller. And a feedback message, the feedback message is used to indicate that the migration operation of the first data from the third storage node to the fourth storage node is completed.
A computer readable medium, comprising computer executed instructions for performing the method of any one of claims 5-8 when a processor of a computer executes the computer to execute an instruction.
A computing device, comprising: a processor, a memory, and a bus;

The memory is configured to store execution instructions, the processor is coupled to the memory via the bus, and when the computing device is running, the processor executes the execution instructions stored by the memory to cause the The apparatus performs the method of any of claims 5-8.