[go: up one dir, main page]

CN105516365A - Management method of distributed mirror image storage block equipment based on network - Google Patents

Management method of distributed mirror image storage block equipment based on network Download PDF

Info

Publication number
CN105516365A
CN105516365A CN201610042458.2A CN201610042458A CN105516365A CN 105516365 A CN105516365 A CN 105516365A CN 201610042458 A CN201610042458 A CN 201610042458A CN 105516365 A CN105516365 A CN 105516365A
Authority
CN
China
Prior art keywords
resource management
data
destination
network
source
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610042458.2A
Other languages
Chinese (zh)
Inventor
张景
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
IEIT Systems Co Ltd
Original Assignee
Inspur Electronic Information Industry Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Inspur Electronic Information Industry Co Ltd filed Critical Inspur Electronic Information Industry Co Ltd
Priority to CN201610042458.2A priority Critical patent/CN105516365A/en
Publication of CN105516365A publication Critical patent/CN105516365A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1097Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1095Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

本发明提供一种基于网络的分布式镜像存储块设备的管理方法,涉及磁盘数据管理技术领域,保证源端和目的端网络互通,在同一资源管理平台中创建资源管理组,将源端(本地主机)和目的端(目的主机)集中于统一的资源管理平台的同一资源管理组种。通过这种方式,允许用户在远程机器上建立一个对本地数据以块设备为单位进行的实时镜像,从而可以实现对数据块进行分布式的存储。并添加双向心跳探测,当一端在20s内ping不同对端时,就会发出报警,并记录此时故障情况。具有集中化管理、直观等优点。

The invention provides a network-based management method for distributed mirror storage block devices, which relates to the technical field of disk data management, ensures the network intercommunication between the source end and the destination end, creates a resource management group in the same resource management platform, and integrates the source end (local host) and the destination (destination host) are centralized in the same resource management group of the unified resource management platform. In this way, users are allowed to establish a real-time mirror image of local data in units of block devices on a remote machine, so that distributed storage of data blocks can be realized. And add two-way heartbeat detection. When one end pings different peers within 20s, an alarm will be issued and the failure situation at this time will be recorded. It has the advantages of centralized management and intuition.

Description

一种基于网络的分布式镜像存储块设备的管理方法A management method for network-based distributed mirror storage block devices

技术领域 technical field

本发明涉及磁盘数据管理技术领域,尤其涉及一种基于网络的分布式镜像存储块设备的管理方法。 The invention relates to the technical field of disk data management, in particular to a management method of a network-based distributed mirror storage block device.

背景技术 Background technique

随着磁盘共享技术大规模应用于教学、实验以及生产系统,在实际的生产应用中担任起越来越重的角色,为人们带来了便捷的体验、高效的服务。然而随着时代的进步,受限于共享磁盘单点故障、I/O瓶颈等,原有共享磁盘的安全性、易扩展性已达不到需求,故而迫切需要更安全、更高效、更好的方案来管理数据。 With the large-scale application of disk sharing technology in teaching, experiment and production systems, it plays an increasingly important role in actual production applications, bringing people convenient experience and efficient services. However, with the progress of the times, limited by the single point of failure of shared disks, I/O bottlenecks, etc., the security and scalability of the original shared disks have not met the requirements, so there is an urgent need for safer, more efficient, and better scheme to manage data.

发明内容 Contents of the invention

为了解决该问题,本发明提出了一种基于网络的分布式镜像存储块设备的管理方法。该方法是一种高可靠、高效、高可用的存储解决方案,具有集中化管理、直观等优点。 In order to solve this problem, the present invention proposes a network-based management method for distributed mirror storage block devices. This method is a storage solution with high reliability, high efficiency and high availability, and has the advantages of centralized management and intuition.

本发明基于网络,通过网络传输将源端(本地)数据以数据块的方式实时复制到目标端(远端),在复制过程中不需要认为的干预。并且对源端和目的端进行实时的监控,当有一端出现故障后,会启动报警机制,通知管理员,并准确记录故障时间、故障原因。管理员可根据具体故障日志对其进行恢复,非常实用可靠。 The present invention is based on the network, and the source (local) data is copied to the target (remote) in real time in the form of data blocks through network transmission, without any intervention in the process of copying. In addition, real-time monitoring is carried out on the source and destination ends. When one end fails, an alarm mechanism will be activated to notify the administrator, and the failure time and cause of the failure will be accurately recorded. The administrator can restore it according to the specific fault log, which is very practical and reliable.

本发明的技术方案是: Technical scheme of the present invention is:

通过分布式同步镜像的理念,首先保证源端和目的端网络互通,在同一资源管理平台中创建资源管理组,将源端(本地主机)和目的端(目的主机)集中于统一的资源管理平台的同一资源管理组中。通过这种方式,允许用户在远程机器上建立一个对本地数据以块设备为单位进行的实时镜像,从而可以实现对数据块进行分布式的存储。并添加双向心跳探测,当一端在20s内ping不同对端时,就会发出报警,并记录此时故障情况。 Through the concept of distributed synchronous mirroring, firstly ensure the network interworking between the source and destination, create a resource management group in the same resource management platform, and concentrate the source (local host) and destination (destination host) on a unified resource management platform in the same resource management group. In this way, users are allowed to establish a real-time mirror image of local data in units of block devices on a remote machine, so that distributed storage of data blocks can be realized. And add two-way heartbeat detection. When one end pings different peers within 20s, an alarm will be issued and the failure situation at this time will be recorded.

同时也可以将多台机器上的数据实时复制到同一台机器上,通过在管理平台中创建多个资源管理组,将不同的源端机器添加到不同的资源管理组中,并划分多个磁盘空间与其相对应。以这种方式来实现对多系统、多地、多平台的数据进行实时备份,提高安全性的也实现了可高扩展性。 At the same time, the data on multiple machines can be copied to the same machine in real time. By creating multiple resource management groups in the management platform, different source machines can be added to different resource management groups, and multiple disks can be divided. The space corresponds to it. In this way, real-time backup of multi-system, multi-place, and multi-platform data is realized, which improves security and achieves high scalability.

本发明可以被用于高可用(HA)之中,它类似于一个网络RAID-1功能。将数据写入源端文件系统时,数据还将会被发送到网络中目的端上,以相同的形式记录在一个文件系统中。源端(主节点)与目的端(备节点)的数据可以保证实时同步。当源端系统出现故障时,目的端主机上还会保留有一份相同的数据,可以继续使用。 The present invention can be used in High Availability (HA), which is similar to a network RAID-1 function. When data is written to the source file system, the data will also be sent to the destination in the network and recorded in a file system in the same form. Data at the source end (primary node) and destination end (standby node) can be synchronized in real time. When the source system fails, the same data will remain on the destination host, which can continue to be used.

本发明通过网络传输将源端(本地)数据以数据块的方式实时复制到目标端(远端),在复制过程中不需要认为的干预。并且对源端和目的端进行实时的监控,当有一端出现故障后,会启动报警机制,通知管理员,并准确记录故障时间、故障原因。管理员可根据具体故障日志对其进行恢复,非常实用可靠。 The present invention replicates the source (local) data to the target (remote) in real time in the form of data blocks through network transmission, and does not require artificial intervention during the replication process. It also monitors the source and destination in real time. When one end fails, an alarm mechanism will be activated to notify the administrator, and the failure time and cause will be accurately recorded. The administrator can restore it according to the specific fault log, which is very practical and reliable.

本发明提供了一种更加安全、更易扩展的管理方法,可以代替使用一个共享盘阵的方式。因为数据同时存在于源端主机和目的端主机上,避免了因共享磁盘故障而引起数据丢失的事故。同时也可以将多台机器上的数据实时复制到同一台机器上,在提高安全性的也实现了可高扩展性。切换时,远程主机只要使用本端的备份数据,就可以继续进行服务。 The invention provides a more secure and more expandable management method, which can replace the way of using a shared disk array. Because the data exists on the source host and the destination host at the same time, the accident of data loss caused by the failure of the shared disk is avoided. At the same time, data on multiple machines can be replicated to the same machine in real time, achieving high scalability while improving security. When switching, the remote host can continue to serve as long as it uses the backup data of the local end.

附图说明 Description of drawings

图1是本发明的管理平台示意图; Fig. 1 is a schematic diagram of the management platform of the present invention;

图2是本发明的工作流程图。 Fig. 2 is a working flow chart of the present invention.

具体实施方式 detailed description

下面对本发明的内容进行更加详细的阐述: The content of the present invention is described in more detail below:

图1中为完整的基于网络的分布式镜像存储块设备的管理平台示意图,源端主机磁盘和目的端主机磁盘通过网络进行实时镜像块同步,整个同步是基于块设备进行的,用户可以通过管理平台对整个同步过程进行监控和问题的及时处理。从而实现对本地磁盘进行实时复制、异地容灾的高安全、高可用性等功能。 Figure 1 is a schematic diagram of a complete network-based distributed mirror storage block device management platform. The source host disk and the destination host disk perform real-time mirror block synchronization through the network. The entire synchronization is based on block devices. Users can manage The platform monitors the entire synchronization process and handles problems in a timely manner. In this way, functions such as real-time replication of local disks, high security and high availability of remote disaster recovery can be realized.

管理平台主要使用监控和管理保障分布式镜像存储块设备,具体实施方式如下: The management platform mainly uses monitoring and management to ensure distributed mirror storage block devices. The specific implementation methods are as follows:

(1)根据实际需求对本地磁盘进行格式化挂载等步骤; (1) Format and mount the local disk according to actual needs;

(2)在目的端格式化出和本地端一样的磁盘; (2) Format the same disk on the destination end as the local end;

(3)配置网络,使本地端和目的端能够实现网络通信; (3) Configure the network so that the local end and the destination end can realize network communication;

(4)安装并登陆管理平台,新建实时同步组,将源端和目的端资源添加到组,并添加心跳监控; (4) Install and log in to the management platform, create a new real-time synchronization group, add source and destination resources to the group, and add heartbeat monitoring;

(5)配置完成,开始镜像。可实现分布式镜像存储块设备的实时存储、故障检测、故障切换等功能; (5) After the configuration is complete, start mirroring. Real-time storage, fault detection, failover and other functions of distributed mirror storage block devices can be realized;

(6)当出现问题时,可通过管理平台的日志对故障进行实时的监控和处理。 (6) When a problem occurs, the log of the management platform can be used to monitor and deal with the fault in real time.

Claims (3)

1.一种基于网络的分布式镜像存储块设备的管理方法,其特征在于, 1. A management method based on a network-based distributed mirror storage block device, characterized in that, 首先保证源端和目的端网络互通,在同一资源管理平台中创建资源管理组,将源端和目的端集中于统一的资源管理平台的同一资源管理组中;通过这种方式,允许用户在远程机器上建立一个对本地数据以块设备为单位进行的实时镜像,从而可以实现对数据块进行分布式的存储;并添加双向心跳探测,当一端在20s内ping不同对端时,就会发出报警,并记录此时故障情况;当源端系统出现故障时,目的端主机上还会保留有一份相同的数据,可以继续使用。 Firstly, ensure the network communication between the source end and the destination end, create a resource management group on the same resource management platform, and gather the source end and the destination end in the same resource management group on the unified resource management platform; in this way, users are allowed to remotely A real-time mirroring of local data in units of block devices is established on the machine, so that distributed storage of data blocks can be realized; and bidirectional heartbeat detection is added. When one end pings different peers within 20s, an alarm will be issued , and record the fault situation at this time; when the source end system fails, the same data will be kept on the destination end host, which can continue to be used. 2.根据权利要求1所述的方法,其特征在于, 2. The method of claim 1, wherein, 可以将多台机器上的数据实时复制到同一台机器上,通过在管理平台中创建多个资源管理组,将不同的源端机器添加到不同的资源管理组中,并划分多个磁盘空间与其相对应。 The data on multiple machines can be copied to the same machine in real time. By creating multiple resource management groups in the management platform, different source machines can be added to different resource management groups, and multiple disk spaces can be divided into different resource management groups. Corresponding. 3.根据权利要求1或2所述的方法,其特征在于, 3. The method according to claim 1 or 2, characterized in that, 将数据写入源端文件系统时,数据还将会被发送到网络中目的端上,以相同的形式记录在一个文件系统中,保证源端与目的端的数据可以实时同步。 When data is written to the source file system, the data will also be sent to the destination in the network and recorded in a file system in the same form to ensure that the data at the source and destination can be synchronized in real time.
CN201610042458.2A 2016-01-22 2016-01-22 Management method of distributed mirror image storage block equipment based on network Pending CN105516365A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610042458.2A CN105516365A (en) 2016-01-22 2016-01-22 Management method of distributed mirror image storage block equipment based on network

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610042458.2A CN105516365A (en) 2016-01-22 2016-01-22 Management method of distributed mirror image storage block equipment based on network

Publications (1)

Publication Number Publication Date
CN105516365A true CN105516365A (en) 2016-04-20

Family

ID=55723995

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610042458.2A Pending CN105516365A (en) 2016-01-22 2016-01-22 Management method of distributed mirror image storage block equipment based on network

Country Status (1)

Country Link
CN (1) CN105516365A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107197032A (en) * 2017-06-20 2017-09-22 郑州云海信息技术有限公司 A kind of server data online backup method of real-time mirror image
CN107241430A (en) * 2017-07-03 2017-10-10 国家电网公司 A kind of enterprise-level disaster tolerance system and disaster tolerant control method based on distributed storage

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101043310A (en) * 2007-04-27 2007-09-26 北京佳讯飞鸿电气有限责任公司 Image backup method for dual-core control of core controlled system
CN101635638A (en) * 2008-07-25 2010-01-27 中兴通讯股份有限公司 Disaster tolerance system and disaster tolerance method thereof
US20110099420A1 (en) * 2009-10-26 2011-04-28 Macdonald Mcalister Grant Alexander Failover and recovery for replicated data instances
CN102467508A (en) * 2010-11-04 2012-05-23 中兴通讯股份有限公司 Method for providing database service and database system
CN102629906A (en) * 2012-03-30 2012-08-08 浪潮电子信息产业股份有限公司 A design method of using cluster management nodes as dual machines to improve the availability of cluster services
CN103152414A (en) * 2013-03-01 2013-06-12 四川省电力公司信息通信公司 High available system based on cloud calculation and implementation method thereof
CN103384267A (en) * 2013-06-07 2013-11-06 曙光信息产业(北京)有限公司 Parastor200 parallel storage management node high availability method based on distributed block device
CN103473328A (en) * 2013-09-17 2013-12-25 中电长城网际系统应用有限公司 MYSQL (my structured query language)-based database cloud and construction method for same
CN103546914A (en) * 2013-10-21 2014-01-29 大唐移动通信设备有限公司 HSS (home subscriber server) master-slave management method and HSS master-slave management device
CN103840961A (en) * 2012-11-23 2014-06-04 景幂机械(上海)有限公司 Dual-computer hot backup system

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101043310A (en) * 2007-04-27 2007-09-26 北京佳讯飞鸿电气有限责任公司 Image backup method for dual-core control of core controlled system
CN101635638A (en) * 2008-07-25 2010-01-27 中兴通讯股份有限公司 Disaster tolerance system and disaster tolerance method thereof
US20110099420A1 (en) * 2009-10-26 2011-04-28 Macdonald Mcalister Grant Alexander Failover and recovery for replicated data instances
CN102467508A (en) * 2010-11-04 2012-05-23 中兴通讯股份有限公司 Method for providing database service and database system
CN102629906A (en) * 2012-03-30 2012-08-08 浪潮电子信息产业股份有限公司 A design method of using cluster management nodes as dual machines to improve the availability of cluster services
CN103840961A (en) * 2012-11-23 2014-06-04 景幂机械(上海)有限公司 Dual-computer hot backup system
CN103152414A (en) * 2013-03-01 2013-06-12 四川省电力公司信息通信公司 High available system based on cloud calculation and implementation method thereof
CN103384267A (en) * 2013-06-07 2013-11-06 曙光信息产业(北京)有限公司 Parastor200 parallel storage management node high availability method based on distributed block device
CN103473328A (en) * 2013-09-17 2013-12-25 中电长城网际系统应用有限公司 MYSQL (my structured query language)-based database cloud and construction method for same
CN103546914A (en) * 2013-10-21 2014-01-29 大唐移动通信设备有限公司 HSS (home subscriber server) master-slave management method and HSS master-slave management device

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107197032A (en) * 2017-06-20 2017-09-22 郑州云海信息技术有限公司 A kind of server data online backup method of real-time mirror image
CN107241430A (en) * 2017-07-03 2017-10-10 国家电网公司 A kind of enterprise-level disaster tolerance system and disaster tolerant control method based on distributed storage

Similar Documents

Publication Publication Date Title
US10282262B2 (en) Non-disruptive controller replacement in a cross-cluster redundancy configuration
CN104023246B (en) A kind of video data private cloud storage system and video data private cloud storage method
CN104794028B (en) A kind of disaster tolerance processing method, device, primary data center and preliminary data center
US6915448B2 (en) Storage disk failover and replacement system
CN106357787A (en) Storage disaster tolerant control system
US9503422B2 (en) Apparatus, systems, platforms, and methods for securing communication data exchanges between multiple networks for industrial and non-industrial applications
CN104239164A (en) Cloud storage based disaster recovery backup switching system
CN104243195A (en) Remote disaster recovery processing method and device
CN115576655B (en) Container data protection system, method, device, equipment and readable storage medium
CN104572355A (en) Asynchronous remote data copying method and device
CN102752093A (en) Distributed file system-based data processing method, device and system
CN108810150B (en) Data replication method for application-level disaster recovery system of collaborative office system
CN105988901A (en) Data copying method and storage system
WO2016177231A1 (en) Dual-control-based active-backup switching method and device
CN112948484A (en) Distributed database system and data disaster recovery drilling method
CN115658390A (en) Container disaster tolerance method, system, device, equipment and computer readable storage medium
US20250165167A1 (en) Non-disruptively transition from asynchronous replication to bi-directional synchronous replication for a multi-site storage system
CN106250048B (en) Manage the method and device of storage array
CN105516365A (en) Management method of distributed mirror image storage block equipment based on network
KR20160004721A (en) Method for Replicationing of Redo Log without Data Loss and System Thereof
WO2025163398A1 (en) Data storage method and data storage apparatus
CN105790985B (en) Data switching method, first device, second device and system
CN103384267B (en) A kind of Parastor200 parallel memorizing management node high availability methods based on distributed block equipment
CN116185697B (en) Container cluster management method, device, system, electronic equipment and storage medium
CN102281159A (en) Recovery method of cluster system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20160420

RJ01 Rejection of invention patent application after publication