CN105516365A - Management method of distributed mirror image storage block equipment based on network - Google Patents
Management method of distributed mirror image storage block equipment based on network Download PDFInfo
- Publication number
- CN105516365A CN105516365A CN201610042458.2A CN201610042458A CN105516365A CN 105516365 A CN105516365 A CN 105516365A CN 201610042458 A CN201610042458 A CN 201610042458A CN 105516365 A CN105516365 A CN 105516365A
- Authority
- CN
- China
- Prior art keywords
- resource management
- data
- destination
- network
- source
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
本发明提供一种基于网络的分布式镜像存储块设备的管理方法,涉及磁盘数据管理技术领域,保证源端和目的端网络互通,在同一资源管理平台中创建资源管理组,将源端(本地主机)和目的端(目的主机)集中于统一的资源管理平台的同一资源管理组种。通过这种方式,允许用户在远程机器上建立一个对本地数据以块设备为单位进行的实时镜像,从而可以实现对数据块进行分布式的存储。并添加双向心跳探测,当一端在20s内ping不同对端时,就会发出报警,并记录此时故障情况。具有集中化管理、直观等优点。
The invention provides a network-based management method for distributed mirror storage block devices, which relates to the technical field of disk data management, ensures the network intercommunication between the source end and the destination end, creates a resource management group in the same resource management platform, and integrates the source end (local host) and the destination (destination host) are centralized in the same resource management group of the unified resource management platform. In this way, users are allowed to establish a real-time mirror image of local data in units of block devices on a remote machine, so that distributed storage of data blocks can be realized. And add two-way heartbeat detection. When one end pings different peers within 20s, an alarm will be issued and the failure situation at this time will be recorded. It has the advantages of centralized management and intuition.
Description
技术领域 technical field
本发明涉及磁盘数据管理技术领域,尤其涉及一种基于网络的分布式镜像存储块设备的管理方法。 The invention relates to the technical field of disk data management, in particular to a management method of a network-based distributed mirror storage block device.
背景技术 Background technique
随着磁盘共享技术大规模应用于教学、实验以及生产系统,在实际的生产应用中担任起越来越重的角色,为人们带来了便捷的体验、高效的服务。然而随着时代的进步,受限于共享磁盘单点故障、I/O瓶颈等,原有共享磁盘的安全性、易扩展性已达不到需求,故而迫切需要更安全、更高效、更好的方案来管理数据。 With the large-scale application of disk sharing technology in teaching, experiment and production systems, it plays an increasingly important role in actual production applications, bringing people convenient experience and efficient services. However, with the progress of the times, limited by the single point of failure of shared disks, I/O bottlenecks, etc., the security and scalability of the original shared disks have not met the requirements, so there is an urgent need for safer, more efficient, and better scheme to manage data.
发明内容 Contents of the invention
为了解决该问题,本发明提出了一种基于网络的分布式镜像存储块设备的管理方法。该方法是一种高可靠、高效、高可用的存储解决方案,具有集中化管理、直观等优点。 In order to solve this problem, the present invention proposes a network-based management method for distributed mirror storage block devices. This method is a storage solution with high reliability, high efficiency and high availability, and has the advantages of centralized management and intuition.
本发明基于网络,通过网络传输将源端(本地)数据以数据块的方式实时复制到目标端(远端),在复制过程中不需要认为的干预。并且对源端和目的端进行实时的监控,当有一端出现故障后,会启动报警机制,通知管理员,并准确记录故障时间、故障原因。管理员可根据具体故障日志对其进行恢复,非常实用可靠。 The present invention is based on the network, and the source (local) data is copied to the target (remote) in real time in the form of data blocks through network transmission, without any intervention in the process of copying. In addition, real-time monitoring is carried out on the source and destination ends. When one end fails, an alarm mechanism will be activated to notify the administrator, and the failure time and cause of the failure will be accurately recorded. The administrator can restore it according to the specific fault log, which is very practical and reliable.
本发明的技术方案是: Technical scheme of the present invention is:
通过分布式同步镜像的理念,首先保证源端和目的端网络互通,在同一资源管理平台中创建资源管理组,将源端(本地主机)和目的端(目的主机)集中于统一的资源管理平台的同一资源管理组中。通过这种方式,允许用户在远程机器上建立一个对本地数据以块设备为单位进行的实时镜像,从而可以实现对数据块进行分布式的存储。并添加双向心跳探测,当一端在20s内ping不同对端时,就会发出报警,并记录此时故障情况。 Through the concept of distributed synchronous mirroring, firstly ensure the network interworking between the source and destination, create a resource management group in the same resource management platform, and concentrate the source (local host) and destination (destination host) on a unified resource management platform in the same resource management group. In this way, users are allowed to establish a real-time mirror image of local data in units of block devices on a remote machine, so that distributed storage of data blocks can be realized. And add two-way heartbeat detection. When one end pings different peers within 20s, an alarm will be issued and the failure situation at this time will be recorded.
同时也可以将多台机器上的数据实时复制到同一台机器上,通过在管理平台中创建多个资源管理组,将不同的源端机器添加到不同的资源管理组中,并划分多个磁盘空间与其相对应。以这种方式来实现对多系统、多地、多平台的数据进行实时备份,提高安全性的也实现了可高扩展性。 At the same time, the data on multiple machines can be copied to the same machine in real time. By creating multiple resource management groups in the management platform, different source machines can be added to different resource management groups, and multiple disks can be divided. The space corresponds to it. In this way, real-time backup of multi-system, multi-place, and multi-platform data is realized, which improves security and achieves high scalability.
本发明可以被用于高可用(HA)之中,它类似于一个网络RAID-1功能。将数据写入源端文件系统时,数据还将会被发送到网络中目的端上,以相同的形式记录在一个文件系统中。源端(主节点)与目的端(备节点)的数据可以保证实时同步。当源端系统出现故障时,目的端主机上还会保留有一份相同的数据,可以继续使用。 The present invention can be used in High Availability (HA), which is similar to a network RAID-1 function. When data is written to the source file system, the data will also be sent to the destination in the network and recorded in a file system in the same form. Data at the source end (primary node) and destination end (standby node) can be synchronized in real time. When the source system fails, the same data will remain on the destination host, which can continue to be used.
本发明通过网络传输将源端(本地)数据以数据块的方式实时复制到目标端(远端),在复制过程中不需要认为的干预。并且对源端和目的端进行实时的监控,当有一端出现故障后,会启动报警机制,通知管理员,并准确记录故障时间、故障原因。管理员可根据具体故障日志对其进行恢复,非常实用可靠。 The present invention replicates the source (local) data to the target (remote) in real time in the form of data blocks through network transmission, and does not require artificial intervention during the replication process. It also monitors the source and destination in real time. When one end fails, an alarm mechanism will be activated to notify the administrator, and the failure time and cause will be accurately recorded. The administrator can restore it according to the specific fault log, which is very practical and reliable.
本发明提供了一种更加安全、更易扩展的管理方法,可以代替使用一个共享盘阵的方式。因为数据同时存在于源端主机和目的端主机上,避免了因共享磁盘故障而引起数据丢失的事故。同时也可以将多台机器上的数据实时复制到同一台机器上,在提高安全性的也实现了可高扩展性。切换时,远程主机只要使用本端的备份数据,就可以继续进行服务。 The invention provides a more secure and more expandable management method, which can replace the way of using a shared disk array. Because the data exists on the source host and the destination host at the same time, the accident of data loss caused by the failure of the shared disk is avoided. At the same time, data on multiple machines can be replicated to the same machine in real time, achieving high scalability while improving security. When switching, the remote host can continue to serve as long as it uses the backup data of the local end.
附图说明 Description of drawings
图1是本发明的管理平台示意图; Fig. 1 is a schematic diagram of the management platform of the present invention;
图2是本发明的工作流程图。 Fig. 2 is a working flow chart of the present invention.
具体实施方式 detailed description
下面对本发明的内容进行更加详细的阐述: The content of the present invention is described in more detail below:
图1中为完整的基于网络的分布式镜像存储块设备的管理平台示意图,源端主机磁盘和目的端主机磁盘通过网络进行实时镜像块同步,整个同步是基于块设备进行的,用户可以通过管理平台对整个同步过程进行监控和问题的及时处理。从而实现对本地磁盘进行实时复制、异地容灾的高安全、高可用性等功能。 Figure 1 is a schematic diagram of a complete network-based distributed mirror storage block device management platform. The source host disk and the destination host disk perform real-time mirror block synchronization through the network. The entire synchronization is based on block devices. Users can manage The platform monitors the entire synchronization process and handles problems in a timely manner. In this way, functions such as real-time replication of local disks, high security and high availability of remote disaster recovery can be realized.
管理平台主要使用监控和管理保障分布式镜像存储块设备,具体实施方式如下: The management platform mainly uses monitoring and management to ensure distributed mirror storage block devices. The specific implementation methods are as follows:
(1)根据实际需求对本地磁盘进行格式化挂载等步骤; (1) Format and mount the local disk according to actual needs;
(2)在目的端格式化出和本地端一样的磁盘; (2) Format the same disk on the destination end as the local end;
(3)配置网络,使本地端和目的端能够实现网络通信; (3) Configure the network so that the local end and the destination end can realize network communication;
(4)安装并登陆管理平台,新建实时同步组,将源端和目的端资源添加到组,并添加心跳监控; (4) Install and log in to the management platform, create a new real-time synchronization group, add source and destination resources to the group, and add heartbeat monitoring;
(5)配置完成,开始镜像。可实现分布式镜像存储块设备的实时存储、故障检测、故障切换等功能; (5) After the configuration is complete, start mirroring. Real-time storage, fault detection, failover and other functions of distributed mirror storage block devices can be realized;
(6)当出现问题时,可通过管理平台的日志对故障进行实时的监控和处理。 (6) When a problem occurs, the log of the management platform can be used to monitor and deal with the fault in real time.
Claims (3)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610042458.2A CN105516365A (en) | 2016-01-22 | 2016-01-22 | Management method of distributed mirror image storage block equipment based on network |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610042458.2A CN105516365A (en) | 2016-01-22 | 2016-01-22 | Management method of distributed mirror image storage block equipment based on network |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105516365A true CN105516365A (en) | 2016-04-20 |
Family
ID=55723995
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610042458.2A Pending CN105516365A (en) | 2016-01-22 | 2016-01-22 | Management method of distributed mirror image storage block equipment based on network |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105516365A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107197032A (en) * | 2017-06-20 | 2017-09-22 | 郑州云海信息技术有限公司 | A kind of server data online backup method of real-time mirror image |
| CN107241430A (en) * | 2017-07-03 | 2017-10-10 | 国家电网公司 | A kind of enterprise-level disaster tolerance system and disaster tolerant control method based on distributed storage |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101043310A (en) * | 2007-04-27 | 2007-09-26 | 北京佳讯飞鸿电气有限责任公司 | Image backup method for dual-core control of core controlled system |
| CN101635638A (en) * | 2008-07-25 | 2010-01-27 | 中兴通讯股份有限公司 | Disaster tolerance system and disaster tolerance method thereof |
| US20110099420A1 (en) * | 2009-10-26 | 2011-04-28 | Macdonald Mcalister Grant Alexander | Failover and recovery for replicated data instances |
| CN102467508A (en) * | 2010-11-04 | 2012-05-23 | 中兴通讯股份有限公司 | Method for providing database service and database system |
| CN102629906A (en) * | 2012-03-30 | 2012-08-08 | 浪潮电子信息产业股份有限公司 | A design method of using cluster management nodes as dual machines to improve the availability of cluster services |
| CN103152414A (en) * | 2013-03-01 | 2013-06-12 | 四川省电力公司信息通信公司 | High available system based on cloud calculation and implementation method thereof |
| CN103384267A (en) * | 2013-06-07 | 2013-11-06 | 曙光信息产业(北京)有限公司 | Parastor200 parallel storage management node high availability method based on distributed block device |
| CN103473328A (en) * | 2013-09-17 | 2013-12-25 | 中电长城网际系统应用有限公司 | MYSQL (my structured query language)-based database cloud and construction method for same |
| CN103546914A (en) * | 2013-10-21 | 2014-01-29 | 大唐移动通信设备有限公司 | HSS (home subscriber server) master-slave management method and HSS master-slave management device |
| CN103840961A (en) * | 2012-11-23 | 2014-06-04 | 景幂机械(上海)有限公司 | Dual-computer hot backup system |
-
2016
- 2016-01-22 CN CN201610042458.2A patent/CN105516365A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101043310A (en) * | 2007-04-27 | 2007-09-26 | 北京佳讯飞鸿电气有限责任公司 | Image backup method for dual-core control of core controlled system |
| CN101635638A (en) * | 2008-07-25 | 2010-01-27 | 中兴通讯股份有限公司 | Disaster tolerance system and disaster tolerance method thereof |
| US20110099420A1 (en) * | 2009-10-26 | 2011-04-28 | Macdonald Mcalister Grant Alexander | Failover and recovery for replicated data instances |
| CN102467508A (en) * | 2010-11-04 | 2012-05-23 | 中兴通讯股份有限公司 | Method for providing database service and database system |
| CN102629906A (en) * | 2012-03-30 | 2012-08-08 | 浪潮电子信息产业股份有限公司 | A design method of using cluster management nodes as dual machines to improve the availability of cluster services |
| CN103840961A (en) * | 2012-11-23 | 2014-06-04 | 景幂机械(上海)有限公司 | Dual-computer hot backup system |
| CN103152414A (en) * | 2013-03-01 | 2013-06-12 | 四川省电力公司信息通信公司 | High available system based on cloud calculation and implementation method thereof |
| CN103384267A (en) * | 2013-06-07 | 2013-11-06 | 曙光信息产业(北京)有限公司 | Parastor200 parallel storage management node high availability method based on distributed block device |
| CN103473328A (en) * | 2013-09-17 | 2013-12-25 | 中电长城网际系统应用有限公司 | MYSQL (my structured query language)-based database cloud and construction method for same |
| CN103546914A (en) * | 2013-10-21 | 2014-01-29 | 大唐移动通信设备有限公司 | HSS (home subscriber server) master-slave management method and HSS master-slave management device |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107197032A (en) * | 2017-06-20 | 2017-09-22 | 郑州云海信息技术有限公司 | A kind of server data online backup method of real-time mirror image |
| CN107241430A (en) * | 2017-07-03 | 2017-10-10 | 国家电网公司 | A kind of enterprise-level disaster tolerance system and disaster tolerant control method based on distributed storage |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10282262B2 (en) | Non-disruptive controller replacement in a cross-cluster redundancy configuration | |
| CN104023246B (en) | A kind of video data private cloud storage system and video data private cloud storage method | |
| CN104794028B (en) | A kind of disaster tolerance processing method, device, primary data center and preliminary data center | |
| US6915448B2 (en) | Storage disk failover and replacement system | |
| CN106357787A (en) | Storage disaster tolerant control system | |
| US9503422B2 (en) | Apparatus, systems, platforms, and methods for securing communication data exchanges between multiple networks for industrial and non-industrial applications | |
| CN104239164A (en) | Cloud storage based disaster recovery backup switching system | |
| CN104243195A (en) | Remote disaster recovery processing method and device | |
| CN115576655B (en) | Container data protection system, method, device, equipment and readable storage medium | |
| CN104572355A (en) | Asynchronous remote data copying method and device | |
| CN102752093A (en) | Distributed file system-based data processing method, device and system | |
| CN108810150B (en) | Data replication method for application-level disaster recovery system of collaborative office system | |
| CN105988901A (en) | Data copying method and storage system | |
| WO2016177231A1 (en) | Dual-control-based active-backup switching method and device | |
| CN112948484A (en) | Distributed database system and data disaster recovery drilling method | |
| CN115658390A (en) | Container disaster tolerance method, system, device, equipment and computer readable storage medium | |
| US20250165167A1 (en) | Non-disruptively transition from asynchronous replication to bi-directional synchronous replication for a multi-site storage system | |
| CN106250048B (en) | Manage the method and device of storage array | |
| CN105516365A (en) | Management method of distributed mirror image storage block equipment based on network | |
| KR20160004721A (en) | Method for Replicationing of Redo Log without Data Loss and System Thereof | |
| WO2025163398A1 (en) | Data storage method and data storage apparatus | |
| CN105790985B (en) | Data switching method, first device, second device and system | |
| CN103384267B (en) | A kind of Parastor200 parallel memorizing management node high availability methods based on distributed block equipment | |
| CN116185697B (en) | Container cluster management method, device, system, electronic equipment and storage medium | |
| CN102281159A (en) | Recovery method of cluster system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160420 |
|
| RJ01 | Rejection of invention patent application after publication |