CN109639773A - A kind of the distributed data cluster control system and its method of dynamic construction - Google Patents
A kind of the distributed data cluster control system and its method of dynamic construction Download PDFInfo
- Publication number
- CN109639773A CN109639773A CN201811417178.0A CN201811417178A CN109639773A CN 109639773 A CN109639773 A CN 109639773A CN 201811417178 A CN201811417178 A CN 201811417178A CN 109639773 A CN109639773 A CN 109639773A
- Authority
- CN
- China
- Prior art keywords
- data
- terminal device
- service
- node
- central
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000010276 construction Methods 0.000 title claims abstract description 24
- 238000000034 method Methods 0.000 title claims abstract description 22
- 238000007726 management method Methods 0.000 claims abstract description 44
- 230000001360 synchronised effect Effects 0.000 claims abstract description 16
- 230000000712 assembly Effects 0.000 claims description 9
- 238000000429 assembly Methods 0.000 claims description 9
- 238000004891 communication Methods 0.000 claims description 5
- 238000013500 data storage Methods 0.000 claims description 4
- 230000015572 biosynthetic process Effects 0.000 claims description 3
- 230000000052 comparative effect Effects 0.000 claims description 3
- 230000008569 process Effects 0.000 claims description 2
- 238000013523 data management Methods 0.000 abstract description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 230000005012 migration Effects 0.000 description 2
- 238000013508 migration Methods 0.000 description 2
- 238000011160 research Methods 0.000 description 2
- 230000006641 stabilisation Effects 0.000 description 2
- 238000011105 stabilization Methods 0.000 description 2
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 239000004744 fabric Substances 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000004043 responsiveness Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/0654—Management of faults, events, alarms or notifications using network fault recovery
- H04L41/0659—Management of faults, events, alarms or notifications using network fault recovery by isolating or reconfiguring faulty entities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/10—Active monitoring, e.g. heartbeat, ping or trace-route
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/14—Session management
- H04L67/141—Setup of application sessions
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Cardiology (AREA)
- General Health & Medical Sciences (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses the distributed data cluster control system and its method of a kind of dynamic construction, which includes service terminal device, management end device, client terminal device.This method notifies other nodes that the update of node is just sent to central node when carrying out data update and affairs submission immediately by submitting data to be updated to database, central together, improves the synchronous low delay index of data, the timeliness index that data update and avoids data collision.The present invention is capable of providing the back end addition of dynamic and configurable and removes, data management service is carried out to back end by client terminal device, service terminal device, improve the treatment effeciency and level of distributed data, so that the data consistency between back end is protected, is read in for data and write-in provides low delay service.The present invention is able to solve under data consistency and the scene of the synchronous low delay of data, dynamic the problems such as constructing distributed data cluster and larger data synchrodata amount.
Description
Technical field
The invention belongs to dcs field, the distributed data clustered control system of especially a kind of dynamic construction
System and its method.
Background technique
Now with the development of the technologies such as big data technology, cloud, artificial intelligence, data volume is increasing, data
Storage and processing have also obtained more concern.In order to preferably provide system service and data processing, distributed type assemblies become
Preferably Technical Architecture and embodiment.It is standby that distributed type assemblies for system application provide data distribution, local cache, copy redundancy
Part, fault-tolerant, affairs, con current control etc. support, Data Migration, it is fault-tolerant with during concurrent reading and writing guarantee data it is consistent
Property, it is simultaneously synchronous with data using the storage access support for providing remote center's database.At present in existing distribution
It is dynamic to construct distributed data cluster in the case that cluster cannot provide data service service scenarios stabilization, realize data section
Being dynamically added and dynamically removing for point, reduces the flexibility of distributed type assemblies data service.Simultaneously with data service scene
High concurrent feature, the low delay index for how improving data service also becomes the important research in current distributed type assemblies field
Direction.
Distributed type assemblies have following 2 in specific application at present:
(1) how distributed data cluster is dynamically constructed, guarantees the consistency of data.Dynamic building distributed data
Cluster is constituted by back end is newly added and removes two kinds of situations of fault data node, is guaranteeing available data node offer stabilization
On the basis of reliability services, the data cluster for taking which kind of tactful dynamic construction new is the important research side of current field of distributed type
One of to.
(2) it is more how to solve distributed data company-data number of nodes, under the big scene of data traffic, improves data
Communication efficiency between node improves the synchronous efficiency of data, data management is made to reach the requirement of low delay.
Summary of the invention
Technical problem solved by the invention be to provide a kind of dynamic construction distributed data cluster control system and
Its method, the system are capable of providing the back end addition of dynamic and configurable and remove, and keep the data between back end consistent
Property be protected, for data read in and write-in low delay service is provided.
The technical solution for realizing the aim of the invention is as follows: a kind of distributed data cluster control system of dynamic construction,
Including service terminal device, management end device, N number of client terminal device, service terminal device simultaneously with multiple client device, management end
Device connection；Service terminal device includes multiple serving data node examples, and all serving data node examples constitute a service
Node cluster, each serving data node example are known as a service node, and wherein some service node is as service node
The central of cluster, remaining service node are data from node；
The service terminal device, for parsing and loading the network and configurations information of distributed data clustered node；
The management end device provides the interface of management distributed data cluster for user, and user can be by inquiring language
Say the state and data information of Querying Distributed data cluster, and can be with initialization data and more new data；Wherein, the shape of cluster
State is service node normal work or failure；
The client terminal device for Help Center's host node and establishes connection, and executes data synchronization and data update
Operation.
A kind of distributed data cluster control method of the dynamic construction based on above system, comprising the following steps:
Step 1, user carry out parsing operation by configuration information of the service terminal device to distributed data cluster；Specific packet
Include clustered node configuration information, cluster node network configuration information, data storage configuration information, log recording configuration information；
Step 2, distributed data clustered node of the operation with parameter, and orderly add the node newly increased one by one
Enter company-data queue；
Step 3, according to the hash value size of service node each in service terminal device, service node is ordered as ordered ring
Shape；Each service node is connect with away from right side node that is nearest and working normally later, and formation one is stable orderly to close
Ring is configured to a dynamic distributed data cluster；
Step 4, management end device and service terminal device establish connection；
Step 5, comparative management end device, service terminal device versions of data, if service terminal device versions of data than pipe
The versions of data for managing end device is new, then executes the versions of data that data simultaneously operating updates management end device；
Step 6, management end device obtain the versions of data less than service terminal device, that is, show the distribution of service terminal device
Data cluster is the cluster newly constructed, is carried out by the database table structure of management end device to the data of service terminal device initial
Change；
Step 7, client terminal device are established connection with service terminal device and are communicated, and obtain central and connected
It connects；The continual connection status for detecting itself and central of client terminal device, obtains if central breaks down
New central is attached；
Step 8, service terminal device have new data information, and notice client terminal device carries out data simultaneously operating；
Step 9, client terminal device inquire the data inside it under conditions of service terminal device does not have data update notification
To provide data service；
The state and data shape of each node of distributed data cluster in step 10, management end device query service end device
State；
Step 11, management end device pass through the versions of data of data query language query service end device；
It, can synchronized update extremely service after step 12, management end device and the respective versions of data of client terminal device update
In the database of end device；
New version data distribution is carried out data to management end device, client terminal device and synchronized by step 13, service terminal device.
Compared with prior art, the present invention its remarkable advantage: 1) present invention receives multiple data in back end and updates
When, it puts it into an affairs and is committed to database together, improve the synchronous low delay index of data；2) present invention passes through
Central registration data updates, and other nodes is notified to have data update immediately, and the timeliness for improving data update refers to
Mark；3) present invention by continuous data update in a manner of increment in the memory that certain time is stored in central, subtract
The data volume of processing is lacked；4) back end passes through central node to the update of data in the present invention, has ensured the one of data
Cause property.
Present invention is further described in detail with reference to the accompanying drawing.
Detailed description of the invention
Fig. 1 is the structural schematic diagram of the distributed data cluster control system of dynamic construction of the present invention.
Fig. 2 is the flow chart of the distributed data cluster control method of dynamic construction of the present invention.
Fig. 3 is the flow chart that data are synchronous in the distributed data cluster control method of dynamic construction of the present invention.
Fig. 4 is the flow chart that data update in the distributed data cluster control method of dynamic construction of the present invention.
Specific embodiment
In conjunction with Fig. 1, a kind of distributed data cluster control system of dynamic construction of the present invention, which is characterized in that including clothes
Be engaged in end device 1, management end device 2, N number of client terminal device 3, service terminal device 1 simultaneously with multiple client device 3, management end
Device 2 connects；Service terminal device 1 includes multiple serving data node examples, and all serving data node examples constitute a clothes
Business node cluster, each serving data node example are known as a service node, and wherein some service node is as service section
The central of point cluster, remaining service node are data from node；
Service terminal device 1, for parsing and loading the network and configurations information of distributed data clustered node, basis
Configuration information includes that distributed type assemblies back end configuration information, distributed type assemblies back end network configuration information, data are deposited
Store up configuration information, log recording configuration information.
End device 2 is managed, provides the interface of management distributed data cluster for user, user can look by query language
The state and data information of distributed data cluster are ask, and can be with initialization data and more new data；Wherein, the state of cluster is
Service node works normally or failure.Before the operation of distributed data cluster, management end device 2 carries out just data structure
Beginningization establishes database table structure.
Client terminal device 3 for Help Center's host node and establishes connection, and executes synchronous update with data of data and grasp
Make.
Further, central of the service node as service node cluster, what which chose
Detailed process are as follows:
1) priority is preset for each service node in service node cluster, the corresponding priority of each service node
It is same or different；
2) descending arrangement is carried out to priority；
If 3) the corresponding service node of maximum priority only has one, by host node centered on the service node；
If the corresponding service node of maximum priority there are several, one of service node conduct is randomly selected by Hash method
Central；
4) 3 timing of client terminal device sends heartbeat packet to service terminal device, if some service node fails in setting
In receive the heartbeat packet i.e. service node and break down, then the service node is removed from service node cluster, and will
Its data copies in other service nodes, if central be removed, repeat it is above-mentioned 2), 3) from remaining service node
In Selection Center host node again.
In conjunction with Fig. 2, the distributed data cluster control method of dynamic construction of the present invention, comprising the following steps:
Step 1, user carry out parsing operation by configuration information of the service terminal device 1 to distributed data cluster；Specifically
Including clustered node configuration information, cluster node network configuration information, data storage configuration information, log recording configuration information；
Step 2, distributed data clustered node of the operation with parameter, and orderly add the node newly increased one by one
Enter company-data queue；
Step 3, according to the hash value size of service node each in service terminal device 1, service node is ordered as orderly
Annular；Each service node connect with away from right side node that is nearest and working normally later, and formation one is stable orderly
Closed loop is configured to a dynamic distributed data cluster；
Step 4, management end device 2 and service terminal device 1 establish connection；
Step 5, comparative management end device 2, service terminal device 1 versions of data, if the versions of data ratio of service terminal device 1
The versions of data for managing end device 2 is new, then executes the versions of data that data simultaneously operating updates management end device 2；
Step 6, management end device 2 obtain the versions of data less than service terminal device 1, that is, show point of service terminal device 1
Cloth data cluster is the cluster newly constructed, is carried out by the database table structure of management end device 2 to the data of service terminal device 1
Initialization；
Step 7, client terminal device 3 are established connection with service terminal device 1 and are communicated, and obtain central and connected
It connects；The continual connection status for detecting itself and central of client terminal device 3, obtains if central breaks down
New central is attached；
Step 8, service terminal device 1 have new data information, and notice client terminal device 3 carries out data simultaneously operating such as Fig. 3
It is shown, specifically:
Step 8-1, the data of some client terminal device 3 update, and are carried out by the central of service terminal device 1
Registration；
Step 8-2, other data of central notice service terminal device 1 carry out data update from node；
If the data of multiple client device 3 successively update, by central according to update sequence successively into
Certain time is registered and saved in the memory of central to row, obtains data and updates packet, and the data are updated to wrap and are submitted
To the database of service terminal device 1, other data are reinformed later from node and carry out data update；
Step 9, client terminal device 3 are in service terminal device 1 without inquiring the number inside it under conditions of data update notification
Data service is provided accordingly, improves the responsiveness of service；
The state and data of each node of distributed data cluster in step 10, management 2 query service end device 1 of end device
State；
Step 11, management end device 2 pass through the versions of data of data query language query service end device 1；
It, can synchronized update extremely clothes after step 12, management end device 2 and the respective versions of data of client terminal device 3 update
Be engaged in end device 1 database in as shown in figure 4, specifically:
Step 12-1, some back end manages end device 2 or some client terminal device 3 writes the update of data
Enter and forms data packet in memory；
Step 12-2, central is sent data packets to when a transaction commits；
Step 12-3, data collision is analyzed:
1) whenever, the data mode of central node is the end-state of data；
2) when the data of back end fall behind central node, data can be still updated, but:
1) back end cannot add already present entry on central node.Wherein entry is determined by major key, identical master
Key is considered as same entry；
2) back end cannot delete the entry being not present on central node；
3) back end cannot modify on central node the entry of modified mistake, the i.e. entry and data section of central node
When the entry of point is inconsistent, it cannot modify；
3) data of back end lag behind the data of central, when leading to update inconsistency, will carry out data rewind,
And it cannot be submitted in the database of back end；
4) data of back end lag behind the data of central, when leading to update inconsistency, actively with the main section in center
Point synchronizes；
Step 12-4, central the data packet received is written in the database of central, and immediately will
Data packet is sent to other back end and manages end device 2 or client terminal device 3, while being put into memory queue, is lined up
It is written in persistent storage, to complete just to return without waiting for disk I/O operation, reduces disk I/O time delay；If back end is same
When receive multiple data packets, the database for being committed to back end together is updated.
Step 13, service terminal device 1 are same to management end device 2, the progress of client terminal device 3 data by new version data distribution
Step.
Further, step 4 management end device 2 and service terminal device 1 establish connection, step 7 client terminal device 3 and service
End device 1 is established connection and is communicated, and is to establish TCP communication connection.
Further, central is sent data packets to by the way of TCP_NODELAY in step 12-2, force
It is sent immediately when having data, reduces network delay.
Further, after step 12-4 sends data packets to other back end immediately, back end can be determined
When with central communication inquiry data mode, back end update data collision when, immediately carry out back end update.
In conclusion by using technical solution of the present invention, for can dynamic under stable data service service scenarios
Building distributed data cluster, data distribution, local cache, copy redundancy backup, fault-tolerant, affairs, con current control etc. are provided
Function is supported；And guarantee the consistency of data during Data Migration, fault-tolerant and concurrent reading and writing, it is simultaneously using providing
The storage access of remote center's database is supported synchronous with data；For processor calculation delay, network delay, disk I/O time delay
The problems such as, guarantee technology using the low time delay of data management, improves data and update and synchronous response timeliness.
Claims (10)
1. a kind of distributed data cluster control system of dynamic construction, which is characterized in that including service terminal device (1), management
End device (2), N number of client terminal device (3), service terminal device (1) simultaneously with multiple client device (3), management end device (2)
Connection；Service terminal device (1) includes multiple serving data node examples, and all serving data node examples constitute a service section
Point cluster, each serving data node example are known as a service node, and wherein some service node is as service node collection
The central of group, remaining service node are data from node；
The service terminal device (1), for parsing and loading the network and configurations information of distributed data clustered node；
The management end device (2) provides the interface of management distributed data cluster for user, and user can pass through query language
The state and data information of Querying Distributed data cluster, and can be with initialization data and more new data；Wherein, the state of cluster
For service node normal work or failure；
The client terminal device (3), for Help Center's host node and establishes connection, and executes synchronous update with data of data and grasp
Make.
2. the distributed data cluster control system of dynamic construction according to claim 1, which is characterized in that the basis
Configuration information includes that distributed type assemblies back end configuration information, distributed type assemblies back end network configuration information, data are deposited
Store up configuration information, log recording configuration information.
3. the distributed data cluster control system of dynamic construction according to claim 1, which is characterized in that one
Central of the service node as service node cluster, the detailed process which chooses are as follows:
1) priority is preset for each service node in service node cluster, the corresponding priority of each service node is identical
Or it is different；
2) descending arrangement is carried out to priority；
3) number of the corresponding service node of maximum priority is judged, if the corresponding service node of maximum priority
Only one, then by host node centered on the service node；If the corresponding service node of maximum priority has several,
Host node centered on one of service node is randomly selected by Hash method；
4) client terminal device (3) periodically sends heartbeat packet to service terminal device, if some service node fails in setting time
It inside receives the heartbeat packet i.e. service node to break down, then removes the service node from service node cluster, and
Its data is copied in other service nodes, if central is removed, repeat the above steps 2), step 3) is from residue
Service node in Selection Center host node again, until selecting the central of normal work.
4. the distributed data cluster control system of dynamic construction according to claim 1, which is characterized in that the distribution
Before the operation of formula data cluster, management end device (2), which initializes data structure, establishes database table structure.
5. a kind of distributed data cluster control method of the dynamic construction based on system described in claim 4, which is characterized in that
The following steps are included:
Step 1 carries out parsing operation by configuration information of the service terminal device (1) to distributed data cluster；Specifically include collection
Group node configuration information, cluster node network configuration information, data storage configuration information, log recording configuration information；
Step 2, distributed data clustered node of the operation with parameter, and orderly the node newly increased is added into collection one by one
Group data queue；
Step 3, according to the hash value size of each service node in service terminal device (1), service node is ordered as ordered ring
Shape；Each service node is connect with away from right side node that is nearest and working normally later, and formation one is stable orderly to close
Ring is configured to a dynamic distributed data cluster；
Connection is established in step 4, management end device (2) and service terminal device (1)；
Step 5, comparative management end device (2), service terminal device (1) versions of data, if the versions of data of service terminal device (1)
Versions of data than managing end device (2) is new, then executes the versions of data that data simultaneously operating updates management end device (2)；
Step 6, management end device (2) obtain the versions of data less than service terminal device (1), that is, show service terminal device (1)
Distributed data cluster is the cluster newly constructed, by the database table structure of management end device (2) to the number of service terminal device (1)
According to being initialized；
Step 7, client terminal device (3) are established connection with service terminal device (1) and are communicated, and obtain central and connected
It connects；The continual connection status for detecting itself and central of client terminal device (3), is obtained if central breaks down
New central is taken to be attached；
Step 8, service terminal device (1) have new data information, and notice client terminal device (3) carries out data simultaneously operating；
Step 9, client terminal device (3) are in service terminal device (1) without inquiring its internal number under conditions of data update notification
Data service is provided accordingly；
The state and data of each node of distributed data cluster in step 10, management end device (2) query service end device (1)
State；
Step 11, management end device (2) pass through the versions of data of data query language query service end device (1)；
After step 12, management end device (2) and client terminal device (3) respective versions of data update, equal synchronized update to service
In the database of end device (1)；
New version data distribution to management end device (2), client terminal device (3) are carried out data by step 13, service terminal device (1)
It is synchronous.
6. the distributed data cluster control method of dynamic construction according to claim 5, which is characterized in that step 4 institute
It states management end device (2) and service terminal device (1) establishes client terminal device described in connection, step 7 (3) and service terminal device (1)
It establishes connection to be communicated, is to establish TCP communication connection.
7. the distributed data cluster control method of dynamic construction according to claim 5 or 6, which is characterized in that step 8
The service terminal device (1) has new data information, and notice client terminal device (3) carries out data simultaneously operating, specifically:
Step 8-1, the data of some client terminal device (3) update, and are carried out by the central of service terminal device (1)
Registration；
Step 8-2, other data of central notice service terminal device (1) carry out data update from node；
If the data of multiple client device (3) successively update, successively carried out by central according to the sequence updated
Certain time is registered and saved in the memory of central, data is obtained and updates packet, and the data are updated to wrap and are committed to
The database of service terminal device (1) reinforms other data from node later and carries out data update.
8. the distributed data cluster control method of dynamic construction according to claim 5 or 6, which is characterized in that step
After the 12 management end devices (2) and client terminal device (3) respective versions of data update, can synchronized update to server-side fill
In the database for setting (1), specifically:
Step 12-1, some back end manages end device (2) or some client terminal device (3) writes the update of data
Enter and forms data packet in memory；
Step 12-2, central is sent data packets to when a transaction commits；
Step 12-3, data collision is analyzed:
1) data of back end lag behind the data of central, when leading to update inconsistency, will carry out data rewind, without
It can be submitted in the database of back end；
2) data of back end lag behind the data of central, when leading to update inconsistency, actively and central into
Row synchronizes；
Step 12-4, central the data packet received is written in the database of central, and immediately by data
Packet is sent to other back end and manages end device (2) or client terminal device (3)；If back end receives multiple simultaneously
The database for being committed to back end together is updated by data packet.
9. the distributed data cluster control method of dynamic construction according to claim 8, which is characterized in that step 12-2
The central that sends data packets to is by the way of TCP_NODELAY.
10. the distributed data cluster control method of dynamic construction according to claim 8, which is characterized in that step 12-
It is sent data packets to described in 4 after other back end, back end can timing and central communication inquiry data
State when back end updates data collision, carries out back end update immediately.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811417178.0A CN109639773B (en) | 2018-11-26 | 2018-11-26 | Dynamically constructed distributed data cluster control system and method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811417178.0A CN109639773B (en) | 2018-11-26 | 2018-11-26 | Dynamically constructed distributed data cluster control system and method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109639773A true CN109639773A (en) | 2019-04-16 |
| CN109639773B CN109639773B (en) | 2021-04-13 |
Family
ID=66069181
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811417178.0A Active CN109639773B (en) | 2018-11-26 | 2018-11-26 | Dynamically constructed distributed data cluster control system and method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109639773B (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111163176A (en) * | 2020-01-02 | 2020-05-15 | 山东超越数控电子股份有限公司 | VirtualBox-based cluster management system |
| CN111460030A (en) * | 2020-03-18 | 2020-07-28 | 紫光云技术有限公司 | ZooKeeper-based distributed data exchange system |
| CN112532625A (en) * | 2020-11-27 | 2021-03-19 | 杭州安恒信息安全技术有限公司 | Network situation awareness evaluation data updating method and device and readable storage medium |
| CN113783921A (en) * | 2021-01-27 | 2021-12-10 | 北京京东振世信息技术有限公司 | Method and apparatus for creating cache components |
| CN115329391A (en) * | 2022-10-18 | 2022-11-11 | 成都卫士通信息产业股份有限公司 | Protection method, device, equipment and medium for text database |
| CN117851459A (en) * | 2024-03-08 | 2024-04-09 | 江苏金恒信息科技股份有限公司 | Data processing method based on multi-level cache under industrial data acquisition |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102025550A (en) * | 2010-12-20 | 2011-04-20 | 中兴通讯股份有限公司 | System and method for managing data in distributed cluster |
| CN103475566A (en) * | 2013-07-10 | 2013-12-25 | 北京发发时代信息技术有限公司 | Real-time message exchange platform and distributed cluster establishment method |
| CN104753994A (en) * | 2013-12-27 | 2015-07-01 | 杭州海康威视系统技术有限公司 | Method and device for data synchronization based on cluster server system |
| US20160041859A1 (en) * | 2014-08-11 | 2016-02-11 | Sas Institute Inc. | Synchronization testing of active clustered servers |
| CN105824810A (en) * | 2015-01-04 | 2016-08-03 | 中国移动通信集团河北有限公司 | Hadoop cluster system and data processing method |
-
2018
- 2018-11-26 CN CN201811417178.0A patent/CN109639773B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102025550A (en) * | 2010-12-20 | 2011-04-20 | 中兴通讯股份有限公司 | System and method for managing data in distributed cluster |
| CN103475566A (en) * | 2013-07-10 | 2013-12-25 | 北京发发时代信息技术有限公司 | Real-time message exchange platform and distributed cluster establishment method |
| CN104753994A (en) * | 2013-12-27 | 2015-07-01 | 杭州海康威视系统技术有限公司 | Method and device for data synchronization based on cluster server system |
| US20160041859A1 (en) * | 2014-08-11 | 2016-02-11 | Sas Institute Inc. | Synchronization testing of active clustered servers |
| CN105824810A (en) * | 2015-01-04 | 2016-08-03 | 中国移动通信集团河北有限公司 | Hadoop cluster system and data processing method |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111163176A (en) * | 2020-01-02 | 2020-05-15 | 山东超越数控电子股份有限公司 | VirtualBox-based cluster management system |
| CN111460030A (en) * | 2020-03-18 | 2020-07-28 | 紫光云技术有限公司 | ZooKeeper-based distributed data exchange system |
| CN112532625A (en) * | 2020-11-27 | 2021-03-19 | 杭州安恒信息安全技术有限公司 | Network situation awareness evaluation data updating method and device and readable storage medium |
| CN112532625B (en) * | 2020-11-27 | 2022-09-13 | 杭州安恒信息安全技术有限公司 | Network situation awareness evaluation data updating method and device and readable storage medium |
| CN113783921A (en) * | 2021-01-27 | 2021-12-10 | 北京京东振世信息技术有限公司 | Method and apparatus for creating cache components |
| CN115329391A (en) * | 2022-10-18 | 2022-11-11 | 成都卫士通信息产业股份有限公司 | Protection method, device, equipment and medium for text database |
| CN117851459A (en) * | 2024-03-08 | 2024-04-09 | 江苏金恒信息科技股份有限公司 | Data processing method based on multi-level cache under industrial data acquisition |
| CN117851459B (en) * | 2024-03-08 | 2024-06-07 | 江苏金恒信息科技股份有限公司 | Data processing method based on multi-level cache under industrial data acquisition |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109639773B (en) | 2021-04-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11360854B2 (en) | Storage cluster configuration change method, storage cluster, and computer system | |
| CN109639773A (en) | A kind of the distributed data cluster control system and its method of dynamic construction | |
| EP3127018B1 (en) | Geographically-distributed file system using coordinated namespace replication | |
| US9785691B2 (en) | Method and apparatus for sequencing transactions globally in a distributed database cluster | |
| US5854895A (en) | Network distribution information management system | |
| US7653668B1 (en) | Fault tolerant multi-stage data replication with relaxed coherency guarantees | |
| US8856091B2 (en) | Method and apparatus for sequencing transactions globally in distributed database cluster | |
| US20050193248A1 (en) | Computer system for recovering data based on priority of the data | |
| WO2016070375A1 (en) | Distributed storage replication system and method | |
| CN103345502B (en) | Transaction processing method and system of distributed type database | |
| CN113268472B (en) | Distributed data storage system and method | |
| CN107787490A (en) | Function is directly connected in distributed data base grid | |
| US20150317371A1 (en) | Method, device, and system for peer-to-peer data replication and method, device, and system for master node switching | |
| CN102012944A (en) | Distributed NOSQL (not only structured query language) database capable of providing replication property | |
| JP7322161B2 (en) | Asynchronous storage management in distributed systems | |
| JP7678892B2 (en) | Geographically Distributed Hybrid Cloud Clusters | |
| CN109726211B (en) | Distributed time sequence database | |
| CN110807039A (en) | A system and method for maintaining data consistency in cloud computing environment | |
| CN114020279A (en) | Application software distributed deployment method, system, terminal and storage medium | |
| CN105323271A (en) | Cloud computing system, and processing method and apparatus thereof | |
| CN117827402A (en) | A method and device for executing scheduled tasks in a remote active-active system | |
| WO2007028249A1 (en) | Method and apparatus for sequencing transactions globally in a distributed database cluster with collision monitoring | |
| US20210248108A1 (en) | Asynchronous data synchronization and reconciliation | |
| US12086158B2 (en) | Hybrid cloud asynchronous data synchronization | |
| Liang et al. | A novel scheme of data consistency in distributed controller deployment for SDON |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP01 | Change in the name or title of a patent holder |
Address after: 222001 No.18 Shenghu Road, Lianyungang City, Jiangsu Province Patentee after: The 716th Research Institute of China Shipbuilding Corp. Address before: 222001 No.18 Shenghu Road, Lianyungang City, Jiangsu Province Patentee before: 716TH RESEARCH INSTITUTE OF CHINA SHIPBUILDING INDUSTRY Corp. |
|
| CP01 | Change in the name or title of a patent holder |