CN103051686A - Method and system for isolating dynamic application of distributed system - Google Patents
Method and system for isolating dynamic application of distributed system Download PDFInfo
- Publication number
- CN103051686A CN103051686A CN2012105302738A CN201210530273A CN103051686A CN 103051686 A CN103051686 A CN 103051686A CN 2012105302738 A CN2012105302738 A CN 2012105302738A CN 201210530273 A CN201210530273 A CN 201210530273A CN 103051686 A CN103051686 A CN 103051686A
- Authority
- CN
- China
- Prior art keywords
- server
- controlled group
- service request
- data
- group
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 25
- 238000007726 management method Methods 0.000 claims description 27
- 238000006062 fragmentation reaction Methods 0.000 claims description 18
- 238000013467 fragmentation Methods 0.000 claims description 17
- 238000002955 isolation Methods 0.000 claims description 12
- 238000013523 data management Methods 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 6
- 230000005012 migration Effects 0.000 description 3
- 238000013508 migration Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 2
- 230000000712 assembly Effects 0.000 description 1
- 238000000429 assembly Methods 0.000 description 1
- 239000006185 dispersion Substances 0.000 description 1
- 238000005303 weighing Methods 0.000 description 1
Images
Landscapes
- Computer And Data Communications (AREA)
- Multi Processors (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention provides a method and system for isolating dynamic application of a distributed system. The method comprises the following steps of: dividing a server of the system into different controlled groups according to the application types of servers in the distributed system; distributing servers of the corresponding quantity for each controlled group according to the requirements of service request to the controlled groups with different application types; storing a data sheet to be called by the service request to a server in the controlled group with the corresponding application type, so that the service request executed by the server is limited within the range of the controlled group. According to the method and system disclosed by the invention, all server resources of the system are divided into different controlled groups by virtue of a resource management technology of the controlled groups; data distribution and service requests of different data sheets are limited by the controlled group resources; different data sheets are enabled to use the server resources without interference in a mutually isolated manner; and mutually incompatible application of the plurality of the server sources is realized, and the system infrastructure can be shared.
Description
Technical field
The present invention relates to computer realm, relate in particular to a kind of on distributed sequence list, the method for setting up controlled group and keeping data distribute and service request takies in the different controlled group server resource mutually to isolate.
Background technology
When system need to support a plurality ofly during to the huge application of server resource configuration requirement difference, usually need to build a plurality of clusters, therefore need a plurality of support systems satisfy operation demand, can't mutual foundation facility platform.In other words, in system, when if the service request of some tables of data is excessive to the demand of server, server to the service request of these tables of data carry out too frequent, so that the service request of other tables of data can not get carrying out for a long time, so present prior art does not have also to realize to support the incompatible application of a plurality of server resources that the problem of sharing system infrastructure also belongs to distributed system or database field technical problem just to be solved.
Summary of the invention
The present invention proposes a kind of method of distributed system dynamic application isolation, assurance different pieces of information table can isolate not interfereing with each other mutually when using server resource, realized supporting the incompatible application of a plurality of server resources, energy sharing system infrastructure, described technical scheme is as follows:
A kind of method of distributed system dynamic application isolation is characterized in that described method comprises:
In distributed system, the type of using according to server is divided into different controlled group with the server of system;
According to the demand of service request to different application type controlled group, distribute the server of respective numbers for each controlled group;
The tables of data that described service request will be called is stored on the server in the controlled group of respective application type, and the performed service request of server is limited in the controlled group scope.
Further, in described distributed system, the data in the tables of data are divided into a plurality of horizontal data bursts according to major key, and described data fragmentation is assigned in the same controlled group on a plurality of servers.
Further, when service request changes the demand of dissimilar controlled group, redistribute the quantity of server in the controlled group, server moves between controlled group.
Further, the described method that server is moved comprises:
Data fragmentation in the server that will move is transferred on other servers of same controlled group;
The described server that will move is deleted from former controlled group;
With the described server registration that will move in new controlled group;
In new controlled group, the partial data burst on the part server is transferred on the described server of newly moving to group.
Further, according to the situation of server load in the controlled group distribution of data burst is done and redistributed.
Further, described situation according to server load in the controlled group is done to redistribute to the distribution of data burst and is comprised:
The relatively load of Servers-all in controlled group;
In the server with the load maximum, the data fragmentation of partial data table is transferred in the server of least-loaded;
Repeat above two steps, until in the server of load maximum and least-loaded, the burst difference of data is 1, shut-down operation.
A kind of system of distributed system dynamic application isolation, described system comprises:
Control module is used for service request is sent to the identical service request Executive Module of application type by the assembly management module, and to the instruction of administration module sending assembly management between group;
The assembly management module is connected with described control module, is used for the service request Executive Module identical according to the type selecting application type of service request, and manages described service request Executive Module;
The service request Executive Module is connected with described assembly management module, is used for the data fragmentation of storage system, carries out the service request that described control module sends;
Wherein, described service request Executive Module is comprised of a plurality of servers, is divided into different controlled group according to the type of using, and the performed service request of server is limited in the controlled group scope.
Further, described assembly management module comprises:
Server management module is used for the service request Executive Module identical according to the type selecting application type of service request, and manages server in the described service request Executive Module to the execution of service request;
Data management module, be used for according to the demand of service request to different application type controlled group, the server that distributes respective numbers for each controlled group, and when service request changes the demand of dissimilar controlled group, redistribute the quantity of server in the controlled group, server moves between controlled group;
Server load balancing administration module in the controlled group is used for according to the situation of server load in the controlled group equilibrium being carried out in the distribution of data burst and distributes.
The controlled group resource management techniques of the present invention by proposing, whole server resources of system are divided into different controlled group, the restriction that the data distribution of different pieces of information table and service request are subject to the controlled group resource, guarantee that the different pieces of information table uses server resource mutually to isolate and do not interfere with each other, realized supporting the incompatible application of a plurality of server resources, can sharing system infrastructure.
Description of drawings
Fig. 1 is the method flow diagram of the distributed system dynamic application isolation that provides of the embodiment of the invention;
Fig. 2 is the system function module block diagram of the distributed system dynamic application isolation that provides of the embodiment of the invention;
Fig. 3 is the basic structure schematic diagram of the distributed system controlled group resource management that provides of the embodiment of the invention.
Embodiment
The present invention is described in further detail below in conjunction with drawings and Examples.Be understandable that specific embodiment described herein only is used for explaining the present invention, but not limitation of the invention.
Embodiment one
Distributed system (distributed system) is the software systems that are based upon on the network.In a distributed system, one group independently computer represent to the user be a unified integral body, be a system.System has physics and the logical resource of many general, dynamic allocating task, and physics and the logical resource of dispersion are realized information exchange by computer network.There is the mode supervisory computer distribution of resource formula operating system with the overall situation in the system.Usually, concerning the user, distributed system only has a model or pattern.On operating system, there is one deck software middleware (middle ware) to be responsible for realizing this model.The example of a famous distributed system is World Wide Web (WWW) (World Wide Web), and in the World Wide Web (WWW), all seem that just looking like is that a document (Web) is the same.
Fig. 1 is the method flow diagram of the distributed system dynamic application isolation that provides of the embodiment of the invention.As shown in Figure 1:
The method of distributed system dynamic application isolation comprises:
Step 101: in distributed system, the type of using according to server is divided into different controlled group with the server of system;
In distributed system, the type that server is used has a variety of, the type that the server is here used comprise read buffer memory, write buffer memory, the size of caching system internal memory etc., the type that these servers are used is different to the demand of server, and the different application type determines the demand of the server service request by certain period, such as, the operation of sometimes reading buffer memory is more, and it is just more to the demand of server then to read buffer memory.The type of using according to server first is divided into different controlled group with the server of system, every kind of corresponding a kind of application type of controlled group so that follow-up be the controlled group distribution server.
Step 102: according to the demand of service request to different application type controlled group, distribute the server of respective numbers for each controlled group;
Because the type that server is used is different to the demand of server, and the different application type determines the demand of the server service request by certain period, so, can be according to the demand of service request to the different application type, the server that distributes respective numbers for each controlled group, can get the server of a greater number to the application type controlled group that the server demands amount is more, and the less application type controlled group of server demands amount be got the server of lesser amt.Can take full advantage of resource like this, the service request execution that is unlikely to occur in some server is not come, and a lot of service requests can not obtain carrying out, and some server is left unused, and is not fully utilized.
Step 103: the tables of data that service request will be called is stored on the server in the controlled group of respective application type, and the performed service request of server is limited in the controlled group scope.
At first, in distributed system, the data in the tables of data are divided into a plurality of horizontal data bursts according to major key, and these data fragmentations are assigned in the same controlled group on a plurality of servers.The operation of these tables of data is also corresponding with the application type of the controlled group at place.The data fragmentation of the tables of data that service request will be called is stored on the server in the controlled group of respective application type, and the performed service request of server is limited in the controlled group scope, and other controlled group then can not be called this tables of data.
When service request changes the demand of dissimilar controlled group, redistribute the quantity of server in the controlled group, server is moved between controlled group.Server migration in the controlled group that demand is less is to the larger controlled group of demand.
The method that server is moved comprises:
Step 1031: the data fragmentation in the server that move is transferred on other servers of same controlled group;
Step 1032: the server that move is deleted from former controlled group.
Step 1033: in new controlled group, and new controlled group is larger to the demand of server with the server registration that will move.
Step 1034: in new controlled group, the partial data burst on the part server is transferred on the server of newly moving to group.
Since the migration of server between the controlled group, and cause the data fragmentation in the controlled group to distribute and service request skewness weighing apparatus, do the distribution of data burst according to the situation of server load in the controlled group and redistribute.So that server resource reaches balanced in the controlled group.
According to the situation of server load in the controlled group distribution of data burst is done to redistribute and comprises:
Step 1035: the relatively load of Servers-all in controlled group, wherein, the load of server refers to the quantity of data fragmentation in the server.
Step 1036: in the server with the load maximum, the data fragmentation of partial data table is transferred in the server of least-loaded;
Step 1037: repeat above two steps, until in the server of load maximum and least-loaded, the data fragmentation difference of data is 1, shut-down operation.
Embodiment two
Fig. 2 is the system function module block diagram of the distributed system dynamic application isolation that provides of the embodiment of the invention; As shown in Figure 2:
The system of distributed system dynamic application isolation comprises:
Server management module is used for the service request Executive Module identical according to the type selecting application type of service request, and manages server in the described service request Executive Module to the execution of service request; Data management module, be used for according to the demand of service request to different application type controlled group, the server that distributes respective numbers for each controlled group, and when service request changes the demand of dissimilar controlled group, redistribute the quantity of server in the controlled group, server is moved between controlled group; Server load balancing administration module in the controlled group is used for according to the situation of server load in the controlled group equilibrium being carried out in the distribution of data burst and distributes.
Embodiment three
Fig. 3 is the basic structure schematic diagram of the distributed system controlled group resource management that provides of the embodiment of the invention.As shown in Figure 3:
Take the migration of server between group as example, the server that moves is given data fragmentation other servers of same controlled group uniformly, behind the transferring data burst, send request for the server management module in the assembly management system, server management module finds the controlled group that needs to add server, then the server that will move is deleted from original controlled group, be registered to new controlled group.
After being registered to new controlled group, by server load balancing administration module in the controlled group data fragmentation of storing on the server in the new controlled group is carried out equilibrium treatment, reach at last the equilibrium that the new interior data of controlled group distribute.
The controlled group resource management techniques of the present invention by proposing, whole server resources of system are divided into different controlled group, the restriction that the data distribution of different pieces of information table and service request are subject to the controlled group resource, guarantee that the different pieces of information table uses server resource mutually to isolate and do not interfere with each other, realized supporting the incompatible application of a plurality of server resources, can sharing system infrastructure.
It below only is the explanation of doing for the preferred embodiments of the present invention and know-why thereof; and be not the restriction that technology contents of the present invention is carried out; anyly be familiar with those skilled in the art in technical scope disclosed in this invention; the variation of being expected easily or replacement all should be encompassed in protection scope of the present invention.
Claims (8)
1. the method for distributed system dynamic application isolation is characterized in that described method comprises:
In distributed system, the type of using according to server is divided into different controlled group with the server of system;
According to the demand of service request to different application type controlled group, distribute the server of respective numbers for each controlled group;
The tables of data that described service request will be called is stored on the server in the controlled group of respective application type, and the performed service request of server is limited in the controlled group scope.
2. method according to claim 1 is characterized in that, in described distributed system, the data in the tables of data are divided into a plurality of horizontal data bursts according to major key, and described data fragmentation is assigned in the same controlled group on a plurality of servers.
3. method according to claim 1 is characterized in that, when service request changes the demand of dissimilar controlled group, redistributes the quantity of server in the controlled group, and server moves between controlled group.
4. method according to claim 3 is characterized in that, the described method that server is moved comprises:
Data fragmentation in the server that will move is transferred on other servers of same controlled group;
The described server that will move is deleted from former controlled group;
With the described server registration that will move in new controlled group;
In new controlled group, the partial data burst on the part server is transferred on the described server of newly moving to group.
5. method according to claim 4 is characterized in that, according to the situation of server load in the controlled group distribution of data burst is done and is redistributed.
6. method according to claim 5 is characterized in that, described situation according to server load in the controlled group is done to redistribute to the distribution of data burst and comprised:
The relatively load of Servers-all in controlled group;
In the server with the load maximum, the data fragmentation of partial data table is transferred in the server of least-loaded;
Repeat above two steps, until in the server of load maximum and least-loaded, the burst difference of data is 1, shut-down operation.
7. the system of distributed system dynamic application isolation is characterized in that described system comprises:
Control module is used for service request is sent to the identical service request Executive Module of application type by the assembly management module, and to the instruction of administration module sending assembly management between group;
The assembly management module is connected with described control module, is used for the service request Executive Module identical according to the type selecting application type of service request, and manages described service request Executive Module;
The service request Executive Module is connected with described assembly management module, is used for the data fragmentation of storage system, carries out the service request that described control module sends;
Wherein, described service request Executive Module is comprised of a plurality of servers, is divided into different controlled group according to the type of using, and the performed service request of server is limited in the controlled group scope.
8. method according to claim 7 is characterized in that, described assembly management module comprises:
Server management module is used for the service request Executive Module identical according to the type selecting application type of service request, and manages server in the described service request Executive Module to the execution of service request;
Data management module, be used for according to the demand of service request to different application type controlled group, the server that distributes respective numbers for each controlled group, and when service request changes the demand of dissimilar controlled group, redistribute the quantity of server in the controlled group, server moves between controlled group;
Server load balancing administration module in the controlled group is used for according to the situation of server load in the controlled group equilibrium being carried out in the distribution of data burst and distributes.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210530273.8A CN103051686B (en) | 2012-12-10 | 2012-12-10 | A kind of method and system of distributed system dynamic application isolation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210530273.8A CN103051686B (en) | 2012-12-10 | 2012-12-10 | A kind of method and system of distributed system dynamic application isolation |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103051686A true CN103051686A (en) | 2013-04-17 |
| CN103051686B CN103051686B (en) | 2018-03-27 |
Family
ID=48064180
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210530273.8A Active CN103051686B (en) | 2012-12-10 | 2012-12-10 | A kind of method and system of distributed system dynamic application isolation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103051686B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106776613A (en) * | 2015-11-20 | 2017-05-31 | 北大方正集团有限公司 | Data migration method and device |
| CN108932104A (en) * | 2017-05-25 | 2018-12-04 | 腾讯科技（深圳）有限公司 | A kind of data processing method, device and processing server |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101222490A (en) * | 2007-12-07 | 2008-07-16 | 中国科学院计算技术研究所 | A network server system and method |
| US20090037445A1 (en) * | 2006-04-11 | 2009-02-05 | Brother Kogyo Kabushiki Kaisha | Information communication system, content catalog information distributing method, node device, and the like |
| CN102033889A (en) * | 2009-09-29 | 2011-04-27 | 熊凡凡 | Distributed database parallel processing system |
| CN102158513A (en) * | 2010-02-11 | 2011-08-17 | 联想(北京)有限公司 | Service cluster and energy-saving method and device thereof |
| CN102202073A (en) * | 2010-03-24 | 2011-09-28 | 杭州华三通信技术有限公司 | Distributed system and data synchronization method thereof |
| CN102790715A (en) * | 2011-05-23 | 2012-11-21 | 同济大学 | Resource allocation system and method based on internet |
-
2012
- 2012-12-10 CN CN201210530273.8A patent/CN103051686B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090037445A1 (en) * | 2006-04-11 | 2009-02-05 | Brother Kogyo Kabushiki Kaisha | Information communication system, content catalog information distributing method, node device, and the like |
| CN101222490A (en) * | 2007-12-07 | 2008-07-16 | 中国科学院计算技术研究所 | A network server system and method |
| CN102033889A (en) * | 2009-09-29 | 2011-04-27 | 熊凡凡 | Distributed database parallel processing system |
| CN102158513A (en) * | 2010-02-11 | 2011-08-17 | 联想(北京)有限公司 | Service cluster and energy-saving method and device thereof |
| CN102202073A (en) * | 2010-03-24 | 2011-09-28 | 杭州华三通信技术有限公司 | Distributed system and data synchronization method thereof |
| CN102790715A (en) * | 2011-05-23 | 2012-11-21 | 同济大学 | Resource allocation system and method based on internet |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106776613A (en) * | 2015-11-20 | 2017-05-31 | 北大方正集团有限公司 | Data migration method and device |
| CN108932104A (en) * | 2017-05-25 | 2018-12-04 | 腾讯科技（深圳）有限公司 | A kind of data processing method, device and processing server |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103051686B (en) | 2018-03-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104168323B (en) | A kind of cloud service system and method | |
| CN102521038B (en) | Virtual machine migration method and device based on distributed file system | |
| CN102855294B (en) | Intelligent hash data layout method, cluster storage system and method thereof | |
| KR101502896B1 (en) | Distributed memory cluster control apparatus and method using map reduce | |
| US10356150B1 (en) | Automated repartitioning of streaming data | |
| CN102025550A (en) | System and method for managing data in distributed cluster | |
| US9201747B2 (en) | Real time database system | |
| CN102193814A (en) | Method and system for dynamically distributing embedded virtual memory | |
| CN104679594B (en) | A kind of middleware distributed computing method | |
| CN101071434B (en) | User distributing method, device and system for distributed database system | |
| CN110188084A (en) | A kind of distributed file storage system and file memory method | |
| CN102088484A (en) | Write lock method of distributed file system and a system thereof | |
| CN101470667A (en) | Method for assigning physical memory in specified address range on Linux system platform | |
| CN105302817B (en) | Distributed file system management method and device | |
| CN104254839A (en) | Systems and methods for partitioning of singly linked lists for allocation memory elements | |
| CN106202082A (en) | The method and device of built-up foundation data buffer storage | |
| CN104202424A (en) | Method for extending cache by software architecture | |
| CN102594881A (en) | Virtual machine load balancing method, management modules and virtual machine cluster system | |
| CN101226553A (en) | Method and device for storing length-various field of embedded database | |
| CN104348793A (en) | Storage server system and storage method for data information | |
| CN101415023A (en) | Intelligent dynamic load equilibrium technology for server | |
| CN103051686A (en) | Method and system for isolating dynamic application of distributed system | |
| CN119357005B (en) | Resource planning method, resource scheduling method, device, storage medium and product | |
| CN113626138B (en) | Application program access method and related device | |
| CN103634344A (en) | Method and apparatus for unit operation multiple MySQL database examples |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| ASS | Succession or assignment of patent right |
Owner name: BEIJING PEZY CHUANGZHI DATA TECHNOLOGY CO., LTD. Free format text: FORMER OWNER: BEIJING PEZY TIANJI DATA TECHNOLOGY CO., LTD. Effective date: 20130530 |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| C53 | Correction of patent of invention or patent application | ||
| CB03 | Change of inventor or designer information |
Inventor after: He Xiaofeng Inventor before: Liu Jia Inventor before: Hu Xiao Inventor before: Cha Li |
|
| COR | Change of bibliographic data |
Free format text: CORRECT: INVENTOR; FROM: LIU JIA HU XIAO CHA LI TO: HE XIAOFENG Free format text: CORRECT: ADDRESS; FROM: 100083 HAIDIAN, BEIJING TO: 100180 HAIDIAN, BEIJING |
|
| TA01 | Transfer of patent application right |
Effective date of registration: 20130530 Address after: 100180, No. 28, Fu Cheng Road, 9, Beijing, Haidian District, 4-906 Applicant after: Beijing Puze Powerise Data Technology Co Ltd Address before: 100083. 4-906, 9, 4-908, 28 Fu Cheng Road, Beijing, Haidian District Applicant before: Beijing Pezy Data Technology Co., Ltd. |
|
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20200421 Address after: 100102 Beijing Chaoyang District Chuangda Road 1 Courtyard 1 Building 7 Floor 101 Patentee after: BUSINESS-INTELLIGENCE OF ORIENTAL NATIONS CORPORATION Ltd. Address before: 100180, No. 28, Fu Cheng Road, 9, Beijing, Haidian District, 4-906 Patentee before: Beijing Puze Powerise Data Technology Co.,Ltd. |