CN102497353B - Multi-server distributed data processing method, server and system - Google Patents
Multi-server distributed data processing method, server and system Download PDFInfo
- Publication number
- CN102497353B CN102497353B CN201110334695.3A CN201110334695A CN102497353B CN 102497353 B CN102497353 B CN 102497353B CN 201110334695 A CN201110334695 A CN 201110334695A CN 102497353 B CN102497353 B CN 102497353B
- Authority
- CN
- China
- Prior art keywords
- data
- bit stream
- mission bit
- server
- remote agent
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Landscapes
- Information Transfer Between Computers (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Computer And Data Communications (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a kind of multi-server Distributed data processing method, central server reads after the data pick-up mission bit stream of remote agent server information and described remote agent server and data merge mission bit stream, send described data pick-up mission bit stream to described remote agent server, described remote agent server is made to extract the data required in described data pick-up mission bit stream, and return the data after compress-encrypt, the database server address requiring the data place extracted is carried in described data pick-up mission bit stream, receive the data after described compress-encrypt, and the data after the described compress-encrypt that decompresses, mission bit stream is merged according to described data, by the data composite shipment after decompression in data warehouse.The multi-server Distributed data processing method that the embodiment of the present invention provides, can realize dynamically adding data source, and can adapt to various network environment and network quality.
Description
Technical field
The present invention relates to technical field of data processing, be specifically related to a kind of multi-server Distributed data processing method, server and system.
Background technology
Data are extracted, change and load (ETL, Extraction-Transformation-Loading) as business intelligence (BI, Business Intelligence) and data warehouse (DW, Data Warehouse) core and soul, integrated and improve the value of data according to unified rule, being responsible for the process that data transform from data source to target data warehouse, is the important step in implementation data warehouse.If the devising and drawing the blueprint of the modelling Shi Yizuo mansion of data warehouse, data are brick and tile, and so ETL is exactly the process of JianShe Building.
ETL process is generally applied in local area network (LAN), by the data of data source after extracting, change, cleaning, be loaded in data warehouse, the present inventor finds, why ETL process can be applied in a local network, be because the network environment in usual local area network (LAN) and network quality better, data source is relatively fixing.Huge for online game (WebGame) this data volume, game server throughout world various places, network environment is complicated, and network quality is uneven, especially the distributed data of data source instability adopts above-mentioned ETL method to process, and just can not adapt to the present situation of WebGame.
Summary of the invention
The embodiment of the present invention provides a kind of multi-server Distributed data processing method, can realize dynamically adding data source, and can adapt to various network.The embodiment of the present invention additionally provides corresponding server and system.
A kind of multi-server Distributed data processing method, comprising:
Central server reads after the data pick-up mission bit stream of remote agent server information and described remote agent server and data merge mission bit stream, send described data pick-up mission bit stream to described remote agent server, described remote agent server is made to extract the data required in described data pick-up mission bit stream, and return the data after compress-encrypt, carry the database server address requiring the data place extracted in described data pick-up mission bit stream;
Receive the data after described compress-encrypt, and the data after the described compress-encrypt that decompresses;
Mission bit stream is merged, by the data composite shipment after decompression in data warehouse according to described data.
A kind of multi-server Distributed data processing method, comprising:
Remote agent server receives data pick-up mission bit stream, carries the database server address requiring the data place extracted in described data pick-up mission bit stream;
Connect according to described database server address and described database server;
The data required in described data pick-up mission bit stream are extracted from described database server;
To the described data compression that is drawn into and encryption;
Send the data after described compress-encrypt to central server.
A kind of central server, comprising:
Transmitting element, after merging mission bit stream at the data pick-up mission bit stream and data that read remote agent server information and described remote agent server, the database server address requiring the data place extracted is carried in described data pick-up mission bit stream, send described data pick-up mission bit stream to described remote agent server, make described remote agent server extract the data required in described data pick-up mission bit stream, and return the data after compress-encrypt;
Receiving element, for receiving the data after described compress-encrypt;
Decompression processing unit, after the data after described receiving element receives compress-encrypt, the data after the described compress-encrypt that decompresses;
Composite shipment unit, for merging mission bit stream according to described data, the data composite shipment after described decompression processing unit being decompressed is in data warehouse.
A kind of remote agent server, comprising:
Receiving element, for receiving data pick-up mission bit stream, carries the database server address requiring the data place extracted in described data pick-up mission bit stream;
Set up unit, connect for the described database server address that receives according to described receiving element and described database server;
Data pick-up unit, for setting up after unit and described database server connect described, extracts the data required in described data pick-up mission bit stream from described database server;
Compress-encrypt processing unit, for the data compression that is drawn into described data pick-up unit and encryption;
Transmitting element, for compressing at described compress-encrypt processing unit and after the data be drawn into described in encrypting, sending the data after described compress-encrypt to central server.
A kind of multi-server Distributed data handling system, comprising:
Central server, remote agent server and database server, described remote agent server has multiple, and the data interaction between described central server and each remote agent server is unrelated;
Central server reads after the data pick-up mission bit stream of remote agent server information and described remote agent server and data merge mission bit stream, carry the database server address requiring the data place extracted in described data pick-up mission bit stream, send described data pick-up mission bit stream to described remote agent server;
Remote agent server receives described data pick-up mission bit stream, the database server address requiring the data place extracted is carried in described data pick-up mission bit stream, connect according to described database server address and described database server, the data required in described data pick-up mission bit stream are extracted from described database server, to the described data compression that is drawn into and encryption, send the data after described compress-encrypt to central server;
Described central server receives the data after described compress-encrypt, and the data after the described compress-encrypt that decompresses, merge mission bit stream according to described data, by the data composite shipment after decompression in data warehouse.
The multi-server Distributed data processing method that the embodiment of the present invention provides, central server is adopted to read after the data pick-up mission bit stream of remote agent server information and described remote agent server and data merge mission bit stream, send described data pick-up mission bit stream to described remote agent server, described remote agent server is made to extract the data required in described data pick-up mission bit stream, and return the data after compress-encrypt, the database server address requiring the data place extracted is carried in described data pick-up mission bit stream, receive the data after described compress-encrypt, and the data after the described compress-encrypt that decompresses, mission bit stream is merged according to described data, by the data composite shipment after decompression in data warehouse.Compared with prior art, the multi-server Distributed data processing method that the embodiment of the present invention provides, can realize dynamically adding data source, and can adapt to various network environment and network quality.
Figure of description
Fig. 1 is an embodiment schematic diagram of distributed data processing method in the embodiment of the present invention;
Fig. 2 is another embodiment schematic diagram of distributed data processing method in the embodiment of the present invention;
Fig. 3 is central server and remote agent server one embodiment schematic diagram in the embodiment of the present invention;
Fig. 4 is central server and another embodiment schematic diagram of remote agent server in the embodiment of the present invention;
Fig. 5 is distributed data processing system one embodiment schematic diagram in the embodiment of the present invention.
Embodiment
The embodiment of the present invention provides a kind of multi-server Distributed data processing method, can realize dynamically adding data source, and can adapt to various network.The embodiment of the present invention additionally provides corresponding server and system.Below be described in detail respectively.
Consult Fig. 1, from the angle of central server, the multi-server Distributed data processing method that the embodiment of the present invention provides comprises:
101, central server reads after the data pick-up mission bit stream of remote agent server information and described remote agent server and data merge mission bit stream, sends described data pick-up mission bit stream to described remote agent server.
Central server reads user configured mission bit stream, find remote agent server information and mission bit stream, described mission bit stream comprises described data pick-up mission bit stream and described data merge mission bit stream, described data are got mission bit stream and are sent to described remote agent server by central server, described remote agent server is made to extract the data required in described data pick-up mission bit stream, and return the data after compress-encrypt, carry the database server address requiring the data place extracted in described data pick-up mission bit stream.
102, the data after described compress-encrypt are received, and the data after the described compress-encrypt that decompresses.
103, mission bit stream is merged according to described data, by the data composite shipment after decompression in data warehouse.
After data decompression after compress-encrypt, merge mission bit stream according to data, by the data composite shipment after decompression in data warehouse, realize the transfer from data source to data warehouse.
In the embodiment of the present invention, central server is adopted to read after the data pick-up mission bit stream of remote agent server information and described remote agent server and data merge mission bit stream, send described data pick-up mission bit stream to described remote agent server, described remote agent server is made to extract the data required in described data pick-up mission bit stream, and return the data after compress-encrypt, the database server address requiring the data place extracted is carried in described data pick-up mission bit stream, receive the data after described compress-encrypt, and the data after the described compress-encrypt that decompresses, mission bit stream is merged according to described data, by the data composite shipment after decompression in data warehouse.Compared with prior art, the multi-server Distributed data processing method that the embodiment of the present invention provides, can realize dynamically adding data source, and can adapt to various network environment and network quality.
Alternatively, on the basis of embodiment corresponding to above-mentioned Fig. 1, can also comprise before step 101: receive user configured remote agent server information and mission bit stream, described mission bit stream comprises described data pick-up mission bit stream, and described data merge mission bit stream and task execution time information.
Alternatively, on the basis of above-described embodiment, can also comprise after step 103: upgrade described task execution time information.
Consult Fig. 2, from remote agent server angle, the multi-server Distributed data processing method that the embodiment of the present invention provides comprises:
201, remote agent server receives data pick-up mission bit stream, carries the database server address requiring the data place extracted in described data pick-up mission bit stream.
202, connect according to described database server address and described database server.
Remote agent server is connected by Agent and database server.
203, from described database server, extract the data required in described data pick-up mission bit stream;
204, to the described data compression that is drawn into and encryption;
205, the data after described compress-encrypt are sent to central server.
In the embodiment of the present invention, remote agent server receives data pick-up mission bit stream, the database server address requiring the data place extracted is carried in described data pick-up mission bit stream, connect according to described database server address and described database server, the data required in described data pick-up mission bit stream are extracted from described database server, to the described data compression that is drawn into and encryption, send the data after described compress-encrypt to central server.Compared with prior art, the multi-server Distributed data processing method that the embodiment of the present invention provides, can realize dynamically adding data source, and can adapt to various network environment and network quality.
Alternatively, on the basis of embodiment corresponding to above-mentioned Fig. 2, can also comprise before the step 204: change and the data be drawn into described in cleaning.
Alternatively, on the basis of above-described embodiment, while step 203, also comprise flag data extract position.
Consult Fig. 3, an embodiment of central server of the present invention and remote agent server comprises: central server 30 and remote agent server 40, and described central server 30 comprises:
Transmitting element 301, after merging mission bit stream at the data pick-up mission bit stream and data that read remote agent server information and described remote agent server, the database server address requiring the data place extracted is carried in described data pick-up mission bit stream, send described data pick-up mission bit stream to described remote agent server, make described remote agent server extract the data required in described data pick-up mission bit stream, and return the data after compress-encrypt;
Receiving element 302, for receiving the data after described compress-encrypt;
Decompression processing unit 303, after the data after described receiving element 302 receives compress-encrypt, the data after the described compress-encrypt that decompresses;
Composite shipment unit 304, for merging mission bit stream according to described data, the data composite shipment after described decompression processing unit 303 being decompressed is in data warehouse.
Described remote agent server 40 comprises:
Receiving element 401, for receiving data pick-up mission bit stream, carries the database server address requiring the data place extracted in described data pick-up mission bit stream;
Set up unit 402, connect for the described database server address that receives according to described receiving element 401 and described database server;
Data pick-up unit 403, for setting up after unit 402 connects with described database server described, extracts the data required in described data pick-up mission bit stream from described database server;
Compress-encrypt processing unit 404, for the data compression that is drawn into described data pick-up unit 403 and encryption;
Transmitting element 405, for compressing at described compress-encrypt processing unit 404 and after the data be drawn into described in encrypting, sending the data after described compress-encrypt to central server.
In the embodiment of the present invention, the transmitting element 301 of central server 30 sends described data pick-up mission bit stream to the receiving element 401 of described remote agent server 40, set up unit 402 to connect in the described database server address that described receiving element 401 receives and described database server 50, data pick-up unit 403 is set up after unit 402 connects with described database server described, the data required in described data pick-up mission bit stream are extracted from described database server, the data compression that compress-encrypt processing unit 404 is drawn into described data pick-up unit 403 encryption, transmitting element 405 sends the data after described compress-encrypt to the receiving element 302 of central server 30, after the data of decompression processing unit 303 after described receiving element 302 receives compress-encrypt, decompress the data after described compress-encrypt, composite shipment unit 304, mission bit stream is merged according to described data, data composite shipment after described decompression processing unit 303 being decompressed is in data warehouse.The central server that the embodiment of the present invention provides and remote agent server can realize dynamically adding data source, and can adapt to various network environment and network quality.
Consult Fig. 4, alternatively, on the basis of above-described embodiment, central server 30 can also comprise:
Described receiving element 302, also for receiving the mission bit stream of user configured remote agent server information and described remote agent server, described mission bit stream comprises described data pick-up mission bit stream, and described data merge mission bit stream and task execution time information.
Updating block 305, for described composite shipment unit by decompress after data composite shipment in data warehouse after, upgrade described task execution time information.
Remote agent server 40 can also comprise:
Conversion cleaning processing unit 406, for compressing at described compress-encrypt processing unit and changing before the data be drawn into described in encrypting and the data be drawn into described in cleaning.
Data markers unit 407, for when described data pick-up unit 403 extracted data, flag data extracts position.
In the embodiment of the present invention, data markers unit 407 is when described data pick-up unit 403 extracted data, and flag data extracts position.After generation network failure, data pick-up unit 403 from the position continuation process of extracted data last time, can reduce the impact that Network Abnormal brings.
Consult Fig. 5, the multi-server Distributed data handling system that the embodiment of the present invention provides comprises:
Central server 30, remote agent server 40 and database server 50, described remote agent server has 4, and the data interaction between described central server 30 and each remote agent server 40 is unrelated;
Central server 30 reads after the data pick-up mission bit stream of remote agent server information and described remote agent server and data merge mission bit stream, carry the database server address requiring the data place extracted in described data pick-up mission bit stream, send described data pick-up mission bit stream to described remote agent server;
Remote agent server 40 receives described data pick-up mission bit stream, the database server address requiring the data place extracted is carried in described data pick-up mission bit stream, connect according to described database server address and described database server, the data required in described data pick-up mission bit stream are extracted from described database server, to the described data compression that is drawn into and encryption, send the data after described compress-encrypt to central server.
Described central server 30 receives the data after described compress-encrypt, and the data after the described compress-encrypt that decompresses, merge mission bit stream according to described data, by the data composite shipment after decompression in data warehouse.
The multi-server Distributed data handling system that the embodiment of the present invention provides carries out compress-encrypt to the data extracted on remote agent server, again the data after compress-encrypt are transferred to central server, ensure that the network security of data, on the other hand, central server is executed the task according to user configuration information, when the data source that adds when there being new data source or have been friends in the past reduces, central server is read by information and just can find, thus achieves and dynamically add data source.And data interaction between central server and any one remote agent server is unrelated, after having a remote agent server to go wrong, other servers can not be affected, and this data interactive mode can make multiple remote agent service carry out data interaction with central server simultaneously, accelerate data interaction speed, improve systematic function.
Only give 4 remote agent servers 40 in the embodiment of the present invention, in fact remote agent server can have multiple, and the quantity of the present invention to remote agent server does not limit.
One of ordinary skill in the art will appreciate that all or part of step realized in above-described embodiment method is that the hardware that can carry out instruction relevant by program completes, this program can be stored in a kind of computer-readable recording medium, the above-mentioned storage medium mentioned can be read-only memory, disk or CD etc.
Above multi-server Distributed data processing method provided by the present invention, server and system are described in detail, for one of ordinary skill in the art, according to the thought of the embodiment of the present invention, all will change in specific embodiments and applications, therefore, this description should not be construed as limitation of the present invention.
Claims (13)
1. a multi-server Distributed data processing method, is characterized in that, comprising:
Central server reads after the data pick-up mission bit stream of remote agent server information and described remote agent server and data merge mission bit stream, send described data pick-up mission bit stream to described remote agent server, described remote agent server is made to extract the data required in described data pick-up mission bit stream, and return the data after compress-encrypt, carry the database server address requiring the data place extracted in described data pick-up mission bit stream;
Receive the data after described compress-encrypt, and the data after the described compress-encrypt that decompresses;
Mission bit stream is merged, by the data composite shipment after decompression in data warehouse according to described data.
2. multi-server Distributed data processing method according to claim 1, it is characterized in that, after described central server reads the data pick-up mission bit stream of remote agent server information and described remote agent server and data merge mission bit stream, send described data pick-up mission bit stream to before described remote agent server, described method also comprises:
Described central server receives user configured remote agent server information and mission bit stream, and described mission bit stream comprises described data pick-up mission bit stream, and described data merge mission bit stream and task execution time information.
3. multi-server Distributed data processing method according to claim 2, is characterized in that, also comprises after the data composite shipment after decompression is in data warehouse described:
Upgrade described task execution time information.
4. a multi-server Distributed data processing method, is characterized in that, comprising:
Remote agent server receives data pick-up mission bit stream, carries the database server address requiring the data place extracted in described data pick-up mission bit stream;
Connect according to described database server address and described database server;
The data required in described data pick-up mission bit stream are extracted from described database server;
To the described data compression that is drawn into and encryption;
Send the data after described compress-encrypt to central server, the data after described compress-encrypt are received to make described central server, and the data after the described compress-encrypt that decompresses, merge mission bit stream according to described data, by the data composite shipment after decompression in data warehouse.
5. multi-server Distributed data processing method according to claim 4, is characterized in that, also comprises the described data compression that is drawn into described before encryption:
Change and the data be drawn into described in cleaning.
6. the multi-server Distributed data processing method according to claim 4 or 5, is characterized in that, also comprises when extracted data:
Flag data extracts position.
7. a central server, is characterized in that, comprising:
Transmitting element, after merging mission bit stream at the data pick-up mission bit stream and data that read remote agent server information and described remote agent server, send described data pick-up mission bit stream to described remote agent server, described remote agent server is made to extract the data required in described data pick-up mission bit stream, and return the data after compress-encrypt, wherein, the database server address requiring the data place extracted is carried in described data pick-up mission bit stream;
Receiving element, for receiving the data after described compress-encrypt;
Decompression processing unit, after the data after described receiving element receives compress-encrypt, the data after the described compress-encrypt that decompresses;
Composite shipment unit, for merging mission bit stream according to described data, the data composite shipment after described decompression processing unit being decompressed is in data warehouse.
8. central server according to claim 7, is characterized in that, also comprises:
Described receiving element, also for receiving the mission bit stream of user configured remote agent server information and described remote agent server, described mission bit stream comprises described data pick-up mission bit stream, and described data merge mission bit stream and task execution time information.
9. central server according to claim 8, is characterized in that, also comprises:
Updating block, for described composite shipment unit by decompress after data composite shipment in data warehouse after, upgrade described task execution time information.
10. a remote agent server, is characterized in that, comprising:
Receiving element, for receiving data pick-up mission bit stream, carries the database server address requiring the data place extracted in described data pick-up mission bit stream;
Set up unit, connect for the described database server address that receives according to described receiving element and described database server;
Data pick-up unit, for setting up after unit and described database server connect described, extracts the data required in described data pick-up mission bit stream from described database server;
Compress-encrypt processing unit, for the data compression that is drawn into described data pick-up unit and encryption;
Transmitting element, for to compress at described compress-encrypt processing unit and after the data be drawn into described in encrypting, send the data after described compress-encrypt to central server, the data after described compress-encrypt are received to make described central server, and the data after the described compress-encrypt that decompresses, mission bit stream is merged, by the data composite shipment after decompression in data warehouse according to described data.
11. remote agent servers according to claim 10, is characterized in that, also comprise:
Conversion cleaning processing unit, for compressing at described compress-encrypt processing unit and changing before the data be drawn into described in encrypting and the data be drawn into described in cleaning.
12. remote agent servers according to claim 10 or 11, is characterized in that, also comprise:
Data markers unit, for when described data pick-up unit extracted data, flag data extracts position.
13. 1 kinds of multi-server Distributed data handling systems, is characterized in that, comprising:
Central server, remote agent server and database server, described remote agent server has multiple, and the data interaction between described central server and each remote agent server is unrelated;
Central server reads after the data pick-up mission bit stream of remote agent server information and described remote agent server and data merge mission bit stream, send described data pick-up mission bit stream to described remote agent server, in described data pick-up mission bit stream, carry the database server address requiring the data place extracted;
Remote agent server receives described data pick-up mission bit stream, the database server address requiring the data place extracted is carried in described data pick-up mission bit stream, connect according to described database server address and described database server, the data required in described data pick-up mission bit stream are extracted from described database server, to the described data compression that is drawn into and encryption, send the data after described compress-encrypt to central server;
Described central server receives the data after described compress-encrypt, and the data after the described compress-encrypt that decompresses, merge mission bit stream according to described data, by the data composite shipment after decompression in data warehouse.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110334695.3A CN102497353B (en) | 2011-10-28 | 2011-10-28 | Multi-server distributed data processing method, server and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110334695.3A CN102497353B (en) | 2011-10-28 | 2011-10-28 | Multi-server distributed data processing method, server and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102497353A CN102497353A (en) | 2012-06-13 |
| CN102497353B true CN102497353B (en) | 2015-08-26 |
Family
ID=46189139
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110334695.3A Expired - Fee Related CN102497353B (en) | 2011-10-28 | 2011-10-28 | Multi-server distributed data processing method, server and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102497353B (en) |
Families Citing this family (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103902585A (en) * | 2012-12-27 | 2014-07-02 | 中国移动通信集团公司 | Data loading method and system |
| CN104468670B (en) * | 2013-09-23 | 2018-10-23 | 深圳市腾讯计算机系统有限公司 | A kind of method, apparatus and distributed disaster recovery method, system of processing management data |
| CN103678488B (en) * | 2013-11-12 | 2015-03-04 | 德比软件(上海)有限公司 | Distributed mass dynamic task engine and method for processing data with same |
| CN105446653B (en) * | 2014-08-27 | 2018-12-14 | 阿里巴巴集团控股有限公司 | A kind of data merging method and equipment |
| CN104317928A (en) * | 2014-10-31 | 2015-01-28 | 北京思特奇信息技术股份有限公司 | Service ETL (extraction-transformation-loading) method and service ETL system both based on distributed database |
| CN104392132B (en) * | 2014-11-24 | 2019-11-12 | 深圳市第二人民医院 | A medical data storage system based on cloud computing |
| CN104461761B (en) * | 2014-12-08 | 2017-11-21 | 北京奇虎科技有限公司 | Data verification method, device and server |
| CN106557469B (en) * | 2015-09-24 | 2020-11-20 | 创新先进技术有限公司 | Method and device for processing data in data warehouse |
| CN107295036B (en) * | 2016-03-31 | 2021-02-23 | 华为技术有限公司 | Data sending method and data merging equipment |
| CN108572845B (en) * | 2018-03-15 | 2022-05-31 | 华为技术有限公司 | Upgrade method and related system of distributed microservice cluster |
| CN110995730B (en) * | 2019-12-11 | 2022-07-05 | 成都知道创宇信息技术有限公司 | Data transmission method and device, proxy server and proxy server cluster |
| CN115408478B (en) * | 2022-09-02 | 2023-03-21 | 西湖大学 | A data storage and management system and method for sharing experimental instruments |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101105793A (en) * | 2006-07-11 | 2008-01-16 | 阿里巴巴公司 | Data processing method and system of data library |
| CN101163024A (en) * | 2006-10-12 | 2008-04-16 | 国际商业机器公司 | Method and device of performing concurrent operation to a plurality of network servers |
| CN101621529A (en) * | 2008-06-30 | 2010-01-06 | 上海全成通信技术有限公司 | High-efficient and low-cost loading method for heterogeneous mass data |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7941398B2 (en) * | 2007-09-26 | 2011-05-10 | Pentaho Corporation | Autopropagation of business intelligence metadata |
-
2011
- 2011-10-28 CN CN201110334695.3A patent/CN102497353B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101105793A (en) * | 2006-07-11 | 2008-01-16 | 阿里巴巴公司 | Data processing method and system of data library |
| CN101163024A (en) * | 2006-10-12 | 2008-04-16 | 国际商业机器公司 | Method and device of performing concurrent operation to a plurality of network servers |
| CN101621529A (en) * | 2008-06-30 | 2010-01-06 | 上海全成通信技术有限公司 | High-efficient and low-cost loading method for heterogeneous mass data |
Non-Patent Citations (1)
| Title |
|---|
| 《基于多Agent与工作流的分布式ETL引擎的研究》;丁进等;《计算机应用》;20090131;第29卷(第1期);第2页-第4页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102497353A (en) | 2012-06-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102497353B (en) | Multi-server distributed data processing method, server and system | |
| CN109343963B (en) | Application access method and device for container cluster and related equipment | |
| CN107391629B (en) | Method, system, server and computer storage medium for data migration between clusters | |
| KR102851373B1 (en) | Network storage gateway | |
| CN102523314A (en) | Identifying an efficient destination server | |
| KR102445290B1 (en) | Information processing method, apparatus, device, and readable storage medium | |
| CN113209633A (en) | Mirror image processing method and device, electronic equipment and readable storage medium | |
| CN102123279A (en) | Distributed real-time transcoding method and system | |
| CN103731448A (en) | Method and system for compressing picture | |
| CN112804312B (en) | File uploading method, equipment and computer readable medium | |
| US11178197B2 (en) | Idempotent processing of data streams | |
| CN109634912B (en) | Data migration method and system | |
| CN109889588B (en) | File acquisition method and device, computer equipment and storage medium | |
| CN106170968A (en) | A kind of data compression storage method, device, and distributed file system | |
| CN111111214A (en) | Game archive processing method, device and system | |
| CN101673217B (en) | Method for realizing remote program call and system thereof | |
| CN105162837A (en) | Method and system for improving I/O throughput rate in massive data storage environment | |
| US20120260050A1 (en) | Data storage resource management systems and methods | |
| CN105279020A (en) | Task scheduling method and system | |
| CN102419753A (en) | Information processing apparatus, information processing method, and information processing system | |
| US20120324560A1 (en) | Token data operations | |
| US20200387412A1 (en) | Method To Manage Database | |
| US20090259675A1 (en) | Remote differential compression applied to storage | |
| CN111090530B (en) | A distributed cross-process communication bus system | |
| CN104077374A (en) | Method and device for achieving internet protocol (IP) disk file storage |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| ASS | Succession or assignment of patent right |
Owner name: SHENZHEN 7ROAD NETWORK TECHNOLOGY CO., LTD. Free format text: FORMER OWNER: SHENZHEN 7ROAD TECHNOLOGY CO., LTD. Effective date: 20120828 |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| COR | Change of bibliographic data |
Free format text: CORRECT: ADDRESS; FROM: 518000 SHENZHEN, GUANGDONG PROVINCE TO: 518057 SHENZHEN, GUANGDONG PROVINCE |
|
| TA01 | Transfer of patent application right |
Effective date of registration: 20120828 Address after: Nanshan District Shenzhen City, Guangdong province 518057 Shennan Road No. 9996 building, 7 storey main building height of song Applicant after: SHENZHEN 7ROAD NETWORK TECHNOLOGY CO.,LTD. Address before: Shenzhen City, Guangdong Province, 518000 Shennan Road No. 9996, building 7-9, golden song Applicant before: Shenzhen 7road Technology Co.,Ltd. |
|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C41 | Transfer of patent application or patent right or utility model | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20161020 Address after: Unit B2-B5 16 building 518000 Guangdong city of Shenzhen province Nanshan District high in the four EVOC Technology Building No. 31 Patentee after: SHENZHEN 7ROAD TECHNOLOGY Co.,Ltd. Address before: Nanshan District Shenzhen City, Guangdong province 518057 Shennan Road No. 9996 building, 7 storey main building height of song Patentee before: SHENZHEN 7ROAD NETWORK TECHNOLOGY CO.,LTD. |
|
| C56 | Change in the name or address of the patentee | ||
| CP02 | Change in the address of a patent holder |
Address after: Nanshan District Keyuan Road Shenzhen city Guangdong province 518057 No. 15 Kexing Science Park Building 2 unit A 17 Patentee after: SHENZHEN 7ROAD TECHNOLOGY Co.,Ltd. Address before: Unit B2-B5 16 building 518000 Guangdong city of Shenzhen province Nanshan District high in the four EVOC Technology Building No. 31 Patentee before: Shenzhen 7road Technology Co.,Ltd. |
|
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20180425 Address after: 518052 Room 201, building A, No. 1, Qian Wan Road, Qianhai Shenzhen Hong Kong cooperation zone, Shenzhen, Guangdong (Shenzhen Qianhai business secretary Co., Ltd.) Patentee after: Shenzhen Qianhai illusion Network Technology Co.,Ltd. Address before: 518057, 17 unit, 2 unit, A building, Kexing Science Park, 15 Keyuan Road, Nanshan District, Shenzhen, Guangdong. Patentee before: Shenzhen 7road Technology Co.,Ltd. |
|
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20150826 |