CN101004743B - Distributed document conversion system and method - Google Patents
Distributed document conversion system and method Download PDFInfo
- Publication number
- CN101004743B CN101004743B CN200610033196A CN200610033196A CN101004743B CN 101004743 B CN101004743 B CN 101004743B CN 200610033196 A CN200610033196 A CN 200610033196A CN 200610033196 A CN200610033196 A CN 200610033196A CN 101004743 B CN101004743 B CN 101004743B
- Authority
- CN
- China
- Prior art keywords
- task
- server
- completed
- document processing
- document
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Computer And Data Communications (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
A method for converting distributed file includes receiving task request sent by service system and converting said request to be task being added into system queue to be processed, indexing out available file processing server in low load and distributing task to said file processing server for carrying out treatment on said task there.
Description
[technical field]
The present invention relates to a kind of file conversion system and method, particularly a kind of distribution type file conversion system and method.
[background technology]
Along with the generation of computing machine, the operation processing mode of many business all is transformed into and operates operation on the computing machine.The professional processing that generally all can relate to document of Computer Processing, for example, report generation, document conversion, forms printing etc.The process of these document process is generally transferred to server and is finished, therefore, can the stability of server process document process and efficient will directly have influence on normally moving of system, if system handles document calculations complexity particularly, frequency height, when huge the and client of quantity needed response fast, the load of separate unit server was just too heavy, and the performance of processing can not satisfy the demands far away.
General document conversion method is so at present.For example, the contract administration system need change a large amount of contract documents every day, transfer process is that at first user end to server sends conversion request, server will specify the content of contract to take out from internal memory after receiving request, with its format and be saved as document, at last the document is converted to the file type that the user needs then.Such processing procedure is complicated, and system resources consumption is more, and to send the request average waiting response time simultaneously long when multi-client, in case and Transformation Service make mistakes, system can't normally use, thereby restrict the many parts of performances that the contract document is changed simultaneously.
[summary of the invention]
In view of above content, be necessary to provide a kind of distribution type file conversion system, it can distribute to the task requests of client different document process servers, to reduce the workload of separate unit server, improves the task treatment effeciency of server integral body.
In addition, also be necessary to provide a kind of distribution type file conversion method, it can distribute to the task requests of client different document process servers, to reduce the workload of separate unit server, improves the task treatment effeciency of server integral body.
A kind of distribution type file conversion system, it runs in the document process control center server, to distributing from the task requests of client in the operation system and carrying out parallel processing.The document processing controls central server links to each other with operation system and many document process servers.This distribution type file conversion system comprises: the task receiver module is used to receive the task requests that operation system sends, and is converted into task; The task judge module is used for judging whether the pending formation of this system exists this task, judges system has finished whether there is this task in the cache set; The task management module is used for having finished when all having this task in the cache set when the pending formation of system and system, adds described task to the pending formation of system; The retrieval server module is used to retrieve the minimum and available document process server of charge capacity; The Task Distribution module is used for giving described charge capacity minimum and available document process server in the Task Distribution of the pending formation of system.
Further, described distribution type file conversion system also comprises the task notification module, is used for the informing business system task and awaits orders or finish.
Further, the described task receiver module task of also being used to receive the document process server is finished information.
Further, described task management module also is used for adding task to system have been finished set and it has been issued operation system, simultaneously task is deleted from the pending formation of system, and interpolation task to system finishes in the cache set.
A kind of distribution type file conversion method, it runs in the document process control center server, to distributing from the task requests of client in the operation system and carrying out parallel processing.The document processing controls central server links to each other with operation system and many document process servers.This method comprises the steps: the task requests that (a) system that accepts business sends, and is converted into task; (b) judge in the pending formation of system whether have this task; (c) if had this task in the pending formation of system, then the informing business system task is awaited orders; (d) if do not have this task in the pending formation of system, then add task to the pending formation of system; (e) retrieve the minimum and available document process server of charge capacity, and give the document processing server Task Distribution; (f) this task of document process server process.
Further, this method also comprises step: judge (g) whether the task processing completes successfully; (h), then turn back to the step of the minimum and available document process server of retrieval charge capacity if do not complete successfully; (i) if complete successfully, then add task to system and finished set and it is issued operation system, simultaneously task is removed from the pending formation of system; (j) interpolation task to system has finished cache set; (k) the informing business system task is finished.
Compared to prior art, the request task that the processing client that described distribution type file conversion system and method adopt multiple servers to walk abreast sends, improved the efficient of system handles document, and when certain station server is made mistakes, system can carry out to other server the Task Distribution of makeing mistakes, thereby has improved the stability of system.
[description of drawings]
Fig. 1 is the hardware frame figure of the preferred embodiment of distribution type file conversion system of the present invention.
Fig. 2 is the functional block diagram of distribution type file conversion system of the present invention.
Fig. 3 is the process flow diagram of the preferred embodiment of distribution type file conversion method of the present invention.
[embodiment]
As shown in Figure 1, be the hardware frame figure of the preferred embodiment of distribution type file conversion system of the present invention.The hardware frame of this preferred embodiment mainly comprises client 10, operation system 20, document process control center server 30, and a plurality of document process server 40.This distribution type file conversion system 100 runs in the document processing controls central server 30, is used to receive the document convert task request of client 10 and it is distributed to each document process server 40, comes the task requests of parallel processing client 10.This distribution type file conversion system 100 comprises a plurality of functional modules, sees Fig. 2 description for details.
As shown in Figure 2, be the functional block diagram of distribution type file conversion system of the present invention.This distribution type file conversion system 100 comprises task receiver module 110, task judge module 120, task management module 130, retrieval server module 140, Task Distribution module 150, and task notification module 160.
Described task receiver module 110 is used to receive the document convert task request that operation system 20 sends and is converted into task, and the task of receiving document process server 40 is finished information.
Described task judge module 120 is used for judging whether the pending formation of system exists this task, judges system has finished whether there is this task in the cache set.In this preferred embodiment, described system has finished cache set and has been used for placing and finishes the task of (in 2 minutes) recently, and the system that enters has finished task in the cache set and finished in this system that to deposit certain hour (such as 2 minutes) back in the cache set just deleted.
Described task management module 130 is used for the interpolation task to the pending formation of system, adding task to system has finished in the set and with it and has issued operation system, simultaneously task is deleted from the pending formation of system, interpolation task to system finishes in the cache set.In this preferred embodiment, described system has finished set and has been used to place all completed tasks, all tasks that supervisory system is finished dealing with.After a certain task is finished, the system that is put into has finished in the set with this task earlier, and task deleted from the pending formation of system, finished from system then and added this task to system the set and finished in the cache set, this task system finished treat in the cache set as 2 minutes will be deleted, when operation system 20 is sent the task requests of same task in 2 minutes, task judge module 120 will be judged this task and be present in system and finish in the cache set, has finished in the set and with it and issues operation system 20 so just this task has been finished the system that copies to the cache set from system.
Described retrieval server module 140 is used to retrieve the minimum and available document process server 40 of charge capacity.Details are as follows for the minimum also available document process server 40 of described retrieval charge capacity: before document process server 40 Processing tasks, document process server 40 is initialized as zero with its task average handling time, behind the document processing server 40 beginning Processing tasks, the document processing server 40 upgrades its task average handling time according to T.T. of its Processing tasks divided by the task sum of its processing; Retrieval server module 140 is obtained the task average handling time of each document process server 40 and pending number of tasks, calculates the charge capacity of each document process server 40 according to this task average handling time and this pending number of tasks.In this preferred embodiment, system can be every document process server 40 of regular hour (such as 2 seconds) retrieval.
Described Task Distribution module 150 is used for charge capacity minimum and available document process server 40 that the pending formation of system is just waiting pending Task Distribution to be retrieved for retrieval server module 140 are handled.
Described task notification module 160 is used for informing business system 20 tasks and awaits orders or finish.Judge in the task receiver module 110 task pending formation of system Already in converted according to its task requests of accepting when task judge module 120, task notification module 160 informing business systems 20 tasks are awaited orders.After task management module 130 was added into task system and has finished in the cache set, task notification module 160 informing business systems 20 tasks were finished.
By above-mentioned distribution type file conversion system 100, as described below to the method that distribution type file is changed.
In present embodiment, at first, the task requests that task receiver module 110 reception operation systems 20 send over also is converted into task; Then, task judge module 120 judges in the pending formation of system whether have this task; If do not have this task in the pending formation of system, task judge module 120 judges system has finished whether there is this task in the buffer memory again; If system has finished and also do not had this task in the buffer memory, task management module 130 is added into the pending formation of system with this task; Then, the minimum and available document process server 40 of retrieval server module 140 retrieval charge capacity, Task Distribution module 150 will just wait pending Task Distribution to handle to this document process server that retrieves 40 in the pending formation of system; Then, document process server 40 begins to create new thread and handles this task, after finishing dealing with, the information of finishing dealing with is returned to task receiver module 110; Task receiver module 110 tasks of receiving are finished dealing with after the information, task management module 130 is added this task to system and has been finished in the set and with it and issue operation system 20, simultaneously task is deleted from the pending formation of system, again this task is added into system and has finished in the cache set; At last, task notification module 160 informing business system tasks are finished.
As shown in Figure 3, be the process flow diagram of the preferred embodiment of distribution type file conversion method of the present invention.At first, step S11, operation system 20 receives client 10 document convert task requests, and sends this task requests to distribution type file conversion system 100.
Step S12, task receiver module 110 receives the task requests that operation system 20 sends, and is converted into task.
Step S13, task judge module 120 judge in the pending formation of system whether have this task.In this preferred embodiment, the pending formation of system is used to place waits for the task that document process server 40 is handled that is assigned to, and task is assigned with according to the first in first out wait in the pending formation of this system.
Step S14, if there is this task in the pending formation of system, task notification module 160 informing business systems 20 these tasks are awaited orders, and promptly this task is in the pending formation of system, wait for and distribute to document process server 40 or just processing in document process server 40.
Step S15, if do not have this task in the pending formation of system, task judge module 120 continues to judge system has finished whether there is this task in the cache set.In this preferred embodiment, described system has finished cache set and has been used for placing and finishes the task of (in 2 minutes) recently, and the task that the system that enters has finished buffer memory has finished in this system that to deposit certain hour (such as 2 minutes) back in the cache set just deleted.
Step S16, if system has finished and do not had this task in the cache set, task management module 130 is added this task to the pending formation of system.
There is this task in step S17 if system has finished in the cache set, this task has been finished the system that copies to the cache set from system finished in the set and with it and issue operation system 20, forwards step S23 then to.
Step S18, the minimum and available document process server 40 of retrieval server module 140 retrieval charge capacity, Task Distribution module 150 is just waiting pending Task Distribution to this document process server 40 that retrieves in the pending formation of system.
Step S19, document process server 40 is handled this task.
Step S20, document process server 40 judge whether successful this task is handled.If task is finished dealing with and is handled successfully with regard to the expression task; Interrupting just expression if the task processing is not finished handles unsuccessful.
Step S21, if this task handles successfully, task management module 130 is added this task to system and is finished in the set, and task is deleted from the pending formation of system.In this preferred embodiment, described system has finished set and has been used to place all completed tasks, all tasks that supervisory system is finished dealing with.
Step S22, task management module 130 is added this task to system and is finished in the cache set.
Step S23, task notification module 160 informing business systems 20 tasks are finished.
In step S20, unsuccessful if this task is handled, then be back to step S18.
Claims (9)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200610033196A CN101004743B (en) | 2006-01-21 | 2006-01-21 | Distributed document conversion system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200610033196A CN101004743B (en) | 2006-01-21 | 2006-01-21 | Distributed document conversion system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101004743A CN101004743A (en) | 2007-07-25 |
| CN101004743B true CN101004743B (en) | 2010-05-26 |
Family
ID=38703888
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200610033196A Expired - Fee Related CN101004743B (en) | 2006-01-21 | 2006-01-21 | Distributed document conversion system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101004743B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102567106A (en) * | 2010-12-30 | 2012-07-11 | 中国移动通信集团云南有限公司 | Task scheduling method, system and device |
| WO2017092660A1 (en) * | 2015-12-01 | 2017-06-08 | International Business Machines Corporation | Vehicle domain multi-level parallel buffering and context-based streaming data pre-processing system |
Families Citing this family (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101226557B (en) * | 2008-02-22 | 2010-07-14 | 中国科学院软件研究所 | An Efficient Data Processing Method for Linked Topic Model |
| EP2338112B1 (en) * | 2008-10-15 | 2015-10-14 | Oracle International Corporation | Batch processing system |
| CN101551898B (en) * | 2009-05-08 | 2012-12-26 | 北京锐安科技有限公司 | A distributed image processing method and system |
| CN102117437A (en) * | 2009-12-31 | 2011-07-06 | 鸿富锦精密工业(深圳)有限公司 | Distributed electronic sing-off realization system and method |
| CN102387136A (en) * | 2011-10-10 | 2012-03-21 | 深圳中兴网信科技有限公司 | System and method for converting distributed PPT (Power Point) files into swf (small web format) files |
| CN105095299A (en) * | 2014-05-16 | 2015-11-25 | 北京奇虎科技有限公司 | Picture capturing method and system |
| CN104408068A (en) * | 2014-10-29 | 2015-03-11 | 中国建设银行股份有限公司 | Report form data processing method and related equipment |
| CN105824699A (en) * | 2015-01-06 | 2016-08-03 | 中国移动通信集团山东有限公司 | Distributed task scheduling apparatus and method |
| CN104536827B (en) * | 2015-01-27 | 2019-05-28 | 浪潮(北京)电子信息产业有限公司 | A kind of data dispatching method and device |
| CN105589957A (en) * | 2015-12-22 | 2016-05-18 | 新浪网技术(中国)有限公司 | Document conversion method and document conversion system |
| CN106599259B (en) * | 2016-12-21 | 2021-01-01 | 江苏省连云港工贸高等职业技术学校 | System for quickly accessing SQL database |
| CN109800120B (en) * | 2017-11-17 | 2020-12-08 | 鹰硕(韶关)信息产业集团有限公司 | Monitoring system of server group of remote education system |
| CN109286665B (en) * | 2018-09-17 | 2021-04-20 | 北京龙拳风暴科技有限公司 | Real-time mobile game long link processing method and device |
| CN109635652A (en) * | 2018-11-08 | 2019-04-16 | 杭州火视科技有限公司 | Distributed face characteristic extraction system based on embedded device |
| CN113364852B (en) * | 2021-06-02 | 2023-04-07 | 中国工商银行股份有限公司 | File transmission method and device and server |
| CN115145707A (en) * | 2022-07-14 | 2022-10-04 | 中国电子技术标准化研究院 | High-performance and load-balancing document format conversion method |
| CN116932502B (en) * | 2023-07-14 | 2024-04-05 | 广州东瑞科技有限公司 | Distributed medical record document generation method, system, computer equipment and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1184977A (en) * | 1996-12-07 | 1998-06-17 | 国际商业机器公司 | High-availability computer server system |
| US5887168A (en) * | 1994-12-30 | 1999-03-23 | International Business Machines Corporation | Computer program product for a shared queue structure for data integrity |
| US6393458B1 (en) * | 1999-01-28 | 2002-05-21 | Genrad, Inc. | Method and apparatus for load balancing in a distributed object architecture |
-
2006
- 2006-01-21 CN CN200610033196A patent/CN101004743B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5887168A (en) * | 1994-12-30 | 1999-03-23 | International Business Machines Corporation | Computer program product for a shared queue structure for data integrity |
| CN1184977A (en) * | 1996-12-07 | 1998-06-17 | 国际商业机器公司 | High-availability computer server system |
| US6393458B1 (en) * | 1999-01-28 | 2002-05-21 | Genrad, Inc. | Method and apparatus for load balancing in a distributed object architecture |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102567106A (en) * | 2010-12-30 | 2012-07-11 | 中国移动通信集团云南有限公司 | Task scheduling method, system and device |
| CN102567106B (en) * | 2010-12-30 | 2014-10-01 | 中国移动通信集团云南有限公司 | Task scheduling method, system and device |
| WO2017092660A1 (en) * | 2015-12-01 | 2017-06-08 | International Business Machines Corporation | Vehicle domain multi-level parallel buffering and context-based streaming data pre-processing system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101004743A (en) | 2007-07-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101004743B (en) | Distributed document conversion system and method | |
| TWI298129B (en) | System and method for processing files distributively | |
| US9183271B2 (en) | Big-fast data connector between in-memory database system and data warehouse system | |
| CN103106249A (en) | Data parallel processing system based on Cassandra | |
| CN102299959A (en) | Load balance realizing method of database cluster system and device | |
| CN103338252B (en) | Realizing method of distributed database concurrence storage virtual request mechanism | |
| CN102859961B (en) | There is the distributed video transcoding system of adaptive file process | |
| CN106170016A (en) | A kind of method and system processing high concurrent data requests | |
| US20110286037A1 (en) | Cloud computing system, document processing method, and storage medium | |
| CN105005611B (en) | A kind of file management system and file management method | |
| CN112520284B (en) | Goods shelf storage position adjusting method and system | |
| CN106777311B (en) | Flight space state caching method and system | |
| CN108900626A (en) | Date storage method, apparatus and system under a kind of cloud environment | |
| JP2011076371A (en) | Job processing system, and method and program for the same | |
| JP4000223B2 (en) | Information search method, information search system, and search management apparatus for the system | |
| CN106302647B (en) | Message distribution method and server | |
| CN108984571A (en) | Transaction Identifier operating method, system and computer readable storage medium | |
| CN102982116A (en) | Multi-media transfer method and system based on cloud | |
| CN112597173A (en) | Distributed database cluster system peer-to-peer processing system and processing method | |
| CN105872856A (en) | Method and system for distributing stream media files | |
| CN104052677A (en) | Soft load balancing method and apparatus of single data source | |
| CN108228327A (en) | A kind for the treatment of method and apparatus of task | |
| CN118467187B (en) | Distributed cluster data production system | |
| CN111401752A (en) | Flywheel energy storage frequency modulation sharing processing method, device and system and electronic equipment | |
| CN101873342A (en) | Data access method, data access system and disk array storage system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20100526 Termination date: 20150121 |
|
| EXPY | Termination of patent right or utility model |