CN110134739A - Flow path processing method, system, equipment and computer storage medium are write in a kind of mixing - Google Patents
Flow path processing method, system, equipment and computer storage medium are write in a kind of mixing Download PDFInfo
- Publication number
- CN110134739A CN110134739A CN201910434306.0A CN201910434306A CN110134739A CN 110134739 A CN110134739 A CN 110134739A CN 201910434306 A CN201910434306 A CN 201910434306A CN 110134739 A CN110134739 A CN 110134739A
- Authority
- CN
- China
- Prior art keywords
- write
- mixing
- writes
- deferred
- disk
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Computing Systems (AREA)
- Data Mining & Analysis (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
This application discloses it is a kind of mixing write flow path processing method, system, equipment and computer storage medium, be applied to distributed sha red memory system, this method comprises: judge it is received write process whether be mix write process；If so, process is write in mixing is split as that simple write writes process and deferred write writes process；Process is write to simple write in a parallel fashion and deferred write writes process and handles.Flow path processing method is write in a kind of mixing provided by the present application, writes process to simple write in a parallel fashion and deferred write writes process and handles, improve treatment effeciency.A kind of mixing provided by the present application writes flow processing system, equipment and computer readable storage medium and also solves the problems, such as relevant art.
Description
Technical field
This application involves Distributed sharing technical field of memory, write flow processing side more specifically to a kind of mixing
Method, system, equipment and computer storage medium.
Background technique
With the fast development of cloud computing technology, industry to the performance of distributed sha red memory system and safety increasingly
Concern, in the process, devises and writes process based on the engine framework that is locally stored of Self management raw device to handle.
However, being that (that newly writes/be aligned write field scape writes behaviour comprising simple write when writing process when process is write in processing
Make) when writing process with the mixing of deferred write (write operation for needing record log scene), it is general using first handling
The serial processing mode of simple write, post-processing deferred write write process to handle mixing, so that distribution
It is lower that formula shared memory systems carry out the efficiency that mixing is write.
In conclusion how to improve distributed sha red memory system to carry out the efficiency that mixing is write is current those skilled in the art
Member's urgent problem to be solved.
Summary of the invention
The purpose of the application is to provide a kind of mix and writes flow path processing method, can solve how to improve to a certain extent
Distributed sha red memory system carries out the technical issues of efficiency that mixing is write.Present invention also provides a kind of mixing to write flow processing
System, equipment and computer readable storage medium.
To achieve the goals above, the application provides the following technical solutions:
Flow path processing method is write in a kind of mixing, is applied to distributed sha red memory system, comprising:
Judge it is received write process whether be mixing write process；
If so, process is write in the mixing is split as that simple write writes process and deferred write writes stream
Journey；
Process is write to the simple write in a parallel fashion and the deferred write writes process and handles.
Preferably, described process to be write to the simple write in a parallel fashion and the deferred write writes stream
Cheng Jinhang processing, comprising:
The simple write IO write request for writing process is committed to disk, so that the disk is by the simple
Itself is written in the first data that write writes process；
And during the IO write request that the simple write is write process is committed to disk, read from the disk
It takes the deferred write to write the second data that process to be covered, submits second data, the second metadata, second day
Will and total metadata are to k/v database, so that the disk is written in second log by the k/v database；
Wherein, second metadata indicates that the deferred write writes the metadata that process stored originally；It is described
Second log indicates that the deferred write writes the log of process data to be written；Described in total metadata expression
Simple write writes process and the deferred write writes process total metadata to be stored.
Preferably, the simple write is write the first data write-in of process behind by the disk, further includes:
The first call back function is executed by total metadata cache to the k/v database；
Second log is written after disk the k/v database, further includes:
It executes the second call back function and deletes second data, second metadata and institute in the k/v database
State the second log.
Preferably, further includes:
The deferred write is submitted to write the I/O request of process to k/v database；
Judge whether first data are all written the disk, if so, returning to the information that mixing write operation is completed
To upper layer.
It is preferably, described to judge received to write whether process is after process is write in mixing, further includes:
If the process of writing is that single simple write writes process, the simple write is write to the IO of process
Write request is committed to disk；
Behind the first data write-in certainly that the simple write is write process by the disk, the first readjustment letter is executed
The simple write is write total metadata cache of process to k/v database by number；
Information that simple write write operation is completed is returned to upper layer.
It is preferably, described to judge received to write whether process is after process is write in mixing, further includes:
If the process of writing is that single deferred write writes process, the deferred write is write into process
Total metadata and corresponding third log buffer to k/v database；
Information that deferred write write operation is completed is returned to upper layer；
After disk is written in the third log, execution third call back function is deleted described in the k/v database
Third log.
Preferably, it is described judge it is received write process whether be mixing write process, comprising:
Judge it is received write whether carried in process the simple write write process first label and it is described
Deferred write writes the second label of process；
If described write carries first label and second label in process, process is write as mixing described in judgement
Write process.
Flow processing system is write in a kind of mixing, is applied to distributed sha red memory system, comprising:
First judgment module, for judge it is received write process whether be mixing write process；
First splits module, is when mixing to write process, process to be write in the mixing and is split as the process of writing
Simple write writes process and deferred write writes process；
First processing module, for writing process and the deferred to the simple write in a parallel fashion
Write writes process and is handled.
Flow processing equipment is write in a kind of mixing, is applied to distributed sha red memory system, comprising:
Memory, for storing computer program；
Processor realizes that as above flow path processing method is write in any mixing when for executing the computer program
Step.
A kind of computer readable storage medium is applied to distributed sha red memory system, the computer-readable storage medium
It is stored with computer program in matter, realizes that as above process is write in any mixing when the computer program is executed by processor
The step of processing method.
Flow path processing method is write in a kind of mixing provided by the present application, is applied to distributed sha red memory system, judges to receive
Write process whether be mixing write process；If so, by mixing write process be split as simple write write process and
Deferred write writes process；Process is write to simple write in a parallel fashion and deferred write writes process and carries out
Processing.It is provided by the present application it is a kind of mixing write flow path processing method, determine it is received write process for mixing write process after, will mix
Conjunction writes process and is split as that simple write writes process and deferred write writes process, and in a parallel fashion to simple
Write writes process and deferred write writes process and handled, also can simultaneously to simple write write process and
Deferred write writes process and is handled, and writes process and deferred with existing serial mode processing simple write
Write writes process and compares, and improves treatment effeciency.Flow processing system, equipment and calculating are write in a kind of mixing provided by the present application
Machine readable storage medium storing program for executing also solves the problems, such as relevant art.
Detailed description of the invention
In order to illustrate the technical solutions in the embodiments of the present application or in the prior art more clearly, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
The embodiment of application for those of ordinary skill in the art without creative efforts, can also basis
The attached drawing of offer obtains other attached drawings.
Fig. 1 is the first pass figure that flow path processing method is write in a kind of mixing provided by the embodiments of the present application；
Fig. 2 is the second flow chart that flow path processing method is write in a kind of mixing provided by the embodiments of the present application；
Fig. 3 is the first structure diagram that flow processing system is write in a kind of mixing provided by the embodiments of the present application；
Fig. 4 is the structural schematic diagram that flow processing equipment is write in a kind of mixing provided by the embodiments of the present application；
Fig. 5 is another structural schematic diagram that flow processing equipment is write in a kind of mixing provided by the embodiments of the present application.
Specific embodiment
Below in conjunction with the attached drawing in the embodiment of the present application, technical solutions in the embodiments of the present application carries out clear, complete
Site preparation description, it is clear that described embodiments are only a part of embodiments of the present application, instead of all the embodiments.It is based on
Embodiment in the application, it is obtained by those of ordinary skill in the art without making creative efforts every other
Embodiment shall fall in the protection scope of this application.
With the fast development of cloud computing technology, industry to the performance of distributed sha red memory system and safety increasingly
Concern, in the process, devises and writes process based on the engine framework that is locally stored of Self management raw device to handle.However,
It is comprising simple write (write operation for newly writing/being aligned write field scape) and deferred when writing process when process is write in processing
It is general using simple write is first handled when process is write in the mixing of write (write operation for needing record log scene), locate afterwards
The serial processing mode of reason deferred write writes process to handle mixing, so that distributed sha red memory system carries out
It is lower to mix the efficiency write.A kind of mixing provided by the present application writes flow path processing method and distributed sha red memory system can be improved
Carry out the efficiency that mixing is write.
Referring to Fig. 1, Fig. 1 is the first pass figure that flow path processing method is write in a kind of mixing provided by the embodiments of the present application.
Flow path processing method is write in a kind of mixing provided by the embodiments of the present application, is applied to distributed sha red memory system, can
With the following steps are included:
Step S101: judge it is received write process whether be mixing write process, if so, thening follow the steps S102.
In practical application, distributed sha red memory system receive write process when, first judge received whether write process
Process is write for mixing, namely judges received to write whether process is that simple write writes process and deferred write writes stream
Process is write in the mixing of journey, it can be appreciated that writing with mixing, process is corresponding just to write process or list for single simple write
One deferred write writes process.
Whether in concrete application scene, can write to carry to mark accordingly to judge to write process in process by judgement is
It is no to write process for mixing, then judge it is received write process whether be mixing write the process of process can be with specifically: judge received
Write whether carried in process simple write write process first label and deferred write write process second mark
Note；If writing and carrying the first label and the second label in process, judgement writes process and writes process for mixing.Specifically, can be with
Setting, which indicates to write process, writes the single labelled of process as mixing, in this way, distributed sha red memory system is determining to write in process to wrap
When single labelled containing this, just determine that this is write process and writes process for mixing.
In practical application, distributed sha red memory system judge it is received write process whether be mixing write process after, also
It can perform the following operations: if writing process is that single simple write writes process, simple write being write into process
IO write request is committed to disk；Behind the first data write-in certainly that simple write is write process by disk, execute first time
Simple write is write total metadata cache of process to k/v database (non-relational database) by letter of transfer number；It returns
The information that simple write write operation is completed is to upper layer.
In practical application, distributed sha red memory system judge it is received write process whether be mixing write process after, also
It can perform the following operations: if writing process is that single deferred write writes process, deferred write being write into stream
Total metadata of journey and corresponding third log buffer are to k/v database；Return to the letter that deferred write write operation is completed
It ceases to upper layer；After disk is written in third log, the third log in third call back function deletion k/v database is executed.
Step S102: process is write into mixing and is split as that simple write writes process and deferred write writes process.
In practical application, distributed sha red memory system can will mix after determining that writing process writes process for mixing
It writes process and is split as that simple write writes process and deferred write writes process.
Step S103: process is write to simple write in a parallel fashion and deferred write writes at process
Reason.
In practical application, distributed sha red memory system by mixing write process be split as simple write write process and
After deferred write writes process, process can be write to simple write in a parallel fashion and deferred write writes
Process is handled, and parallel namely meeting write process to simple write simultaneously and deferred write writes at process
Reason.
In concrete application scene, process write to simple write in a parallel fashion and deferred write write process into
The process of row processing can be with specifically: the simple write IO write request for writing process is committed to disk, so that disk will
Itself is written in the first data that simple write writes process；And it is committed in the IO write request that simple write is write to process
During disk, deferred write is read from disk and writes process the second data to be covered, submits the second data, second
Metadata, the second log and total metadata are to k/v database, so that disk is written in the second log by k/v database；Wherein,
Binary data indicates that deferred write writes the metadata that process stored originally；Second log indicates that deferred write writes
The log of process data to be written；Total metadata indicates that simple write writes process and deferred write writes process and waits depositing
Total metadata of storage.Disk involved in the application can be SSD (Solid State Disk, solid state hard disk), can also be with
For HDD (Hard Disk Drive, disc driver).
In concrete application scene, simple write is write the first data of process in disk by distributed sha red memory system
The first call back function can also be performed by total metadata cache to k/v database behind in write-in；Correspondingly, can also be in k/v
Database by the second log be written disk after, execute the second call back function delete k/v database in the second data, second yuan
Data and the second log.
In concrete application scene, for the completion of prior notice upper layer write operation, so that client prepares to write in advance next time
Operation, distributed sha red memory system can also submit deferred write to write the I/O request of process to k/v database, and sentence
Whether disconnected first metadata is all written disk, if so, returning to information that mixing write operation is completed to upper layer.
Flow path processing method is write in a kind of mixing provided by the present application, is applied to distributed sha red memory system, judges to receive
Write process whether be mixing write process；If so, by mixing write process be split as simple write write process and
Deferred write writes process；Process is write to simple write in a parallel fashion and deferred write writes process and carries out
Processing.It is provided by the present application it is a kind of mixing write flow path processing method, determine it is received write process for mixing write process after, will mix
Conjunction writes process and is split as that simple write writes process and deferred write writes process, and in a parallel fashion to simple
Write writes process and deferred write writes process and handled, also can simultaneously to simple write write process and
Deferred write writes process and is handled, and writes process and deferred with existing serial mode processing simple write
Write writes process and compares, and improves treatment effeciency.
Referring to Fig. 2, Fig. 2 is the second flow chart that flow path processing method is write in a kind of mixing provided by the embodiments of the present application.
In practical application, distributed sha red memory system may need to handle a series of processes of writing received,
Then flow path processing method is write in a kind of mixing provided by the embodiments of the present application may comprise steps of:
Step S201: judge it is received write process whether be mixing write process, if so, S202 is thened follow the steps, if it is not, then
Execute step S208.
Step S202: writing process for mixing and be split as that simple write writes process and deferred write writes process,
Execute step S203 and step S204.
Step S203: being committed to disk for the simple write IO write request for writing process, so that disk is by simple
Itself is written in the first data that write writes process；Execute total metadata that simple write is write process by the first call back function
It caches to k/v database.
Step S204: submission deferred write writes the I/O request of process to k/v database, so that k/v database is slow
The second data, the second log, the second metadata and total metadata are deposited, disk is written into the second log；Execute the second call back function
Delete the second data, the second metadata and the second log in k/v database.
Step S205: judge that simple write writes whether process is completed, if so, thening follow the steps S206.
Step S206: the information that return mixing write operation is completed to upper layer.
Step S207: judging that deferred write writes whether process is completed, if so, return step S201.
Step S208: judgement writes whether process is that single simple write writes process, if so, thening follow the steps
S209, if it is not, thening follow the steps S210.
Step S209: the simple write IO write request for writing process is committed to disk；In disk by simple
Write writes the first data write-in of process behind, executes the first call back function for total metadata cache to k/v database；It returns
Information that simple write write operation is completed is returned to upper layer；Return step S201.
Step S210: by the deferred write total metadata for writing process and third log buffer to k/v database；It returns
Information that deferred write write operation is completed is returned to upper layer；After disk is written in third log, executes third and adjust back letter
Number deletes the third log in k/v database；Return step S201.
Present invention also provides a kind of mixing to write flow processing system, with a kind of mixing provided by the embodiments of the present application
Write the correspondence effect that flow path processing method has.Referring to Fig. 3, Fig. 3 is that process is write in a kind of mixing provided by the embodiments of the present application
The first structure diagram of processing system.
Flow processing system is write in a kind of mixing provided by the embodiments of the present application, is applied to distributed sha red memory system, can
To include:
First judgment module 101, for judge it is received write process whether be mixing write process；
First splits module 102, when writing process for writing process for mixing, process is write in mixing and is split as simple
Write writes process and deferred write writes process；
First processing module 103, for writing process to simple write in a parallel fashion and deferred write writes
Process is handled.
Flow processing system is write in a kind of mixing provided by the embodiments of the present application, is applied to distributed sha red memory system, the
One processing module may include:
First processing units, the IO write request for simple write to be write to process are committed to disk, so that disk will
Itself is written in the first data that simple write writes process；
The second processing unit, during for being committed to disk in the IO write request that simple write is write to process from
Disk reads deferred write and writes process the second data to be covered, and submits the second data, the second metadata, the second log
With total metadata to k/v database so that k/v database by the second log be written disk；Wherein, the second metadata indicates
Deferred write writes the metadata that process stored originally；Second log indicates that deferred write writes process number to be written
According to log；Total metadata indicates that simple write writes process and deferred write writes process total first number to be stored
According to.
Flow processing system is write in a kind of mixing provided by the embodiments of the present application, is applied to distributed sha red memory system, also
May include:
First execution module, the first data write-in that simple write is write process for disk execute the behind
One call back function is by total metadata cache to k/v database；
Second execution module after disk is written in the second log for k/v database, executes the second call back function and deletes
The second data, the second metadata and the second log in k/v database.
Flow processing system is write in a kind of mixing provided by the embodiments of the present application, is applied to distributed sha red memory system, also
May include:
Second judgment module for submitting deferred write to write the I/O request of process to k/v database, and judges
Whether one data are all written disk, if so, returning to information that mixing write operation is completed to upper layer.
Flow processing system is write in a kind of mixing provided by the embodiments of the present application, is applied to distributed sha red memory system, also
May include:
First submit module, for first judgment module judge it is received write process whether be mix write process after, if
Writing process is that single simple write writes process, then the simple write IO write request for writing process is committed to disk；
Third execution module, for executing behind the first data write-in certainly that simple write is write process by disk
Simple write is write total metadata cache of process to k/v database by the first call back function；
First return module, for returning to the information of simple write write operation completion to upper layer.
Flow processing system is write in a kind of mixing provided by the embodiments of the present application, is applied to distributed sha red memory system, also
May include:
First cache module, for first judgment module judge it is received write process whether be mixing write process after, if
Writing process is that single deferred write writes process, then deferred write is write to the metadata and corresponding the of process
Three log buffers are to k/v database；
Second return module, for returning to the information of deferred write write operation completion to being upper layer；
4th execution module, for executing third call back function and deleting after disk is written in third log by k/v database
Except the third log in k/v database.
Flow processing system is write in a kind of mixing provided by the embodiments of the present application, is applied to distributed sha red memory system, the
One judgment module may include:
First judging unit received writes whether carry that simple write writes process in process first for judging
Label and deferred write write the second label of process；The first label and the second label are carried in process if writing, and are sentenced
Surely it writes process and writes process for mixing.
Present invention also provides a kind of mixing to write flow processing equipment and computer readable storage medium, all has this Shen
Please embodiment provide a kind of mixing write the correspondence effect that flow path processing method has.Referring to Fig. 4, Fig. 4 is the application implementation
The structural schematic diagram of flow processing equipment is write in a kind of mixing that example provides.
Flow processing equipment is write in a kind of mixing provided by the embodiments of the present application, is applied to distributed sha red memory system, packet
It includes:
Memory 201, for storing computer program；
Processor 202 realizes that any embodiment as above is retouched when for executing the computer program stored in memory 201
The step of flow path processing method is write in the mixing stated.
Referring to Fig. 5, another mixing provided by the embodiments of the present application, which is write in flow processing equipment, can also include: and locate
The input port 203 that device 202 connects is managed, is used for transmission the extraneous order inputted to processor 202；It is connect with processor 202
Display unit 204, the processing result for video-stream processor 202 is to the external world；The communication module 205 connecting with processor 202 is used
Flow processing equipment and extraneous communication are write in realizing to mix.Display unit 204 can make to show for display panel, laser scanning
Device etc.；Communication mode used by communication module 205 includes but is not limited to mobile high definition chained technology (HML), general serial
Bus (USB), is wirelessly connected high-definition media interface (HDMI): adopting wireless fidelity technology (WiFi), Bluetooth Communication Technology, low function
Consume Bluetooth Communication Technology, the communication technology based on IEEE802.11s.
A kind of computer readable storage medium provided by the embodiments of the present application is applied to distributed sha red memory system, meter
It is stored with computer program in calculation machine readable storage medium storing program for executing, any embodiment as above is realized when computer program is executed by processor
The step of flow path processing method is write in described mixing.
Computer readable storage medium involved in the application includes random access memory (RAM), memory, read-only memory
(ROM), electrically programmable ROM, electrically erasable ROM, register, hard disk, moveable magnetic disc, CD-ROM or technical field
Any other form of storage medium well known to interior.
A kind of mixing provided by the embodiments of the present application writes flow processing system, phase in equipment and computer readable storage medium
The explanation for closing part refers to a kind of mix provided by the embodiments of the present application and writes in flow path processing method corresponding part specifically
Bright, details are not described herein.In addition, in above-mentioned technical proposal provided by the embodiments of the present application with correspond to technical solution in the prior art
The consistent part of realization principle is simultaneously unspecified, in order to avoid excessively repeat.
It should also be noted that, herein, relational terms such as first and second and the like are used merely to one
Entity or operation are distinguished with another entity or operation, without necessarily requiring or implying between these entities or operation
There are any actual relationship or orders.Moreover, the terms "include", "comprise" or its any other variant are intended to contain
Lid non-exclusive inclusion, so that the process, method, article or equipment including a series of elements is not only wanted including those
Element, but also including other elements that are not explicitly listed, or further include for this process, method, article or equipment
Intrinsic element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that
There is also other identical elements in process, method, article or equipment including the element.
The foregoing description of the disclosed embodiments makes those skilled in the art can be realized or use the application.To this
A variety of modifications of a little embodiments will be apparent for a person skilled in the art, and the general principles defined herein can
Without departing from the spirit or scope of the application, to realize in other embodiments.Therefore, the application will not be limited
It is formed on the embodiments shown herein, and is to fit to consistent with the principles and novel features disclosed in this article widest
Range.
Claims (10)
1. flow path processing method is write in a kind of mixing, which is characterized in that be applied to distributed sha red memory system, comprising:
Judge it is received write process whether be mixing write process；
If so, process is write in the mixing is split as that simple write writes process and deferred write writes process；
Process is write to the simple write in a parallel fashion and the deferred write writes process and handles.
2. the method according to claim 1, wherein described write stream to the simple write in a parallel fashion
Journey and the deferred write write process and are handled, comprising:
The simple write IO write request for writing process is committed to disk, so that the disk is by the simple
Itself is written in the first data that write writes process；
And during the IO write request that the simple write is write process is committed to disk, institute is read from the disk
State deferred write and write process the second data to be covered, submit second data, the second metadata, the second log and
Total metadata is to k/v database, so that the disk is written in second log by the k/v database；
Wherein, second metadata indicates that the deferred write writes the metadata that process stored originally；Described second
Log indicates that the deferred write writes the log of process data to be written；Total metadata indicates the simple
Write writes process and the deferred write writes process total metadata to be stored.
3. according to the method described in claim 2, it is characterized in that, the simple write is write the of process by the disk
The write-in of one data is behind, further includes:
The first call back function is executed by total metadata cache to the k/v database；
Second log is written after disk the k/v database, further includes:
It executes the second call back function and deletes second data, second metadata and described in the k/v database
Two logs.
4. according to the method described in claim 2, it is characterized by further comprising:
The deferred write is submitted to write the I/O request of process to k/v database；
Judge whether first data are all written the disk, if so, it is supreme to return to the information that mixing write operation is completed
Layer.
5. the method according to claim 1, wherein it is described judge it is received write process whether be mixing write process
Later, further includes:
If the process of writing is that single simple write writes process, the simple write IO for writing process is write and is asked
It asks and is committed to disk；
Behind the first data write-in certainly that the simple write is write process by the disk, executing the first call back function will
The simple write writes total metadata cache of process to k/v database；
Information that simple write write operation is completed is returned to upper layer.
6. the method according to claim 1, wherein it is described judge it is received write process whether be mixing write process
Later, further includes:
If the process of writing is that single deferred write writes process, the deferred write is write into the total of process
Metadata and corresponding third log buffer are to k/v database；
Information that deferred write write operation is completed is returned to upper layer；
After the disk is written in the third log, execution third call back function is deleted described in the k/v database
Third log.
7. method according to any one of claims 1 to 6, which is characterized in that it is described judge it is received write process whether be
Process is write in mixing, comprising:
Judge it is received write whether carried in process the simple write write process first label and it is described
Deferred write writes the second label of process；
If described write carries first label and second label in process, process is write described in judgement and writes stream for mixing
Journey.
8. flow processing system is write in a kind of mixing, which is characterized in that be applied to distributed sha red memory system, comprising:
First judgment module, for judge it is received write process whether be mixing write process；
First splits module, is when mixing to write process, process to be write in the mixing and is split as simple for the process of writing
Write writes process and deferred write writes process；
First processing module, for writing process to the simple write in a parallel fashion and the deferred write writes
Process is handled.
9. flow processing equipment is write in a kind of mixing, which is characterized in that be applied to distributed sha red memory system, comprising:
Memory, for storing computer program；
Processor realizes that mixing as described in any one of claim 1 to 7 is write at process when for executing the computer program
The step of reason method.
10. a kind of computer readable storage medium, which is characterized in that be applied to distributed sha red memory system, the computer
It is stored with computer program in readable storage medium storing program for executing, such as claim 1 to 7 is realized when the computer program is executed by processor
The step of flow path processing method is write in described in any item mixing.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910434306.0A CN110134739A (en) | 2019-05-23 | 2019-05-23 | Flow path processing method, system, equipment and computer storage medium are write in a kind of mixing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910434306.0A CN110134739A (en) | 2019-05-23 | 2019-05-23 | Flow path processing method, system, equipment and computer storage medium are write in a kind of mixing |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110134739A true CN110134739A (en) | 2019-08-16 |
Family
ID=67572774
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910434306.0A Pending CN110134739A (en) | 2019-05-23 | 2019-05-23 | Flow path processing method, system, equipment and computer storage medium are write in a kind of mixing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110134739A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1838165A (en) * | 2005-03-25 | 2006-09-27 | 微软公司 | Work item rules for a work item tracking system |
| US8024515B2 (en) * | 2007-12-07 | 2011-09-20 | Hitachi Global Storage Technologies Netherlands B.V. | Non-volatile cache in disk drive emulation |
| US9400819B2 (en) * | 2013-06-07 | 2016-07-26 | Dell Products, Lp | Updating object attributes in a lock-coupled namespace traversal |
| CN108255429A (en) * | 2018-01-10 | 2018-07-06 | 郑州云海信息技术有限公司 | A kind of write operation control method, system, device and computer readable storage medium |
-
2019
- 2019-05-23 CN CN201910434306.0A patent/CN110134739A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1838165A (en) * | 2005-03-25 | 2006-09-27 | 微软公司 | Work item rules for a work item tracking system |
| US8024515B2 (en) * | 2007-12-07 | 2011-09-20 | Hitachi Global Storage Technologies Netherlands B.V. | Non-volatile cache in disk drive emulation |
| US9400819B2 (en) * | 2013-06-07 | 2016-07-26 | Dell Products, Lp | Updating object attributes in a lock-coupled namespace traversal |
| CN108255429A (en) * | 2018-01-10 | 2018-07-06 | 郑州云海信息技术有限公司 | A kind of write operation control method, system, device and computer readable storage medium |
Non-Patent Citations (1)
| Title |
|---|
| ERIC: ""Ceph BlueStore"", 《HTTP://BLOG.WJIN.ORG/POSTS/CEPH-BLUESTORE.HTML》 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106469022A (en) | The memory management method of memory driver and system | |
| CN109062512A (en) | A kind of distributed storage cluster, data read-write method, system and relevant apparatus | |
| CN108519862A (en) | Storage method, device, system and the storage medium of block catenary system | |
| CN111736945B (en) | Virtual machine thermomigration method, device, equipment and medium based on intelligent network card | |
| CN103035219B (en) | The reading/writing method of dot matrix type liquid crystal display and device | |
| CN104536904A (en) | Data management method, equipment and system | |
| CN105224528A (en) | The large data processing method calculated based on figure and device | |
| US11977785B2 (en) | Non-volatile memory device-assisted live migration of virtual machine data | |
| US20120173752A1 (en) | Methods for Managing Data Acquisition and Transfer | |
| CN107544937A (en) | A kind of coprocessor, method for writing data and processor | |
| CN102347851B (en) | Event processing method and server thereof | |
| CN111475736A (en) | Community mining method, device and server | |
| CN118444849A (en) | Data storage method, apparatus, electronic device and computer program product | |
| CN110019063A (en) | Method, terminal device and the storage medium of calculate node data disaster tolerance playback | |
| CN116431080A (en) | A method, system, device, and computer-readable storage medium for data storage | |
| CN111158954A (en) | Cloud host snapshot method, system, equipment and computer readable storage medium | |
| US10055304B2 (en) | In-memory continuous data protection | |
| CN115757356A (en) | Data migration method, device, system, electronic equipment and storage medium | |
| US10635645B1 (en) | Systems and methods for maintaining aggregate tables in databases | |
| CN110134739A (en) | Flow path processing method, system, equipment and computer storage medium are write in a kind of mixing | |
| US9286302B2 (en) | Inode reuse systems and methods | |
| CN107003932A (en) | The CACHE DIRECTORY processing method and contents controller of multi-core processor system | |
| CN206711145U (en) | A kind of Government Projects Performance Management System | |
| CN116257550A (en) | A data processing method, device, equipment and medium | |
| CN103645865B (en) | A kind of processing method of command timeout |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190816 |