CN104794172A - Data processing method and device - Google Patents
Data processing method and device Download PDFInfo
- Publication number
- CN104794172A CN104794172A CN201510149862.5A CN201510149862A CN104794172A CN 104794172 A CN104794172 A CN 104794172A CN 201510149862 A CN201510149862 A CN 201510149862A CN 104794172 A CN104794172 A CN 104794172A
- Authority
- CN
- China
- Prior art keywords
- counting
- count
- data
- instruction
- branch
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Computer And Data Communications (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention provides a data processing method and device. The method includes the steps that a counting request instruction sent by a client terminal is received by a counting agent entity; the counting request instruction comprises the type of data and the counting quantity of the data; counting operation is executed through the counting agent entity according to the counting quantity of the data in the counting request instruction; whether the counting result meets a counting transfer condition or not is judged through the counting agent entity; if yes, a counting transfer entity sends a counting increasing instruction to a counting server, and thus the counting server conducts data processing according to the counting increasing instruction; the counting increasing instruction comprises the type of the data and the increasing quantity of the data. According to the data processing method and device, the mode of adding a middle layer agent in an in-memory database such as the client terminal and a Redis is adopted, the in-memory database such as the Redis can be used in a high concurrency counting application scene, and the performance requirement can be met.
Description
Technical field
The present invention relates to Internet technical field, particularly relate to a kind of data processing method and device.
Background technology
Redis is a well-known memory database, and its advantage is stable, functional and rich interface.But maximum problem is, only support single-point write data at present.And its framework is that one process is single-threaded.This means when load acquires a certain degree, no matter CPU has several core, Redis always shows Calculation bottleneck, because it can only use one of them core at most.In fact, under existing hardware condition, when load exceedes 100,000 operations per second, Redis has shown serious performance bottleneck.This causes under some high concurrent application scenarioss, and the memory databases such as Redis can not meet performance need.
Summary of the invention
The invention provides a kind of data processing method and device, to solve under some high concurrent application scenarioss, the problem that the memory database performances such as Redis are low.
In order to solve the problem, the invention discloses a kind of data processing method, comprising:
The Counting requests instruction of client transmission is received by tallying agent entity; Described Counting requests instruction comprises the type of data and the count number of data;
Described tallying agent entity is utilized to perform counting operation according to the count number of the data in described Counting requests instruction;
Judge whether count results meets branch on count condition by described tallying agent entity;
When meeting, utilizing branch on count entity to send counting increases instruction to counting server, increases instruction carry out data processing to make described counting server according to described counting; Described counting increases instruction and comprises the type of data and accelerating of data.
Preferably, describedly judge whether count results meets branch on count condition, comprising by described tallying agent entity:
Judge whether current count numerical value is more than or equal to predetermined threshold value by described tallying agent entity, and/or whether the branch on count frequency is more than or equal to pre-determined threshold;
When current count numerical value is more than or equal to predetermined threshold value, and/or, when the branch on count frequency is more than or equal to pre-determined threshold, determine that count results meets branch on count condition;
When being less than predetermined threshold value when current count numerical value, and/or, when the branch on count frequency is less than pre-determined threshold, determine that count results does not meet branch on count condition.
Preferably, described method also comprises:
While utilizing branch on count entity to send counting increase instruction to counting server, send counting by described branch on count entity and reduce instruction extremely described tallying agent entity; Described counting reduces instruction and comprises the type of data and the minimizing quantity of data;
By described tallying agent entity according to the type of data in described counting minimizing instruction and the minimizing quantity of data, reduce the quantity of data.
Preferably, to increase accelerating of data in instruction equal with the described minimizing quantity counting the data reduced in instruction for described counting.
Preferably, before the described Counting requests instruction by the transmission of tallying agent entity reception client, described method also comprises:
Select the tallying agent entity corresponding with the type of the data in described Counting requests instruction.
Correspondingly, the invention also discloses a kind of data processing equipment, comprising:
Tallying agent module, for receiving the Counting requests instruction that client sends; Described Counting requests instruction comprises the type of data and the count number of data;
Described tallying agent module, also performs counting operation for the count number according to the data in described Counting requests instruction;
Described tallying agent module, also for judging whether count results meets branch on count condition;
Branch on count module, during for meeting branch on count condition when count results, sending counting increases instruction to counting server, increases instruction carry out data processing to make described counting server according to described counting; Described counting increases instruction and comprises the type of data and accelerating of data.
Preferably, described tallying agent module, comprising:
Judge module, for judging whether current count numerical value is more than or equal to predetermined threshold value, and/or whether the branch on count frequency is more than or equal to pre-determined threshold;
Determination module, for being more than or equal to predetermined threshold value when current count numerical value, and/or, when the branch on count frequency is more than or equal to pre-determined threshold, determine that count results meets branch on count condition; When being less than predetermined threshold value when current count numerical value, and/or, when the branch on count frequency is less than pre-determined threshold, determine that count results does not meet branch on count condition.
Preferably, described branch on count module, also for while transmission counting increase instruction to counting server, sends counting and reduces instruction extremely described tallying agent module; Described counting reduces instruction and comprises the type of data and the minimizing quantity of data;
Described tallying agent module, also for according to the type of data in described counting minimizing instruction and the minimizing quantity of data, reduces the quantity of data.
Preferably, to increase accelerating of data in instruction equal with the described minimizing quantity counting the data reduced in instruction for described counting.
Preferably, also comprise:
Select module, for before the Counting requests instruction of described tallying agent module reception client transmission, select the tallying agent module corresponding with the type of the data in described Counting requests instruction.
Compared with background technology, the present invention includes following advantage:
Technical solution of the present invention utilizes tallying agent entity to receive the Counting requests instruction of client transmission, and performs counting operation according to the count number of the data in Counting requests instruction; Judge whether count results meets branch on count condition by tallying agent entity; When meeting, utilizing branch on count entity to send counting increases instruction to counting server, increases instruction carry out data processing to make counting server according to counting.By increasing the mode of the middle layer agency comprising tallying agent entity and technique transfers entity between the memory database such as client and Redis, the memory databases such as Redis are made to be used to, under high this application scenarios of concurrent counting, can performance requirement be met.
Accompanying drawing explanation
Fig. 1 is the system chart of technical solution of the present invention;
Fig. 2 is the flow chart of steps of a kind of data processing method in the embodiment of the present invention one;
Fig. 3 is the flow chart of steps of a kind of data processing method in the embodiment of the present invention two;
Fig. 4 is the flow chart of steps of a kind of data processing method in the embodiment of the present invention three;
Fig. 5 is the structural representation of a kind of data processing equipment in the embodiment of the present invention four;
Fig. 6 is the structural representation of a kind of data processing equipment in the embodiment of the present invention five;
Fig. 7 is the structural representation of a kind of data handling system in the embodiment of the present invention six.
Embodiment
For enabling above-mentioned purpose of the present invention, feature and advantage become apparent more, and below in conjunction with the drawings and specific embodiments, the present invention is further detailed explanation.
Technical solution of the present invention, for the single-point performance bottleneck problem of the host nodes such as Redis, adopts the mode increasing middle layer agency, replaces host node to accept and process the request from client.Result after process is first carried out certain gathering by middle layer agency, and then sends to the host nodes such as Redis.The work role of such host node, from client direct dialogue, become and middle layer proxy Session, and indirectly talked with client.
The system chart of technical solution of the present invention as shown in Figure 1, can act on behalf of with each self-corresponding middle layer and be connected by each client, and each middle layer agency is connected with Redis host node.
A kind of data processing method provided by the invention and device is introduced in detail below by enumerating several specific embodiment.
Embodiment one
Introduce a kind of data processing method that the embodiment of the present invention provides in detail.
With reference to Fig. 2, show the flow chart of steps of a kind of data processing method in the embodiment of the present invention.
Step 100, receives the Counting requests instruction of client transmission by tallying agent entity.
Described tallying agent entity can be actual device, it can also be virtual module, described tallying agent entity can be arranged in client, and can also arrange and count in server, the embodiment of the present invention does not limit the concrete form of tallying agent entity and position etc.
Described Counting requests instruction comprises the type of data and the count number of data.
Step 102, utilizes described tallying agent entity to perform counting operation according to the count number of the data in described Counting requests instruction.
If described Counting requests instruction comprises the type A of data, the count number of the type A of data is 2, then the count number of the data of the type A of current data can be increased by 2 by described tallying agent entity, obtains the count number of the data of the type A of up-to-date data.
By described tallying agent entity, step 104, judges whether count results meets branch on count condition; When meeting, perform step 106; When not meeting, flow process terminates.
Described technique transfers condition can for judging whether a kind of Rule of judgment count number of data being transferred to counting server.
Step 106, utilizing branch on count entity to send counting increases instruction to counting server, increases instruction carry out data processing to make described counting server according to described counting.
Wherein, described counting increase instruction can comprise the type of data and accelerating of data.
Described counting server can be the memory database servers such as Redis.
If described Counting requests instruction comprises the type A of data, the count number of the type A of data is 5, when count results meets branch on count condition, branch on count entity can send counting to counting server increases instruction, with the count number making counting server increase the type A of data, the quantity that can increase is the count number 5 of the data in Counting requests instruction, the quantity that also can increase is other quantity, namely the accelerating of data that described counting increases in instruction can be equal with the count number of the data in Counting requests instruction, also can not wait, specifically can determine according to actual conditions.
In sum, technical solution of the present invention utilizes tallying agent entity to receive the Counting requests instruction of client transmission, and performs counting operation according to the count number of the data in Counting requests instruction; Judge whether count results meets branch on count condition by tallying agent entity; When meeting, utilizing branch on count entity to send counting increases instruction to counting server, increases instruction carry out data processing to make counting server according to counting.By increasing the mode of the middle layer agency comprising tallying agent entity and technique transfers entity between the memory database such as client and Redis, the memory databases such as Redis are made to be used to, under high this application scenarios of concurrent counting, can performance requirement be met.
Embodiment two
Introduce a kind of data processing method that the embodiment of the present invention provides in detail.
With reference to Fig. 3, show the flow chart of steps of a kind of data processing method in the embodiment of the present invention.
Step 200, selects the tallying agent entity corresponding with the type of the data in the Counting requests instruction that client sends.
Described tallying agent entity can be actual device, it can also be virtual module, described tallying agent entity can be arranged in client, and can also arrange and count in server, the embodiment of the present invention does not limit the concrete form of tallying agent entity and position etc.
The type of different pieces of information can be corresponding different tallying agent entity, same tallying agent entity also may correspond to the type of multiple different data.
Step 202, receives the Counting requests instruction of client transmission by tallying agent entity.
Described Counting requests instruction comprises the type of data and the count number of data.
Step 204, utilizes described tallying agent entity to perform counting operation according to the count number of the data in described Counting requests instruction.
If described Counting requests instruction comprises the type A of data, the count number of the type A of data is 2, then the count number of the data of the type A of current data can be increased by 2 by described tallying agent entity, obtains the count number of the data of the type A of up-to-date data.
By described tallying agent entity, step 206, judges whether count results meets branch on count condition; When meeting, perform step 208; When not meeting, flow process terminates.
Described technique transfers condition can for judging whether a kind of Rule of judgment count number of data being transferred to counting server.
Preferably, described step 206 can comprise:
By described tallying agent entity, step 2061, judges whether current count numerical value is more than or equal to predetermined threshold value, and/or whether the branch on count frequency is more than or equal to pre-determined threshold.
Two can be comprised judge parameter in branch on count condition, be respectively predetermined threshold value and pre-determined threshold.Wherein, predetermined threshold value is the parameter compared with current count numerical value, and pre-determined threshold is the parameter compared with the branch on count frequency.
In actual applications, branch on count condition can adopt separately wherein any one parameter, also can adopt above-mentioned two parameters simultaneously.
Step 2062, when current count numerical value is more than or equal to predetermined threshold value, and/or, when the branch on count frequency is more than or equal to pre-determined threshold, determine that count results meets branch on count condition.
Correspondingly, if branch on count condition adopts separately a parameter in predetermined threshold value and pre-determined threshold, then judged result is also a result corresponding with predetermined threshold value and pre-determined threshold; If branch on count condition adopts two parameters in predetermined threshold value and pre-determined threshold, then judged result is two each and every one results corresponding with predetermined threshold value and pre-determined threshold.
Step 2063, when being less than predetermined threshold value when current count numerical value, and/or, when the branch on count frequency is less than pre-determined threshold, determine that count results does not meet branch on count condition.
Correspondingly, if branch on count condition adopts separately a parameter in predetermined threshold value and pre-determined threshold, then judged result is also a result corresponding with predetermined threshold value and pre-determined threshold; If branch on count condition adopts two parameters in predetermined threshold value and pre-determined threshold, then judged result is two each and every one results corresponding with predetermined threshold value and pre-determined threshold.
Step 208, utilizing branch on count entity to send counting increases instruction to counting server, increases instruction carry out data processing to make described counting server according to described counting.
Wherein, described counting increase instruction can comprise the type of data and accelerating of data.
Described counting server can be the memory database servers such as Redis.
If described Counting requests instruction comprises the type A of data, the count number of the type A of data is 5, when count results meets branch on count condition, branch on count entity can send counting to counting server increases instruction, with the count number making counting server increase the type A of data, the quantity that can increase is the count number 5 of the data in Counting requests instruction, the quantity that also can increase is other quantity, namely the accelerating of data that described counting increases in instruction can be equal with the count number of the data in Counting requests instruction, also can not wait, specifically can determine according to actual conditions.
Step 210, while utilizing branch on count entity to send counting increase instruction to counting server, sends counting by described branch on count entity and reduces instruction extremely described tallying agent entity.
Described counting reduces instruction can comprise the type of data and the minimizing quantity of data.
Step 212, by described tallying agent entity according to the type of data in described counting minimizing instruction and the minimizing quantity of data, reduces the quantity of data.
Preferably, to increase accelerating of data in instruction equal with the described minimizing quantity counting the data reduced in instruction for described counting.
When branch on count entity sends counting increase instruction to counting server, current count numerical value after tallying agent entity performs counting operation should reduce, because branch on count entity increases instruction by counting, order counting server adds the quantity of counting.So by above-mentioned steps 210 and step 212, tallying agent entity reduces the quantity of the data that counting server increases.
In sum, technical solution of the present invention utilizes tallying agent entity to receive the Counting requests instruction of client transmission, and performs counting operation according to the count number of the data in Counting requests instruction; Judge whether count results meets branch on count condition by tallying agent entity; When meeting, utilizing branch on count entity to send counting increases instruction to counting server, increases instruction carry out data processing to make counting server according to counting.By increasing the mode of the middle layer agency comprising tallying agent entity and technique transfers entity between the memory database such as client and Redis, the memory databases such as Redis are made to be used to, under high this application scenarios of concurrent counting, can performance requirement be met.
Embodiment three
Introduce a kind of data processing method that the embodiment of the present invention provides in detail.
With reference to Fig. 4, show the flow chart of steps of a kind of data processing method in the embodiment of the present invention.
Step 300, sends Counting requests instruction.
Initiate the Counting requests instruction to named variable by client, request performs counting operation.
Step 302, performs counting operation.
Select the tallying agent module of specifying, perform the counting operation of particular variables.
Step 304, threshold decision; When reaching branch on count condition, perform step 306; When not reaching branch on count condition, repeated execution of steps 302.
According to the threshold condition preset, judge whether to reach branch on count condition.
Step 306, sends branch on count instruction.
Send branch on count instruction to branch on count module, show to reach branch on count condition, count value can transfer to counting master server.
Step 308, sending counting to host node increases instruction.
By current count value, send to counting master server to count increase instruction.
Step 310, sends counting to agent node and reduces instruction.
By current count value, send to tallying agent module with the instruction counting minimizing; It must be same value that counting increases instruction with the counting count value reduced in instruction.
Step 312, counting increases.
Counting master server accepts counting increases instruction, and performing counting increases operation, realizes overall counting operation.
Step 314, counting reduces.
Tallying agent module accepts counting and reduces instruction, performs counting and reduces operation, keeps the synchronism with counting master server count value.
In sum, technical solution of the present invention utilizes tallying agent entity to receive the Counting requests instruction of client transmission, and performs counting operation according to the count number of the data in Counting requests instruction; Judge whether count results meets branch on count condition by tallying agent entity; When meeting, utilizing branch on count entity to send counting increases instruction to counting server, increases instruction carry out data processing to make counting server according to counting.By increasing the mode of the middle layer agency comprising tallying agent entity and technique transfers entity between the memory database such as client and Redis, the memory databases such as Redis are made to be used to, under high this application scenarios of concurrent counting, can performance requirement be met.
Embodiment four
Introduce a kind of data processing equipment that the embodiment of the present invention provides in detail.
With reference to Fig. 5, show the structural representation of a kind of data processing equipment in the embodiment of the present invention.
Described device can comprise: tallying agent module 400, branch on count module 402.
Introduce the relation between the function of each module and each module below respectively in detail.
Tallying agent module 400, for receiving the Counting requests instruction that client sends; Described Counting requests instruction comprises the type of data and the count number of data.
Described tallying agent module 400, also performs counting operation for the count number according to the data in described Counting requests instruction.
Described tallying agent module 400, also for judging whether count results meets branch on count condition.
Branch on count module 402, during for meeting branch on count condition when count results, sending counting increases instruction to counting server, increases instruction carry out data processing to make described counting server according to described counting; Described counting increases instruction and comprises the type of data and accelerating of data.
In sum, technical solution of the present invention utilizes tallying agent entity to receive the Counting requests instruction of client transmission, and performs counting operation according to the count number of the data in Counting requests instruction; Judge whether count results meets branch on count condition by tallying agent entity; When meeting, utilizing branch on count entity to send counting increases instruction to counting server, increases instruction carry out data processing to make counting server according to counting.By increasing the mode of the middle layer agency comprising tallying agent entity and technique transfers entity between the memory database such as client and Redis, the memory databases such as Redis are made to be used to, under high this application scenarios of concurrent counting, can performance requirement be met.
Embodiment five
Introduce a kind of data processing equipment that the embodiment of the present invention provides in detail.
With reference to Fig. 6, show the structural representation of a kind of data processing equipment in the embodiment of the present invention.
Described device can comprise: select module 500, tallying agent module 502, branch on count module 504.
Wherein, described tallying agent module 502 can comprise judge module 5021, determination module 5022.
Introduce the relation between the function of each module and each module below respectively in detail.
Select module 500, for receive in described tallying agent module 502 client send Counting requests instruction before, select the tallying agent module corresponding with the type of the data in described Counting requests instruction.
Tallying agent module 502, for receiving the Counting requests instruction that client sends; Described Counting requests instruction comprises the type of data and the count number of data.
Described tallying agent module 502, also performs counting operation for the count number according to the data in described Counting requests instruction.
Described tallying agent module 502, also for judging whether count results meets branch on count condition.
Preferably, described tallying agent module 502, can comprise:
Judge module 5021, for judging whether current count numerical value is more than or equal to predetermined threshold value, and/or whether the branch on count frequency is more than or equal to pre-determined threshold.
Determination module 5022, for being more than or equal to predetermined threshold value when current count numerical value, and/or, when the branch on count frequency is more than or equal to pre-determined threshold, determine that count results meets branch on count condition; When being less than predetermined threshold value when current count numerical value, and/or, when the branch on count frequency is less than pre-determined threshold, determine that count results does not meet branch on count condition.
Branch on count module 504, during for meeting branch on count condition when count results, sending counting increases instruction to counting server, increases instruction carry out data processing to make described counting server according to described counting; Described counting increases instruction and comprises the type of data and accelerating of data.
Preferably, described branch on count module 504, also for while transmission counting increase instruction to counting server, sends counting and reduces instruction extremely described tallying agent module 502; Described counting reduces instruction and comprises the type of data and the minimizing quantity of data.
Preferably, described tallying agent module 502, also for according to the type of data in described counting minimizing instruction and the minimizing quantity of data, reduces the quantity of data.
Preferably, to increase accelerating of data in instruction equal with the described minimizing quantity counting the data reduced in instruction for described counting.
In sum, technical solution of the present invention utilizes tallying agent entity to receive the Counting requests instruction of client transmission, and performs counting operation according to the count number of the data in Counting requests instruction; Judge whether count results meets branch on count condition by tallying agent entity; When meeting, utilizing branch on count entity to send counting increases instruction to counting server, increases instruction carry out data processing to make counting server according to counting.By increasing the mode of the middle layer agency comprising tallying agent entity and technique transfers entity between the memory database such as client and Redis, the memory databases such as Redis are made to be used to, under high this application scenarios of concurrent counting, can performance requirement be met.
Embodiment six
Introduce a kind of data handling system that the embodiment of the present invention provides in detail.
With reference to Fig. 7, show the structural representation of a kind of data handling system in the embodiment of the present invention.
Described system can comprise client, middle layer and counting master server.
Client: the one end sending Counting requests.
Middle layer: comprise two large modules, tallying agent module and branch on count module; Primary responsibility accepts Counting requests, and performs counting operation; Send counting to counting master server and increase instruction, send counting to tallying agent module and reduce instruction; Horizontal and vertical expansion is supported in the realization in middle layer, to tackle high concurrent count requirement.
Counting master server: the instruction sent according to middle layer, performing the counting overall situation increases operation.
Client sends Counting requests instruction to middle layer.
Middle layer receives client count instruction, counting operation is performed by tallying agent module, judge whether after counting terminates to reach branch on count condition (this condition can be that counting reaches certain threshold value or transfer reaches certain frequency or both same limit), if jump condition meets, tallying agent module sends branch on count instruction to branch on count module, after branch on count module accepts instruction, send counting to counting server simultaneously and increase instruction, send counting to tallying agent module and reduce instruction, after tallying agent module accepts counting minimizing instruction, realize the minimizing of counting.
Counting master server, receives the counting increase instruction that branch on count module sends, performs increase operation to corresponding count value.
In sum, technical solution of the present invention utilizes tallying agent entity to receive the Counting requests instruction of client transmission, and performs counting operation according to the count number of the data in Counting requests instruction; Judge whether count results meets branch on count condition by tallying agent entity; When meeting, utilizing branch on count entity to send counting increases instruction to counting server, increases instruction carry out data processing to make counting server according to counting.By increasing the mode of the middle layer agency comprising tallying agent entity and technique transfers entity between the memory database such as client and Redis, the memory databases such as Redis are made to be used to, under high this application scenarios of concurrent counting, can performance requirement be met.
For device embodiment, due to itself and embodiment of the method basic simlarity, so description is fairly simple, relevant part illustrates see the part of embodiment of the method.
Each embodiment in this instructions all adopts the mode of going forward one by one to describe, and what each embodiment stressed is the difference with other embodiments, between each embodiment identical similar part mutually see.
A kind of the data processing method above embodiment of the present invention provided and device, be described in detail, apply specific case herein to set forth principle of the present invention and embodiment, the explanation of above embodiment just understands method of the present invention and core concept thereof for helping; Meanwhile, for one of ordinary skill in the art, according to thought of the present invention, all will change in specific embodiments and applications, in sum, this description should not be construed as limitation of the present invention.
Claims (10)
1. a data processing method, is characterized in that, comprising:
The Counting requests instruction of client transmission is received by tallying agent entity; Described Counting requests instruction comprises the type of data and the count number of data;
Described tallying agent entity is utilized to perform counting operation according to the count number of the data in described Counting requests instruction;
Judge whether count results meets branch on count condition by described tallying agent entity;
When meeting, utilizing branch on count entity to send counting increases instruction to counting server, increases instruction carry out data processing to make described counting server according to described counting; Described counting increases instruction and comprises the type of data and accelerating of data.
2. method according to claim 1, is characterized in that, describedly judges whether count results meets branch on count condition, comprising by described tallying agent entity:
Judge whether current count numerical value is more than or equal to predetermined threshold value by described tallying agent entity, and/or whether the branch on count frequency is more than or equal to pre-determined threshold;
When current count numerical value is more than or equal to predetermined threshold value, and/or, when the branch on count frequency is more than or equal to pre-determined threshold, determine that count results meets branch on count condition;
When being less than predetermined threshold value when current count numerical value, and/or, when the branch on count frequency is less than pre-determined threshold, determine that count results does not meet branch on count condition.
3. method according to claim 1, is characterized in that, described method also comprises:
While utilizing branch on count entity to send counting increase instruction to counting server, send counting by described branch on count entity and reduce instruction extremely described tallying agent entity; Described counting reduces instruction and comprises the type of data and the minimizing quantity of data;
By described tallying agent entity according to the type of data in described counting minimizing instruction and the minimizing quantity of data, reduce the quantity of data.
4. method according to claim 3, is characterized in that, it is equal with the described minimizing quantity counting the data reduced in instruction that described counting increases accelerating of data in instruction.
5. method according to claim 1, is characterized in that, before the described Counting requests instruction by the transmission of tallying agent entity reception client, described method also comprises:
Select the tallying agent entity corresponding with the type of the data in described Counting requests instruction.
6. a data processing equipment, is characterized in that, comprising:
Tallying agent module, for receiving the Counting requests instruction that client sends; Described Counting requests instruction comprises the type of data and the count number of data;
Described tallying agent module, also performs counting operation for the count number according to the data in described Counting requests instruction;
Described tallying agent module, also for judging whether count results meets branch on count condition;
Branch on count module, during for meeting branch on count condition when count results, sending counting increases instruction to counting server, increases instruction carry out data processing to make described counting server according to described counting; Described counting increases instruction and comprises the type of data and accelerating of data.
7. device according to claim 6, is characterized in that, described tallying agent module, comprising:
Judge module, for judging whether current count numerical value is more than or equal to predetermined threshold value, and/or whether the branch on count frequency is more than or equal to pre-determined threshold;
Determination module, for being more than or equal to predetermined threshold value when current count numerical value, and/or, when the branch on count frequency is more than or equal to pre-determined threshold, determine that count results meets branch on count condition; When being less than predetermined threshold value when current count numerical value, and/or, when the branch on count frequency is less than pre-determined threshold, determine that count results does not meet branch on count condition.
8. device according to claim 6, is characterized in that,
Described branch on count module, also for while transmission counting increase instruction to counting server, sends counting and reduces instruction extremely described tallying agent module; Described counting reduces instruction and comprises the type of data and the minimizing quantity of data;
Described tallying agent module, also for according to the type of data in described counting minimizing instruction and the minimizing quantity of data, reduces the quantity of data.
9. device according to claim 8, is characterized in that,
It is equal with the described minimizing quantity counting the data reduced in instruction that described counting increases accelerating of data in instruction.
10. device according to claim 6, is characterized in that, also comprises:
Select module, for before the Counting requests instruction of described tallying agent module reception client transmission, select the tallying agent module corresponding with the type of the data in described Counting requests instruction.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510149862.5A CN104794172B (en) | 2015-03-31 | 2015-03-31 | A kind of data processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510149862.5A CN104794172B (en) | 2015-03-31 | 2015-03-31 | A kind of data processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104794172A true CN104794172A (en) | 2015-07-22 |
| CN104794172B CN104794172B (en) | 2018-09-11 |
Family
ID=53558964
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510149862.5A Active CN104794172B (en) | 2015-03-31 | 2015-03-31 | A kind of data processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104794172B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111274010A (en) * | 2020-01-14 | 2020-06-12 | Oppo广东移动通信有限公司 | Data control method, device, electronic device and storage medium |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101923577A (en) * | 2010-09-02 | 2010-12-22 | 北京开心人信息技术有限公司 | Expandable counting method and system |
| CN201725332U (en) * | 2010-09-02 | 2011-01-26 | 北京开心人信息技术有限公司 | Expandable counting system |
| CN102495979A (en) * | 2011-11-11 | 2012-06-13 | 广州大学 | System for realizing credible counting in digital resource transaction |
| CN102722405A (en) * | 2012-06-06 | 2012-10-10 | 新浪网技术(中国)有限公司 | Counting method in high concurrent and multithreaded application and system |
| CN102833281A (en) * | 2011-06-15 | 2012-12-19 | 中兴通讯股份有限公司 | Method, device and system for realizing distributed automatically-increasing counting |
| US8364677B2 (en) * | 2008-08-01 | 2013-01-29 | International Business Machines Corporation | Method and apparatus for generating partitioning keys for a range-partitioned database |
| CN103473272A (en) * | 2013-08-20 | 2013-12-25 | 小米科技有限责任公司 | Data processing method, device and system |
| CN104199957A (en) * | 2014-09-17 | 2014-12-10 | 合一网络技术(北京)有限公司 | Redis universal agent implementation method |
| CN104239486A (en) * | 2014-09-05 | 2014-12-24 | 广州华多网络科技有限公司 | Method and system for processing data, and related device |
-
2015
- 2015-03-31 CN CN201510149862.5A patent/CN104794172B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8364677B2 (en) * | 2008-08-01 | 2013-01-29 | International Business Machines Corporation | Method and apparatus for generating partitioning keys for a range-partitioned database |
| CN101923577A (en) * | 2010-09-02 | 2010-12-22 | 北京开心人信息技术有限公司 | Expandable counting method and system |
| CN201725332U (en) * | 2010-09-02 | 2011-01-26 | 北京开心人信息技术有限公司 | Expandable counting system |
| CN102833281A (en) * | 2011-06-15 | 2012-12-19 | 中兴通讯股份有限公司 | Method, device and system for realizing distributed automatically-increasing counting |
| CN102495979A (en) * | 2011-11-11 | 2012-06-13 | 广州大学 | System for realizing credible counting in digital resource transaction |
| CN102722405A (en) * | 2012-06-06 | 2012-10-10 | 新浪网技术(中国)有限公司 | Counting method in high concurrent and multithreaded application and system |
| CN103473272A (en) * | 2013-08-20 | 2013-12-25 | 小米科技有限责任公司 | Data processing method, device and system |
| CN104239486A (en) * | 2014-09-05 | 2014-12-24 | 广州华多网络科技有限公司 | Method and system for processing data, and related device |
| CN104199957A (en) * | 2014-09-17 | 2014-12-10 | 合一网络技术(北京)有限公司 | Redis universal agent implementation method |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111274010A (en) * | 2020-01-14 | 2020-06-12 | Oppo广东移动通信有限公司 | Data control method, device, electronic device and storage medium |
| CN111274010B (en) * | 2020-01-14 | 2024-01-16 | Oppo广东移动通信有限公司 | Data control method, device, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104794172B (en) | 2018-09-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101662506B (en) | Load balancing method based on CPU kernel sharing and device thereof | |
| CN102801784B (en) | A kind of distributed data storage method and equipment | |
| CN110022330B (en) | Processing method and device for network data packet and electronic equipment | |
| CN106712981B (en) | Node change notification method and device | |
| US11144366B2 (en) | Computing node processor resource optimization method, computing node and server cluster | |
| CN103237060B (en) | A kind of data object acquisition, Apparatus and system | |
| CN108810170A (en) | resource allocation method and system | |
| CN103516744A (en) | A data processing method, an application server and an application server cluster | |
| CN113259415B (en) | A network message processing method, device and network server | |
| CN105610992A (en) | Task allocation load balancing method for distributed stream computing system | |
| CN115955437B (en) | Data transmission method, device, equipment and medium | |
| JP2020080059A (en) | Evaluation device, evaluation method, and evaluation program | |
| CN104809026B (en) | A kind of method that CPU computing resources are borrowed using remote node | |
| CN105117401A (en) | Method, device and system for parallel transmission of pictures | |
| CN117472844B (en) | Multi-chip module and data processing method | |
| CN104794172A (en) | Data processing method and device | |
| CN108632321A (en) | Treating method and apparatus based on scheduling of resource under big data platform | |
| CN111209263A (en) | Data storage method, device, equipment and storage medium | |
| CN111131367B (en) | Distributed access service processing method and device | |
| CN115037803B (en) | Service calling method, electronic equipment and storage medium | |
| CN116991562A (en) | Data processing method and device, electronic equipment and storage medium | |
| CN102420764B (en) | Link establishment method and equipment | |
| CN112689011B (en) | Service transmission method, device, equipment and medium based on NFS protocol | |
| CN109195187B (en) | Switching network slice method based on network slice server log file | |
| CN105187244A (en) | Access management system of digital communication equipment supporting multiple management modes |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| EXSB | Decision made by sipo to initiate substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |