CN104243405B - A kind of request processing method, apparatus and system - Google Patents

Abstract

The embodiment of the invention discloses a kind of request processing method, execution priority and resource allocation for dynamically adjusting request according to the processing time of request.Present invention method includes：The remote procedure call request that traffic assignments server is sent is received, RPC requests are added into service request queue；The execution priority that each RPC according to being set the response time constraint information asked of each RPC in the service request queue is asked, and/or distribute the execution resource of each RPC requests.

Description

A request processing method, device and system

technical field

The present invention relates to the communication field, in particular to a request processing method, device and system.

Background technique

Internet applications such as e-mail, search, online shopping, social networking, online video, and web maps have become a part of people's lives. These applications often serve hundreds of millions of users, which means that Internet applications have become a social public service, and data centers that support Internet applications with a large number of users have also become the core infrastructure of society.

The number of active users and the number of user visits are the main factors affecting the revenue of Internet companies. Fast service response time is the key to satisfying and retaining users. Internet companies generally use free services to attract users, so response time is a key indicator for measuring service quality (Quality of Service, QoS). Since Internet applications need to provide services for hundreds of millions of users at the same time, most of them are implemented in a distributed manner for the sake of performance and scalability. An application is decomposed into many services and deployed on multiple business processing servers. Therefore, a user The requests will eventually be assigned to multiple different business processing servers for processing. Sequence/dependency mode is a typical service aggregation mode. In this mode, the output of the service in the previous stage is the input of the service in the next stage, and the services in the two adjacent stages have dependencies.

Affected by various factors such as request characteristics, network, and background operations in the data center, the response time of each service stage will continue to fluctuate. At the same time, in order to pursue low-cost goals, Internet companies usually use resource The sharing method improves the utilization rate of resources. While reducing costs, this kind of sharing will also cause mutual interference between applications and aggravate the fluctuation of application response time. What's more serious is that the response time delay of the service in the previous stage in the business processing server may be further amplified in the service processing process of the next stage. In the sequential/dependent service aggregation mode, the response time delay of each level The time will be superimposed step by step, causing a large delay in the response time of the end user request. This delay in response time can seriously affect the quality of service of many delay-sensitive applications (such as search, online shopping, etc.).

In the existing technology, before deploying shared applications, technicians pre-analyze and test a large number of existing applications, and select the applications with the least mutual interference for mixed deployment, thereby reducing the impact of mutual interference between applications on response time. Avoid delays in response time as much as possible.

However, this existing technology needs to pre-analyze and test a large number of existing applications before deployment, which is difficult to operate. Moreover, due to the variety and uncertainty of existing applications, even if the applications are analyzed before deployment , It can only reduce the mutual interference between some applications, and there is still a lot of interference between many applications, and the effect of avoiding response time delay is not good.

Contents of the invention

The embodiment of the present invention provides a request processing method, which is used to dynamically adjust the execution priority and resource allocation of the request according to the processing time of the request.

The request processing method provided in the first aspect of the embodiment of the present invention includes:

The service processing server receives the remote procedure call RPC request sent by the service distribution server, and the RPC request includes: response time constraint information; the response time constraint information is used to mark the processing constraint time of the user request corresponding to the RPC request and the completed processing time occurs; the business processing server adds the RPC request to the service request queue; the business processing server sets the execution priority of each RPC request according to the response time constraint information of each RPC request in the service request queue, And/or allocate execution resources for each RPC request.

In a first possible implementation of the first aspect,

If the business processing server can process all the RPC requests in the service request queue at the same time, the business processing server allocates execution resources for each RPC request according to the response time constraint information of each RPC request in the service request queue ;

If the business processing server can only process any RPC request in the service request queue independently, then the business processing server sets the time limit of each RPC request according to the response time constraint information of each RPC request in the service request queue. execution priority;

If the business processing server can neither process all RPC requests in the service request queue at the same time, nor can it only process any RPC request in the service request queue independently, then the service processing server The response time constraint information of each RPC request in the queue sets the execution priority of each RPC request, and allocates the execution resources of each RPC request.

In combination with the first aspect or the first implementation method of the first aspect, in the second possible implementation method of the first aspect, when the business processing server sets the response time constraint information of each RPC request in the service request queue When the execution priority of each RPC request is described, the execution priority of each RPC request is set according to the response time constraint information of each RPC request in the service request queue, including:

Obtain the constraint remaining time of the processing constraint time of each RPC request according to the response time constraint information; set the execution priority of each RPC request according to a predefined rule, and the predefined rule includes: the longer the constraint remaining time The less, the higher the execution priority is set.

In combination with the first aspect or the first implementation method of the first aspect, in the third possible implementation method of the first aspect, when the business processing server allocates all RPC requests according to the response time constraint information of each RPC request in the service request queue When describing the execution resources of each RPC request, the allocation of the execution resources of each RPC request according to the response time constraint information of each RPC request in the service request queue includes:

Obtain the remaining time of the processing constraint time of each RPC request according to the response time constraint information; allocate the execution resources of each RPC request according to a predefined rule, the predefined rule includes: the less the remaining time of the constraint, The more execution resources are allocated.

In combination with the second implementation method of the first aspect or the third implementation method of the first aspect, in the fourth possible implementation method of the first aspect, the predefined rule further includes: if the remaining time of the processing constraint time If it is less than the predicted completion time of the RPC request, setting the execution priority and allocating execution resources for the RPC request is abandoned.

In combination with the second implementation method of the first aspect or the third implementation method of the first aspect, in the fifth possible implementation method of the first aspect, the predefined rules further include: if there are more than two RPC requests If the constraint remaining time is equal, then obtain the ratio of the constraint remaining time to the processing constraint time, set a higher execution priority for the RPC request with a smaller ratio, and/or allocate more execution resources.

In combination with the first aspect or any one of the first to third implementation methods of the first aspect, in the sixth possible implementation method of the first aspect, after receiving the remote procedure call RPC request sent by the service distribution server, it includes:

Select a processing strategy for the RPC request according to the response time constraint information and an emergency threshold, the processing strategy includes: a first processing strategy and a second processing strategy, if the constraint remaining time of the response time constraint information is greater than the emergency threshold, select to execute the first processing strategy, if the constraint remaining time of the response time constraint information is less than or equal to the emergency threshold, then select to execute the second processing strategy, the processing of the first processing strategy is complex degrees greater than the second processing strategy.

In combination with the first aspect or any one of the first to third implementation methods of the first aspect, in the seventh possible implementation method of the first aspect, the setting of the response time constraint information of each RPC request in the service request queue After the execution priority of each RPC request, and/or after allocating the execution resources of each RPC request, include:

The business processing server processes the RPC request with the highest priority, records the processing time of the RPC request, and updates the response time constraint information of the RPC request according to the processing time; The allocation server feeds back the response time constraint information of the completed RPC request.

The request processing method provided by the second aspect of the embodiment of the present invention includes:

The service allocation server receives the user request; the service allocation server allocates response time constraint information for the user request, and the response time constraint information is used to mark the processing constraint time and the processing time of the user request; the service allocation The server generates a remote procedure call RPC request according to the user request; the service allocation server sends an RPC request to the service processing server, and the RPC request carries the response time constraint information; so that the service processing server according to the response time The constraint information sets execution priority for the RPC request, and/or allocates execution resources.

In the first possible implementation method of the second aspect, the allocating the response time constraint information of the user request includes:

Allocating response time constraint information to the user request according to the historical value of the response time constraint information and the hardware information of the service processing server.

In combination with the first possible implementation method of the second aspect, in the second possible implementation method of the second aspect, if the current hardware performance of the business processing server is different from the historical value recorded for the response time constraint information If there is a change, the allocation of response time constraint information to the user request according to the historical value of the response time constraint information and the hardware information of the business processing server includes:

Obtain the ratio of the first processing speed to the second processing speed, multiply the historical value of the response time constraint information by the ratio, and obtain the response time constraint information currently assigned to the user request; the first processing speed is The processing speed of the hardware performance of the current business processing server for the RPC request, the second processing speed is the processing speed of the hardware performance of the business processing server for the RPC request when recording the historical value of the response time constraint information ;

If the hardware performance of the current service processing server has not changed compared with the historical value of the response time constraint information recorded, then the historical value according to the response time constraint information and the hardware information of the service processing server are the User request allocation response time constraint information, including:

The historical value of the response time constraint information is used as the response time constraint information currently assigned to the user request.

In combination with the second aspect or any one of the first to second implementation methods of the second aspect, in the third possible implementation method of the second aspect, the generating a remote procedure call RPC request according to a user request includes:

Extracting the business parameters needed to complete the user request; determining the steps to be executed to complete the user request according to the preset business logic, and determining the business processing server to be called according to the steps to be executed; The service processing server assigns the corresponding service parameters, and generates an RPC request corresponding to the service processing server.

In combination with the second aspect or any one of the first to second implementation methods of the second aspect, in the fourth possible implementation method of the second aspect, after sending the RPC request to the business processing server, it includes:

Receiving the response time constraint information fed back by the business processing server; using the response time constraint information to update the response time constraint information of the corresponding RPC request.

With reference to the fourth implementation method of the second aspect, in the fifth possible implementation method of the second aspect, after receiving the response time constraint information fed back by the business processing server, include:

Select the allocation processing strategy corresponding to the user request according to the response time constraint information and the emergency allocation threshold, the allocation processing strategy includes: a first allocation processing strategy and a second allocation processing strategy, if the response time constraint information is constrained If the remaining time is greater than the emergency processing threshold, the first allocation processing strategy is selected to be executed, and if the constraint remaining time of the response time constraint information is less than or equal to the emergency processing threshold, the second allocation processing strategy is selected to be executed , the processing complexity of the first allocation processing policy is greater than that of the second allocation processing policy.

The service processing server provided by the third aspect of the embodiment of the present invention includes:

A request receiving unit, configured to receive a remote procedure call (RPC) request sent by a service distribution server, the RPC request including: response time constraint information; the response time constraint information is used to mark a processing constraint of a user request corresponding to the RPC request time and the processing time that has occurred; a storage unit for adding the RPC request to a service request queue; a setting unit for setting the execution of each RPC request according to the response time constraint information of each RPC request in the service request queue Priority, and/or allocation of execution resources for each RPC request.

The service processing server provided by the fourth aspect of the embodiment of the present invention includes:

A user request receiving unit, configured to receive a user request; an information allocation unit, configured to assign response time constraint information to the user request, and the response time constraint information is used to mark the processing constraint time of the user request and the processing time that has occurred a request generation unit, configured to generate a remote procedure call (RPC) request according to the user request; a request sending unit, configured to send an RPC request to a service processing server, the RPC request carrying the response time constraint information; making the service The processing server sets an execution priority for the RPC request according to the response time constraint information, and/or allocates execution resources.

The service processing server provided by the fifth aspect of the embodiment of the present invention includes:

Business distribution server and business processing server;

The service allocation server is used to receive user requests; allocate response time constraint information for the user requests, and the response time constraint information is used to mark the processing constraint time and the processing time of the user request; according to the user request Generate a remote procedure call RPC request; send the RPC request to the business processing server; the RPC request carries the response time constraint information;

The service processing server is used to receive the remote procedure call RPC request sent by the service distribution server, add the RPC request to the service request queue; set the RPC request according to the response time constraint information of each RPC request in the service request queue the execution priority of each RPC request, and/or allocate execution resources for each RPC request.

It can be seen from the above technical solutions that the embodiments of the present invention have the following advantages:

In the embodiment of the present invention, the remote procedure call (Remote Procedure Call, RPC) request received by the business processing server carries response time constraint information, and the response time constraint information is used to mark the processing constraint of the user request corresponding to the RPC request time and the processing time that has occurred, so that before processing the RPC request, the business processing server can allocate the execution priority and/or execution resource of each RPC request in the service request queue according to the response time constraint information of each RPC request, so that the time Urgent RPC requests can be prioritized.

Description of drawings

FIG. 1 is a schematic flowchart of a request processing method according to an embodiment of the present invention;

FIG. 2 is another schematic flowchart of a request processing method according to an embodiment of the present invention;

FIG. 3 is another schematic flowchart of a request processing method according to an embodiment of the present invention;

FIG. 4 is another schematic flowchart of a request processing method according to an embodiment of the present invention;

FIG. 5 is a schematic structural diagram of a business processing server according to an embodiment of the present invention;

FIG. 6 is a schematic structural diagram of a service distribution server according to an embodiment of the present invention;

FIG. 7 is a schematic structural diagram of a request processing system according to an embodiment of the present invention;

FIG. 8 is a schematic structural diagram of a computer device according to an embodiment of the present invention.

detailed description

The embodiment of the present invention provides a request processing method, which is used to dynamically adjust the execution priority and resource allocation of the request according to the processing time of the request.

Referring to Fig. 1, an embodiment of the request processing method in the embodiment of the present invention includes:

101. The service processing server receives the RPC request sent by the service distribution server;

The service processing server receives the RPC request sent by the service distribution server, and the RPC request includes: response time constraint information; the response time constraint information is used to mark the processing constraint time and the processing time of the user request corresponding to the RPC request .

Exemplarily, after the response time constraint information is acquired, the response time constraint information may be stored in a thread local storage (Thread Local Storage, TLS) of the service processing server.

In practical applications, the service allocation server will receive the user request sent by the user, and assign a response time constraint information to the user request, the response time constraint information includes a processing constraint time corresponding to the application or service requested by the user , which is used to limit the maximum response time of the user request in the entire processing process (that is, the user request needs to be processed within the processing constraint time), and there is also an occurred processing time with an initial state of zero, which is used to count the user The total processing time of the request in the processing stages of each business processing server.

After the service allocation server allocates the response time constraint information for the user request, the service allocation server generates an RPC request according to the user request, and sends a request to the target service processing server (that is, the service processing server corresponding to the application or service requested by the RPC request) ) to send the RPC request, the RPC request carries response time constraint information corresponding to the user request, and the RPC request is used to request service processing from the target service processing server. In practical applications, completing a user request may need to be processed in multiple stages. Among them, the service distribution server will generate an RPC request for each stage, and each RPC request will be sent to the corresponding service distribution server in turn for processing. At the same time, The RPC request at each stage will carry the current response time constraint information. Every time an RPC request is completed, the response time constraint information will be updated once. The current response time constraint information also reflects the processing constraint time of the user request, and the previous Total processing time incurred by each stage.

Optionally, since the difference between the processing constraint time and the processed processing time that has occurred is equal to the processing remaining time of the processing constraint time, the parameter of the processed processing time that has occurred can also be replaced by the processing remaining time of the processing constraint time, and the parameters are obvious Substitutions should not be construed as limiting the invention.

102. The business processing server adds the RPC request to a service request queue;

The service processing server adds the RPC request to a service request queue, and the service request queue is used to store different RPC requests.

In practical applications, in order to reduce operating costs and improve resource utilization, the resources in one business processing server may be shared and utilized by multiple business distribution servers. Therefore, the business processing server may need to process multiple RPC requests at the same time , and these RPC requests will be added to the service request queue for allocation processing.

103. The service processing server allocates an execution priority and/or execution resource to the RPC request.

The service processing server sets the execution priority of each RPC request according to the response time constraint information of each RPC request in the service request queue, and/or allocates the execution resources of each RPC request.

Optionally, allocating execution resources for each RPC request may include: adjusting a central processing unit (Central Processing Unit, CPU) scheduling priority of a thread, adjusting an input/output (I/O) priority of a thread, and the like.

In the embodiment of the present invention, the RPC request received by the business processing server carries response time constraint information, and the response time constraint information is used to mark the processing constraint time and the processing time of the user request corresponding to the RPC request, so that Before processing the RPC request, the business processing server can allocate the execution priority and/or execution resources of each RPC request according to the response time constraint information of each RPC request in the service request queue, so that the time-critical RPC requests can be processed first .

In practical applications, the business processing server can have multiple strategies for regulation and control according to the response time constraint information. Referring to FIG. 2, another embodiment of the request processing method in the embodiment of the present invention includes:

201. The service processing server receives the RPC request sent by the service distribution server;

The service processing server receives the remote procedure call RPC request sent by the service distribution server, and the RPC request includes: response time constraint information; the response time constraint information is used to mark the processing constraint time of the user request corresponding to the RPC request and the completed Processing time occurs.

202. The service processing server selects a processing strategy for the RPC request according to the response time constraint information and the emergency threshold;

The business processing server selects a processing strategy for the RPC request according to the response time constraint information and the emergency threshold, and if the remaining constraint time of the response time constraint information is greater than the emergency threshold, selects and executes the first processing strategy, if If the constraint remaining time of the response time constraint information is less than or equal to the emergency threshold, the second processing strategy is selected to be executed, and the processing strategy includes: a first processing strategy and a second processing strategy, and the first processing strategy The processing complexity of is greater than that of the second processing strategy.

The emergency threshold is a judgment threshold for the service processing server to select a processing strategy for the RPC request, and may specifically be a time threshold.

Exemplarily, in an actual application, the first processing strategy may specifically include recommending content that the user may care about through data mining and analysis according to the user's request; the second processing strategy may specifically include directly recommending to the user the currently concerned content high-degree content; because the processing complexity of the first processing strategy is greater than that of the second processing strategy, when the processing time is urgent (specifically reflected by the remaining time of the constraint being less than or equal to the emergency threshold), the business processing server can choose a higher processing complexity Small second processing strategy to save processing time.

It can be understood that the first processing strategy and the second processing strategy represent only two types of strategies with different processing complexities, not specifically any two strategies, and the first processing strategy may represent the same processing complexity or two or more similar processing strategies, and the second processing strategy may also represent two or more processing strategies with the same or similar processing complexity.

Further, the business processing server may also set multi-level emergency thresholds to respectively correspond to processing strategies of various types of complexity, which is not specifically limited here.

203. The service processing server adds the RPC request to a service request queue;

The service processing server adds the RPC request to a service request queue, and the service request queue is used to store different RPC requests.

In practical applications, in order to reduce operating costs and improve resource utilization, the resources in one business processing server may be shared and utilized by multiple business distribution servers. Therefore, the business processing server may need to process multiple RPC requests at the same time , and these RPC requests will be added to the service request queue for allocation processing.

It can be understood that, in the actual application of this embodiment of the present invention, there is no strict sequence relationship between step 202 and step 203, that is, "add the RPC request to the service request queue" can also be executed, and then "according to the response time constraint information and urgency thresholds to select a processing strategy for said RPC request".

204. The business processing server assigns execution priority and/or execution resources to the RPC request;

The service processing server sets the execution priority of each RPC request according to the response time constraint information of each RPC request in the service request queue, and/or allocates the execution resources of each RPC request.

Optionally, the assignment of execution priority and/or execution resources can be performed by adjusting the resource usage of different request processing threads in the operating system or hypervisor (Hypervisor), such as adjusting the CPU scheduling priority of the thread, adjusting the I of the thread /O priority, etc.; the execution priority of the request processing thread can also be adjusted through hardware that supports priority, such as the priority determined according to the response time constraint information on the CPU's cache memory, memory controller or system bus The level allocates the hardware resources used by each processing thread.

In practical applications, before the business processing server processes the RPC request, it will determine the processing method of the RPC request according to the processing capability of the device itself, and the number and type of RPC requests in the service request queue; if the business processing server can simultaneously process For all RPC requests in the service request queue, the service processing server allocates execution resources for each RPC request according to the response time constraint information of each RPC request in the service request queue; if the service processing server can only Process any RPC request in the service request queue separately, then the service processing server sets the execution priority of each RPC request according to the response time constraint information of each RPC request in the service request queue; The processing server cannot process all RPC requests in the service request queue at the same time, and can not only process any RPC request in the service request queue separately, then the business processing server The response time constraint information sets the execution priority of each RPC request, and allocates the execution resources of each RPC request.

Further, when the business processing server sets the execution priority of each RPC request according to the response time constraint information of each RPC request in the service request queue, the business processing server can obtain the RPC request according to the response time constraint information. The constraint remaining time of the request processing constraint time; then set the execution priority of each RPC request according to the predefined rules, the predefined rules include: the less the constraint remaining time, the higher the execution priority set.

When the business processing server allocates execution resources of each RPC request according to the response time constraint information of each RPC request in the service request queue, the business processing server may acquire the processing constraints of each RPC request according to the response time constraint information The remaining time of the time: allocate the execution resources of each RPC request according to a predefined rule, and the predefined rule includes: the less the remaining time of the constraint, the more execution resources are allocated.

Still further, after the business processing server obtains the remaining time of the constraint of each RPC request, if it is found that the remaining time of the constraint of two or more RPC requests is equal, then the ratio of the remaining time of the constraint to the processing constraint time is obtained, Set a higher execution priority for the RPC request with a smaller ratio, and/or allocate more execution resources.

Still further, after the business processing server obtains the constraint remaining time of the processing constraint time, it may first judge the constraint remaining time, and if the remaining time of the processing constraint time is less than the predicted completion time of the RPC request, then give up Setting the execution priority and allocating execution resources for the RPC request, so as to save the processing resources of the business processing server; optionally, the business processing server at this time may choose to send a request failure response to the business distribution server, and the business distribution server feeds back to the user The processing of the user request fails, so that the service request is resent.

In practical applications, the business processing server can know the minimum processing time of the user request in each processing stage (it can be notified by the service distribution server), and the current service processing server adds the minimum processing time of the remaining processing stages of the user request , the predicted completion time can be obtained.

205. The service processing server feeds back the response time constraint information of the processed RPC request to the service distribution server.

After completing the setting of the execution priority and/or the allocation of execution resources, the business processing server processes the RPC request with the highest priority, records the processing time of the RPC request, and updates the RPC request according to the processing time Response time constraint information (that is, adding the processing time to the processing time that has occurred in the response time constraint information to obtain the updated processing time that has occurred).

The service processing server feeds back the response time constraint information (that is, the updated response time constraint information) of the processed RPC request to the service distribution server, so that the service distribution server updates the response time constraint information of the corresponding user request.

The above is a description of the request processing method in the embodiment of the present invention from the perspective of the service processing server, and the following describes the request processing method in the embodiment of the present invention from the side of the service distribution server. Please refer to FIG. 3 , the request processing method in the embodiment of the present invention Another embodiment of the request processing method includes:

301. The service distribution server receives a user request;

The service allocation server receives a user request, which is a service requirement or an application requirement put forward by the user to the network side, and the service requirement or application requirement may include: search, online shopping, and the like.

302. The service allocation server allocates response time constraint information for the user request;

The service allocation server allocates response time constraint information for the user request, and the response time constraint information is used to mark the processing constraint time and the processing time of the user request.

Exemplarily, the response time constraint information may be stored in the TLS of the service distribution server.

The response time constraint information includes a processing constraint time corresponding to the application or service requested by the user, which is used to limit the maximum response time of the user request in the entire processing process (that is, the user request must be processed within the constraint time processing completed), and an elapsed processing time whose initial state is zero, which is used to count the total processing time of the user request in the processing stages of each business processing server.

Optionally, the response time constraint information can be set by the administrator according to the service or application type requested by different users. After the initialization setting is completed, the service allocation server can automatically allocate according to the historical value of the response time constraint information requested by the corresponding user .

303. The service allocation server generates an RPC request according to the user request;

After the service allocation server allocates the response time constraint information for the user request, the service allocation server generates an RPC request according to the user request, and the RPC request carries the response time constraint information corresponding to the user request. The business processing server requests business processing. In practical applications, completing a user request may need to be processed in multiple stages. Among them, the service distribution server will generate an RPC request for each stage, and each RPC request will be sent to the corresponding service distribution server in turn for processing. At the same time, The RPC request at each stage will carry the current response time constraint information. Every time an RPC request is completed, the response time constraint information will be updated once. The current response time constraint information also reflects the processing constraint time of the user request, and the previous Total processing time incurred by each stage.

304. The service allocation server sends an RPC request to the service processing server.

The service allocation server sends an RPC request to the service processing server, the RPC request carrying the response time constraint information; making the service processing server set an execution priority for the RPC request according to the response time constraint information, and/or Allocate execution resources.

In the embodiment of the present invention, the RPC request sent by the service distribution server to the service processing server carries response time constraint information, and the response time constraint information is used to mark the processing constraint time and the processing time of the user request, so that the business Before processing the RPC request, the processing server may allocate the execution priority and/or execution resources of each RPC request according to the response time constraint information of each RPC request in the service request queue, so that time-critical RPC requests can be processed first.

Next, the service allocation server execution request processing method will be described in detail again. Please refer to FIG. 4. Another embodiment of the request processing method in the embodiment of the present invention includes:

401. The service allocation server receives a user request;

The service allocation server receives a user request, which is a service requirement or an application requirement put forward by the user to the network side, and the service requirement or application requirement may include: search, online shopping, and the like.

402. The service allocation server allocates response time constraint information for the user request;

The service allocation server allocates response time constraint information for the user request, and the response time constraint information is used to mark the processing constraint time of the user request and the processing time that has occurred;

The response time constraint information includes a processing constraint time corresponding to the application or service requested by the user, which is used to limit the maximum response time of the user request in the entire processing process (that is, the user request must be processed within the constraint time processing completed), and an elapsed processing time whose initial state is zero, which is used to count the total processing time of the user request in the processing stages of each business processing server.

Optionally, the response time constraint information can be set by the administrator according to the service or application type requested by different users. After the initialization setting is completed, the service allocation server can automatically allocate according to the historical value of the response time constraint information requested by the corresponding user .

Optionally, the service allocation server may allocate response time constraint information to the user request according to the historical value of the response time constraint information and the hardware information of the service processing server; specifically, if the current service processing server hardware performance , when the historical value of the response time constraint information is changed, then the ratio of the first processing speed to the second processing speed is obtained, and the historical value of the response time constraint information is multiplied by the ratio to obtain the current The response time constraint information allocated for the user request; the first processing speed is the processing speed of the RPC request by the hardware performance of the current business processing server, and the second processing speed is recording the response time constraint information The hardware performance of the business processing server at the historical value of the processing speed of the RPC request; if the hardware performance of the current business processing server has not changed compared with the historical value of the response time constraint information, then the all The historical value of the response time constraint information is used as the response time constraint information currently assigned to the user request.

403. The service allocation server generates an RPC request according to the user request;

After the service allocation server allocates the response time constraint information for the user request, the service allocation server generates an RPC request according to the user request, and the RPC request carries the response time constraint information corresponding to the user request. The business processing server requests business processing. In practical applications, completing a user request may need to be processed in multiple stages. Among them, the service distribution server will generate an RPC request for each stage, and each RPC request will be sent to the corresponding service distribution server in turn for processing. At the same time, The RPC request at each stage will carry the current response time constraint information. Every time an RPC request is completed, the response time constraint information will be updated once. The current response time constraint information also reflects the processing constraint time of the user request, and the previous Total processing time incurred by each stage.

Exemplarily, the method for generating an RPC request may be: extracting the business parameters required to complete the user request (such as request type, user ID, product ID, etc.); step, determining the business processing server to be called according to the steps to be executed; assigning corresponding business parameters to the business processing server to be called, and generating an RPC request corresponding to the business processing server.

404. The service allocation server sends an RPC request to the service processing server;

The service allocation server sends an RPC request to the service processing server, the RPC request carrying the response time constraint information; making the service processing server set an execution priority for the RPC request according to the response time constraint information, and/or Allocate execution resources.

405. The service allocation server receives the response time constraint information fed back by the service processing server;

The service distribution server receives the response time constraint information fed back by the service processing server, and uses the response time constraint information to update the response time constraint information of the corresponding RPC request.

406. The service allocation server selects an allocation processing policy corresponding to the user request according to the updated response time constraint information.

The service allocation server selects the allocation processing strategy corresponding to the user request according to the response time constraint information and the emergency allocation threshold, and the allocation processing strategy includes: a first allocation processing strategy and a second allocation processing strategy, if the response time constraint If the constraint remaining time of the information is greater than the emergency processing threshold, the first allocation processing strategy is selected to be executed; if the constraint remaining time of the response time constraint information is less than or equal to the emergency processing threshold, the second allocation processing strategy is selected to be executed. Allocating processing strategies, the processing complexity of the first allocating processing strategy is greater than that of the second allocating processing strategy.

The emergency allocation threshold is a judgment threshold for the service allocation server to select a processing strategy for user requests, and may specifically be a time threshold.

Exemplarily, in practical applications, the first allocation processing strategy may specifically include the necessary business processing flow for completing user requests, and optional data mining, statistics, and analysis flow content for improving service quality; The second allocation processing strategy can specifically include only the business processing flow content necessary to complete the user request; since the processing complexity of the first allocation processing strategy is greater than that of the second allocation processing strategy, when the processing time is urgent (specifically by constraining the remaining time When it is less than or equal to the emergency threshold), the service distribution server may select a second distribution processing strategy with less processing complexity to save processing time.

It can be understood that the first allocation processing strategy and the second allocation processing strategy represent only two types of strategies with different processing complexities, and do not specifically refer to any two strategies, and the first allocation processing strategy may represent a processing For two or more processing strategies with the same or similar complexity, the second allocated processing strategy may also represent two or more processing strategies with the same or similar processing complexity.

Further, the service allocation server may also set multi-level emergency allocation thresholds to respectively correspond to allocation processing strategies of various types of complexity, which is not specifically limited here.

The following describes an embodiment of the service processing server of the present invention for executing the above request processing method. Please refer to FIG. 5 for its logical structure. An embodiment of the service processing server in the embodiment of the present invention includes:

The request receiving unit 501 is configured to receive the remote procedure call RPC request sent by the service distribution server, the RPC request includes: response time constraint information; the response time constraint information is used to mark the processing of the user request corresponding to the RPC request Constraint time and elapsed processing time;

a storage unit 502, configured to add the RPC request to a service request queue;

The setting unit 503 is configured to set the execution priority of each RPC request according to the response time constraint information of each RPC request in the service request queue, and/or allocate the execution resources of each RPC request.

Further, the setting unit 503 in the embodiment of the present invention is specifically used for:

If the business processing server can process all the RPC requests in the service request queue at the same time, the business processing server allocates execution resources for each RPC request according to the response time constraint information of each RPC request in the service request queue ;

If the business processing server can only process any RPC request in the service request queue independently, then the business processing server sets the time limit of each RPC request according to the response time constraint information of each RPC request in the service request queue. execution priority;

If the business processing server cannot process all the RPC requests in the service request queue at the same time, nor can it only process any RPC request in the service request queue independently, then the service processing server The response time constraint information of each RPC request in the queue sets the execution priority of each RPC request, and allocates the execution resources of each RPC request.

Further, the setting unit 503 in the embodiment of the present invention may include:

The resource allocation module 5031 is configured to obtain the constraint remaining time of the processing constraint time of each RPC request according to the response time constraint information; set the execution priority of each RPC request according to a predefined rule, and the predefined rule includes : The less the remaining time of the constraint is, the higher the execution priority is set;

The priority setting module 5032 is configured to obtain the remaining time of the processing constraint time of each RPC request according to the response time constraint information; allocate the execution resources of each RPC request according to predefined rules, and the predefined rules include: The smaller the remaining time of the constraint, the more execution resources are allocated.

Further, the business processing server in the embodiment of the present invention may also include:

A processing strategy selection unit 504, configured to select a processing strategy for the RPC request according to the response time constraint information and the emergency threshold, the processing strategy includes: a first processing strategy and a second processing strategy, if the response time constraint information If the constraint remaining time of the response time constraint information is greater than the emergency threshold, the first processing strategy is selected to be executed, and if the constraint remaining time of the response time constraint information is less than or equal to the emergency threshold, the second processing strategy is selected to be executed, so The processing complexity of the first processing strategy is greater than that of the second processing strategy.

Further, the business processing server in the embodiment of the present invention also includes:

The request processing unit 505 is configured to process the RPC request with the highest priority, record the processing time of the RPC request, and update the response time constraint information of the RPC request according to the processing time;

The information feedback unit 506 is configured to feed back the response time constraint information of the processed RPC request to the service distribution server.

The specific interaction process of each unit of the service distribution server in the embodiment of the present invention is as follows:

The request receiving unit 501 receives the RPC request sent by the service allocation server, the RPC request includes: response time constraint information; the response time constraint information is used to mark the processing constraint time and the processing that has occurred for the user request corresponding to the RPC request time. Exemplarily, after the response time constraint information is acquired, the response time constraint information may be stored in the thread local memory of the service processing server.

After receiving the RPC request, the storage unit 502 adds the RPC request to a service request queue, and the service request queue is used to store different RPC requests. In practical applications, in order to reduce operating costs and improve resource utilization, the resources in one business processing server may be shared and utilized by multiple business distribution servers. Therefore, the business processing server may need to process multiple RPC requests at the same time , and these RPC requests will be added to the service request queue for allocation processing.

Optionally, after obtaining the response time constraint information, the processing policy selection unit 504 may select a processing policy for the RPC request according to the response time constraint information and the emergency threshold, if the constraints of the response time constraint information remain If the time is greater than the emergency threshold, then choose to execute the first processing strategy, if the constraint remaining time of the response time constraint information is less than or equal to the emergency threshold, then choose to execute the second processing strategy, the processing strategy It includes: a first processing strategy and a second processing strategy, the processing complexity of the first processing strategy is greater than that of the second processing strategy.

The emergency threshold is a judgment threshold for the service processing server to select a processing strategy for the RPC request, and may specifically be a time threshold.

Exemplarily, in an actual application, the first processing strategy may specifically include recommending content that the user may care about through data mining and analysis according to the user's request; the second processing strategy may specifically include directly recommending to the user the currently concerned content high-degree content; because the processing complexity of the first processing strategy is greater than that of the second processing strategy, when the processing time is urgent (specifically reflected by the remaining time of the constraint being less than or equal to the emergency threshold), the business processing server can choose a higher processing complexity Small second processing strategy to save processing time.

After adding the RPC request to the service request queue, the setting unit 503 sets the execution priority of each RPC request according to the response time constraint information of each RPC request in the service request queue, and/or allocates the execution priority of each RPC request Execution resources.

Specifically, before processing the RPC request, the processing mode of the RPC request will be determined according to the processing capability of the device itself and the number and type of RPC requests in the service request queue; if the service processing server can process the service request queue at the same time For all RPC requests in the service request queue, the service processing server allocates execution resources for each RPC request according to the response time constraint information of each RPC request in the service request queue; if the service processing server can only process the service Any RPC request in the request queue, the service processing server sets the execution priority of each RPC request according to the response time constraint information of each RPC request in the service request queue; if the service processing server cannot simultaneously Process all RPC requests in the service request queue, and not only process any RPC request in the service request queue separately, then the service processing server can Setting the execution priority of each RPC request, and allocating the execution resources of each RPC request.

Further, the resource allocation module 5031 of the setting unit 503 may obtain the constraint remaining time of the processing constraint time of each RPC request according to the response time constraint information; set the execution priority of each RPC request according to a predefined rule, The predefined rules include: the less the constraint remaining time, the higher the execution priority set; the priority setting module 5032 obtains the remaining time of the processing constraint time of each RPC request according to the response time constraint information ; Allocating the execution resources of each RPC request according to a predefined rule, the predefined rule includes: the less the remaining time of the constraint is, the more execution resources are allocated.

After completing the execution priority setting and/or execution resource allocation, the request processing unit 505 processes the RPC request with the highest priority, records the processing time of the RPC request, and updates the RPC request according to the processing time The response time constraint information (that is, adding the processing time to the processing time that has occurred in the response time constraint information to obtain the updated processing time that has occurred).

The information feedback unit 506 feeds back the response time constraint information (that is, the updated response time constraint information) of the processed RPC request to the service distribution server, so that the service distribution server updates the response time constraint information of the corresponding user request.

The following describes an embodiment of the service distribution server of the present invention for executing the above request processing method. Please refer to FIG. 6 for its logical structure. An embodiment of the service distribution server in the embodiment of the present invention includes:

A user request receiving unit 601, configured to receive a user request;

An information allocating unit 602, configured to allocate response time constraint information to the user request, where the response time constraint information is used to mark the processing constraint time of the user request and the processing time that has occurred;

A request generation unit 603, configured to generate a remote procedure call RPC request according to the user request;

A request sending unit 604, configured to send an RPC request to a business processing server, the RPC request carrying the response time constraint information; enabling the business processing server to set an execution priority for the RPC request according to the response time constraint information , and/or allocate execution resources.

Further, the information distribution unit 602 in the embodiment of the present invention is specifically used for:

Allocating response time constraint information to the user request according to the historical value of the response time constraint information and the hardware information of the service processing server.

Further, the information distribution unit 602 in the embodiment of the present invention includes:

The first allocation module 6021 is configured to obtain the ratio of the first processing speed to the second processing speed if the hardware performance of the current business processing server has changed compared to the historical value recorded in the response time constraint information, and The historical value of the response time constraint information is multiplied by the ratio to obtain the response time constraint information currently assigned to the user request; the first processing speed is the hardware performance of the current service processing server for the RPC request processing speed, the second processing speed is the processing speed of the hardware performance of the service processing server for the RPC request when recording the historical value of the response time constraint information;

The second allocation module 6022 is configured to use the historical value of the response time constraint information as the current value of the response time constraint information if the hardware performance of the current service processing server has not changed compared with the historical value of the response time constraint information recorded. Response time constraint information for user request allocation.

Further, the request generating unit 603 in this embodiment of the present invention includes:

A parameter extraction module 6031, configured to extract service parameters required to complete the user request;

Logic analysis module 6032, configured to determine the steps to be executed to complete the user request according to the preset business logic, and determine the business processing server to be called according to the steps to be executed;

The request generating module 6033 is configured to assign corresponding service parameters to the service processing servers that need to be invoked, and generate RPC requests corresponding to the service processing servers.

Further, the business processing server in the embodiment of the present invention also includes:

An information receiving unit 605, configured to receive response time constraint information fed back by the business processing server;

An information updating unit 606, configured to use the response time constraint information to update the response time constraint information of the corresponding RPC request.

An allocation policy selection unit 607, configured to select an allocation processing policy corresponding to the user request according to the response time constraint information and the emergency allocation threshold, where the allocation processing policy includes: a first allocation processing policy and a second allocation processing policy, if If the constraint remaining time of the response time constraint information is greater than the emergency processing threshold, select and execute the first allocation processing strategy; if the constraint remaining time of the response time constraint information is less than or equal to the emergency processing threshold, select The second allocation processing policy is executed, and the processing complexity of the first allocation processing policy is greater than that of the second allocation processing policy.

The specific interaction process of each unit of the service distribution server in the embodiment of the present invention is as follows:

The user request receiving unit 601 receives a user request. The user request is a service requirement or application requirement put forward by the user to the network side. The service requirement or application requirement may include: search and online shopping.

After receiving the user request, the information allocating unit 602 allocates response time constraint information for the user request, and the response time constraint information is used to mark the processing constraint time of the user request and the processing time that has occurred.

Optionally, if the hardware performance of the current business processing server has changed compared to the historical value recorded for the response time constraint information, the first allocation module 6021 obtains the ratio of the first processing speed to the second processing speed, Multiplying the historical value of the response time constraint information by the ratio to obtain the response time constraint information currently assigned to the user request; the first processing speed is the current hardware performance of the business processing server for the RPC request The processing speed, the second processing speed is the processing speed of the hardware performance of the service processing server for the RPC request when recording the historical value of the response time constraint information; if the hardware performance of the current business processing server is relative to If there is no change when the historical value of the response time constraint information is recorded, the second allocating module 6022 takes the historical value of the response time constraint information as the response time constraint information currently allocated to the user request.

After the service distribution server distributes the response time constraint information for the user request, the request generation unit 603 generates an RPC request according to the user request, the RPC request carries the response time constraint information corresponding to the user request, and the RPC request is used to send The business process server of the target requests a business process.

Specifically, the parameter extraction module 6031 extracts the business parameters required to complete the user request (such as request type, user identification, product identification, etc.); the logic analysis module 6032 determines the required execution of the user request according to the preset business logic. step, determining the business processing server that needs to be called according to the steps that need to be executed; the request generation module 6033 assigns the corresponding business parameters to the business processing server that needs to be called, and generates an RPC request corresponding to the business processing server .

After generating the RPC request, the request sending unit 604 sends the RPC request to the service processing server, the RPC request carrying the response time constraint information; making the service processing server set the RPC request according to the response time constraint information Execution priority, and/or allocation of execution resources.

The information receiving unit 605 receives the response time constraint information fed back by the service processing server, and triggers the information updating unit 606 to use the response time constraint information to update the response time constraint information of the corresponding RPC request.

After updating the response time constraint information, the allocation policy selection unit 607 selects the allocation processing policy corresponding to the user request according to the response time constraint information and the emergency allocation threshold, and the allocation processing policy includes: a first allocation processing policy and a second allocation processing policy Two allocation processing strategies, if the constraint remaining time of the response time constraint information is greater than the emergency processing threshold, select and execute the first allocation processing strategy, if the constraint remaining time of the response time constraint information is less than or equal to the If the emergency processing threshold is exceeded, the second allocation processing strategy is selected to be executed, and the processing complexity of the first allocation processing strategy is greater than that of the second allocation processing strategy.

The emergency allocation threshold is a judgment threshold for the service allocation server to select a processing strategy for user requests, and may specifically be a time threshold.

Exemplarily, in practical applications, the first allocation processing strategy may specifically include the necessary business processing flow for completing user requests, and optional data mining, statistics, and analysis flow content for improving service quality; The second allocation processing strategy can specifically include only the business processing flow content necessary to complete the user request; since the processing complexity of the first allocation processing strategy is greater than that of the second allocation processing strategy, when the processing time is urgent (specifically by constraining the remaining time When it is less than or equal to the emergency threshold), the service distribution server may select a second distribution processing strategy with less processing complexity to save processing time.

The following describes an embodiment of the request processing system of the present invention for implementing the above request processing method. Please refer to FIG. 7 for its logical structure. An embodiment of the request processing system in the embodiment of the present invention includes:

Service distribution server 701 and service processing server 702;

The service allocation server 701 is used to receive user requests; allocate response time constraint information for the user requests, and the response time constraint information is used to mark the processing constraint time and the processing time of the user request; according to the user Request to generate a remote procedure call RPC request; send the RPC request to the business processing server; the RPC request carries the response time constraint information;

The business processing server 702 is configured to receive the remote procedure call RPC request sent by the business distribution server, add the RPC request to the service request queue; set the RPC requests according to the response time constraint information of each RPC request in the service request queue request execution priority, and/or allocate execution resources for each RPC request.

For the specific steps performed by the service distribution server 701 and the service processing server 702 in the embodiment of the present invention, reference may be made to the foregoing method embodiments, and details are not repeated here.

An embodiment of the present invention also provides a computer storage medium, wherein the computer storage medium can store a program, and when the program is executed, some or all steps of the request processing method described in the above method embodiments are included.

Referring to Fig. 8, the embodiment of the present invention also provides a business processing server, which may specifically include:

Receiver 801, transmitter 802, memory 803 and processor 804 (the number of processors in the service processing server may be one or more, one processor is taken as an example in FIG. 8 ) In some embodiments of the present invention, The receiver 801 , the transmitter 802 , the memory 803 and the processor 804 may be connected through a bus or in other ways, where connection through a bus is taken as an example in FIG. 8 .

Wherein, the memory 803 can be used to store the following content:

The RPC request includes: response time constraint information; the response time constraint information is used to mark the processing constraint time of the user request corresponding to the RPC request and the processing time that has occurred;

Pre-defined rules: the less the remaining time of the constraint, the higher the execution priority set; the less the remaining time of the constraint, the more execution resources are allocated; if the remaining time of the processing constraint time is less than the RPC If the predicted completion time of the request is predicted, then give up setting the execution priority and allocating execution resources for the RPC request; if the constraint remaining time of more than two RPC requests is equal, then obtain the difference between the constraint remaining time and the processing constraint time ratio, setting a higher execution priority for the RPC request with a smaller ratio, and/or allocating more execution resources.

And the specific content of the first processing strategy and the second processing strategy.

The receiver 801 is configured to receive the RPC request sent by the service distribution server.

The sender 802 is configured to feed back the response time constraint information of the processed RPC request to the service distribution server.

The processor 804 is configured to perform the following steps:

After the receiver 801 receives the remote procedure call RPC request sent by the service distribution server, add the RPC request to the service request queue; set the execution of each RPC request according to the response time constraint information of each RPC request in the service request queue Priority, and/or allocation of execution resources for each RPC request. Specifically, the setting of execution priority and/or the allocation of execution resources may be performed according to predefined rules.

If the business processing server can process all the RPC requests in the service request queue at the same time, the business processing server allocates execution resources for each RPC request according to the response time constraint information of each RPC request in the service request queue ;

If the business processing server can only process any RPC request in the service request queue independently, then the business processing server sets the time limit of each RPC request according to the response time constraint information of each RPC request in the service request queue. execution priority;

If the business processing server cannot process all the RPC requests in the service request queue at the same time, nor can it only process any RPC request in the service request queue independently, then the service processing server The response time constraint information of each RPC request in the queue sets the execution priority of each RPC request, and allocates the execution resources of each RPC request.

Select a processing strategy for the RPC request according to the response time constraint information and an emergency threshold, the processing strategy includes: a first processing strategy and a second processing strategy, if the constraint remaining time of the response time constraint information is greater than the emergency threshold, select to execute the first processing strategy, if the constraint remaining time of the response time constraint information is less than or equal to the emergency threshold, then select to execute the second processing strategy, the processing of the first processing strategy is complex degrees greater than the second processing strategy.

Also referring to FIG. 8, an embodiment of the present invention also provides a service distribution server, which may specifically include:

Receiver 801, transmitter 802, memory 803 and processor 804 (the number of processors in the service distribution server may be one or more, one processor is taken as an example in FIG. 8 ) In some embodiments of the present invention, The receiver 801 , the transmitter 802 , the memory 803 and the processor 804 may be connected through a bus or in other ways, where connection through a bus is taken as an example in FIG. 8 .

Wherein, the memory 803 of the service allocation server can be used to store the following content:

The RPC request includes: response time constraint information; the response time constraint information is used to mark the processing constraint time of the user request corresponding to the RPC request and the processing time that has occurred;

The historical value of the response time constraint information and the hardware information of the service processing server.

The receiver 801 of the service distribution server is configured to receive user requests and response time constraint information fed back by the service processing server.

The sender 802 of the service distribution server is used to send an RPC request to the service processing server.

The processor 804 of the service distribution server is used to perform the following steps:

After receiving the user request from the receiver 801; assign response time constraint information to the user request, and generate a remote procedure call (RPC) request according to the user request.

Further, when assigning the response time constraint information to the user request, if the hardware performance of the current service processing server has changed compared with the historical value recorded in the response time constraint information, then the first processing speed and The ratio of the second processing speed, the historical value of the response time constraint information is multiplied by the ratio to obtain the response time constraint information currently assigned to the user request; the first processing speed is the current service processing server's The processing speed of the hardware performance for the RPC request, the second processing speed is the processing speed of the hardware performance of the business processing server for the RPC request when recording the historical value of the response time constraint information; if the current business processing If the hardware performance of the server has not changed since the historical value of the response time constraint information is recorded, the historical value of the response time constraint information is used as the response time constraint information currently assigned to the user request.

Further, after receiving the response time constraint information fed back by the service processing server, an allocation processing strategy corresponding to the user request is selected according to the response time constraint information and the emergency allocation threshold, and the allocation processing strategy includes: a first allocation processing strategy and a second allocation processing strategy, if the constraint remaining time of the response time constraint information is greater than the emergency processing threshold, select and execute the first allocation processing strategy, if the constraint remaining time of the response time constraint information is less than or is equal to the emergency processing threshold, the second allocation processing strategy is selected to be executed, and the processing complexity of the first allocation processing strategy is greater than that of the second allocation processing strategy.

In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or May be integrated into another system, or some features may be ignored, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.

If the integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the essence of the technical solution of the present invention or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium , including several instructions to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-OnlyMemory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk and other media that can store program codes.

The above is only a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Anyone skilled in the art can easily think of changes or substitutions within the technical scope disclosed in the present invention. Should be covered within the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Claims (26)

1. A request processing method, characterized in that, comprising: The service processing server receives the remote procedure call RPC request sent by the service distribution server, and the RPC request includes: response time constraint information; the response time constraint information is used to mark the processing constraint time of the user request corresponding to the RPC request and the completed processing time occurs; The business processing server adds the RPC request to a service request queue; The service processing server sets the execution priority of each RPC request according to the response time constraint information of each RPC request in the service request queue, and/or allocates the execution resources of each RPC request. 2. The method of claim 1, wherein, If the business processing server can process all the RPC requests in the service request queue at the same time, the business processing server allocates execution resources for each RPC request according to the response time constraint information of each RPC request in the service request queue ; If the business processing server can only process any RPC request in the service request queue independently, then the business processing server sets the time limit of each RPC request according to the response time constraint information of each RPC request in the service request queue. execution priority; If the business processing server can neither process all RPC requests in the service request queue at the same time, nor can it only process any RPC request in the service request queue independently, then the service processing server The response time constraint information of each RPC request in the queue sets the execution priority of each RPC request, and allocates the execution resources of each RPC request. 3. The method according to claim 2, wherein when the business processing server sets the execution priority of each RPC request according to the response time constraint information of each RPC request in the service request queue, the service The response time constraint information of each RPC request in the request queue sets the execution priority of each RPC request, including: Acquiring the constraint remaining time of the processing constraint time of each RPC request according to the response time constraint information; The execution priority of each RPC request is set according to a predefined rule, and the predefined rule includes: the shorter the remaining time of the constraint, the higher the execution priority set. 4. The method according to claim 2, wherein when the business processing server allocates execution resources for each RPC request according to the response time constraint information of each RPC request in the service request queue, the service request The response time constraint information of each RPC request in the queue allocates the execution resources of each RPC request, including: Acquiring the remaining time of the processing constraint time of each RPC request according to the response time constraint information; Allocate the execution resources of each RPC request according to a predefined rule, and the predefined rule includes: the smaller the remaining time of the constraint time, the more execution resources are allocated. 5. The method according to claim 3 or 4, wherein the predefined rule further comprises: if the remaining time of the processing constraint time is less than the predicted completion time of the RPC request, then abandoning the request for the RPC Requests to set execution priorities and allocate execution resources. 6. The method according to claim 3 or 4, wherein the predefined rule further comprises: if there are two or more RPC requests with the same constraint remaining time, then obtaining the constraint remaining time and the processing The ratio of the constraint time, setting a higher execution priority for the RPC request with a smaller ratio, and/or allocating more execution resources. 7. The method according to any one of claims 1 to 4, characterized in that, after receiving the remote procedure call (RPC) request sent by the service distribution server, the method includes: Select a processing strategy for the RPC request according to the response time constraint information and an emergency threshold, the processing strategy includes: a first processing strategy and a second processing strategy, if the constraint remaining time of the response time constraint information is greater than the emergency threshold, select to execute the first processing strategy, if the constraint remaining time of the response time constraint information is less than or equal to the emergency threshold, then select to execute the second processing strategy, the processing of the first processing strategy is complex degrees greater than the second processing strategy. 8. The method according to any one of claims 1 to 4, wherein the execution priority of each RPC request is set according to the response time constraint information of each RPC request in the service request queue, and/or the allocation After the execution resource of each RPC request, it includes: The business processing server processes the RPC request with the highest priority, records the processing time of the RPC request, and updates the response time constraint information of the RPC request according to the processing time; The service processing server feeds back the response time constraint information of the processed RPC request to the service distribution server. 9. A request processing method, comprising: The service distribution server receives the user request; The service allocation server allocates response time constraint information for the user request, and the response time constraint information is used to mark the processing constraint time of the user request and the processing time that has occurred; The service distribution server generates a remote procedure call (RPC) request according to the user request; The service allocation server sends an RPC request to the service processing server, the RPC request carrying the response time constraint information; making the service processing server set an execution priority for the RPC request according to the response time constraint information, and /or allocate execution resources. 10. The method according to claim 9, wherein the allocating the response time constraint information of the user request comprises: Allocating response time constraint information to the user request according to the historical value of the response time constraint information and the hardware information of the service processing server. 11. The method of claim 10, wherein, If the hardware performance of the current business processing server has changed compared to the historical value of the response time constraint information recorded, then the historical value according to the response time constraint information and the hardware information of the business processing server are the User request allocation response time constraint information, including: Obtain the ratio of the first processing speed to the second processing speed, multiply the historical value of the response time constraint information by the ratio, and obtain the response time constraint information currently assigned to the user request; the first processing speed is The processing speed of the hardware performance of the current business processing server for the RPC request, the second processing speed is the processing speed of the hardware performance of the business processing server for the RPC request when recording the historical value of the response time constraint information ; If the hardware performance of the current service processing server has not changed compared with the historical value of the response time constraint information recorded, then the historical value according to the response time constraint information and the hardware information of the service processing server are the User request allocation response time constraint information, including: The historical value of the response time constraint information is used as the response time constraint information currently assigned to the user request. 12. The method according to any one of claims 9 to 11, wherein the generating a remote procedure call (RPC) request according to a user request comprises: Extracting the service parameters required to complete the user request; Determine the steps to be executed to complete the user request according to the preset business logic, and determine the business processing server to be called according to the steps to be executed; Allocating corresponding service parameters to the service processing servers that need to be invoked, and generating RPC requests corresponding to the service processing servers. 13. The method according to any one of claims 9 to 11, characterized in that, after sending the RPC request to the business processing server, it includes: receiving response time constraint information fed back by the business processing server; The response time constraint information of the corresponding RPC request is updated by using the response time constraint information. 14. The method according to claim 13, characterized in that, after receiving the response time constraint information fed back by the business processing server, the method comprises: Select the allocation processing strategy corresponding to the user request according to the response time constraint information and the emergency allocation threshold, the allocation processing strategy includes: a first allocation processing strategy and a second allocation processing strategy, if the response time constraint information is constrained If the remaining time is greater than the emergency allocation threshold, the first allocation processing strategy is selected to be executed, and if the constraint remaining time of the response time constraint information is less than or equal to the emergency processing threshold, the second allocation processing strategy is selected to be executed , the processing complexity of the first allocation processing policy is greater than that of the second allocation processing policy. 15. A business processing server, characterized in that it comprises: A request receiving unit, configured to receive a remote procedure call (RPC) request sent by a service allocation server, the RPC request including: response time constraint information; the response time constraint information is used to mark the processing constraints of user requests corresponding to the RPC request time and elapsed processing time; a storage unit, configured to add the RPC request to a service request queue; A setting unit, configured to set the execution priority of each RPC request according to the response time constraint information of each RPC request in the service request queue, and/or allocate the execution resources of each RPC request. 16. The business processing server according to claim 15, wherein the setting unit is specifically used for: If the business processing server can process all the RPC requests in the service request queue at the same time, the business processing server allocates execution resources for each RPC request according to the response time constraint information of each RPC request in the service request queue ; If the business processing server can only process any RPC request in the service request queue independently, then the business processing server sets the time limit of each RPC request according to the response time constraint information of each RPC request in the service request queue. execution priority; If the business processing server cannot process all the RPC requests in the service request queue at the same time, nor can it only process any RPC request in the service request queue independently, then the service processing server The response time constraint information of each RPC request in the queue sets the execution priority of each RPC request, and allocates the execution resources of each RPC request. 17. The service processing server according to claim 16, wherein the setting unit comprises: A resource allocation module, configured to obtain the constraint remaining time of the processing constraint time of each RPC request according to the response time constraint information; set the execution priority of each RPC request according to predefined rules, and the predefined rules include: The shorter the remaining time of the constraint, the higher the execution priority set; A priority setting module, configured to obtain the remaining time of the processing constraint time of each RPC request according to the response time constraint information; allocate the execution resources of each RPC request according to predefined rules, and the predefined rules include: The less time remaining for the above constraints, the more execution resources are allocated. 18. The service processing server according to any one of claims 15 to 17, wherein the service processing server further comprises: A processing strategy selection unit, configured to select a processing strategy for the RPC request according to the response time constraint information and the emergency threshold, the processing strategy includes: a first processing strategy and a second processing strategy, if the response time constraint information If the remaining time of the constraint is greater than the emergency threshold, the first processing strategy is selected to be executed, and if the remaining time of the constraint of the response time constraint information is less than or equal to the emergency threshold, the second processing strategy is selected to be executed, and the The processing complexity of the first processing strategy is greater than that of the second processing strategy. 19. The service processing server according to any one of claims 15 to 17, wherein the service processing server further comprises: A request processing unit, configured to process the RPC request with the highest priority, record the processing time of the RPC request, and update the response time constraint information of the RPC request according to the processing time; The information feedback unit is configured to feed back the response time constraint information of the processed RPC request to the service allocation server. 20. A service distribution server, comprising: a user request receiving unit, configured to receive a user request; An information allocation unit, configured to allocate response time constraint information to the user request, where the response time constraint information is used to mark the processing constraint time of the user request and the processing time that has occurred; a request generation unit, configured to generate a remote procedure call (RPC) request according to the user request; a request sending unit, configured to send an RPC request to a business processing server, the RPC request carrying the response time constraint information; enabling the business processing server to set an execution priority for the RPC request according to the response time constraint information, and/or allocate execution resources. 21. The service distribution server according to claim 20, wherein the information distribution unit is specifically used for: Allocating response time constraint information to the user request according to the historical value of the response time constraint information and the hardware information of the service processing server. 22. The service distribution server according to claim 21, wherein the information distribution unit comprises: The first allocation module is configured to obtain the ratio of the first processing speed to the second processing speed if the hardware performance of the current business processing server has changed compared to the historical value of the response time constraint information recorded, and divide the The historical value of the response time constraint information is multiplied by the ratio to obtain the response time constraint information currently assigned to the user request; the first processing speed is the processing of the RPC request by the hardware performance of the current business processing server Speed, the second processing speed is the processing speed of the hardware performance of the service processing server for the RPC request when recording the historical value of the response time constraint information; The second allocation module is configured to use the historical value of the response time constraint information as the current value of the response time constraint information if the current hardware performance of the service processing server has not changed compared to the historical value of the response time constraint information recorded. Response time constraint information assigned by user request. 23. The service distribution server according to any one of claims 20 to 22, wherein the request generating unit comprises: A parameter extraction module, configured to extract service parameters required to complete the user request; A logic analysis module, configured to determine the steps to be executed to complete the user request according to preset business logic, and determine the business processing server to be called according to the steps to be executed; The request generation module is configured to assign corresponding service parameters to the service processing servers that need to be invoked, and generate RPC requests corresponding to the service processing servers. 24. The service distribution server according to any one of claims 20 to 22, wherein the service distribution server further comprises: an information receiving unit, configured to receive response time constraint information fed back by the business processing server; An information updating unit, configured to use the response time constraint information to update the response time constraint information of the corresponding RPC request. 25. The service distribution server according to claim 24, characterized in that, the service distribution server further comprises: An allocation policy selection unit, configured to select an allocation processing policy corresponding to the user request according to the response time constraint information and the emergency allocation threshold, where the allocation processing policy includes: a first allocation processing policy and a second allocation processing policy, if the If the constraint remaining time of the response time constraint information is greater than the emergency allocation threshold, select and execute the first allocation processing strategy; if the constraint remaining time of the response time constraint information is less than or equal to the emergency processing threshold, select to execute In the second allocation processing strategy, the processing complexity of the first allocation processing strategy is greater than that of the second allocation processing strategy. 26. A request processing system, comprising: Business distribution server and business processing server; The service allocation server is used to receive user requests; allocate response time constraint information for the user requests, and the response time constraint information is used to mark the processing constraint time and the processing time of the user request; according to the user request Generate a remote procedure call RPC request; send the RPC request to the business processing server; the RPC request carries the response time constraint information; The service processing server is used to receive the remote procedure call RPC request sent by the service distribution server, add the RPC request to the service request queue; set the RPC request according to the response time constraint information of each RPC request in the service request queue the execution priority of each RPC request, and/or allocate execution resources for each RPC request.