CN108965457A - A kind of message delivery method of distributed cluster system, device, equipment and medium - Google Patents

Abstract

The embodiment of the invention discloses a message delivery method, device, equipment and computer-readable storage medium of a distributed cluster system. Wherein, the method includes that the message middleware acquires the message to be sent by the first business application, sends it to the second business application, changes the status of the message to be sent to sent after the sending is completed; and then receives the feedback from the second business application After confirming the message, the message to be sent is deleted from the middleware queue. This application is based on the information transfer of message middleware, and the business processing and message transfer are carried out asynchronously, which avoids the impact on the business operation of the distributed cluster system; through the consistency of information sending and receiving information, the process of information transfer is guaranteed Consistency can not only decouple complex calls between distributed cluster systems by passing messages, and reduce the complexity of the system; it also ensures the reliability of communication between distributed cluster systems and the consistency of business operations and message delivery.

Description

A message delivery method, device, equipment and medium of a distributed cluster system

technical field

Embodiments of the present invention relate to the technical field of distributed storage clusters, and in particular, relate to a message delivery method, device, equipment, and computer-readable storage medium of a distributed cluster system.

Background technique

With the rapid development of big data and cloud computing, distributed cluster systems have been rapidly developed and widely used.

Distributed clusters generally contain multiple nodes, and these nodes provide external services in a unified manner. Usually, there are various subsystems in the cluster. These subsystems are deployed on multiple nodes in the cluster based on the requirements of high availability. Therefore, the mutual calls between subsystems have also changed from stand-alone calls to distributed cluster system calls. Based on some business requirements, there may be interdependence and mutual calls between these systems.

As the business functions handled by the distributed cluster system gradually enrich, the number of subsystems contained in the distributed cluster system is also increasing, and the calls between subsystems will become very complicated. When one of the interdependent subsystems is modified, all related system calls need to be modified.

Message middleware uses efficient and reliable message delivery mechanism for platform-independent data exchange, and integrates distributed cluster systems based on data communication. By providing message passing and message queuing models, the communication between processes is extended in a distributed environment, such as RabbitMQ, ActiveMQ, etc., which are widely used at present.

In the existing technology, message middleware is usually introduced to decouple the mutual calls between systems, and each subsystem sends and receives messages through message middleware, transforming direct calls between systems into asynchronous calls based on message passing .

However, cross-node message transmission may be lost due to network and other reasons, so there may be inconsistencies in sending and receiving messages through message middleware. It can be seen that how to ensure the consistency of message delivery when using message middleware in a distributed cluster system is an urgent problem to be solved by those skilled in the art.

Contents of the invention

The purpose of the embodiments of the present invention is to provide a message delivery method, device, equipment and computer-readable storage medium of a distributed cluster system, and to perform message delivery in a distributed cluster system based on message middleware, which not only completes the distributed cluster system The decoupling between subsystems in the system can also ensure the reliability of message delivery and the consistency of business operations and message delivery.

In order to solve the above technical problems, embodiments of the present invention provide the following technical solutions:

On the one hand, an embodiment of the present invention provides a message delivery method for a distributed cluster system, based on message middleware, including:

Acquiring the message to be sent by the first service application, sending it to the second service application, and changing the status of the message to be sent to sent;

Obtain message confirmation information fed back by the second service application, and delete the message to be sent from the middleware queue.

Optionally, the acquiring the message to be sent of the first service application includes:

Querying the first message table of the first service application according to a preset frequency to obtain messages to be sent in the first message table.

Optionally, the acquiring the message confirmation information fed back by the second service application includes:

judging whether the message confirmation information fed back by the second service application is received within a preset time period;

If not, the to-be-sent message is sent to the second service application again until the message confirmation information fed back by the second service application is received.

Another aspect of the embodiment of the present invention provides a message delivery device for a distributed cluster system, based on message middleware, including:

An information sending module, configured to obtain a message to be sent by the first service application, send it to the second service application, and change the status of the message to be sent to sent;

The information confirmation receiving module is configured to obtain the message confirmation information fed back by the second service application, and delete the message to be sent from the middleware queue.

Optionally, the information sending module is a module that inquires the first message table of the first service application according to a preset frequency, and acquires messages to be sent in the first message table.

Optionally, the information confirmation receiving module includes:

A judging submodule, configured to judge whether the message confirmation information fed back by the second service application is received within a preset time period;

The re-sending submodule is configured to resend the message to be sent to the second service application if the message confirmation information fed back by the second service application is not received within a preset period of time until the second service application is received. 2. Message confirmation information fed back by the business application.

The embodiment of the present invention also provides a message delivery device of a distributed cluster system, including a processor, and the processor is used to implement the message delivery method of the distributed cluster system as described in any one of the preceding items when executing the computer program stored in the memory A step of.

The embodiment of the present invention also provides a computer-readable storage medium, the message delivery program of the distributed cluster system is stored on the computer-readable storage medium, and the message delivery program of the distributed cluster system is implemented when executed by the processor. The steps of the message delivery method of the distributed cluster system as described in any one of the preceding items.

The embodiment of the present invention also provides a message delivery method of a distributed cluster system, based on the first business application, including:

When executing a business operation, a message is written in the first message table through a local transaction, and the status of the message is to be sent;

Sending the message to the message middleware, so that the message middleware sends the message to the second service application, and changes the state of the message to sent after the sending is completed.

Finally, the embodiment of the present invention also provides a message delivery method of a distributed cluster system, based on the second business application, including:

When receiving the message sent by the message middleware, according to the hash value of the message, check whether the message has been processed in the second message table;

If it has been processed, send the processing result of the message to the message middleware;

If it is not processed, execute the corresponding business operation processing according to the information carried in the message, and feed back the message confirmation information to the message middleware; when the execution of the business operation is completed, save the message and the corresponding hash value to the second message table.

An embodiment of the present invention provides a message delivery method for a distributed cluster system. The message middleware acquires the message to be sent by the first business application, sends it to the second service application, and changes the state of the message to be sent after the sending is completed. is sent; then, after receiving the message confirmation information fed back by the second business application, the message to be sent is deleted from the middleware queue. The advantage of the technical solution provided by this application is that, based on the information transfer of the message middleware, business processing and message transfer are performed asynchronously, thus avoiding the impact on the business operation of the distributed cluster system, and transferring calls between distributed cluster systems from remote The call is transformed into a message-based method to decouple each subsystem; through the consistency of information sending and receiving information, the consistency in the process of information transmission can be guaranteed, and the distributed cluster system can be connected by sending messages. Decoupling complex calls to reduce the complexity of the distributed cluster system; also to ensure the reliability of communication between distributed cluster systems, and the consistency of business operations and message delivery.

In addition, the embodiments of the present invention also provide corresponding implementation devices, devices, and computer-readable storage media for the message delivery method of the distributed cluster system, which further makes the method more practical. The device, device, and computer-readable The storage medium has corresponding advantages.

Description of drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions of the prior art, the following will briefly introduce the accompanying drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only For some embodiments of the present invention, those skilled in the art can also obtain other drawings based on these drawings without creative work.

FIG. 1 is a schematic diagram of an interaction process of a message delivery method of a distributed cluster system provided by an embodiment of the present invention;

FIG. 2 is a structural diagram of a specific implementation manner of a message transfer device of a distributed cluster system provided by an embodiment of the present invention;

FIG. 3 is a structural diagram of another specific implementation manner of the message transfer device of the distributed cluster system provided by the embodiment of the present invention;

FIG. 4 is a structural diagram of yet another specific implementation manner of the message delivery device of the distributed cluster system provided by the embodiment of the present invention.

Detailed ways

In order to enable those skilled in the art to better understand the solution of the present invention, the present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments. Apparently, the described embodiments are only some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

The terms "first", "second", "third" and "fourth" in the specification and claims of this application and the above drawings are used to distinguish different objects, rather than to describe a specific order . Furthermore, the terms "comprising" and "having", and any variations thereof, are intended to cover a non-exclusive inclusion. For example, a process, method, system, product, or device comprising a series of steps or units is not limited to the listed steps or units, but may include unlisted steps or units.

After introducing the technical solutions of the embodiments of the present invention, various non-limiting implementations of the present application will be described in detail below.

First, referring to FIG. 1, FIG. 1 is a schematic diagram of an interactive flow diagram of a message delivery method of a distributed cluster system provided by an embodiment of the present invention. The embodiment of the present invention may include the following:

S101: When performing a business operation, the first business application writes a message in the first message table through a local transaction, and the state of the message is a state to be sent.

The first message table is used to store the messages of the first business application. The first business application can write the messages that need to be sent when performing business operations into the first message table through local transactions. When the message middleware does not read the messages , the state of the information in the first message table is the state to be sent.

S102: After completing the service operation, the first service application sends a request instruction to the message middleware for sending the message to the second service application.

S103: The message middleware obtains the message to be sent by the first service application in the first message table, sends it to the second service application, and changes the status of the message to be sent to sent.

S104: The second service application receives the message sent by the message middleware, and checks whether the message has been processed in the second message table according to the hash value of the message, and if yes, executes S105; if not, executes S106.

The second message table is used to store messages of the second service application.

As for how to obtain the hash value of the message and query the information from the second message table according to the hash value, reference may be made to the prior art, and details will not be repeated here.

S105: The second service application sends a processing result of the message to the message middleware.

The processing result may be the result that the message has been processed, or it has been completed, so that the message middleware knows that the second service application has received the message sent to it by the first service application.

S106: The second service application performs corresponding service operation processing according to the information carried in the message, and feeds back message confirmation information to the message middleware.

When the first service application sends a message to the second service application, the message will carry relevant address information of the first service application, relevant address information of the second service application, business operations to be performed by the second service application, etc., so that the second service application 2. The business application defines the tasks to be performed.

S107: After the second service application executes the service operation, save the message and the corresponding hash value in the second message table.

S108: The message middleware acquires the message confirmation information fed back by the second service application, and deletes the message from the middleware queue.

In the technical solution provided by the embodiment of the present invention, based on the information transfer of the message middleware, the business processing and the message transfer are carried out asynchronously, thereby avoiding the impact on the business operation of the distributed cluster system, and the inter-distributed cluster system call from The remote call is transformed into a message-based method to decouple each subsystem; through the consistency of information sending and receiving information, the consistency in the process of information transmission can be guaranteed, and the distributed cluster system can be updated by passing messages. Decoupling the complex calls between distributed cluster systems reduces the complexity of distributed cluster systems; it also ensures the reliability of communication between distributed cluster systems and the consistency of business operations and message delivery.

Based on the above-mentioned embodiments, in order to further ensure the consistency of information transmission, the present application can also add a polling thread to the message middleware, and the polling thread can regularly query the first message table according to a certain frequency (for example, every 1 minute). , timely query the messages whose status is to be sent in the first message table, and send the messages that have not been successfully sent due to network and other reasons, and perform the sending operation again. Similarly, after the sending is completed, change the status of the message to "sent".

In order to further ensure the consistency of information reception, this application may also include:

The message middleware judges whether the message confirmation information fed back by the second business application is received within a preset period of time (for example, 5 minutes);

If not, the message to be sent is sent to the second service application again until the message confirmation information fed back by the second service application is received.

Of course, if the message middleware sends messages to the second business application multiple times in succession (threshold can be set according to the actual application scenario, for example, 5 times), but no confirmation information fed back by the second business application is received, at this time, the system may appear For other problems, you can give feedback to the relevant personnel, so that the relevant staff can promptly investigate the cause of the problem and perform maintenance in a timely manner, improve the work efficiency of the entire system, and further ensure the consistency of information sending and receiving.

The embodiment of the present invention also provides a corresponding implementation device for the message delivery method of the distributed cluster system, which further makes the method more practical. The message delivery device of the distributed cluster system provided by the embodiment of the present invention is introduced below. The message delivery device of the distributed cluster system described below and the message delivery method of the distributed cluster system described above can be referred to in correspondence.

Referring to FIG. 2, FIG. 2 is a structural diagram of a message delivery device of a distributed cluster system provided in an embodiment of the present invention in a specific implementation manner, and the device may include:

The information sending module 201 is used to obtain the message to be sent by the first service application, send it to the second service application, and change the status of the message to be sent to sent;

The information confirmation receiving module 202 is configured to obtain the message confirmation information fed back by the second service application, and delete the message to be sent from the middleware queue.

Optionally, in a specific implementation manner, the information sending module 201 may also be a module that inquires the first message table of the first service application at a preset frequency to obtain messages to be sent in the first service application.

In another implementation manner, the information confirmation receiving module 202 may further include:

The judging sub-module is used to judge whether the message confirmation information fed back by the second business application is received within the preset time period;

The re-sending sub-module is used to resend the message to be sent to the second service application if the message confirmation information fed back by the second service application is not received within the preset time period, until the message confirmation information fed back by the second service application is received .

In addition, please refer to FIG. 3 , the present application also provides another message delivery device for a distributed cluster system in a specific implementation manner, which may specifically include:

The message writing module 301 is used to write a message in the first message table through a local transaction when performing a business operation, and the status of the message is to be sent;

The message sending module 302 is configured to send the message to the message middleware, so that the message middleware sends the message to the second service application, and changes the state of the message to sent after the sending is completed.

Finally, as shown in FIG. 4 , this application also provides another message delivery device for a distributed cluster system in a specific implementation manner, which may specifically include:

The information search module 401 is used to search whether the message has been processed in the second message table according to the hash value of the message when receiving the message sent by the message middleware;

Feedback result module 402, configured to send the processing result of the message to the message middleware when the message has been processed;

The message processing module 403 is configured to perform corresponding business operation processing according to the information carried in the message when the message has been processed, and feed back message confirmation information to the message middleware;

The message storage module 404 is configured to store the message and the corresponding hash value in the second message table after the execution of the service operation is completed.

The functions of each functional module of the message delivery device of the distributed cluster system described in the embodiment of the present invention can be specifically implemented according to the method in the above method embodiment, and the specific implementation process can refer to the relevant description of the above method embodiment, and will not be repeated here repeat.

It can be seen from the above that the embodiment of the present invention performs message transmission in the distributed cluster system based on message middleware, which not only completes the decoupling between subsystems in the distributed cluster system, but also ensures the reliability of message transmission and business operations and messaging consistency.

The embodiment of the present invention also provides a message delivery device for a distributed cluster system, which may specifically include:

memory for storing computer programs;

A processor, configured to execute a computer program to implement the steps of the message delivery method for a distributed cluster system as described in any one of the above embodiments.

The functions of each functional module of the message delivery device of the distributed cluster system described in the embodiment of the present invention can be specifically implemented according to the method in the above method embodiment, and the specific implementation process can refer to the relevant description of the above method embodiment, which will not be repeated here repeat.

It can be seen from the above that the embodiment of the present invention performs message transmission in the distributed cluster system based on message middleware, which not only completes the decoupling between subsystems in the distributed cluster system, but also ensures the reliability of message transmission and business operations and messaging consistency.

The embodiment of the present invention also provides a computer-readable storage medium, which stores the message delivery program of the distributed cluster system. When the message delivery program of the distributed cluster system is executed by the processor, the distributed Steps of a message passing method for a cluster system.

The functions of each functional module of the computer-readable storage medium in the embodiments of the present invention can be specifically implemented according to the methods in the above-mentioned method embodiments, and the specific implementation process can refer to the relevant descriptions of the above-mentioned method embodiments, which will not be repeated here.

It can be seen from the above that the embodiment of the present invention performs message transmission in the distributed cluster system based on message middleware, which not only completes the decoupling between subsystems in the distributed cluster system, but also ensures the reliability of message transmission and business operations and messaging consistency.

Each embodiment in this specification is described in a progressive manner, each embodiment focuses on the difference from other embodiments, and the same or similar parts of each embodiment can be referred to each other. As for the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and for the related information, please refer to the description of the method part.

Professionals can further realize that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, computer software or a combination of the two. In order to clearly illustrate the possible For interchangeability, in the above description, the composition and steps of each example have been generally described according to their functions. Whether these functions are executed by hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the present invention.

The steps of the methods or algorithms described in connection with the embodiments disclosed herein may be directly implemented by hardware, software modules executed by a processor, or a combination of both. Software modules can be placed in random access memory (RAM), internal memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or any other Any other known storage medium.

The message transfer method, device, equipment and computer-readable storage medium of a distributed cluster system provided by the present invention have been introduced in detail above. In this paper, specific examples are used to illustrate the principle and implementation of the present invention, and the descriptions of the above embodiments are only used to help understand the method and core idea of the present invention. It should be pointed out that for those skilled in the art, without departing from the principle of the present invention, some improvements and modifications can be made to the present invention, and these improvements and modifications also fall within the protection scope of the claims of the present invention.

Claims (10)

1. a kind of message delivery method of distributed cluster system, which is characterized in that be based on message-oriented middleware, comprising:

The message to be sent for obtaining the first service application, sends it to the second service application, and by the message to be sent State is changed to send；

The message authentication information for obtaining the second service application feedback, the message to be sent is deleted from middleware queue It removes.

2. the message delivery method of distributed cluster system according to claim 1, which is characterized in that described to obtain first The message to be sent of service application includes:

The first message table that first service application is inquired according to predeterminated frequency obtains to be sent in the first message table Message.

3. the message delivery method of distributed cluster system according to claim 2, which is characterized in that described in the acquisition Second service application feedback message authentication information include:

Judge the message authentication information that the second service application feedback whether is received in preset duration；

If it is not, the message to be sent is then sent to second service application again, until receiving second business Using the message authentication information of feedback.

4. a kind of messaging device of distributed cluster system, which is characterized in that be based on message-oriented middleware, comprising:

Information sending module sends it to the second service application, and will for obtaining the message to be sent of the first service application The state of the message to be sent is changed to send；

Validation of information receiving module will be described to be sent for obtaining the message authentication information of the second service application feedback Message is deleted from middleware queue.

5. the messaging device of distributed cluster system according to claim 4, which is characterized in that the information is sent Module is that the first message table of first service application is inquired according to predeterminated frequency, is obtained pending in the first message table Send the module of message.

6. the messaging device of distributed cluster system according to claim 5, which is characterized in that the validation of information Receiving module includes:

Judging submodule, the message authentication letter for judging whether to receive the second service application feedback in preset duration Breath；

Sending submodule again, for not receiving the message authentication letter of the second service application feedback in preset duration Breath, then be sent to second service application for the message to be sent again, until it is anti-to receive second service application The message authentication information of feedback.

7. a kind of message transmission device of distributed cluster system, which is characterized in that including processor, the processor is for holding The message of the distributed cluster system as described in any one of claims 1 to 3 is realized when the computer program stored in line storage The step of transmission method.

8. a kind of computer readable storage medium, which is characterized in that be stored with distribution on the computer readable storage medium It realizes when the messaging program of the messaging program of group system, the distributed cluster system is executed by processor as weighed Benefit requires the step of message delivery method of any one of 1 to 3 distributed cluster system.

9. a kind of message delivery method of distributed cluster system, which is characterized in that be based on the first service application, comprising:

When executing business operation, by local matter, message is written in first message table, the state of the message is pending It send；

Message-oriented middleware is sent the message to, so that the message-oriented middleware sends the message to the second business and answers With, and be changed to send by the state of the message after completing to send.

10. a kind of message delivery method of distributed cluster system, which is characterized in that be based on the second service application, comprising:

When the message for receiving message-oriented middleware transmission searches whether in second message table according to the cryptographic Hash of the message The processed message；

If processed, the processing result of the message is sent to the message-oriented middleware；

If untreated, corresponding business operation is executed according to the information that the message carries and is handled, and among the message Part feedback message confirmation message；After the completion of executing business operation, the message and corresponding cryptographic Hash are saved to described In second message table.