CN116828068A - A new type of heterogeneous equipment networking system and method - Google Patents

Abstract

The invention provides a file transmission compression system based on JSON, which comprises: the JSON text module is used for acquiring the JSON text; the text processing module is used for processing and compressing the JSON text through a preset Huffman coding and LZ77 algorithm to determine a processed text; and the transmission module is used for transmitting the processing text to a preset control terminal based on a preset MQTT protocol. Aiming at the problems of too many attributes or too long attributes in JSON data, the method aims to provide a more efficient and quick dynamic lossless compression method for JSON data packets.

Description

A new type of heterogeneous equipment networking system and method

Technical field

The present invention relates to the technical field of heterogeneous equipment networking, and in particular to a new heterogeneous equipment networking system and method.

Background technique

JSON is a lightweight data exchange format based on a subset of ECMAScript that uses a text format that is completely independent of programming languages to store and represent data. Often used instead of XML to transfer data between server and client. However, when the amount of data transmitted is too large, the application of JSON on the mobile Internet can easily lead to excessive consumption of network resources such as traffic and bandwidth.

Therefore, there is an urgent need for a kind of JSON data compression to process repeated keys or values in JSON data, reduce redundant format description characters, and improve the performance of mqtt transmission.

Contents of the invention

In order to overcome the problems in the above background technology, the present invention provides a JSON-based file transmission compression system to solve the problems in the above background technology.

The present invention provides a JSON-based file transmission compression system, including:

JSON text module, used to obtain JSON text;

The text processing module is used to process and compress the JSON text through the preset Huffman coding and LZ77 algorithm, and determine the processing text;

The transmission module is used to transmit the processed text to the preset control terminal based on the preset MQTT protocol.

As an embodiment of this technical solution, the JSON text module includes:

The transmission file acquisition unit is used to obtain transmission files through the preset MQTT protocol;

An identification unit, used to identify the file format of the transmission file;

JSON text unit, used to obtain JSON text in the file format JSON.

As an embodiment of this technical solution, the text processing module includes:

The optimal transmission path unit is used to calculate the optimal transmission path of the JSON text through preset Huffman coding;

The compressed file unit is used to delete the format descriptor of the JSON text through the preset LZ77 algorithm, perform lossless compression on the JSON text, and determine the compressed file;

A processing file unit is used to package the compressed file and the corresponding optimal transmission path to generate a processing file.

As an embodiment of this technical solution, the optimal transmission path unit includes:

The transmission node subunit is used to determine the transmission node of the JSON text through the preset Huffman encoding;

Path weight subunit, used to assign path weight to the transmission node;

The optimal transmission path subunit is used to calculate the optimal transmission path of the JSON text based on the path weight.

As an embodiment of this technical solution, the compressed file unit includes:

The size subunit of the sliding window is used to obtain the sliding window through the preset LZ77 algorithm and determine the size of the sliding window;

An encoding subunit, used to delete the format descriptor of the JSON text based on the size of the sliding window, and at the same time, encode the JSON text to generate corresponding triples;

The parsing subunit is used to receive a command from the terminal device, and use the command to parse the triplet within a preset space cost and time cost to determine the corresponding compressed file.

The present invention provides a JSON-based file transmission compression method, which includes:

Get JSON text;

Process and compress the JSON text through the preset Huffman coding and LZ77 algorithm to determine the text to be processed;

Based on the preset MQTT protocol, the processing text is transmitted to the preset control terminal.

As an embodiment of this technical solution, obtaining JSON text includes:

Obtain transmission files through the preset MQTT protocol;

Identify the file format of the transmission file;

Get the JSON text of the file in JSON format.

As an embodiment of this technical solution, the JSON text is processed and compressed through preset Huffman coding and LZ77 algorithm, and the processing text is determined to include:

The optimal transmission path unit is used to calculate the optimal transmission path of the JSON text through preset Huffman coding;

Use the preset LZ77 algorithm to delete the format descriptor of the JSON text, perform lossless compression on the JSON text, and determine the compressed file;

Pack the compressed file and the corresponding optimal transmission path to generate a processing file.

As an embodiment of this technical solution, calculating the optimal transmission path of the JSON text through preset Huffman coding includes:

Determine the transmission node of JSON text through the preset Huffman encoding;

Assign path weights to the transmission nodes;

Based on the path weight, the optimal transmission path of the JSON text is calculated.

As an embodiment of this technical solution, the format descriptor of the JSON text is deleted through the preset LZ77 algorithm, and the JSON text is losslessly compressed to determine the compressed file, including:

Through the preset LZ77 algorithm, obtain the sliding window and determine the size of the sliding window;

Based on the size of the sliding window, delete the format descriptor of the JSON text, and at the same time, encode the JSON text to generate the corresponding triple;

Receive a command from the terminal device, and use the command to parse the triplet within a preset space cost and time cost to determine the corresponding compressed file.

Additional features and advantages of the invention will be set forth in the description which follows, and in part will be apparent from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention may be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.

The technical solution of the present invention will be further described in detail below through the accompanying drawings and examples.

Description of the drawings

The drawings are used to provide a further understanding of the present invention and constitute a part of the specification. They are used to explain the present invention together with the embodiments of the present invention and do not constitute a limitation of the present invention. In the attached picture:

Figure 1 is a module diagram of a JSON-based file transmission compression system in an embodiment of the present invention;

Figure 2 is a module diagram of a JSON-based file transmission compression system in an embodiment of the present invention;

Figure 3 is a module diagram of a JSON-based file transmission compression system in an embodiment of the present invention.

Detailed ways

The preferred embodiments of the present invention will be described below with reference to the accompanying drawings. It should be understood that the preferred embodiments described here are only used to illustrate and explain the present invention, and are not intended to limit the present invention.

Example 1:

According to Figure 1, this technical solution provides a JSON-based file transmission compression system, including:

JSON text module, used to obtain JSON text;

The text processing module is used to process and compress the JSON text through the preset Huffman coding and LZ77 algorithm, and determine the processing text;

The transmission module is used to transmit the processed text to the preset control terminal based on the preset MQTT protocol.

The working principle and beneficial effects of the above technical solution are:

This technical solution provides a file transmission compression system based on JSON, including: JSON text module, used to obtain JSON text; JSON is an ideal data exchange language because of its concise and clear hierarchical structure, which is easy for people to read and write. Easy to parse and generate by machine, the text processing module is used to process and compress JSON text through the preset Huffman encoding and LZ77 algorithm, and determine the text to be processed; it also solves the problem of too many attributes or too long attributes in JSON data. The processing and transmission module is used to transmit the processed text to the preset control terminal based on the preset MQTT protocol, providing a more efficient and faster dynamic lossless compression method for JSON data packets.

Example 2:

According to Figure 2, this technical solution provides an embodiment. The JSON text module includes:

The transmission file acquisition unit is used to obtain transmission files through the preset MQTT protocol;

An identification unit, used to identify the file format of the transmission file;

JSON text unit, used to obtain JSON text in the file format JSON.

The working principle and beneficial effects of the above technical solution are:

The JSON text module of this technical solution includes: a transmission file acquisition unit, used to obtain the transmission file through the preset MQTT protocol; an identification unit, used to identify the file format of the transmission file; a JSON text unit, used to obtain the file format of JSON text of JSON accurately identifies the text format, reduces unnecessary resource usage, and provides compression performance.

Example 3:

According to Figure 3, this technical solution provides an embodiment. The text processing module includes:

The optimal transmission path unit is used to calculate the optimal transmission path of the JSON text through preset Huffman coding;

The compressed file unit is used to delete the format descriptor of the JSON text through the preset LZ77 algorithm, perform lossless compression on the JSON text, and determine the compressed file;

A processing file unit is used to package the compressed file and the corresponding optimal transmission path to generate a processing file.

The working principle and beneficial effects of the above technical solution are:

This technical solution processes text modules, including: an optimal transmission path unit, used to calculate the optimal transmission path of JSON text through preset Huffman coding, so that the compression path is as small as possible; a compressed file unit, used to The preset LZ77 algorithm deletes the format descriptor of the JSON text and performs lossless compression on the JSON text to determine the compressed file so that the compressed JSON data packet is as small as possible and the compression rate is as high as possible.

The processing file unit is used to package the compressed file and the corresponding optimal transmission path to generate a processing file.

Example 4:

This technical solution provides an embodiment. The optimal transmission path unit includes:

The transmission node subunit is used to determine the transmission node of the JSON text through the preset Huffman encoding;

Path weight subunit, used to assign path weight to the transmission node;

The optimal transmission path subunit is used to calculate the optimal transmission path of the JSON text based on the path weight.

The working principle and beneficial effects of the above technical solution are:

This technical solution provides an embodiment. The optimal transmission path unit includes: a transmission node subunit, used to determine the transmission node of the JSON text through preset Huffman coding; a path weight subunit, using To assign a path weight to the transmission node; and the optimal transmission path subunit is to calculate the optimal transmission path of the JSON text through the path weight. It effectively solves the problem of too many attributes or too long attributes in JSON data, improves the compression rate of JSON data packets, and reduces network resources such as bandwidth and traffic.

Example 5:

This technical solution provides an embodiment. The compressed file unit includes:

The size subunit of the sliding window is used to obtain the sliding window through the preset LZ77 algorithm and determine the size of the sliding window;

An encoding subunit, used to delete the format descriptor of the JSON text based on the size of the sliding window, and at the same time, encode the JSON text to generate corresponding triples;

The parsing subunit is used to receive a command from the terminal device, and use the command to parse the triplet within a preset space cost and time cost to determine the corresponding compressed file.

The working principle and beneficial effects of the above technical solution are:

The compressed file unit of this technical solution includes: a sliding window size subunit, which is used to obtain the sliding window through the preset LZ77 algorithm and determine the size of the sliding window; an encoding subunit, which is used to determine the size of the sliding window based on the size of the sliding window. , delete the format descriptor of the JSON text, and at the same time, encode the JSON text to generate the corresponding triplet; the parsing subunit is used to receive the command of the terminal device, and through the command, the preset space cost is The triplet is parsed and the corresponding compressed file is determined within the time cost.

Example 6:

According to Figure 1, this technical solution provides a JSON-based file transmission compression method, including:

Get JSON text;

Process and compress the JSON text through the preset Huffman coding and LZ77 algorithm to determine the text to be processed;

Based on the preset MQTT protocol, the processing text is transmitted to the preset control terminal.

The working principle and beneficial effects of the above technical solution are:

This technical solution provides a JSON-based file transmission compression method, including: obtaining JSON text; processing and compressing the JSON text through the preset Huffman encoding and LZ77 algorithm to determine the processing text. JSON is concise because of its simplicity. With a clear hierarchical structure, it is an ideal data exchange language, easy for humans to read and write, and easy for machines to parse and generate. The text processing module is used to process attributes in JSON data through the preset Huffman encoding and LZ77 algorithm. Problems with too many or too long attributes are processed. Based on the preset MQTT protocol, the processed text is transmitted to the preset control terminal, providing a more efficient and faster dynamic lossless compression method for JSON data packets.

Example 7:

This technical solution provides an embodiment. Obtaining JSON text includes:

Obtain transmission files through the preset MQTT protocol;

Identify the file format of the transmission file;

Get the JSON text of the file in JSON format.

The working principle and beneficial effects of the above technical solution are:

This technical solution obtains JSON text, including: obtaining the transmission file through the preset MQTT protocol; identifying the file format of the transmission file; and obtaining the JSON text whose file format is JSON. Accurately identify text formats, reduce unnecessary resource usage, and provide compression performance.

Example 8:

This technical solution provides an embodiment in which the JSON text is processed and compressed through preset Huffman coding and LZ77 algorithm, and the processing text is determined, including:

The optimal transmission path unit is used to calculate the optimal transmission path of the JSON text through preset Huffman coding;

Use the preset LZ77 algorithm to delete the format descriptor of the JSON text, perform lossless compression on the JSON text, and determine the compressed file;

Pack the compressed file and the corresponding optimal transmission path to generate a processing file.

The working principle and beneficial effects of the above technical solution are:

This technical solution processes and compresses JSON text through the preset Huffman coding and LZ77 algorithm, and determines the processing text, including: the optimal transmission path unit, which is used to calculate the JSON text through the preset Huffman coding. Optimal transmission path; make the compression path as small as possible, delete the format descriptor of the JSON text through the preset LZ77 algorithm, perform lossless compression on the JSON text, determine the compressed file, and combine the compressed file and the corresponding optimal transmission path Package and generate processing files.

Example 9:

This technical solution provides an embodiment that calculates the optimal transmission path of the JSON text through preset Huffman coding, including:

Determine the transmission node of JSON text through the preset Huffman encoding;

Assign path weights to the transmission nodes;

Based on the path weight, the optimal transmission path of the JSON text is calculated.

The working principle and beneficial effects of the above technical solution are:

This technical solution calculates the optimal transmission path of JSON text through preset Huffman coding, including: determining the transmission node of JSON text through preset Huffman coding; assigning path weights to transmission nodes; passing path weights Value, calculates the optimal transmission path for JSON text. It effectively solves the problem of too many attributes or too long attributes in JSON data, improves the compression rate of JSON data packets, and reduces network resources such as bandwidth and traffic.

Example 10:

This technical solution provides an embodiment in which the format descriptor of the JSON text is deleted through the preset LZ77 algorithm, and the JSON text is losslessly compressed to determine the compressed file, including:

Through the preset LZ77 algorithm, obtain the sliding window and determine the size of the sliding window;

Based on the size of the sliding window, delete the format descriptor of the JSON text, and at the same time, encode the JSON text to generate the corresponding triple;

Receive a command from the terminal device, and use the command to parse the triplet within a preset space cost and time cost to determine the corresponding compressed file.

The working principle and beneficial effects of the above technical solution are:

This technical solution uses the preset LZ77 algorithm to delete the format descriptor of the JSON text, performs lossless compression on the JSON text, and determines the compressed file, including: obtaining the sliding window through the preset LZ77 algorithm and determining the size of the sliding window; Based on the size of the sliding window, delete the format descriptor of the JSON text, and at the same time, encode the JSON text to generate the corresponding triplet; receive the command from the terminal device, and pass the command within the preset space cost and time cost. Triplet analysis to determine the corresponding compressed file.

Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Thus, the invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, magnetic disk storage, optical storage, etc.) embodying computer-usable program code therein.

The invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each process and/or block in the flowchart illustrations and/or block diagrams, and combinations of processes and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine, such that the instructions executed by the processor of the computer or other programmable data processing device produce a use A device for implementing the functions specified in one process or processes of the flowchart and/or one block or blocks of the block diagram.

These computer program instructions may also be stored in a computer-readable memory that causes a computer or other programmable data processing apparatus to operate in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction means, the instructions The device implements the functions specified in a process or processes of the flowchart and/or a block or blocks of the block diagram.

These computer program instructions may also be loaded onto a computer or other programmable data processing device, causing a series of operating steps to be performed on the computer or other programmable device to produce computer-implemented processing, thereby executing on the computer or other programmable device. Instructions provide steps for implementing the functions specified in a process or processes of a flowchart diagram and/or a block or blocks of a block diagram.

Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the invention. In this way, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and equivalent technologies, the present invention is also intended to include these modifications and variations.

Claims (10)

1. A JSON-based file transfer compression system, comprising:

the JSON text module is used for acquiring the JSON text;

the text processing module is used for processing and compressing the JSON text through a preset Huffman coding and LZ77 algorithm to determine a processed text;

and the transmission module is used for transmitting the processing text to a preset control terminal based on a preset MQTT protocol.

2. The JSON-based file transfer compression system of claim 1, in which the JSON text module comprises:

the transmission file acquisition unit is used for acquiring a transmission file through a preset MQTT protocol;

the identification unit is used for identifying the file format of the transmission file;

and the JSON text unit is used for acquiring the JSON text with the file format of JSON.

3. The JSON-based file transfer compression system of claim 1, in which the process text module comprises:

an optimal transmission path unit, configured to calculate an optimal transmission path of the JSON text through a preset huffman code;

the compression file unit is used for deleting the format descriptor of the JSON text through a preset LZ77 algorithm, carrying out lossless compression on the JSON text and determining a compression file;

and the processing file unit is used for packaging the compressed file and the corresponding optimal transmission path to generate a processing file.

4. A JSON-based file transfer compression system as claimed in claim 3, in which the optimum transfer path unit comprises:

a transmission node subunit, configured to determine a transmission node of the JSON text through a preset huffman code;

a path weight subunit, configured to assign a path weight to the transmission node;

and the optimal transmission path subunit is used for calculating the optimal transmission path of the JSON text through the path weight.

5. A JSON-based file transfer compression system as claimed in claim 3, in which the compressed file unit comprises:

the sliding window size subunit is used for acquiring the sliding window through a preset LZ77 algorithm and determining the size of the sliding window;

the coding subunit is used for deleting the format descriptor of the JSON text based on the size of the sliding window, and simultaneously coding the JSON text to generate a corresponding triplet;

and the analysis subunit is used for receiving the command of the terminal equipment, analyzing the triples within the preset space cost and time cost through the command, and determining the corresponding compressed file.

6. The file transmission compression method based on JSON is characterized by comprising the following steps of:

acquiring a JSON text;

processing and compressing the JSON text through a preset Huffman coding and LZ77 algorithm to determine a processed text;

and transmitting the processing text to a preset control terminal based on a preset MQTT protocol.

7. The JSON-based file transfer compression method of claim 6, in which the obtaining JSON text includes:

acquiring a transmission file through a preset MQTT protocol;

identifying a file format of the transmission file;

obtaining a JSON text with a JSON file format.

8. The JSON-based file transmission compression method of claim 6, in which the processing and compressing the JSON text by a preset huffman coding and LZ77 algorithm, determining the processed text, includes:

an optimal transmission path unit, configured to calculate an optimal transmission path of the JSON text through a preset huffman code;

deleting a format descriptor of a JSON text through a preset LZ77 algorithm, performing lossless compression on the JSON text, and determining a compressed file;

and packaging the compressed file and the corresponding optimal transmission path to generate a processing file.

9. The JSON-based file transmission compression method of claim 8, in which the calculating the optimal transmission path of the JSON text by means of preset huffman coding includes:

determining a transmission node of the JSON text through a preset Huffman code;

assigning a path weight to the transmission node;

and calculating the optimal transmission path of the JSON text through the path weight.

10. The JSON-based file transmission compression method of claim 8, in which deleting the format descriptor of the JSON text by a preset LZ77 algorithm, and performing lossless compression on the JSON text, and determining the compressed file, includes:

acquiring a sliding window through a preset LZ77 algorithm, and determining the size of the sliding window;

based on the size of the sliding window, deleting a format descriptor of the JSON text, and simultaneously encoding the JSON text to generate a corresponding triplet;

and receiving a command of the terminal equipment, analyzing the triples within the preset space cost and time cost through the command, and determining the corresponding compressed file.