CN118467630A - A sewage treatment site edge computing system and method under cloud-edge fusion architecture - Google Patents

Abstract

The invention discloses a sewage treatment site edge computing system and method under a cloud edge fusion architecture, comprising the following steps: the equipment management module is used for managing the sewage treatment equipment, the data acquisition equipment and the auxiliary equipment; the data acquisition module can acquire the original data of each device and analyze the content of the data packet; the data preprocessing module is used for further processing the acquired source data; the data storage module is in charge of storing the data transmitted by the last node into a database; the flow management module is responsible for configuration and modification of the whole process flow of sewage treatment; the flow control module is used for controlling the sewage treatment process to be executed according to rules; the equipment control module is used for executing corresponding actions by equipment; and the data reporting module reports the temporarily stored data to the cloud platform. According to the invention, a large amount of sewage treatment equipment can be connected with the edge computing nodes and is not directly connected with the cloud platform any more, so that the connection pressure of the cloud platform is greatly reduced, and the expandability of the cloud platform is improved.

Description

A sewage treatment site edge computing system and method under cloud-edge fusion architecture

Technical Field

The present invention relates to the technical field of sewage treatment, and in particular to an edge computing system and method for a sewage treatment site under a cloud-edge fusion architecture.

Background Art

In recent years, information technologies such as cloud computing, edge computing, the Internet of Things, 5G, and big data have developed rapidly, and various Internet of Things cloud platforms have emerged one after another. As we all know, cloud computing is usually provided by large data centers, which have a large amount of computing and storage resources to meet the needs of higher-scale applications. However, since data needs to be transmitted to a distant data center, cloud computing has a high latency problem, which will have a certain impact on applications with high real-time requirements. In addition, since cloud computing is highly dependent on the network, its network congestion, high latency, and low service quality may be prominent in large-scale Internet of Things devices and sensor scenarios.

There are many types of terminal equipment in sewage treatment stations, and the number is quite large. The treatment process is extremely complex, and it often requires multiple terminal equipment to cooperate with each other and multiple equipment to complete each link in order to fully realize the process flow of sewage treatment. In the sewage treatment process, various terminal equipment generates a large amount of process data. The next action of the terminal equipment depends on the state reflected by the current process data. Therefore, there is a strong demand for data transmission efficiency and real-time processing capabilities. Conventional cloud computing processes data with delays, which affects the work efficiency of sewage treatment sites.

Summary of the invention

In order to solve the above problems, the present invention provides an edge computing system and method for sewage treatment sites under a cloud-edge fusion architecture, which introduces edge computing to reduce the transmission pressure of cloud computing and improve real-time processing capabilities.

To this end, the technical solution of the present invention is: a sewage treatment site edge computing system under a cloud-edge fusion architecture, comprising:

Equipment management module, used to manage sewage treatment equipment, data acquisition equipment and auxiliary equipment;

The data acquisition module can collect the original data of each device through the Modbus protocol, parse the data packet content, and cooperate with the device management module to correspond the parsed device address to the specific device;

Data preprocessing module, further processing the collected source data;

The data storage module is responsible for storing the data passed from the previous node into the database;

The process management module is responsible for the configuration and modification of the entire process of sewage treatment;

The process control module controls the sewage treatment process to be executed according to the rules based on the information configured by the process management module;

The device control module sends Modbus commands to the specified device to make the device perform corresponding actions;

The data reporting module reports the temporarily stored data to the cloud platform according to the configuration information.

On the basis of the above scheme and as a preferred scheme of the above scheme: the device management module can be configured with various data types, data measurement units, collection frequencies, and numerical conversion methods collected from various devices, and also has the functions of adding, deleting, modifying, and viewing.

On the basis of the above scheme and as a preferred scheme of the above scheme: the further processing of the source data by the data preprocessing module includes: discarding invalid information, deleting redundant information, converting measurement units, converting data types, combining processing and decomposing processing.

On the basis of the above solution and as a preferred solution of the above solution: the database is a time series database InfluxDB.

On the basis of the above scheme and as a preferred scheme of the above scheme: the action instructions sent by the device control module include turning on the device, turning off the device, obtaining the operating status, obtaining the fault status and obtaining the monitoring value.

On the basis of the above scheme and as a preferred scheme of the above scheme: the data reported by the data reporting module includes part of the collected original data, pre-processed data, and the operating status and fault status of various devices.

Another technical solution of the present invention is: an edge computing method for a sewage treatment site under a cloud-edge fusion architecture, comprising the following steps:

1) Continuously collect data from sewage treatment equipment, data acquisition equipment and auxiliary equipment through Modbus protocol;

2) Further processing of source data, including discarding invalid information, deleting redundant information, converting measurement units, converting data types, combining and decomposing. The new data generated after preprocessing is transmitted to the data storage node, process control node and data reporting node;

3) After receiving the data, the data storage node stores the data in the time series database InfluxDB;

4) After receiving the pre-processed data, the process control node performs the following processing:

4.1) Determine whether the data exceeds the threshold. If so, immediately generate the relevant next step instructions and transfer them to the device control node. At the same time, generate warning information and transfer it to the data reporting node;

4.2) Determine whether to trigger the next action based on the value of one or more data received. If the next action is triggered, generate the relevant next instruction, and the instruction is transferred to the device control node;

4.3) Save all current status values of all devices;

4.4) The process control node determines whether to trigger the next action based on the configured time trigger condition and the current corresponding state value;

5) After receiving the command, the device control node translates the command into a Modbus command, and then sends the Modbus command to the port where the device is connected;

6) After receiving the transferred data, the data reporting node pushes the data to the cloud platform.

On the basis of the above scheme and as a preferred scheme of the above scheme: in the step 1), the data collected from various devices are binary values, which are parsed into decimal values, and then corresponding to each specific device in the device library and passed to the next node.

On the basis of the above scheme and as a preferred scheme of the above scheme: in the step 3), reversible encryption is used for data storage, and the data is encrypted before storage and decrypted after data acquisition; and a scheduled data backup mechanism is designed to ensure the integrity and availability of the data.

On the basis of the above scheme and as a preferred scheme of the above scheme: in the step 6), reversible data encryption is used in the data transmission process, the data is encrypted before sending, the transmission process uses encrypted data transmission, and the cloud platform decrypts the data after receiving it.

The sewage treatment site edge computing system of the present invention is connected to the sewage treatment equipment in the south direction. Through this connection, the edge computing node is responsible for sending instructions to the equipment and collecting various status data and process data in the sewage treatment process; it is connected to the cloud platform in the north direction. Through this connection, the edge computing node is responsible for transmitting the pre-processed data to the cloud platform.

The southbound connection uses the Modbus protocol to collect and parse the data, which are the original sewage treatment status data and process data. The amount of these original data is huge. Directly transmitting them to the cloud platform not only takes up a lot of network resources, but also has little value. The data preprocessing module can perform data cleaning, data integration, data transformation, data normalization and data dimension reduction, remove missing values from the original data, process outliers, process duplicate values, and merge them into a large data set. Then, through feature transformation, variable transformation, and numerical transformation, the data in the large data set is transformed into a better form to reduce the noise of the data set, correct unstructured data, and enhance the value of data attributes, so as to ensure the quality and accuracy of the data. The volume of the preprocessed data has been greatly reduced, and its value is more obvious, laying a solid foundation for the subsequent data transmission and temporary storage.

Compared with the prior art, the present invention has the following beneficial effects:

1. A large number of sewage treatment equipment are connected to edge computing nodes instead of directly connected to the cloud platform, which greatly reduces the connection pressure of the cloud platform and improves the scalability of the cloud platform;

2. The edge computing node collects a large amount of raw data, including status data, process data, and warning data, and first pre-processes it before sending it to the cloud platform, which greatly reduces the amount of data transmission and reduces the occupation of bandwidth resources;

3. In the event of a disconnection, the edge computing node can cache the data first, and then transmit the data to the cloud platform when the connection with the cloud platform is restored, which can ensure the integrity of the data;

4. Since the business logic of the sewage treatment process configured in the cloud has been sent to the edge computing node, and the edge node has the ability to pre-process and temporarily store data, the edge subsystem can be operated offline when disconnected from the cloud platform, ensuring the 24-hour uninterrupted operation of the sewage treatment site and enhancing the robustness of the automated sewage treatment in the site;

5. A large number of tasks originally calculated by the cloud platform are offloaded to the edge, reducing the computing pressure of the cloud platform; and the edge realizes local computing, which can better ensure the real-time computing.

BRIEF DESCRIPTION OF THE DRAWINGS

The following is a further detailed description of the embodiments of the present invention in conjunction with the accompanying drawings.

Fig. 1 is a system block diagram of the present invention;

FIG2 is a diagram of an edge network relationship model of the present invention;

Figure 3 is a relationship diagram of cloud, edge computing, terminal devices, and users.

DETAILED DESCRIPTION

In the description of the present invention, it should be noted that directional words, such as the terms "center", "lateral (X)", "longitudinal (Y)", "vertical (Z)", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", "clockwise", "counterclockwise", etc., indicating directions and positional relationships are based on the directions or positional relationships shown in the accompanying drawings, which are only for the convenience of narrating the present invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and cannot be understood as limiting the specific scope of protection of the present invention.

In addition, the terms "first" and "second" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features. Therefore, the definition of "first" and "second" features can explicitly or implicitly include one or more of the features. In the description of the present invention, "several" and "a number" mean two or more, unless otherwise clearly and specifically defined.

The sewage treatment site edge computing system under the cloud-edge fusion architecture described in this embodiment includes: a device management module, a data acquisition module, a data preprocessing module, a data storage module, a process management module, a process control module, a device control module and a data reporting module.

in:

Device management module

Responsible for managing sewage treatment equipment, data collection equipment and various auxiliary equipment, etc. At the same time, it can configure various data types, data measurement units, collection frequencies, numerical conversion methods, etc. collected from various devices, including adding, deleting, modifying and viewing functions.

Data acquisition module

The original data of each device is collected through the Modbus protocol, the data packet content is parsed, and the parsed device address is matched to the specific device in cooperation with the device management module.

Data preprocessing module

The collected source data is further processed, including discarding invalid information, deleting redundant information, converting measurement units, converting data types, combining processing, decomposing processing, etc. After preprocessing, new data is generated and passed to the next node.

Data storage module

Responsible for storing the data passed from the previous node into the database; considering that the data generated by the sewage treatment process is time-related and has a strong timeliness, the time series database InfluxDB is selected.

Process management module

Responsible for the configuration, modification, etc. of the entire sewage treatment process, but not responsible for its execution.

Process control module

According to the information configured in the process management module, the sewage treatment process is controlled to be executed according to the rules.

Equipment control module

Send Modbus commands to the specified device to make the device perform corresponding actions, including turning on the device, turning off the device, obtaining the operating status, obtaining the fault status, obtaining the monitoring value, etc.

Data reporting module

According to the configuration information, the temporarily stored data is reported to the cloud platform. The reported data may include part of the collected original data, pre-processed data, the operating status and fault status of various devices, etc.

The edge computing approach includes the following steps:

1) Through the Modbus protocol, data is continuously collected from sewage treatment equipment, data acquisition equipment and auxiliary equipment; the data collected from various devices are binary values, which are parsed into decimal values and corresponded to each specific device in the device library before being passed to the next node.

2) Further process the source data, including discarding invalid information, deleting redundant information, converting measurement units, converting data types, combining processing, and decomposing processing. The new data generated after preprocessing is passed to the data storage node, process control node, and data reporting node.

3) After receiving the data, the data storage node stores the data in the time series database InfluxDB.

4) After receiving the pre-processed data, the process control node performs the following processing:

4.1) Determine whether the data exceeds the threshold. If so, immediately generate the relevant next step instructions and transfer them to the device control node. At the same time, generate warning information and transfer it to the data reporting node;

4.2) Determine whether to trigger the next action based on the value of one or more data received. If the next action is triggered, generate the relevant next instruction, and the instruction is transferred to the device control node;

4.3) Save all current status values of all devices;

4.4) The process control node determines whether to trigger the next action based on the configured time trigger condition and the current corresponding state value.

5) After receiving the command, the device control node translates the command into a Modbus command, and then sends the Modbus command to the port where the device is connected.

6) After receiving the transferred data, the data reporting node pushes the data to the cloud platform.

Edge computing systems have the following functions:

1. Data collection, preprocessing and transmission can be performed:

The edge computing system of the sewage treatment site is connected to the sewage treatment equipment in the south. Through this connection, the edge computing node is responsible for sending instructions to the equipment and collecting various status data and process data in the sewage treatment process. The southbound connection uses the Modbus protocol to collect and parse the original sewage treatment status data and process data, and then perform data cleaning, data integration, data transformation, data normalization and data dimension reduction. The original data can remove missing values, process outliers, and process duplicate values, and merge them into a large data set. Then, the data in the large data set is transformed into a better form through feature transformation, variable transformation, and numerical transformation, so as to reduce the noise of the data set, correct unstructured data, and enhance the value of data attributes, so as to ensure the quality and accuracy of the data. The volume of the preprocessed data has been greatly reduced, and its value is more obvious, laying a solid foundation for the subsequent data transmission and temporary storage.

2. Configuration synchronization:

The edge computing system of the sewage treatment site transmits data northward through the MQTT (Message Queuing Telemetry Transport) protocol. The sewage treatment process is complex, and there are many types and quantities of equipment in the site. However, because the platform has deeply abstracted the equipment and workflow of the sewage treatment site, the equipment, topology, workflow, etc. in the site can be configured in a visual way on the cloud platform web interface, and then the configuration is notified to the edge site through MQTT instructions. After receiving the notification, the edge site obtains the latest configuration information from the cloud platform through the HTTP protocol.

Notifying edge sites through the MQTT protocol can ensure the timeliness of notifications. The configuration information contains information about dozens or even hundreds of devices in the site, each process flow of the sewage treatment process in the site, and the thresholds of various alarm information. The configuration volume is large. After receiving the notification, the edge site can choose the appropriate time to obtain the configuration information through the http protocol as needed. The two protocols work together to ensure the reliability of obtaining configuration information and make the new configuration information take effect immediately after obtaining it.

3. Can run offline

The configuration information of the sewage treatment site includes equipment information, topology or topology information, workflow, alarm threshold configuration, etc., and is ultimately sent to the edge computing node of the sewage treatment site. Even if the connection with the cloud platform is disconnected, the orderly operation of the sewage treatment process can be guaranteed, thereby ensuring the 24-hour uninterrupted and stable operation of the sewage treatment site.

4. Data Temporary Storage

When the sewage treatment site is disconnected from the cloud platform, it can run offline, but the status data, process data, and alarm data generated during offline operation cannot be delivered to the cloud platform. Therefore, a database for temporarily storing data is designed at the edge computing node, which can save data for a certain period of time, and then transfer it to the cloud platform for storage after the connection with the cloud platform is restored, or automatically delete the temporarily stored data after the storage period expires. This design can not only ensure the integrity of valid data, but also ensure that the storage space and performance of the edge site are released in a timely manner.

5. Data security

Reversible data encryption is used during data transmission. The producer encrypts the data before sending it, and the transmission process uses encrypted data transmission. The consumer decrypts the data after receiving it. In addition, both the MQTT protocol and the HTTP protocol are attached with TLS/SSL to achieve secure transmission.

The local data storage also uses reversible encryption, encrypting the data before storage and decrypting it after retrieval. A scheduled data backup mechanism is also designed to ensure the integrity and availability of the data.

Data permission control is mainly achieved through identity authentication.

The edge computing form of the sewage treatment site under the cloud-edge fusion architecture plays a connecting role and is also the core of the sewage treatment site. Even without the remote command of the cloud platform, the entire treatment process can be completed uninterruptedly; the automated sewage treatment in the site becomes more real-time, effective, accurate and reliable.

The above is only a preferred embodiment of the present invention, and the protection scope of the present invention is not limited to the above embodiments. All technical solutions under the concept of the present invention belong to the protection scope of the present invention. It should be pointed out that for ordinary technicians in this technical field, some improvements and modifications without departing from the principle of the present invention should also be regarded as the protection scope of the present invention.

Claims (10)

1. The utility model provides a sewage treatment website edge computing system under cloud limit fuses framework which characterized in that: comprising the following steps:

The equipment management module is used for managing the sewage treatment equipment, the data acquisition equipment and the auxiliary equipment;

The data acquisition module can acquire the original data of each device through the Modbus protocol, analyze the content of the data packet, and coordinate with the device management module to correspond the analyzed device address to the specific device;

the data preprocessing module is used for further processing the acquired source data;

the data storage module is in charge of storing the data transmitted by the last node into a database;

the flow management module is responsible for configuration and modification of the whole process flow of sewage treatment;

the flow control module is used for controlling the sewage treatment process to be executed according to rules according to the information configured by the flow management module;

The device control module sends Modbus instructions to the appointed devices so that the devices execute corresponding actions;

And the data reporting module is used for reporting the temporarily stored data to the cloud platform according to the configuration information.

2. The edge computing system of a sewage treatment site under a cloud edge fusion architecture as defined in claim 1, wherein: the device management module can configure various data types, data measurement units, acquisition frequencies and numerical conversion modes acquired from various devices, and has the functions of adding, deleting, modifying and viewing.

3. The edge computing system of a sewage treatment site under a cloud edge fusion architecture as defined in claim 1, wherein: the further processing of the source data by the data preprocessing module comprises the following steps: invalid information discarding, redundant information deleting, unit of measure conversion, data type conversion, combination processing, and decomposition processing.

4. The edge computing system of a sewage treatment site under a cloud edge fusion architecture as defined in claim 1, wherein: the database is a time sequence database InfluxDB.

5. The edge computing system of a sewage treatment site under a cloud edge fusion architecture as defined in claim 1, wherein: the action instructions sent by the equipment control module comprise equipment opening, equipment closing, running state acquisition, fault state acquisition and monitoring value acquisition.

6. The edge computing system of a sewage treatment site under a cloud edge fusion architecture as defined in claim 1, wherein: the data reported by the data reporting module comprises part of collected original data, preprocessed data, and running states and fault states of various devices.

7. A sewage treatment site edge calculation method under cloud edge fusion architecture is characterized in that: the method comprises the following steps:

1) Continuously collecting data from the sewage treatment equipment, the data acquisition equipment and the auxiliary equipment through a Modbus protocol;

2) The source data is further processed, including invalid information discarding, redundant information deleting, measurement unit conversion, data type conversion, combination processing and decomposition processing, and new data generated after preprocessing is transmitted to a data storage node, a flow control node and a data reporting node;

3) After receiving the data, the data storage node stores the data into a time sequence database InfluxDB;

4) After receiving the preprocessing data, the flow control node performs the following processing:

4.1 Judging whether the data exceeds a threshold value, if so, immediately generating related next instructions and streaming to the equipment control node, and generating early warning information and streaming to the data reporting node;

4.2 Judging whether to trigger the next action according to the received numerical value of one or more data, and if the next action is triggered, generating a related next instruction, wherein the instruction flow is transferred to the equipment control node;

4.3 Storing all current state values of all devices;

4.4 The flow control node judges whether to trigger the next action according to the configured time triggering condition and the current corresponding state value;

5) After receiving the instruction, the device control node translates the instruction into a Modbus instruction, and then sends the Modbus instruction to a port where the device is connected;

6) And after receiving the transferred data, the data reporting node pushes the data to the cloud platform.

8. The method for calculating the edge of the sewage treatment station under the cloud edge fusion architecture as claimed in claim 1, wherein the method comprises the following steps: in the step 1), the data collected from various devices are binary values, are resolved into decimal values, correspond to specific devices in a device library and are then transferred to the next node.

9. The method for calculating the edge of the sewage treatment station under the cloud edge fusion architecture as claimed in claim 1, wherein the method comprises the following steps: in the step 3), reversible encryption is used for data storage, and the data are encrypted before storage and decrypted after data acquisition respectively; and a timed backup mechanism for data is designed to ensure the integrity and availability of the data.

10. The method for calculating the edge of the sewage treatment station under the cloud edge fusion architecture as claimed in claim 1, wherein the method comprises the following steps: in the step 6), reversible data encryption is adopted in the data transmission process, encryption is adopted before data transmission, encryption data transmission is adopted in the transmission process, and decryption is carried out after the cloud platform receives the data.