CN110708200A - Method for reducing website availability false alarm rate based on account book detection technology - Google Patents
Method for reducing website availability false alarm rate based on account book detection technology Download PDFInfo
- Publication number
- CN110708200A CN110708200A CN201910966124.8A CN201910966124A CN110708200A CN 110708200 A CN110708200 A CN 110708200A CN 201910966124 A CN201910966124 A CN 201910966124A CN 110708200 A CN110708200 A CN 110708200A
- Authority
- CN
- China
- Prior art keywords
- module
- detection
- account book
- website
- detector
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/0631—Management of faults, events, alarms or notifications using root cause analysis; using analysis of correlation between notifications, alarms or events based on decision criteria, e.g. hierarchy, tree or time analysis
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2379—Updates performed during online database operations; commit processing
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention provides a method for reducing the false alarm rate of website availability based on a detection account book technology, which comprises the following steps: the method comprises the following steps: the inspector module is registered in the inspection account book module; when a suspected fault event of a website is detected by a detector module, recording and carrying unique identification information of the detector module, and packaging the unique identification information into a specified format as a data block; the inspector module sends the data block to the account book detection module; when the detection account book module receives the data blocks of all the detector modules, the corresponding detected website is indicated to have a fault. The method can effectively solve the problem of high false alarm rate of website availability detection based on a single detector module in the prior art, can effectively reduce the implementation cost, and is a successful practice of borrowing the design thought of the distributed account book of the block chain and reducing false alarm in the website availability detection scene.
Description
Technical Field
The invention relates to a method for reducing the false alarm rate of website availability, in particular to a method for reducing the false alarm rate of website availability based on a detection account book technology.
Background
With the development of the Internet to this day, application systems based on WEB and database architectures have become mainstream, and are widely applied to business systems inside and outside enterprises. Network highway is continuously expanded, and electronic government affairs, electronic commerce and various business modes based on WEB application are continuously mature. The website availability monitoring can be accompanied with the whole life cycle management of online, maintenance and offline of a WEB service system, and the most basic data of website health is provided for website administrators.
The conventional single inspector module website availability inspection technology has a plurality of problems, such as: the network fault of the inspector module and the false alarm caused by the bug of the inspector module can be summarized as follows: the single detector module mode, the detection result is one-sided confirmed and this mechanism results in a higher false alarm rate.
Excessive false alarms may accumulate in mountains over time, causing website administrators to be tired of manual confirmation, and thus, the efficiency of website management is very low.
Accordingly, there is a need for improvements in the art.
Disclosure of Invention
The invention aims to provide an efficient method for reducing the false alarm rate of the website availability based on the account book detection technology.
In order to solve the technical problem, the invention provides a method for reducing the false alarm rate of website availability based on the account book detection technology, which comprises the following steps: the method comprises the following steps:
1) the detector module is registered in the detection account book module; performing step 2);
2) when the suspected fault event of the website is detected by the detector module, the unique identification information of the detector module is recorded and carried, and is packaged into a specified format to be used as a data block;
3) the data block is sent to the detection account book module by the detector module;
4) and when the detection account book module receives the data blocks of all the detector modules, the corresponding detected website is indicated to have a fault.
The method for reducing the false alarm rate of the website availability based on the account book detection technology is improved by the following steps:
the step 1 comprises the following steps:
1.1) generating a unique identifier of the detector module;
1.2) sending a joining request to a detection account book detector module carrying a unique identifier of the detection account book detector module to the detection account book module;
1.3), the detection account book module updates the topology of detectors and expands the detection queues, the expansion length is 1 unit, each website has a corresponding distributed queue, and the length of the distributed queues is equal to the total number of the registered detector modules;
1.4), the detection account book module writes the unique identification information of the newly added detector module into the unique identification database.
The method for reducing the false alarm rate of the website availability based on the account book detection technology is further improved as follows:
the step 3 comprises the following steps:
3.1), the detector module sends the data block to the detection account book module, and the detection account book module decodes the received data block and firstly resolves a unique identifier;
3.2) comparing the unique identification with the unique identification database, and if the comparison is successful, continuing to process the data block; otherwise, discarding the data block;
3.3) carrying out duplicate removal treatment on the detection result aiming at a certain website and adding the detection result into a distributed queue;
3.4) the detection account book module responds to the corresponding detector module to confirm the message.
The method for reducing the false alarm rate of the website availability based on the account book detection technology is further improved as follows:
the generation method of the unique identifier comprises the following steps:
the MAC address of the machine where the detector module is located is marked as x; system noise, denoted as y; IP address, noted as z;
and (3) obtaining the unique identifier of the detector module through hash calculation:
f(x,y,x)＝hash512(hash512(x+y+z))
f (x, y, x) is the unique identifier of the detector module.
The method for reducing the false alarm rate of the website availability based on the account book detection technology is further improved as follows:
the process that the inspector module exits the account book detection module comprises the following steps:
step (1): the inspector module sends an exit request to the account book detection module;
step (2): and the detection account book module updates the topology of a detector and reduces the capacity of the detection queue, wherein the length of the reduced capacity is 1 unit.
The method for reducing the false alarm rate of the website availability based on the account book detection technology has the technical advantages that:
although the existing scheme uses a multi-detector module detection technology, the false alarm rate can be reduced to a certain extent, the technology is complex to implement, and professional skills and theoretical knowledge in cluster management need to be mastered. The invention mainly provides a method for reducing website usability detection false alarm by using a distributed account book thought and being easy to realize.
The method can effectively solve the problem of high false alarm rate of website availability detection based on a single detector module in the prior art, can effectively reduce the implementation cost, and is a successful practice of borrowing the design thought of the distributed account book of the block chain and reducing false alarm in the website availability detection scene.
Drawings
The following describes embodiments of the present invention in further detail with reference to the accompanying drawings.
FIG. 1 is a block diagram of a system for reducing false alarm rate of website availability based on a ledger detection technique according to the present invention;
fig. 2 is a flow chart illustrating a method for reducing a false alarm rate of website availability based on the account book detection technology.
Detailed Description
The invention will be further described with reference to specific examples, but the scope of the invention is not limited thereto.
Embodiment 1, a method for reducing a false alarm rate of website availability based on a ledger detection technology, which is used for detecting a website, as shown in fig. 1, includes an ledger detection module and a surveyor module.
The account book detection module provides functions of lightweight node registration, distributed queue, subscription and release and the like, and is positioned in the role of the middleware on the design level of a patent scheme. The design of detecting the account book module refers to the realization idea of the block chain distributed account book: all inspector modules are required to preliminarily determine that the website has suspected faults, and the availability of the website is finally determined to have faults. This is a mechanism similar to "real name voting", and therefore, the design needs to consider how to solve the problem of "impersonation voting".
The account book detection module needs to provide functions of lightweight node registration, distributed queue, subscription and release and the like. In the invention, Apache Zookeeper is adopted to realize the functions of node registration, distributed queue, subscription and release and the like. Meanwhile, the detection account book module needs to develop association processing of support node registration/cancellation events and distributed queue length expansion in an increment mode, and the specific processing process is as follows:
(1): when a node is added, automatically expanding the length of the distributed queue, wherein the expansion length is 1 unit;
(2): and when the node exits, automatically carrying out capacity reduction on the length of the distributed queue, wherein the capacity reduction length is 1 unit.
And the inspector modules are responsible for completing the usability detection function of the website, and sending the detection result to the detection account book module when the suspected fault threshold value is touched, and the website detection results are exchanged among the inspector modules through the detection account book module technology.
The number of the account book detection modules is one, the number of the detector modules is a plurality, and the number of the detection websites is a plurality. The detection account book module is connected with all the detector modules, and each detector module is connected with all the to-be-detected websites.
The method for reducing the false alarm rate of the website availability based on the account book detection technology comprises the following steps:
1) the detector module is registered in the detection account book module; performing step 2);
the method specifically comprises the following steps:
1.1) generating a unique identification of the inspector Module
When each detector module is started, a unique identifier is generated.
The unique identifier generation method comprises the following steps:
and multi-dimensional data blending is adopted, so that strong uniqueness is ensured. The only sources of data employed are:
the MAC address of the machine where the inspector module is located, marked as x
Systematic noise, not using pseudo-random algorithm, denoted as y
IP address, noted z
And (3) carrying out hash calculation on the three types of data to obtain the unique identifier of the detector module:
f(x,y,x)＝hash512(hash512(x+y+z))
f (x, y, x) is the unique identifier of the detector module;
1.2), initiating a join request to a checking ledger module
The detector module carries the unique identifier of the detector module to send a joining request to the detection account book module.
1.3), the detection account book module updates the topology of the detector and the length of the distributed queue;
number of detector modules: in a distributed scenario, because this number can vary (network failure, device power down, etc.), it is necessary to update the inspector topology and refresh the distributed queue length at the same time
The detector topology is a management-oriented layer; the distributed queue is oriented to the service layer.
The detection account book module updates detector topology and expands the detection queues, the expansion length is 1 unit, each website has a corresponding distributed queue, and the length of each distributed queue is equal to the total number of the registered detector modules;
1.4), detecting the updating of the unique identification database of the account book module
The account book detection module writes the unique identification information of the newly added detector module into a unique identification database;
2) the detector module generates data;
when a suspected website fault event is detected by a detector module, the unique identification information of the detector module needs to be recorded and carried, and is packaged into a specified format to be used as a data block;
3) the detector module sends the data block;
3.1), the detector module sends the data block to the detection account book module, and the detection account book module decodes the received data block and firstly resolves a unique identifier;
3.2) comparing the unique identification with the unique identification database, and if the comparison is successful, continuing to process the data block; otherwise, the data block is discarded.
3.3) and adding the detection result to the distributed queue after carrying out deduplication processing on the detection result of a certain website.
The duplication removal processing is to remove the same detection result from the same detector module to the same website. In some cases, a packet may be retransmitted due to a network failure, and thus, deduplication is required.
3.4), the detection account book module responds to the corresponding detector module to confirm the message;
4) and when the detection account book module receives the data blocks of all the detector modules, namely the distributed queues are full, the corresponding detected websites are indicated to have faults.
The process that the inspector module exits the account book detection module comprises the following steps:
step (1): the inspector module sends an exit request to the account book detection module
When each monitor leaves the network, the monitor actively sends a leaving request to the checking ledger module.
Step (2): detecting ledger module updating detector topology and distributed queue length
And the detection account book module updates the topology of a detector and reduces the capacity of the detection queue, wherein the length of the reduced capacity is 1 unit.
Finally, it is also noted that the above-mentioned lists merely illustrate a few specific embodiments of the invention. It is obvious that the invention is not limited to the above embodiments, but that many variations are possible. All modifications which can be derived or suggested by a person skilled in the art from the disclosure of the present invention are to be considered within the scope of the invention.
Claims (5)
1. A method for reducing the false alarm rate of website availability based on the account detection technology is characterized in that: the method comprises the following steps:
1) the detector module is registered in the detection account book module; performing step 2);
2) when the suspected fault event of the website is detected by the detector module, the unique identification information of the detector module is recorded and carried, and is packaged into a specified format to be used as a data block; performing step 3);
3) the data block is sent to the detection account book module by the detector module; performing step 4);
4) and when the detection account book module receives the data blocks of all the detector modules, the corresponding detected website is indicated to have a fault.
2. The method for reducing the false alarm rate of the website availability based on the ledger detection technology of claim 1, wherein:
the step 1 comprises the following steps:
1.1) generating a unique identifier of the detector module;
1.2) sending a joining request to a detection account book detector module carrying a unique identifier of the detection account book detector module to the detection account book module;
1.3), the detection account book module updates the topology of detectors and expands the detection queues, the expansion length is 1 unit, each website has a corresponding distributed queue, and the length of the distributed queues is equal to the total number of the registered detector modules;
1.4), the detection account book module writes the unique identification information of the newly added detector module into the unique identification database.
3. The method for reducing the false alarm rate of the website availability based on the ledger detection technology of claim 2, wherein:
the step 3 comprises the following steps:
3.1), the detector module sends the data block to the detection account book module, and the detection account book module decodes the received data block and firstly resolves a unique identifier;
3.2) comparing the unique identification with the unique identification database, and if the comparison is successful, continuing to process the data block; otherwise, discarding the data block;
3.3) carrying out duplicate removal treatment on the detection result aiming at a certain website and adding the detection result into a distributed queue;
3.4) the detection account book module responds to the corresponding detector module to confirm the message.
4. The method for reducing the false alarm rate of the website availability based on the ledger detection technology of claim 3, wherein:
the generation method of the unique identifier comprises the following steps:
the MAC address of the machine where the detector module is located is marked as x; system noise, denoted as y; IP address, noted as z;
and (3) obtaining the unique identifier of the detector module through hash calculation:
f(x,y,x)＝hash512(hash512(x+y+z))
f (x, y, x) is the unique identifier of the detector module.
5. The method for reducing the false alarm rate of the website availability based on the ledger detection technology of claim 4, wherein:
the process that the inspector module exits the account book detection module comprises the following steps:
step (1): the inspector module sends an exit request to the account book detection module;
step (2): and the detection account book module updates the topology of a detector and reduces the capacity of the detection queue, wherein the length of the reduced capacity is 1 unit.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910966124.8A CN110708200A (en) | 2019-10-12 | 2019-10-12 | Method for reducing website availability false alarm rate based on account book detection technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910966124.8A CN110708200A (en) | 2019-10-12 | 2019-10-12 | Method for reducing website availability false alarm rate based on account book detection technology |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110708200A true CN110708200A (en) | 2020-01-17 |
Family
ID=69198525
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910966124.8A Pending CN110708200A (en) | 2019-10-12 | 2019-10-12 | Method for reducing website availability false alarm rate based on account book detection technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110708200A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103384261A (en) * | 2012-05-04 | 2013-11-06 | 上海鱼游网络科技有限公司 | Method and system for determining customer service side login account |
| US20140136693A1 (en) * | 2012-11-09 | 2014-05-15 | Compuware Corporation | Method and system for browser based, non-intrusive measuring of end-user perceived performance of individual third party resource requests |
| CN107579861A (en) * | 2017-10-09 | 2018-01-12 | 杭州安恒信息技术有限公司 | Website Usability alarm method, device and electronic equipment based on multi-line monitoring |
| CN107707427A (en) * | 2017-09-28 | 2018-02-16 | 南华大学 | A kind of Website Usability monitoring system and method |
| CN109104419A (en) * | 2018-07-27 | 2018-12-28 | 中链科技有限公司 | A kind of generation method and system of block chain account |
-
2019
- 2019-10-12 CN CN201910966124.8A patent/CN110708200A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103384261A (en) * | 2012-05-04 | 2013-11-06 | 上海鱼游网络科技有限公司 | Method and system for determining customer service side login account |
| US20140136693A1 (en) * | 2012-11-09 | 2014-05-15 | Compuware Corporation | Method and system for browser based, non-intrusive measuring of end-user perceived performance of individual third party resource requests |
| CN107707427A (en) * | 2017-09-28 | 2018-02-16 | 南华大学 | A kind of Website Usability monitoring system and method |
| CN107579861A (en) * | 2017-10-09 | 2018-01-12 | 杭州安恒信息技术有限公司 | Website Usability alarm method, device and electronic equipment based on multi-line monitoring |
| CN109104419A (en) * | 2018-07-27 | 2018-12-28 | 中链科技有限公司 | A kind of generation method and system of block chain account |
Non-Patent Citations (1)
| Title |
|---|
| WNVALENTIN: "基于Token的身份验证原理", 《HTTPS://BLOG.CSDN.NET/WNVALENTIN/ARTICLE/DETAILS/89854980》 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8917610B2 (en) | Detecting intermittent network link failures | |
| CN102546849B (en) | Detection method for IP (Internet Protocol) address conflict and network equipment | |
| CN112506702B (en) | Disaster recovery method, device, equipment and storage medium for data center | |
| WO2016183967A1 (en) | Failure alarm method and apparatus for key component, and big data management system | |
| US7539150B2 (en) | Node discovery and communications in a network | |
| CN112311580B (en) | Method, device and system for determining message transmission path, and computer storage medium | |
| FI990102A0 (en) | Checked data network recovery in case of failure | |
| CN104521181B (en) | Fault handling method, device and system | |
| CN112601216B (en) | A Zigbee-based trusted platform alarm method and system | |
| CN104468302B (en) | A kind of processing method and processing device of token | |
| CN111654406B (en) | Bidirectional forwarding detection method and device | |
| CN111083049B (en) | User table item recovery method and device, electronic equipment and storage medium | |
| EP4539423A3 (en) | A cyber threat defense system, components, and a method for using artificial intelligence models trained on a normal pattern of life for systems with unusual data sources | |
| CN104753712B (en) | A kind of alarm reporting method, alarm report node and alarm report system | |
| CN103634166B (en) | Equipment survival detection method and equipment survival detection device | |
| CN103607346B (en) | Anomaly and Attack Detection Method of OSPF Protocol in Trusted Router | |
| CN104243192B (en) | Fault handling method and system | |
| CN106909197A (en) | A kind of virtualized host time management method and virtualized host system | |
| EP2945314B1 (en) | Distributed flow processing system fault tolerance method, nodes and system | |
| CN103152263B (en) | Link State Protocol Data Unit burst update method and router | |
| CN108248641A (en) | A kind of urban track traffic data processing method and device | |
| CN105553743A (en) | Log obtaining method, system, first network device and third network device | |
| US10372542B2 (en) | Fault tolerant event management system | |
| CN108509296B (en) | Method and system for processing equipment fault | |
| CN110708200A (en) | Method for reducing website availability false alarm rate based on account book detection technology |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200117 |