CN114285786A - Method and device for constructing network link library - Google Patents
Method and device for constructing network link library Download PDFInfo
- Publication number
- CN114285786A CN114285786A CN202111601394.2A CN202111601394A CN114285786A CN 114285786 A CN114285786 A CN 114285786A CN 202111601394 A CN202111601394 A CN 202111601394A CN 114285786 A CN114285786 A CN 114285786A
- Authority
- CN
- China
- Prior art keywords
- address
- data transmission
- transmission path
- path information
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 56
- 230000005540 biological transmission Effects 0.000 claims abstract description 181
- 230000002776 aggregation Effects 0.000 claims abstract description 24
- 238000004220 aggregation Methods 0.000 claims abstract description 24
- 230000004931 aggregating effect Effects 0.000 claims abstract description 20
- 238000004140 cleaning Methods 0.000 claims abstract description 12
- 230000002159 abnormal effect Effects 0.000 claims description 40
- 238000004458 analytical method Methods 0.000 claims description 17
- 230000036541 health Effects 0.000 claims description 9
- 238000006116 polymerization reaction Methods 0.000 claims description 2
- 230000008569 process Effects 0.000 description 14
- 238000010586 diagram Methods 0.000 description 10
- 230000009471 action Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 238000007667 floating Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000007670 refining Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000003860 storage Methods 0.000 description 1
Images
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/50—Reducing energy consumption in communication networks in wire-line communication networks, e.g. low power modes or reduced link rate
Landscapes
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention provides a method and a device for constructing a network link library, wherein data transmission path information recorded by each load balancing device can be acquired; determining target data transmission path information which does not meet the data cleaning condition in each data transmission path information; based on the intermediate device addresses of the target data transmission path information, carrying out aggregation processing on the target data transmission path information to obtain an initial network link corresponding to each intermediate device address; aggregating each initial network link to obtain a network link library; the network link library comprises a plurality of application access path groups; each application access path group comprises application access paths, and each application access path comprises a target sending end address, at least one intermediate device address and a target receiving end address. The information can be aggregated by the connection, so that a network link library can be quickly constructed, and further, fault location can be quickly carried out based on the network link library.
Description
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a method and an apparatus for constructing a network link library.
Background
With the development of information technology, people rely on computer networks increasingly, so that the reliability of the operation of the computer networks becomes important, and people have higher requirements on network management.
At present, in the management process of a network, flow path information among devices in the network is usually acquired through each load balancing device, then the connection information is simply classified, when the devices break down, it is difficult to determine a faulty device and an influence range from a large number of connection pair information, and the network management requirements of technicians cannot be met.
Disclosure of Invention
The technical problem to be solved by the invention is to provide a method for constructing a network link library, which can quickly and accurately construct the network link library, thereby realizing fault positioning.
The invention also provides a device for constructing the network link library, which is used for ensuring the realization and the application of the method in practice.
A method for constructing a network link library comprises the following steps:
responding to a link analysis instruction, and determining each load balancing device corresponding to the link analysis instruction;
acquiring information of each data transmission path pre-recorded by each load balancing device; each data transmission path information comprises a sending end address, an intermediate equipment address and a receiving end address; the intermediate device address is the address of the load balancing device recording the data transmission path information;
determining target data transmission path information which does not meet preset data cleaning conditions in each data transmission path information;
based on the intermediate device address of each piece of target data transmission path information, performing aggregation processing on each piece of target data transmission path information to obtain an initial network link corresponding to each intermediate device address;
determining a target sending end address in each sending end address of each initial network link, and determining a target receiving end address in each receiving end address of each initial network link; a target sending end corresponding to the target sending end address belongs to a preset first application module; the target receiving terminal corresponding to the target receiving terminal address belongs to a preset second application module;
according to each target sending end address and each target receiving end address, aggregating each initial network link to obtain a network link library; the network link library comprises a plurality of application access path groups; each application access path group comprises at least one application access path, and each application access path comprises a target sending end address, at least one intermediate device address and a target receiving end address.
Optionally, in the method, the aggregating, based on the intermediate device address of each piece of target data transmission path information, the pieces of target data transmission path information to obtain an initial network link corresponding to each intermediate device address includes:
dividing the target data transmission path information according to the intermediate device address of the target data transmission path information to obtain a plurality of data groups; each data group comprises target data transmission path information with consistent multiple intermediate equipment addresses;
aggregating the information of each target data transmission path of each data group to obtain an initial network link corresponding to each intermediate device address; each initial network link corresponding to the intermediate device address comprises a plurality of sending end addresses, the intermediate device address and a plurality of receiving end addresses.
Optionally, the method for aggregating the initial network links according to the target sending end addresses and the target receiving end addresses to obtain a network link library includes:
determining addresses except the target sending end address in each sending end address of the initial network link as intermediate equipment addresses, and determining addresses except the target receiving end address in each receiving end address of the initial network link as intermediate equipment addresses;
and aggregating the initial network links based on the intermediate device addresses of the initial network links to obtain a network link library.
Optionally, the method for determining, in each piece of data transmission path information, target data transmission path information that does not satisfy a preset data cleansing condition includes:
determining first data transmission path information of which the transmission protocol is a preset TCP transmission control protocol in each data transmission path information;
determining second data transmission path information except the first data transmission path information generated by the health check of the load balancing equipment in each piece of first data transmission path information;
determining third data transmission path information generated by the load balancing equipment when the load balancing equipment successfully transmits data in each piece of second data transmission path information;
and determining the third data transmission path information as target data transmission path information meeting the data cleaning condition.
Optionally, the method further includes, after obtaining the network link library:
when an abnormal query request is received, acquiring an abnormal address contained in the abnormal query request;
matching the abnormal address with the network link library to determine an application access path corresponding to the abnormal address;
and displaying the application access path corresponding to the abnormal address.
An apparatus for constructing a network link library, comprising:
the first determining unit is used for responding to a link analysis instruction and determining each load balancing device corresponding to the link analysis instruction;
the acquisition unit is used for acquiring the information of each data transmission path recorded in advance by each load balancing device; each data transmission path information comprises a sending end address, an intermediate equipment address and a receiving end address; the intermediate device address is the address of the load balancing device recording the data transmission path information;
a second determining unit configured to determine, among the pieces of data transmission path information, target data transmission path information that does not satisfy a preset data cleansing condition;
a first aggregation unit, configured to perform aggregation processing on each piece of target data transmission path information based on an intermediate device address of each piece of target data transmission path information, to obtain an initial network link corresponding to each intermediate device address;
a third determining unit, configured to determine a target sending end address in each sending end address of each initial network link, and determine a target receiving end address in each receiving end address of each initial network link; a target sending end corresponding to the target sending end address belongs to a preset first application module; the target receiving terminal corresponding to the target receiving terminal address belongs to a preset second application module;
a second aggregation unit, configured to aggregate each initial network link according to each target sending end address and each target receiving end address, to obtain a network link library; the network link library comprises a plurality of application access path groups; each application access path group comprises at least one application access path, and each application access path comprises a target sending end address, at least one intermediate device address and a target receiving end address.
The above apparatus, optionally, the first aggregation unit includes:
the first execution subunit is configured to divide the target data transmission path information according to an intermediate device address of the target data transmission path information to obtain a plurality of data groups; each data group comprises target data transmission path information with consistent multiple intermediate equipment addresses;
the first aggregation subunit is configured to aggregate the information of each target data transmission path of each data group to obtain an initial network link corresponding to each address of the intermediate device; each initial network link corresponding to the intermediate device address comprises a plurality of sending end addresses, the intermediate device address and a plurality of receiving end addresses.
The above apparatus, optionally, the second polymerization unit, comprises:
a first determining subunit, configured to determine that an address of each of the sender addresses of the initial network link, excluding the target sender address, is an intermediate device address, and determine that an address of each of the receiver addresses of the initial network link, excluding the target receiver address, is an intermediate device address;
and the second aggregation subunit is configured to aggregate each initial network link based on the intermediate device address of each initial network link to obtain a network link library.
The above apparatus, optionally, the second determining unit includes:
the second determining subunit is configured to determine, in each piece of data transmission path information, first data transmission path information of which a transmission protocol is a preset TCP transmission control protocol;
a third determining subunit, configured to determine, in each piece of the first data transmission path information, second data transmission path information other than the first data transmission path information generated by the load balancing device performing the health check;
a fourth determining subunit, configured to determine, in each piece of second data transmission path information, third data transmission path information that is generated when the load balancing device successfully transmits data;
a fifth determining subunit, configured to determine the third data transmission path information as target data transmission path information that satisfies the data cleansing condition.
The above apparatus, optionally, further comprises:
the device comprises a receiving unit, a processing unit and a processing unit, wherein the receiving unit is used for acquiring an abnormal address contained in an abnormal query request when the abnormal query request is received;
the matching unit is used for matching the abnormal address with the network link library so as to determine an application access path corresponding to the abnormal address;
and the display unit is used for displaying the application access path corresponding to the abnormal address.
The embodiment of the invention provides a method and a device for constructing a network link library, wherein the method comprises the following steps: responding to a link analysis instruction, and determining each load balancing device corresponding to the link analysis instruction; acquiring information of each data transmission path pre-recorded by each load balancing device; each data transmission path information comprises a sending end address, an intermediate equipment address and a receiving end address; the intermediate device address is the address of the load balancing device recording the data transmission path information; determining target data transmission path information which does not meet preset data cleaning conditions in each data transmission path information; based on the intermediate device address of each piece of target data transmission path information, performing aggregation processing on each piece of target data transmission path information to obtain an initial network link corresponding to each intermediate device address; determining a target sending end address in each sending end address of each initial network link, and determining a target receiving end address in each receiving end address of each initial network link; a target sending end corresponding to the target sending end address belongs to a preset first application module; the target receiving terminal corresponding to the target receiving terminal address belongs to a preset second application module; according to each target sending end address and each target receiving end address, aggregating each initial network link to obtain a network link library; the network link library comprises a plurality of application access path groups; each application access path group comprises at least one application access path, and each application access path comprises a target sending end address, at least one intermediate device address and a target receiving end address. The information can be aggregated by the connection, so that a network link library can be quickly constructed, and further, fault location can be quickly carried out based on the network link library.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a flowchart of a method for constructing a network link library according to the present invention;
fig. 2 is a flowchart of a process for obtaining an initial network link corresponding to each intermediate device address according to the present invention;
FIG. 3 is a block diagram illustrating an exemplary architecture of a data processing system according to the present invention;
FIG. 4 is an exemplary diagram of an initial network link provided by the present invention;
FIG. 5 is an exemplary diagram of a network link provided by the present invention;
FIG. 6 is an exemplary diagram of an application access group provided by the present invention;
fig. 7 is a schematic structural diagram of a network link library constructing apparatus provided in the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In this application, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The invention is operational with numerous general purpose or special purpose computing device environments or configurations. For example: personal computers, server computers, hand-held or portable devices, tablet-type devices, multi-processor apparatus, distributed computing environments that include any of the above devices or equipment, and the like.
The embodiment of the invention provides a method for constructing a network link library, which can be applied to various system platforms, wherein an execution main body of the method can be a computer terminal or a processor of various mobile devices, and a flow chart of the method is shown in fig. 1 and specifically comprises the following steps:
s101: and responding to the link analysis instruction, and determining each load balancing device corresponding to the link analysis instruction.
In this embodiment, the load balancing device corresponding to the link analysis instruction may be various types of load balancing devices, for example, may be an F5 load balancing device, and the load balancing device is configured to be disposed at a front end of a group of servers with the same or similar functions, and reasonably distribute traffic reaching the server group.
S102: acquiring information of each data transmission path pre-recorded by each load balancing device; each data transmission path information comprises a sending end address, an intermediate equipment address and a receiving end address; the intermediate device address is an address of a load balancing device recording the data transmission path information.
In this embodiment, the data transmission path information may be connection pair information, and the data transmission path information may represent that data flows from the device to which the sending end address belongs to the load device to which the intermediate device address belongs, and then flows from the load balancing device to the device to which the receiving end address belongs; the device to which the sending end address belongs and the device to which the receiving end address belongs may be various types of electronic devices, for example, servers in a server cluster.
Optionally, the sender address may include an IP address and a port of the sender, and the receiver address may include an IP address and a port of the receiver.
S103: and determining target data transmission path information which does not meet preset data cleaning conditions in the data transmission path information.
In this embodiment, it may be determined whether each piece of data transmission path information satisfies a preset data cleaning condition, the piece of data transmission path information satisfying the data cleaning condition may be cleaned, and the piece of data transmission path information not satisfying the data cleaning condition may be determined as the target data transmission path information.
Optionally, the data cleansing condition may be that the data transmission protocol corresponding to the data transmission path information is not a TCP transmission control protocol, and the data transmission path information is generated by a health check of the load balancing device itself or a data packet corresponding to the data transmission path information is not successfully distributed.
S104: and based on the intermediate device address of each piece of target data transmission path information, performing aggregation processing on each piece of target data transmission path information to obtain an initial network link corresponding to each intermediate device address.
In this embodiment, the aggregation processing is performed on each piece of target data transmission path information, and may merge repeated target data transmission paths in each piece of target data transmission path information, and merge repeated sending end addresses, repeated intermediate device addresses, or repeated receiving end addresses in each piece of target data path information with the same intermediate device address.
S105: determining a target sending end address in each sending end address of each initial network link, and determining a target receiving end address in each receiving end address of each initial network link; a target sending end corresponding to the target sending end address belongs to a preset first application module; and the target receiving terminal corresponding to the target receiving terminal address belongs to a preset second application module.
In this embodiment, the first application module may be an application module that sends data, the second application module may be an application module that receives data, and each of the sending-end addresses and each of the receiving-end addresses may be matched with a preset comparison relationship table to determine a target sending-end address in each of the sending-end addresses and a target receiving-end address in each of the receiving-end addresses, the object relationship table includes an association relationship between each of the addresses and each of the application modules, and for each of the addresses having an association relationship with the application module, a device corresponding to the address belongs to the application module.
S106: according to each target sending end address and each target receiving end address, aggregating each initial network link to obtain a network link library; the network link library comprises a plurality of application access path groups; each application access path group comprises at least one application access path, and each application access path comprises a target sending end address, at least one intermediate device address and a target receiving end address.
In this implementation, each application access path group may correspond to different first application modules, and the first application modules corresponding to each target sending end address in the application access paths in each application access path group are consistent.
By applying the method provided by the embodiment of the invention, the information of the connection pair can be aggregated, so that a network link library can be quickly constructed, and further, the fault can be quickly positioned based on the network link library.
In an embodiment provided by the present invention, based on the foregoing implementation process, optionally, the aggregating, based on the intermediate device address of each piece of target data transmission path information, the target data transmission path information is subjected to aggregation processing, so as to obtain an initial network link corresponding to each intermediate device address, as shown in fig. 2, where the method includes:
s201: dividing the target data transmission path information according to the intermediate device address of the target data transmission path information to obtain a plurality of data groups; each data group contains target data transmission path information with a plurality of intermediate equipment addresses consistent.
In this embodiment, each piece of target data transmission path information is divided according to the intermediate device address in each piece of target data transmission path information, and a data group corresponding to each intermediate device address is obtained.
S202: aggregating the information of each target data transmission path of each data group to obtain an initial network link corresponding to each intermediate device address; each initial network link corresponding to the intermediate device address comprises a plurality of sending end addresses, the intermediate device address and a plurality of receiving end addresses.
Optionally, for each data group, aggregating the information of each target data transmission path in the data group to obtain an initial network link, where the initial network link includes multiple sending end addresses, one intermediate device address, and multiple receiving end addresses.
In an embodiment of the present invention, based on the foregoing implementation process, optionally, the aggregating each initial network link according to each destination sending end address and each destination receiving end address to obtain a network link library includes:
determining addresses except the target sending end address in each sending end address of the initial network link as intermediate equipment addresses, and determining addresses except the target receiving end address in each receiving end address of the initial network link as intermediate equipment addresses;
and aggregating the initial network links based on the intermediate device addresses of the initial network links to obtain a network link library.
In this embodiment, the connection relationship between the intermediate devices may be determined first, and the initial network links corresponding to the intermediate devices may be aggregated according to the connection relationship between the intermediate devices, so as to obtain the network link library.
In an embodiment of the present invention, based on the foregoing implementation process, optionally, the determining, in each piece of data transmission path information, target data transmission path information that does not satisfy a preset data cleansing condition includes:
determining first data transmission path information of which the transmission protocol is a preset TCP transmission control protocol in each data transmission path information;
determining second data transmission path information except the first data transmission path information generated by the health check of the load balancing equipment in each piece of first data transmission path information;
determining third data transmission path information generated by the load balancing equipment when the load balancing equipment successfully transmits data in each piece of second data transmission path information;
and determining the third data transmission path information as target data transmission path information meeting the data cleaning condition.
In this embodiment, the data transmission path information of which the transmission protocol is not the TCP transmission control protocol, the data transmission path information generated by the load balancing device performing the health check, and the data transmission path information that is not successfully transmitted may be filtered.
In an embodiment provided by the present invention, based on the foregoing implementation process, optionally, after obtaining the network link library, the method further includes:
when an abnormal query request is received, acquiring an abnormal address contained in the abnormal query request;
matching the abnormal address with the network link library to determine an application access path corresponding to the abnormal address;
and displaying the application access path corresponding to the abnormal address.
In this embodiment, the exception address may be an address of an exception device, or an address of a device of an exception application module.
Optionally, by determining the application access path corresponding to the abnormal address, the abnormal application range and the specific fault location may be quickly determined.
The method for constructing the network link library provided by the embodiment of the invention can be applied to various fields, for example, can be applied to a bank system, and the bank system comprises a network consisting of a plurality of devices, for example, the bank system can comprise a plurality of server clusters, load balancing devices, data processing devices and a configuration center.
Optionally, the load balancer of the server is software or network equipment that is arranged at a front end of a group of servers with the same or similar functions, reasonably distributes traffic reaching the server group, and can transfer an access request to another server that can normally operate when one of the servers fails, and the load balancing equipment in this embodiment may be F5 load balancing equipment.
In the embodiment of the invention, connection pair information is collected at regular time on an F5 device, each piece of connection pair information is represented as '10.227.4.71: 60672, 10.235.91.221:555, 10.235.91.193:60672, 10.235.214.169:555, tcp, 11, (tmm: 2)', wherein there are 4 pieces of IP and port information, and the IP and port of a sending end, the IP and port of an F5VS (F5 virtual server), a Floating IP (Floating IP address) and port, and the IP and port information of a receiving end are represented from left to right in sequence.
In some embodiments, as shown in fig. 3, in an exemplary diagram of a structure of a data processing system according to an embodiment of the present invention, connection pair information, that is, data transmission path information, acquired at regular time by each F5 device may be acquired by an F5 acquisition module, and the connection pair information acquired by the F5 acquisition module is subjected to data cleaning and data merging by an F5 data processing module, so as to obtain a network link library. The specific process is as follows:
first, data of non-TCP (transmission control protocol) connection pairs, connection pair data of F5 self health check, and data which is not successfully distributed in the connection pair information are cleaned up, and the remaining connection pair information is used as target data transmission path information.
Data merging is then performed, and the data merging can be divided into three parts, namely source IP merging, destination IP merging and F5VS merging.
In the embodiment of the present invention, a configuration library may be combined, so that each IP may obtain F5 poolmembers (load balancing pool members) associated with the IP, and F5 poolmembers may further associate an application module or F5 VS; f5VS may merge the IP and port of F5VS through a connection pair.
The first step is as follows: merging three elements of the same source IP, F5VS IP and port, and destination IP and port to obtain metadata of each access relation, and recording the occurrence times of the access relation as the activity of the access pair.
The second step is that: on the basis of the first step, merging is performed by taking F5VS IP and port as elements, as shown in fig. 4, for an exemplary diagram of an initial network link provided by the embodiment of the present invention, access pairs having the same F5VS IP and port may be merged, and duplicate IPs of the source end and the destination end are cleaned up respectively, so as to obtain the initial network link.
The third step: on the basis of the second step, comparing the source IP and the destination IP, finding all F5VS accessed by the source IP, and refining further to obtain a group of network links, as shown in fig. 5, which is an exemplary diagram of a network link provided by the embodiment of the present invention, the network link indicates that there is a group of source IP, and another group of IP is accessed through a plurality of F5VS connected in parallel.
The fourth step: on the basis of the third step, in combination with the configuration library, the IP group of the source end finds its own corresponding cluster according to the F5 Pool (load balancing Pool) belonging to each group, and further knows the application module to which the IP group belongs according to the relationship between the IP and the application module, and the IP group of the destination end performs the same analysis, it is worth mentioning that the IP of the destination end is likely to be associated with F5VS, that is, there is a case of F5 concatenation, and then the analysis is continued to return to the third step until the IP of the destination end is associated with the application module. Finally, obtaining the mutual access links of all the deployed applications of the data center to form a link access relation library, where each application access group in the link access relation library is shown in fig. 6, which is an exemplary diagram of an application access group provided in an embodiment of the present invention. Each source IP and destination IP accessed by the application form an access path, and a network link corresponding to the application network path and network equipment on the link can be obtained by combining the configuration library to form a network link library.
In an embodiment provided by the invention, after a network link library is constructed, the deployment and access relations of all applications of the data center can be obtained through combing, and hidden production operation hidden troubles brought by hidden links, unknown access and the like are eliminated. Under the condition that a certain network device is known to be in fault, the network link where the network device is located is obtained according to the network link library, the affected IP pair is found, and then the affected application link and the affected transaction link are inquired through the table I. Under the condition that a plurality of applications are known to be abnormal, IP pairs related to abnormal applications can be determined according to the application link access relation library, and then network equipment common to the IP pairs is found by combining the network link library, wherein the fault probability of the network equipment is very high.
Corresponding to the method described in fig. 1, an embodiment of the present invention further provides a device for constructing a network link library, which is used to implement the method in fig. 1 specifically, and the device for constructing a network link library provided in the embodiment of the present invention may be applied to a server, and a schematic structural diagram of the device is shown in fig. 7, and specifically includes:
a first determining unit 701, configured to determine, in response to a link analysis instruction, each load balancing device corresponding to the link analysis instruction;
an obtaining unit 702, configured to obtain information of each data transmission path that is recorded in advance by each load balancing device; each data transmission path information comprises a sending end address, an intermediate equipment address and a receiving end address; the intermediate device address is the address of the load balancing device recording the data transmission path information;
a second determining unit 703, configured to determine, among the pieces of data transmission path information, target data transmission path information that does not satisfy a preset data cleansing condition;
a first aggregation unit 704, configured to perform aggregation processing on each piece of target data transmission path information based on an intermediate device address of each piece of target data transmission path information, to obtain an initial network link corresponding to each intermediate device address;
a third determining unit 705, configured to determine a target sending end address in each sending end address of each initial network link, and determine a target receiving end address in each receiving end address of each initial network link; a target sending end corresponding to the target sending end address belongs to a preset first application module; the target receiving terminal corresponding to the target receiving terminal address belongs to a preset second application module;
a second aggregation unit 706, configured to aggregate each initial network link according to each target sending end address and each target receiving end address, to obtain a network link library; the network link library comprises a plurality of application access path groups; each application access path group comprises at least one application access path, and each application access path comprises a target sending end address, at least one intermediate device address and a target receiving end address.
In an embodiment provided by the present invention, based on the above scheme, optionally, the first aggregating unit 704 includes:
the first execution subunit is configured to divide the target data transmission path information according to an intermediate device address of the target data transmission path information to obtain a plurality of data groups; each data group comprises target data transmission path information with consistent multiple intermediate equipment addresses;
the first aggregation subunit is configured to aggregate the information of each target data transmission path of each data group to obtain an initial network link corresponding to each address of the intermediate device; each initial network link corresponding to the intermediate device address comprises a plurality of sending end addresses, the intermediate device address and a plurality of receiving end addresses.
In an embodiment provided by the present invention, based on the above scheme, optionally, the second aggregating unit 706 includes:
a first determining subunit, configured to determine that an address of each of the sender addresses of the initial network link, excluding the target sender address, is an intermediate device address, and determine that an address of each of the receiver addresses of the initial network link, excluding the target receiver address, is an intermediate device address;
and the second aggregation subunit is configured to aggregate each initial network link based on the intermediate device address of each initial network link to obtain a network link library.
In an embodiment provided by the present invention, based on the above scheme, optionally, the second determining unit 703 includes:
the second determining subunit is configured to determine, in each piece of data transmission path information, first data transmission path information of which a transmission protocol is a preset TCP transmission control protocol;
a third determining subunit, configured to determine, in each piece of the first data transmission path information, second data transmission path information other than the first data transmission path information generated by the load balancing device performing the health check;
a fourth determining subunit, configured to determine, in each piece of second data transmission path information, third data transmission path information that is generated when the load balancing device successfully transmits data;
a fifth determining subunit, configured to determine the third data transmission path information as target data transmission path information that satisfies the data cleansing condition.
In an embodiment provided by the present invention, based on the above scheme, optionally, the method further includes:
the device comprises a receiving unit, a processing unit and a processing unit, wherein the receiving unit is used for acquiring an abnormal address contained in an abnormal query request when the abnormal query request is received;
the matching unit is used for matching the abnormal address with the network link library so as to determine an application access path corresponding to the abnormal address;
and the display unit is used for displaying the application access path corresponding to the abnormal address.
The specific principle and the implementation process of each unit and module in the apparatus for constructing a network link library disclosed in the embodiment of the present invention are the same as those of the method for constructing a network link library disclosed in the embodiment of the present invention, and reference may be made to corresponding parts in the method for constructing a network link library provided in the embodiment of the present invention, which are not described herein again.
It should be noted that, in the present specification, the embodiments are all described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments may be referred to each other. For the device-like embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
For convenience of description, the above devices are described as being divided into various units by function, and are described separately. Of course, the functions of the units may be implemented in the same software and/or hardware or in a plurality of software and/or hardware when implementing the invention.
From the above description of the embodiments, it is clear to those skilled in the art that the present invention can be implemented by software plus necessary general hardware platform. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which may be stored in a storage medium, such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method according to the embodiments or some parts of the embodiments.
The method for constructing a network link library provided by the present invention is described in detail above, and the principle and the implementation of the present invention are explained in the present document by applying specific examples, and the description of the above embodiments is only used to help understanding the method of the present invention and the core idea thereof; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (10)
1. A method for constructing a network link library, comprising:
responding to a link analysis instruction, and determining each load balancing device corresponding to the link analysis instruction;
acquiring information of each data transmission path pre-recorded by each load balancing device; each data transmission path information comprises a sending end address, an intermediate equipment address and a receiving end address; the intermediate device address is the address of the load balancing device recording the data transmission path information;
determining target data transmission path information which does not meet preset data cleaning conditions in each data transmission path information;
based on the intermediate device address of each piece of target data transmission path information, performing aggregation processing on each piece of target data transmission path information to obtain an initial network link corresponding to each intermediate device address;
determining a target sending end address in each sending end address of each initial network link, and determining a target receiving end address in each receiving end address of each initial network link; a target sending end corresponding to the target sending end address belongs to a preset first application module; the target receiving terminal corresponding to the target receiving terminal address belongs to a preset second application module;
according to each target sending end address and each target receiving end address, aggregating each initial network link to obtain a network link library; the network link library comprises a plurality of application access path groups; each application access path group comprises at least one application access path, and each application access path comprises a target sending end address, at least one intermediate device address and a target receiving end address.
2. The method according to claim 1, wherein the aggregating the target data transmission path information based on the intermediate device address of the target data transmission path information to obtain an initial network link corresponding to each intermediate device address comprises:
dividing the target data transmission path information according to the intermediate device address of the target data transmission path information to obtain a plurality of data groups; each data group comprises target data transmission path information with consistent multiple intermediate equipment addresses;
aggregating the information of each target data transmission path of each data group to obtain an initial network link corresponding to each intermediate device address; each initial network link corresponding to the intermediate device address comprises a plurality of sending end addresses, the intermediate device address and a plurality of receiving end addresses.
3. The method according to claim 1, wherein said aggregating each of the initial network links according to each of the target sender addresses and each of the target receiver addresses to obtain a network link library comprises:
determining addresses except the target sending end address in each sending end address of the initial network link as intermediate equipment addresses, and determining addresses except the target receiving end address in each receiving end address of the initial network link as intermediate equipment addresses;
and aggregating the initial network links based on the intermediate device addresses of the initial network links to obtain a network link library.
4. The method according to claim 1, wherein the determining, among the respective pieces of data transmission path information, target data transmission path information that does not satisfy a preset data cleansing condition includes:
determining first data transmission path information of which the transmission protocol is a preset TCP transmission control protocol in each data transmission path information;
determining second data transmission path information except the first data transmission path information generated by the health check of the load balancing equipment in each piece of first data transmission path information;
determining third data transmission path information generated by the load balancing equipment when the load balancing equipment successfully transmits data in each piece of second data transmission path information;
and determining the third data transmission path information as target data transmission path information meeting the data cleaning condition.
5. The method of claim 1, wherein after obtaining the network link library, further comprising:
when an abnormal query request is received, acquiring an abnormal address contained in the abnormal query request;
matching the abnormal address with the network link library to determine an application access path corresponding to the abnormal address;
and displaying the application access path corresponding to the abnormal address.
6. An apparatus for constructing a network link library, comprising:
the first determining unit is used for responding to a link analysis instruction and determining each load balancing device corresponding to the link analysis instruction;
the acquisition unit is used for acquiring the information of each data transmission path recorded in advance by each load balancing device; each data transmission path information comprises a sending end address, an intermediate equipment address and a receiving end address; the intermediate device address is the address of the load balancing device recording the data transmission path information;
a second determining unit configured to determine, among the pieces of data transmission path information, target data transmission path information that does not satisfy a preset data cleansing condition;
a first aggregation unit, configured to perform aggregation processing on each piece of target data transmission path information based on an intermediate device address of each piece of target data transmission path information, to obtain an initial network link corresponding to each intermediate device address;
a third determining unit, configured to determine a target sending end address in each sending end address of each initial network link, and determine a target receiving end address in each receiving end address of each initial network link; a target sending end corresponding to the target sending end address belongs to a preset first application module; the target receiving terminal corresponding to the target receiving terminal address belongs to a preset second application module;
a second aggregation unit, configured to aggregate each initial network link according to each target sending end address and each target receiving end address, to obtain a network link library; the network link library comprises a plurality of application access path groups; each application access path group comprises at least one application access path, and each application access path comprises a target sending end address, at least one intermediate device address and a target receiving end address.
7. The apparatus of claim 6, wherein the first aggregation unit comprises:
the first execution subunit is configured to divide the target data transmission path information according to an intermediate device address of the target data transmission path information to obtain a plurality of data groups; each data group comprises target data transmission path information with consistent multiple intermediate equipment addresses;
the first aggregation subunit is configured to aggregate the information of each target data transmission path of each data group to obtain an initial network link corresponding to each address of the intermediate device; each initial network link corresponding to the intermediate device address comprises a plurality of sending end addresses, the intermediate device address and a plurality of receiving end addresses.
8. The apparatus of claim 7, wherein the second polymerization unit comprises:
a first determining subunit, configured to determine that an address of each of the sender addresses of the initial network link, excluding the target sender address, is an intermediate device address, and determine that an address of each of the receiver addresses of the initial network link, excluding the target receiver address, is an intermediate device address;
and the second aggregation subunit is configured to aggregate each initial network link based on the intermediate device address of each initial network link to obtain a network link library.
9. The apparatus of claim 7, wherein the second determining unit comprises:
the second determining subunit is configured to determine, in each piece of data transmission path information, first data transmission path information of which a transmission protocol is a preset TCP transmission control protocol;
a third determining subunit, configured to determine, in each piece of the first data transmission path information, second data transmission path information other than the first data transmission path information generated by the load balancing device performing the health check;
a fourth determining subunit, configured to determine, in each piece of second data transmission path information, third data transmission path information that is generated when the load balancing device successfully transmits data;
a fifth determining subunit, configured to determine the third data transmission path information as target data transmission path information that satisfies the data cleansing condition.
10. The apparatus of claim 6, further comprising:
the device comprises a receiving unit, a processing unit and a processing unit, wherein the receiving unit is used for acquiring an abnormal address contained in an abnormal query request when the abnormal query request is received;
the matching unit is used for matching the abnormal address with the network link library so as to determine an application access path corresponding to the abnormal address;
and the display unit is used for displaying the application access path corresponding to the abnormal address.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111601394.2A CN114285786B (en) | 2021-12-24 | 2021-12-24 | Construction method and device of network link library |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111601394.2A CN114285786B (en) | 2021-12-24 | 2021-12-24 | Construction method and device of network link library |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114285786A true CN114285786A (en) | 2022-04-05 |
| CN114285786B CN114285786B (en) | 2023-12-08 |
Family
ID=80875195
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111601394.2A Active CN114285786B (en) | 2021-12-24 | 2021-12-24 | Construction method and device of network link library |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114285786B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115866071A (en) * | 2023-02-28 | 2023-03-28 | 中信云网有限公司 | Method and device for determining reporting path of initial equipment attribute information |
Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004104709A (en) * | 2002-09-12 | 2004-04-02 | Furukawa Electric Co Ltd:The | Access network system |
| JP2005136589A (en) * | 2003-10-29 | 2005-05-26 | Hitachi Cable Ltd | Relay device with aggregation function |
| US20060159095A1 (en) * | 2005-01-14 | 2006-07-20 | Cisco Technology, Inc. | Techniques for determining network nodes to represent, multiple subnetworks for a routing protocol |
| WO2012136078A1 (en) * | 2011-04-06 | 2012-10-11 | Hangzhou H3C Technologies Co., Ltd. | A method for traffic load balancing |
| US8661295B1 (en) * | 2011-03-31 | 2014-02-25 | Amazon Technologies, Inc. | Monitoring and detecting causes of failures of network paths |
| CN105743816A (en) * | 2014-12-10 | 2016-07-06 | 华为技术有限公司 | Link aggregation method and device |
| WO2016161836A1 (en) * | 2015-04-07 | 2016-10-13 | 胡汉强 | Data transmission method, control plane device and forwarding plane device |
| CN106982170A (en) * | 2017-04-19 | 2017-07-25 | 上海海加网络科技有限公司 | Multi-link load balance method and device based on linux system |
| CN107493178A (en) * | 2016-06-12 | 2017-12-19 | 富士通株式会社 | information aggregation method, device and system |
| CN108123824A (en) * | 2016-11-30 | 2018-06-05 | 华为技术有限公司 | A kind of network fault detecting method and device |
| CN111008075A (en) * | 2019-12-05 | 2020-04-14 | 安超云软件有限公司 | Load balancing system, method, device, equipment and medium |
| CN111049752A (en) * | 2019-12-17 | 2020-04-21 | 锐捷网络股份有限公司 | Load balancing method and device for multiple transmission lines |
| CN111654402A (en) * | 2020-06-23 | 2020-09-11 | 中国平安财产保险股份有限公司 | Network topology creating method, device, equipment and storage medium |
| CN111740860A (en) * | 2020-06-15 | 2020-10-02 | 中国工商银行股份有限公司 | Log data transmission link monitoring method and device |
| CN112291116A (en) * | 2020-11-23 | 2021-01-29 | 迈普通信技术股份有限公司 | Link fault detection method and device and network equipment |
| CN113298672A (en) * | 2021-05-21 | 2021-08-24 | 中国电信股份有限公司 | Commercial power fault monitoring method, device, system, storage medium and electronic equipment |
| CN113364678A (en) * | 2021-06-18 | 2021-09-07 | 北京奇艺世纪科技有限公司 | Data transmission system, method, device, electronic equipment and computer readable medium |
-
2021
- 2021-12-24 CN CN202111601394.2A patent/CN114285786B/en active Active
Patent Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004104709A (en) * | 2002-09-12 | 2004-04-02 | Furukawa Electric Co Ltd:The | Access network system |
| JP2005136589A (en) * | 2003-10-29 | 2005-05-26 | Hitachi Cable Ltd | Relay device with aggregation function |
| US20060159095A1 (en) * | 2005-01-14 | 2006-07-20 | Cisco Technology, Inc. | Techniques for determining network nodes to represent, multiple subnetworks for a routing protocol |
| US8661295B1 (en) * | 2011-03-31 | 2014-02-25 | Amazon Technologies, Inc. | Monitoring and detecting causes of failures of network paths |
| WO2012136078A1 (en) * | 2011-04-06 | 2012-10-11 | Hangzhou H3C Technologies Co., Ltd. | A method for traffic load balancing |
| CN105743816A (en) * | 2014-12-10 | 2016-07-06 | 华为技术有限公司 | Link aggregation method and device |
| WO2016161836A1 (en) * | 2015-04-07 | 2016-10-13 | 胡汉强 | Data transmission method, control plane device and forwarding plane device |
| CN107493178A (en) * | 2016-06-12 | 2017-12-19 | 富士通株式会社 | information aggregation method, device and system |
| CN108123824A (en) * | 2016-11-30 | 2018-06-05 | 华为技术有限公司 | A kind of network fault detecting method and device |
| CN106982170A (en) * | 2017-04-19 | 2017-07-25 | 上海海加网络科技有限公司 | Multi-link load balance method and device based on linux system |
| CN111008075A (en) * | 2019-12-05 | 2020-04-14 | 安超云软件有限公司 | Load balancing system, method, device, equipment and medium |
| CN111049752A (en) * | 2019-12-17 | 2020-04-21 | 锐捷网络股份有限公司 | Load balancing method and device for multiple transmission lines |
| CN111740860A (en) * | 2020-06-15 | 2020-10-02 | 中国工商银行股份有限公司 | Log data transmission link monitoring method and device |
| CN111654402A (en) * | 2020-06-23 | 2020-09-11 | 中国平安财产保险股份有限公司 | Network topology creating method, device, equipment and storage medium |
| CN112291116A (en) * | 2020-11-23 | 2021-01-29 | 迈普通信技术股份有限公司 | Link fault detection method and device and network equipment |
| CN113298672A (en) * | 2021-05-21 | 2021-08-24 | 中国电信股份有限公司 | Commercial power fault monitoring method, device, system, storage medium and electronic equipment |
| CN113364678A (en) * | 2021-06-18 | 2021-09-07 | 北京奇艺世纪科技有限公司 | Data transmission system, method, device, electronic equipment and computer readable medium |
Non-Patent Citations (2)
| Title |
|---|
| 周伟;朱家琪;金豪;: "基于链路聚合的数据专网互联网出口边缘侧保护机制", 通信技术, no. 11 * |
| 鞠洪尧;: "基于链路响应的负载均衡网络实现", 齐齐哈尔大学学报(自然科学版), no. 03 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115866071A (en) * | 2023-02-28 | 2023-03-28 | 中信云网有限公司 | Method and device for determining reporting path of initial equipment attribute information |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114285786B (en) | 2023-12-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11269718B1 (en) | Root cause detection and corrective action diagnosis system | |
| US9665420B2 (en) | Causal engine and correlation engine based log analyzer | |
| JP2022118108A (en) | Log auditing method, device, electronic apparatus, medium and computer program | |
| US9355007B1 (en) | Identifying abnormal hosts using cluster processing | |
| CN110704231A (en) | A fault handling method and device | |
| US9043317B2 (en) | System and method for event-driven prioritization | |
| CN115277566B (en) | Load balancing method and device for data access, computer equipment and medium | |
| CN114095567B (en) | Data access request processing method and device, computer equipment and medium | |
| US10185614B2 (en) | Generic alarm correlation by means of normalized alarm codes | |
| CN106789270A (en) | A method and system for realizing centralized operation and maintenance management of an information system | |
| CN109684280A (en) | Journal file processing method, apparatus and system | |
| CN112380072A (en) | Multi-data center access method and system | |
| CN109978547A (en) | Risk behavior control method and system, equipment and storage medium | |
| CN111784516A (en) | Method and device for determining service path and electronic equipment | |
| CN112737800A (en) | Service node fault positioning method, call chain generation method and server | |
| CN110046994A (en) | Method and system for accepting block link deposit certificate transaction | |
| CN114338684A (en) | Energy management system and method | |
| CN113032000A (en) | Intelligent operation data management device and method and computer system | |
| CN109245915B (en) | Method and system for realizing server set balanced allocation | |
| CN114285786B (en) | Construction method and device of network link library | |
| CN115396280B (en) | Alarm data processing method, device, equipment and storage medium | |
| CN112787853A (en) | Automatic generation method and device of network change scheme and related equipment | |
| CN113760651B (en) | Main sub-chain running state collection method, system and storage medium of block chain | |
| CN110740172A (en) | routing management method, device and system based on micro-service architecture | |
| Sosnowski et al. | Monitoring event logs within a cluster system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |