CN109144830A - A kind of acquisition of data fails to report supervision and is switched fast the method and system of network environment - Google Patents
A kind of acquisition of data fails to report supervision and is switched fast the method and system of network environment Download PDFInfo
- Publication number
- CN109144830A CN109144830A CN201811038619.6A CN201811038619A CN109144830A CN 109144830 A CN109144830 A CN 109144830A CN 201811038619 A CN201811038619 A CN 201811038619A CN 109144830 A CN109144830 A CN 109144830A
- Authority
- CN
- China
- Prior art keywords
- data
- acquisition
- network
- switched fast
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/32—Monitoring with visual or acoustical indication of the functioning of the machine
- G06F11/324—Display of status information
- G06F11/327—Alarm or error message display
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/3006—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3089—Monitoring arrangements determined by the means or processing involved in sensing the monitored data, e.g. interfaces, connectors, sensors, probes, agents
- G06F11/3093—Configuration details thereof, e.g. installation, enabling, spatial arrangement of the probes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/0695—Management of faults, events, alarms or notifications the faulty arrangement being the maintenance, administration or management system
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/12—Network monitoring probes
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
- G06F2201/875—Monitoring of systems including the internet
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Quality & Reliability (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computing Systems (AREA)
- Mathematical Physics (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
Supervision is failed to report the invention discloses a kind of acquisition of data of information collection and network switching technical field and is switched fast the method and system of network environment, and specific step is as follows for this method: S1: acquiring the network data of internet；S2: the network data source of acquisition is received；S3: control centre receives analysis treated signal；S4: entire data acquisition is monitored；S5: different network test environments is switched fast using physically-isolated mode, the present invention is by disposing on central server the information data of acquisition, using being uniformly aggregated into data center after acquisition, screening, processing, classified based on feature extraction, avoid the occurrence of failing to report for data acquisition, guarantee the unified integrality of acquisition data, while the mode based on physical isolation switching is realized and is switched fast to heterogeneous networks test environment.
Description
Technical field
Supervision is failed to report the invention discloses a kind of acquisition of data and is switched fast the method and system of network environment, specially
Information collection and network switching technical field.
Background technique
With the rapid growth of network information management data, the data acquisition of traditional information data system cannot expire
The concurrent processing of sufficient super large data volume, the data information for accessing magnanimity and analysis therefrom quickly is acquired to system data
Basic demand.In the collection process of network data, since the acquisition of network data is excessively mixed and disorderly and huge, it is also easy to produce storage
Server bottleneck, data center's amount of storage be excessive and the data loophole phenomenon of acquisition, while after constructing network environment, from one
A network environment is switched to another network environment, manually first can only close computer, toggle switch to position,
Then computer is opened again, to execute the above movement automatically, to be directed to various types slot ISA, PCI, PCI-E increase hardware connection
Interface circuit, this fractional hardware valence is high and adaptability is limited, it is difficult to meet the desktop computer requirement of each model of all producers, i.e., it is simultaneous
Capacitive is bad, and with the development of technology, the needs of operating system security are enclosed and contacted with slot, or the needs permitted
And lead to increased costs, it becomes be infeasible scheme.For this purpose, failing to report supervision we have proposed a kind of acquisition of data and quickly cutting
The method and system of switching network environment comes into operation, to solve the above problems.
Summary of the invention
Supervision is failed to report the purpose of the present invention is to provide a kind of acquisition of data and is switched fast the method for network environment and is
System, to solve the problems mentioned in the above background technology.
To achieve the above object, the invention provides the following technical scheme: a kind of acquisition of data is failed to report supervision and is switched fast
The method and system of network environment, specific step is as follows for this method:
S1: the network data of internet is acquired, and the data after acquisition are uploaded, is waited to be distributed；
S2: receiving the network data source of acquisition, monitoring computer is uploaded to after data source is carried out packing arrangement, to data
It is analyzed and determined；
S3: control centre receives analysis treated signal, carries out graded dispatching to the data source of acquisition, and feature mentions
It takes, it is ensured that the integrality of the data source of acquisition；
S4: being monitored entire data acquisition, abnormal data alarm occurs and pushes abnormal data information；
S5: different network test environments is switched fast using physically-isolated mode.
Preferably, the detailed process of the acquisition of network data are as follows: the network address domain name or IP address of previously given particular organization；
By configuring, user has permission to access the user people of website and password determines that data acquire target；Previously given Web page classifying column
Purpose keyword, and be converted to datum target mode and be acquired.
Preferably, the parser based on web page contents is used for the acquisition of network data, that is, is directed to text or surpasses
The simple webpage of structure based on link, gradually generates dynamic page by network transmission；Selection strategy, what decision to be downloaded
The page；Again access strategy checks the renewal frequency of the page；Equilibrium strategy avoids the page from overloading；Paralleling tactic realizes distribution
The acquisition of formula data.
Preferably, including data acquisition module, data transmission module, central server, control centre, execution module, prison
Control computer, physical isolation switch card, selection switch module and circuit reset module；
The data acquisition module is used for real-time Internet data, and the data of acquisition are uploaded to the data and transmit mould
In block；The central server receives the acquisition data uploaded from the data transmission module, and data be packaged whole
Reason is transferred in the monitoring computer, while can be analyzed and determined to data, when data area is exceeded, by the monitoring
Computer carries out sound-light alarm；The control centre receives the driving signal from the central server, to the data of acquisition
Graded dispatching is carried out, and carries out feature extraction；The control centre also respectively with the execution module and the monitoring computer
Connection, for the execution module for specifically executing the control of network data acquisition, the monitoring computer is real for operator
When monitoring data collecting flowchart；
The physical isolation switch card with different network test environments for connecting, and the circuit reset module is for inserting
The detection of slot reset signal RESET, achievees the purpose that automatic switchover, as long as that is, computer equipment is detecting reset letter with period
Number effectively switch to another network test environment；The selection switch module is used for for when needing thermal starting, then needing
External switch is first stirred, as automatic switchover processing is cancelled, restarting at this time is only opened under original hard disk environment
It is dynamic.
Preferably, the data transmission module is CC2430 chip, is equipped with a 2.4GHZ DSSS less radio-frequency front end,
And the SRAM and high-capacity FLASH of built-in one 8 8051 enhancement type microprocessors, 8Kbyte.
Preferably, the central server is also connected with the database, and the database is genuinely convinced in described for storing
The data information at the intelligence manufacture scene handled by analysis in business device.
Preferably, the database is also integrated with data query port, is used for real-time display history data store report, and
The function of data query printing is provided.
Preferably, the central server is equipped with I/O interface, RS232 serial ports and SPI serial ports, can outer welding system progress
Dilatation.
Compared with prior art, the beneficial effects of the present invention are: the present invention is by disposing in the information data of acquisition
On central server, using data center is uniformly aggregated into after acquisition, screening, processing, is classified based on feature extraction, avoid the occurrence of number
According to failing to report for acquisition, guarantee the unified integrality of acquisition data, while the mode based on physical isolation switching is realized to different nets
Network test environment is switched fast.
Detailed description of the invention
Fig. 1 is present system functional block diagram.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other
Embodiment shall fall within the protection scope of the present invention.
Referring to Fig. 1, the present invention provides a kind of technical solution: a kind of acquisition of data fails to report supervision and is switched fast network rings
The method in border, specific step is as follows for this method:
S1: the network data of internet is acquired, and the data after acquisition are uploaded, waits to be distributed, the acquisition of network data
Detailed process are as follows: the network address domain name or IP address of previously given particular organization；Website is had permission to access by configuring user
The user people and password determine that data acquire target；The keyword of previously given Web page classifying column, and be converted to datum target
Mode is acquired, and the acquisition for network data uses the parser based on web page contents, i.e., for text or hyperlink
It is connected in the simple webpage of main structure, dynamic page is gradually generated by network transmission；Selection strategy determines the page to be downloaded
Face；Again access strategy checks the renewal frequency of the page；Equilibrium strategy avoids the page from overloading；Paralleling tactic is realized distributed
Data acquisition；
S2: receiving the network data source of acquisition, monitoring computer is uploaded to after data source is carried out packing arrangement, to data
It is analyzed and determined；
S3: control centre receives analysis treated signal, carries out graded dispatching to the data source of acquisition, and feature mentions
It takes, it is ensured that the integrality of the data source of acquisition；
S4: being monitored entire data acquisition, abnormal data alarm occurs and pushes abnormal data information；
S5: different network test environments is switched fast using physically-isolated mode.
Supervision is failed to report the present invention also provides a kind of acquisition of data and is switched fast Environment System, including data acquisition
Module, data transmission module, central server, control centre, execution module, monitoring computer, physical isolation switch card, selection
Switch module and circuit reset module；
The data acquisition module is used for real-time Internet data, and the data of acquisition are uploaded to the data and transmit mould
In block；The central server receives the acquisition data uploaded from the data transmission module, and data be packaged whole
Reason is transferred in the monitoring computer, while can be analyzed and determined to data, when data area is exceeded, by the monitoring
Computer carries out sound-light alarm；The control centre receives the driving signal from the central server, to the data of acquisition
Graded dispatching is carried out, and carries out feature extraction；The control centre also respectively with the execution module and the monitoring computer
Connection, for the execution module for specifically executing the control of network data acquisition, the monitoring computer is real for operator
When monitoring data collecting flowchart；
The physical isolation switch card with different network test environments for connecting, and the circuit reset module is for inserting
The detection of slot reset signal RESET, achievees the purpose that automatic switchover, as long as that is, computer equipment is detecting reset letter with period
Number effectively switch to another network test environment；The selection switch module is used for for when needing thermal starting, then needing
External switch is first stirred, as automatic switchover processing is cancelled, restarting at this time is only opened under original hard disk environment
It is dynamic.
Wherein, the data transmission module is CC2430 chip, is equipped with a 2.4GHZ DSSS less radio-frequency front end, and
The SRAM and high-capacity FLASH of built-in one 8 8051 enhancement type microprocessors, 8Kbyte, the central server also with
The database is connected, and the database is used to store the intelligence manufacture scene handled by analysis in the central server
Data information, the database are also integrated with data query port, are used for real-time display history data store report, and provide number
It is investigated that ask printing function, the central server be equipped with I/O interface, RS232 serial ports and SPI serial ports, can outer welding system into
Row dilatation.
It although an embodiment of the present invention has been shown and described, for the ordinary skill in the art, can be with
A variety of variations, modification, replacement can be carried out to these embodiments without departing from the principles and spirit of the present invention by understanding
And modification, the scope of the present invention is defined by the appended.
Claims (8)
1. a kind of method that data acquisition fails to report supervision and is switched fast network environment, it is characterised in that: the specific step of this method
It is rapid as follows:
S1: the network data of internet is acquired, and the data after acquisition are uploaded, is waited to be distributed；
S2: receiving the network data source of acquisition, uploads to monitoring computer after data source is carried out packing arrangement, carries out to data
It analyzes and determines；
S3: control centre receives analysis treated signal, carries out graded dispatching, and feature extraction to the data source of acquisition, really
Protect the integrality of the data source of acquisition；
S4: being monitored entire data acquisition, abnormal data alarm occurs and pushes abnormal data information；
S5: different network test environments is switched fast using physically-isolated mode.
2. a kind of method that data acquisition fails to report supervision and is switched fast network environment according to claim 1, feature
It is: in the step S1, the detailed process of the acquisition of network data are as follows: the network address domain name of previously given particular organization or IP
Location；By configuring, user has permission to access the user people of website and password determines that data acquire target；Previously given webpage point
The keyword of class column, and be converted to datum target mode and be acquired.
3. a kind of method that data acquisition fails to report supervision and is switched fast network environment according to claim 1, feature
Be: in the step S1, the acquisition for network data uses the parser based on web page contents, i.e., for text or
The simple webpage of structure based on hyperlink, gradually generates dynamic page by network transmission；Selection strategy, decision to be downloaded
The page；Again access strategy checks the renewal frequency of the page；Equilibrium strategy avoids the page from overloading；Paralleling tactic is realized and is divided
The acquisition of cloth data.
4. a kind of acquisition of data fails to report supervision and is switched fast Environment System, it is characterised in that: including data acquisition module,
Data transmission module, central server, control centre, execution module, monitoring computer, physical isolation switch card, selection switch
Module and circuit reset module；
The data acquisition module is used for real-time Internet data, and the data of acquisition are uploaded to the data transmission module
In；The central server receives the acquisition data uploaded from the data transmission module, and data are carried out packing arrangement
It is transferred in the monitoring computer, while data can be analyzed and determined, when data area is exceeded, counted by the monitoring
Calculation machine carries out sound-light alarm；The control centre receives the driving signal from the central server, to the data of acquisition into
Row graded dispatching, and carry out feature extraction；The control centre also connects with the execution module and the monitoring computer respectively
It connects, for the execution module for specifically executing the control of network data acquisition, the monitoring computer is real-time for operator
Monitoring data collecting flowchart；
For the physical isolation switch card for connecting with different network test environments, the circuit reset module is multiple for slot
The detection of position signal RESET, achievees the purpose that automatic switchover, as long as that is, computer equipment is detecting that reset signal has with period
Effect switches to another network test environment；The selection switch module is used for for when needing thermal starting, then needing elder generation
External switch is stirred, as automatic switchover processing is cancelled, restarting at this time only starts under original hard disk environment.
5. a kind of data acquisition according to claim 4 fails to report supervision and is switched fast Environment System, feature exists
In: the data transmission module is CC2430 chip, is equipped with a 2.4GHZ DSSS less radio-frequency front end, and built-in one 8
8051 enhancement type microprocessors, 8Kbyte SRAM and high-capacity FLASH.
6. a kind of data acquisition according to claim 4 fails to report supervision and is switched fast Environment System, feature exists
In: the central server is also connected with the database, and the database is for storing in the central server through excessive
Analyse the data information at the intelligence manufacture scene of processing.
7. a kind of data acquisition according to claim 6 fails to report supervision and is switched fast Environment System, feature exists
In: the database is also integrated with data query port, is used for real-time display history data store report, and provide data query
The function of printing.
8. a kind of data acquisition according to claim 4 fails to report supervision and is switched fast Environment System, feature exists
In: the central server is equipped with I/O interface, RS232 serial ports and SPI serial ports, can outer welding system progress dilatation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811038619.6A CN109144830A (en) | 2018-09-06 | 2018-09-06 | A kind of acquisition of data fails to report supervision and is switched fast the method and system of network environment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811038619.6A CN109144830A (en) | 2018-09-06 | 2018-09-06 | A kind of acquisition of data fails to report supervision and is switched fast the method and system of network environment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109144830A true CN109144830A (en) | 2019-01-04 |
Family
ID=64827451
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811038619.6A Pending CN109144830A (en) | 2018-09-06 | 2018-09-06 | A kind of acquisition of data fails to report supervision and is switched fast the method and system of network environment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109144830A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112397193A (en) * | 2020-11-16 | 2021-02-23 | 康键信息技术（深圳）有限公司 | Data reporting method, device, equipment and storage medium |
| CN115175022A (en) * | 2022-09-05 | 2022-10-11 | 澹泊科技(苏州)有限公司 | Equipment energy consumption monitoring method and system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101083607A (en) * | 2006-05-30 | 2007-12-05 | 倪海生 | Internet accessing server for inside and outside network isolation and its processing method |
| WO2008097809A2 (en) * | 2007-02-02 | 2008-08-14 | Mwa Intelligence, Inc. | Monitoring device mesh network systems and methods |
| CN101800649A (en) * | 2010-03-03 | 2010-08-11 | 武汉华源电力集团股份有限公司 | Physical isolation card |
| CN107942987A (en) * | 2017-12-25 | 2018-04-20 | 陈益德 | A data collection and scheduling system for intelligent manufacturing private network |
-
2018
- 2018-09-06 CN CN201811038619.6A patent/CN109144830A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101083607A (en) * | 2006-05-30 | 2007-12-05 | 倪海生 | Internet accessing server for inside and outside network isolation and its processing method |
| WO2008097809A2 (en) * | 2007-02-02 | 2008-08-14 | Mwa Intelligence, Inc. | Monitoring device mesh network systems and methods |
| CN101800649A (en) * | 2010-03-03 | 2010-08-11 | 武汉华源电力集团股份有限公司 | Physical isolation card |
| CN107942987A (en) * | 2017-12-25 | 2018-04-20 | 陈益德 | A data collection and scheduling system for intelligent manufacturing private network |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112397193A (en) * | 2020-11-16 | 2021-02-23 | 康键信息技术（深圳）有限公司 | Data reporting method, device, equipment and storage medium |
| CN112397193B (en) * | 2020-11-16 | 2024-07-12 | 康键信息技术（深圳）有限公司 | Data reporting method, device, equipment and storage medium |
| CN115175022A (en) * | 2022-09-05 | 2022-10-11 | 澹泊科技(苏州)有限公司 | Equipment energy consumption monitoring method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102929613B (en) | The tuning apparatus and method of operating system | |
| CN111881011B (en) | Log management method, platform, server and storage medium | |
| KR102410151B1 (en) | Method, apparatus and computer-readable medium for machine learning based observation level measurement using server system log and risk calculation using thereof | |
| CN103631922B (en) | Extensive Web information extracting method and system based on Hadoop clusters | |
| CN109684052B (en) | Transaction analysis method, apparatus, device and storage medium | |
| CN104363253B (en) | Website security detection method and device | |
| CN105391800B (en) | Based on " internet+" medical equipment failure self-test and repair system | |
| CN111625383B (en) | Process exception event processing method and device, electronic equipment and storage medium | |
| CN107087001A (en) | A Distributed Internet Important Address Space Retrieval System | |
| US20230231882A1 (en) | Honeypot identification method, apparatus, device, and medium based on cyberspace mapping | |
| CN111740868A (en) | Alarm data processing method and device and storage medium | |
| US20160269428A1 (en) | Data processing | |
| CN111046022A (en) | Database auditing method based on big data technology | |
| AU2015201361A1 (en) | A method and system for efficient performance prediction of structured query for big data | |
| CN105279071A (en) | A virtual machine performance data collection method, system and cloud computing platform | |
| Wang et al. | Honeynet construction based on intrusion detection | |
| CN109144830A (en) | A kind of acquisition of data fails to report supervision and is switched fast the method and system of network environment | |
| CN113672912A (en) | Network Security Monitoring System Based on Computer Hardware Indication and Behavior Analysis | |
| CN107688481B (en) | Multi-node-supporting KVM virtual machine hiding process detection system | |
| Roschke et al. | A flexible and efficient alert correlation platform for distributed ids | |
| CN119697086A (en) | Network device discovery method | |
| JP7383176B2 (en) | Video data acquisition methods, equipment, electronic devices and storage media | |
| CN108289035B (en) | Method and system for visually displaying running states of network and business system | |
| CN116708219A (en) | DPI platform-based data acquisition method and device | |
| CN115495319A (en) | Service link monitoring method and device, storage medium and computer equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190104 |
|
| RJ01 | Rejection of invention patent application after publication |