CN113918413A - Monitoring method and monitoring device for batch operation of bank system and electronic equipment - Google Patents
Monitoring method and monitoring device for batch operation of bank system and electronic equipment Download PDFInfo
- Publication number
- CN113918413A CN113918413A CN202111139057.6A CN202111139057A CN113918413A CN 113918413 A CN113918413 A CN 113918413A CN 202111139057 A CN202111139057 A CN 202111139057A CN 113918413 A CN113918413 A CN 113918413A
- Authority
- CN
- China
- Prior art keywords
- batch
- preset
- job
- log data
- batch jobs
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/302—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a software system
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3065—Monitoring arrangements determined by the means or processing involved in reporting the monitored data
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Quality & Reliability (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a monitoring method and a monitoring device for batch operation of a bank system and electronic equipment. The monitoring method comprises the following steps: after log data of batch jobs of a bank system are collected, the log data are stored in a preset database, operation indexes of the batch jobs are counted according to a plurality of preset dimensions based on the log data, if the index parameter average value of the operation indexes corresponding to each dimension is smaller than a preset average threshold value, the batch jobs are written into an abnormal statistic table, and the batch jobs with abnormal indication by the abnormal statistic table are sent to a target operation and maintenance terminal. The invention solves the technical problem that batch operation cannot be monitored in real time in the related technology.
Description
Technical Field
The invention relates to the technical field of batch job processing, in particular to a monitoring method and a monitoring device for batch jobs of a bank system and electronic equipment.
Background
In the related art, the conventional batch job monitoring method includes the following steps: (1) starting and stopping time monitoring, namely generating an abnormal alarm event when batch work is not started/finished according to specified time; (2) and (4) interrupting monitoring, namely generating an alarm event when the batch work is abnormally interrupted in the execution process.
However, monitoring of batch operations using the above method has the following problems: (1) only result monitoring is carried out, process monitoring is lacked, and real-time monitoring cannot be carried out; (2) only according to a fixed threshold value, comparative analysis is carried out, early warning is carried out according to the analysis result, and analysis according to historical indexes and corresponding threshold value adjustment in time are lacked; (3) the efficiency of checking the execution condition of a longer time interval or counting related indexes is poor based on the relational database recording batch execution logs.
In view of the above problems, no effective solution has been proposed.
Disclosure of Invention
The embodiment of the invention provides a monitoring method, a monitoring device and electronic equipment for batch operation of a bank system, and at least solves the technical problem that the batch operation cannot be monitored in real time in the related technology.
According to an aspect of an embodiment of the present invention, a method for monitoring batch jobs in a banking system is provided, including: after collecting log data of batch jobs of a bank system, storing the log data to a preset database; respectively counting the operation indexes of the batch jobs according to a plurality of preset dimensions based on the log data; if the index parameter average value of the operation index corresponding to each dimension is smaller than a preset average threshold value, writing the batch operation into an abnormal statistical table; and sending the batch jobs with the abnormal indication of the abnormal statistical table to a target operation and maintenance terminal.
Optionally, the log data comprises at least one of: start timestamp, end timestamp, error timestamp, job number, job date, job status, area number, product type.
Optionally, the step of storing the log data in a preset database includes: setting a weight value of each batch job based on attribute information of each batch job in the log data, wherein the attribute information comprises at least one of the following: the mechanism and the operation type of the device; sorting the weighted values of the batch jobs to obtain a sorting result; based on the sorting result, making a corresponding storage strategy; and respectively storing each batch job to a preset database through the storage strategy.
Optionally, after respectively counting the operation indexes of the batch jobs according to a plurality of preset dimensions based on the log data, the monitoring method further includes: and if the occurrence frequency that the index parameter average value of the operation index is smaller than the preset average threshold value within the preset time period is larger than or equal to the preset threshold value, adjusting the preset average threshold value.
Optionally, after collecting log data of batch jobs of the banking system, the monitoring method further includes: and if at least one to-be-executed operation in the currently acquired batch operations is detected to be an abnormal operation, writing the to-be-executed operation into the abnormal statistical table.
Optionally, after storing the log data in a preset database, the monitoring method further includes: receiving a job query request; responding to the job inquiry request, and displaying the information data of the batch jobs, wherein the information data at least comprises: the data of the execution state of the batch jobs, the historical data of the batch jobs and the index data of the batch jobs.
Optionally, the type of the database is a time-series database.
According to another aspect of the embodiments of the present invention, there is also provided a monitoring device for batch jobs in a banking system, including: the storage unit is used for storing the log data of batch jobs of the bank system into a preset database after the log data are collected; the statistical unit is used for respectively counting the operation indexes of the batch jobs according to a plurality of preset dimensions based on the log data; the writing unit is used for writing the batch jobs into an abnormal statistical table if the index parameter average value of the operation index corresponding to each dimension is smaller than a preset average threshold value; and the sending unit is used for sending the batch jobs with the abnormal indication of the abnormal statistical table to the target operation and maintenance terminal.
Optionally, the log data comprises at least one of: start timestamp, end timestamp, error timestamp, job number, job date, job status, area number, product type.
Optionally, the storage unit includes: a first setting module, configured to set a weight value of each batch job in the log data based on attribute information of the batch job, where the attribute information includes at least one of: the mechanism and the operation type of the device; the first sequencing module is used for sequencing the weighted values of the batch jobs to obtain a sequencing result; the first establishing module is used for establishing a corresponding storage strategy based on the sequencing result; and the first storage module is used for storing each batch job to a preset database through the storage strategy.
Optionally, the monitoring device further comprises: and the first adjusting module is used for adjusting the preset average threshold value if the occurrence frequency that the index parameter average value of the operation index is smaller than the preset average threshold value within a preset time period is greater than or equal to the preset threshold value after the operation indexes of the batch jobs are respectively counted according to a plurality of preset dimensions based on the log data.
Optionally, the monitoring device further comprises: the system comprises a first writing-in module, a second writing-in module and a third writing-in module, wherein the first writing-in module is used for writing at least one to-be-executed job in the currently acquired batch jobs into an abnormal statistical table if the log data of the batch jobs of the bank system are acquired and the to-be-executed job is detected to be an abnormal job.
Optionally, the monitoring device further comprises: the first receiving module is used for receiving a job query request after the log data are stored in a preset database; a first display module, configured to display information data of the batch job in response to the job query request, where the information data at least includes: the data of the execution state of the batch jobs, the historical data of the batch jobs and the index data of the batch jobs.
Optionally, the type of the database is a time-series database.
According to another aspect of the embodiments of the present invention, there is also provided an electronic device, including: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to execute any one of the above monitoring methods for batch jobs of the banking system via execution of the executable instructions.
According to another aspect of the embodiments of the present invention, there is also provided a computer-readable storage medium, where the computer-readable storage medium includes a stored computer program, and when the computer program runs, the apparatus where the computer-readable storage medium is located is controlled to execute any one of the above methods for monitoring batch operations of a banking system.
According to the method and the device, after log data of batch jobs of a bank system are collected, the log data are stored in a preset database, operation indexes of the batch jobs are counted respectively according to a plurality of preset dimensions based on the log data, if the index parameter average value of the operation index corresponding to each dimension is smaller than a preset average threshold value, the batch jobs are written into an abnormal statistical table, and the batch jobs with abnormal indication of the abnormal statistical table are sent to a target operation and maintenance terminal. According to the method and the device, the batch job execution logs are collected, stored, the batch job execution logs are counted, the batch job operation indexes are counted, the batch job abnormity is alarmed, the batch job execution condition can be monitored in real time, the system alarming accuracy and effectiveness are improved, and the technical problem that the batch job cannot be monitored in real time in the related technology is solved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
FIG. 1 is a flow chart of an alternative image recognition method according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of an alternative method for monitoring a batch job based on a time series database according to an embodiment of the present invention;
fig. 3 is a schematic diagram of an alternative monitoring apparatus for batch jobs of a banking system according to an embodiment of the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
To facilitate understanding of the invention by those skilled in the art, some terms or nouns referred to in the embodiments of the invention are explained below:
a time sequence database: the vertical database is highly optimized for time series data, and is used for solving the defects of the traditional relational database in time series data storage and analysis.
And (3) continuous query: the method is a query automatically run periodically in the database, is used for placing query results in a specified data table, is a good mode for reducing the sampling rate by utilizing continuous query to query, greatly reduces the system occupation amount of the database by combining the continuous query and a storage strategy, and can store data in the specified data table after the continuous query is used, thereby providing convenience for counting the data with different accuracies later.
The following embodiments of the invention can be applied to monitoring systems and applications of various batch operations, or in scenes needing to monitor the batch operations, and can collect relevant data of the batch operations from various banking systems, financial systems and the like.
Example one
In accordance with an embodiment of the present invention, there is provided an embodiment of a method for monitoring batch jobs in a banking system, it should be noted that the steps illustrated in the flowchart of the accompanying drawings may be performed in a computer system such as a set of computer executable instructions, and that while a logical order is illustrated in the flowchart, in some cases the steps illustrated or described may be performed in an order different than here.
Fig. 1 is a flow chart of an alternative image recognition method according to an embodiment of the present invention, as shown in fig. 1, the method includes the following steps:
and step S102, after collecting the log data of batch jobs of the bank system, storing the log data into a preset database.
And step S104, respectively counting the operation indexes of the batch jobs according to a plurality of preset dimensions based on the log data.
And step S106, if the index parameter average value of the operation index corresponding to each dimension is smaller than a preset average threshold value, writing the batch operation into an abnormal statistical table.
And step S108, sending the batch jobs with the abnormal statistical table indication to the target operation and maintenance terminal.
Through the steps, after log data of batch jobs of the bank system are collected, the log data are stored in a preset database, the operation indexes of the batch jobs are respectively counted according to a plurality of preset dimensions based on the log data, if the index parameter average value of the operation index corresponding to each dimension is smaller than a preset average threshold value, the batch jobs are written into an abnormal statistical table, and the batch jobs with abnormal indication by the abnormal statistical table are sent to a target operation and maintenance terminal. According to the embodiment of the invention, by acquiring the batch job execution logs, storing the batch job execution logs, counting the batch job operation indexes, alarming batch job abnormity and the like, the batch job execution condition can be monitored in real time, the system alarming accuracy and effectiveness are improved, and the technical problem that the batch job cannot be monitored in real time in the related technology is solved.
The following will explain the embodiments of the present invention in detail with reference to the above steps.
The type of the database in the embodiment of the present invention may be a time sequence database (e.g., infiluxdb), and the embodiment of the present invention implements batch job monitoring based on the time sequence database.
And step S102, after collecting the log data of batch jobs of the bank system, storing the log data into a preset database.
In an embodiment of the present invention, the banking system may include various subsystems, such as a deposit subsystem, a loan subsystem, a bond subsystem, a foreign exchange subsystem, and the like, and may store log data of batch jobs collected from the subsystems of the banking systems into a preset database, where the preset database may be a time series database (e.g., infiluxdb).
Log data may include, but is not limited to: the system comprises a start timestamp, an end timestamp, an error timestamp, a job number, a job date, a job state, a zone number, a product type and the like, wherein the job number is the number of each job in the same batch job, the job state can be divided into a normal state or an abnormal state, the abnormal state can be subdivided according to specific abnormal reasons, specific description is not provided herein, the zone number is the number according to the source of the batch job, for example, a source bond subsystem can be numbered A, a source foreign exchange subsystem can be numbered B and the like, and the product type can comprise financial product types such as bonds, foreign exchanges, funds and the like.
Optionally, the step of storing the log data in a preset database includes: setting a weight value of each batch job based on attribute information of each batch job in the log data, wherein the attribute information comprises at least one of the following: the mechanism and the operation type of the device; sorting the weighted values of the batch operation to obtain a sorting result; based on the sorting result, making a corresponding storage strategy; and respectively storing each batch job to a preset database through a storage strategy.
In the embodiment of the present invention, the collected batch job execution logs are stored in the time sequence database, the importance of each organization may be determined by related service personnel according to the importance of the batch jobs (the importance is characterized as a weight parameter in this application, that is, according to attribute information of each batch job, for example, an affiliated organization (for example, a foreign exchange subsystem, etc.), according to the function of each organization in the banking system, the importance of each organization may be determined by related service personnel according to job types (for example, foreign exchanges, bonds, etc.), a weight value of the corresponding batch job may be set, a corresponding retention policy (i.e., a storage policy) may be customized according to the weight value of the batch job, a shorter retention period may be selected for the batch job with a lower importance, so as to save storage space and improve query efficiency, for example, a region number, and a region number, The product type and the like are used as tags (tag) to quickly query the log data of the corresponding batch job.
Optionally, after the log data is stored in the preset database, the monitoring method further includes: receiving a job query request; responding to the job query request, and displaying information data of the batch jobs, wherein the information data at least comprises: execution status data of the batch job, history data of the batch job, and index data of the batch job.
In the embodiment of the invention, the query of batch job log data can be supported, namely, a user is supported to check the execution condition of the batch job in real time, and check the historical detail data, index data and the like of the batch job.
And step S104, respectively counting the operation indexes of the batch jobs according to a plurality of preset dimensions based on the log data.
In the embodiment of the present invention, the running indexes of the batch jobs may be counted according to a preset period (for example, 1 time every 10 minutes) through continuous query, and the running indexes of the batch jobs may be counted by summarizing the number of the batch jobs in different dimensions, for example, in different dimensions such as a region number and a product type.
And step S106, if the index parameter average value of the operation index corresponding to each dimension is smaller than a preset average threshold value, writing the batch operation into an abnormal statistical table.
In the embodiment of the present invention, a preset percentage of an average value of the operation indexes in a last period of time (for example, 70% of the average value of the operation indexes in the last 10 days) may be used as a preset average threshold, and if the index parameter average value of the operation index corresponding to each dimension is smaller than the preset average threshold, it is determined that the batch job is abnormal, and the batch job is written into the abnormal statistical table.
Optionally, after counting the operation indexes of the batch jobs according to a plurality of preset dimensions based on the log data, the monitoring method further includes: and if the occurrence frequency that the index parameter average value of the operation index is smaller than the preset average threshold value within the preset time period is larger than or equal to the preset threshold value, adjusting the preset average threshold value.
In the embodiment of the present invention, if the number of occurrences that the average value of the index parameter of the operation index of the batch job is smaller than the preset average threshold is greater than or equal to the preset threshold within a period of time (i.e., within the preset time period) (for example, it is counted that the average operation index of the batch job is continuously smaller than the preset threshold for 5 times), it is determined that the threshold should be adjusted, and the threshold is adjusted according to the actual situation, so as to avoid the occurrence of the phenomenon that the normal batch job is determined as an abnormal job, and increase the operation and maintenance cost.
Optionally, after collecting log data of batch jobs of the banking system, the monitoring method further includes: and if at least one job to be executed in the currently collected batch jobs is detected to be an abnormal job, writing the job to be executed into an abnormal statistical table.
In the embodiment of the present invention, after collecting log data of a batch job, an abnormal job detected in the collection process may be written into the abnormal statistical table.
And step S108, sending the batch jobs with the abnormal statistical table indication to the target operation and maintenance terminal.
In the embodiment of the invention, the alarm system inquires the batch abnormal statistical table and informs related operation and maintenance personnel in the forms of short messages, mails and the like.
According to the embodiment of the invention, through functional modules such as batch job execution log acquisition, batch job execution log storage, batch job operation index statistics, batch job abnormity monitoring alarm and batch job log data query, the dynamic adjustment of corresponding threshold values according to historical operation indexes is supported, and the alarm accuracy and effectiveness of the system are improved.
Example two
Fig. 2 is a schematic diagram of an optional batch job monitoring method based on a time sequence database according to an embodiment of the present invention, and as shown in fig. 2, the batch job monitoring method based on the time sequence database (e.g., infiluxdb) according to the embodiment of the present invention includes the following components:
1) collecting the execution logs of batch jobs: when the batch operation starts, calling an Http API (application program interface) in a batch server to upload information such as a start timestamp, an operation number, an operation date, an operation state, a region number, a product type and the like; when the batch operation is finished, calling an Http API (application program interface) in the batch server to upload information such as an end timestamp, an operation number, an operation date, an operation state, a region number, a product type and the like; when the batch operation is wrong, the Http API interface in the batch server is called to upload information such as a wrong timestamp, an operation number, an operation date, an operation state, an area number, a product type and the like.
2) Storing the execution log of the batch jobs: the collected batch job execution logs are stored in a time sequence database, a corresponding Retention Policy (Retention Policy) is customized according to the importance degree of the batch job, a shorter Retention period is selected for the batch job with lower importance degree, so that the storage space is saved, the query efficiency is improved, and the area number and the product type can be used as a label (tag) to quickly query the corresponding batch job log data.
3) Counting batch operation indexes: through Continuous Query (continuos Query), the batch operation indexes are counted according to a preset period, for example, 1 time every 10 minutes, the number of batch operations can be summarized by different dimensions such as area numbers, product types and the like, and if the indexes are lower than a preset threshold value in a preset time period, for example, lower than 70% of the average value of the operation indexes of the latest 10 days, the batch operations are written into a batch exception statistical table.
4) Monitoring and alarming for batch operation abnormity: the unified monitoring platform inquires the batch abnormal statistical table and informs related operation and maintenance personnel in the forms of short messages, mails and the like.
5) Batch job log data query: the method supports real-time checking of batch job execution conditions; and the viewing of historical detail data, index data and the like of batch jobs is supported.
The embodiment of the invention provides batch operation monitoring based on a time sequence database, and the method supports dynamic adjustment of corresponding threshold values according to historical operation indexes through functional modules such as batch operation execution log acquisition, batch operation execution log storage, batch operation index statistics, batch operation abnormity monitoring alarm, batch operation log data query and the like, can quickly monitor batch operations in real time, improves the timeliness of batch operation monitoring, and reduces operation and maintenance management costs related to batch operation monitoring alarm.
EXAMPLE III
The monitoring device for batch operations of the banking system provided in this embodiment includes a plurality of implementation units, and each implementation unit corresponds to each implementation step in the first embodiment.
Fig. 3 is a schematic diagram of an alternative monitoring apparatus for batch jobs in a banking system according to an embodiment of the present invention, and as shown in fig. 3, the monitoring apparatus may include: a storage unit 30, a statistics unit 32, a writing unit 34, a sending unit 36, wherein,
the storage unit 30 is used for storing the log data into a preset database after collecting the log data of batch jobs of the bank system;
a counting unit 32, configured to count operation indexes of the batch jobs according to a plurality of preset dimensions based on the log data;
a writing unit 34, configured to write the batch job into the exception statistics table if the index parameter average value of the operation index corresponding to each dimension is smaller than a preset average threshold;
and a sending unit 36, configured to send the batch job indicated by the abnormal statistical table to the target operation and maintenance terminal.
The monitoring device can store log data into a preset database after the log data of batch jobs of a bank system are collected through the storage unit 30, the running indexes of the batch jobs are respectively counted according to a plurality of preset dimensions through the counting unit 32 based on the log data, if the index parameter average value of the running index corresponding to each dimension is smaller than a preset average threshold value through the writing unit 34, the batch jobs are written into the abnormal statistical table, and the batch jobs with abnormal indications are sent to the target operation and maintenance terminal through the sending unit 36. According to the embodiment of the invention, by acquiring the batch job execution logs, storing the batch job execution logs, counting the batch job operation indexes, alarming batch job abnormity and the like, the batch job execution condition can be monitored in real time, the system alarming accuracy and effectiveness are improved, and the technical problem that the batch job cannot be monitored in real time in the related technology is solved.
Optionally, the log data comprises at least one of: start timestamp, end timestamp, error timestamp, job number, job date, job status, area number, product type.
Optionally, the storage unit includes: the log data processing device comprises a first setting module, a second setting module and a third setting module, wherein the first setting module is used for setting the weight value of each batch job based on the attribute information of each batch job in the log data, and the attribute information comprises at least one of the following: the mechanism and the operation type of the device; the first sequencing module is used for sequencing the weighted values of the batch jobs to obtain a sequencing result; the first establishing module is used for establishing a corresponding storage strategy based on the sequencing result; and the first storage module is used for storing each batch job to a preset database respectively through a storage strategy.
Optionally, the monitoring device further includes: the first adjusting module is used for adjusting the preset average threshold value if the occurrence frequency that the index parameter average value of the operation index is smaller than the preset average threshold value within the preset time period is larger than or equal to the preset threshold value after the operation indexes of the batch jobs are respectively counted according to a plurality of preset dimensions based on the log data.
Optionally, the monitoring device further includes: the first writing module is used for writing the to-be-executed operation into the abnormal statistical table if at least one to-be-executed operation in the currently acquired batch operations is detected to be an abnormal operation after the log data of the batch operations of the bank system are acquired.
Optionally, the monitoring device further includes: the system comprises a first receiving module, a second receiving module and a first processing module, wherein the first receiving module is used for receiving a job query request after log data are stored in a preset database; the first display module is used for responding to the job inquiry request and displaying the information data of the batch jobs, wherein the information data at least comprises: execution status data of the batch job, history data of the batch job, and index data of the batch job.
Optionally, the type of the database is a time-series database.
The monitoring device may further include a processor and a memory, and the storage unit 30, the statistic unit 32, the writing unit 34, the sending unit 36, and the like are stored in the memory as program units, and the processor executes the program units stored in the memory to implement corresponding functions.
The processor comprises a kernel, and the kernel calls a corresponding program unit from the memory. The kernel can be set to be one or more than one, and batch jobs with the exception indicated by the exception statistical table are sent to the target operation and maintenance terminal by adjusting kernel parameters.
The memory may include volatile memory in a computer readable medium, Random Access Memory (RAM) and/or nonvolatile memory such as Read Only Memory (ROM) or flash memory (flash RAM), and the memory includes at least one memory chip.
The present application further provides a computer program product adapted to perform a program for initializing the following method steps when executed on a data processing device: after log data of batch jobs of a bank system are collected, the log data are stored in a preset database, operation indexes of the batch jobs are counted according to a plurality of preset dimensions based on the log data, if the index parameter average value of the operation indexes corresponding to each dimension is smaller than a preset average threshold value, the batch jobs are written into an abnormal statistic table, and the batch jobs with abnormal indication by the abnormal statistic table are sent to a target operation and maintenance terminal.
According to another aspect of the embodiments of the present invention, there is also provided an electronic device, including: a processor; and a memory for storing executable instructions for the processor; wherein the processor is configured to execute any one of the above monitoring methods for batch jobs of a banking system via execution of executable instructions.
According to another aspect of the embodiments of the present invention, there is further provided a computer-readable storage medium, where the computer-readable storage medium includes a stored computer program, and when the computer program runs, the apparatus where the computer-readable storage medium is located is controlled to execute any one of the above methods for monitoring batch jobs of a banking system.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
In the above embodiments of the present invention, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed technology can be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units may be a logical division, and in actual implementation, there may be another division, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, units or modules, and may be in an electrical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
The foregoing is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and decorations can be made without departing from the principle of the present invention, and these modifications and decorations should also be regarded as the protection scope of the present invention.
Claims (10)
1. A monitoring method for batch operation of a bank system is characterized by comprising the following steps:
after collecting log data of batch jobs of a bank system, storing the log data to a preset database;
respectively counting the operation indexes of the batch jobs according to a plurality of preset dimensions based on the log data;
if the index parameter average value of the operation index corresponding to each dimension is smaller than a preset average threshold value, writing the batch operation into an abnormal statistical table;
and sending the batch jobs with the abnormal indication of the abnormal statistical table to a target operation and maintenance terminal.
2. The monitoring method of claim 1, wherein the log data includes at least one of: start timestamp, end timestamp, error timestamp, job number, job date, job status, area number, product type.
3. The monitoring method according to claim 1, wherein the step of storing the log data in a preset database comprises:
setting a weight value of each batch job based on attribute information of each batch job in the log data, wherein the attribute information comprises at least one of the following: the mechanism and the operation type of the device;
sorting the weighted values of the batch jobs to obtain a sorting result;
based on the sorting result, making a corresponding storage strategy;
and respectively storing each batch job to a preset database through the storage strategy.
4. The monitoring method according to claim 1, wherein after the running indexes of the batch jobs are respectively counted in a plurality of preset dimensions based on the log data, the monitoring method further comprises:
and if the occurrence frequency that the index parameter average value of the operation index is smaller than the preset average threshold value within the preset time period is larger than or equal to the preset threshold value, adjusting the preset average threshold value.
5. The monitoring method of claim 1, wherein after collecting log data of batch jobs of a banking system, the monitoring method further comprises:
and if at least one to-be-executed operation in the currently acquired batch operations is detected to be an abnormal operation, writing the to-be-executed operation into the abnormal statistical table.
6. The monitoring method according to claim 1, wherein after storing the log data to a preset database, the monitoring method further comprises:
receiving a job query request;
responding to the job inquiry request, and displaying the information data of the batch jobs, wherein the information data at least comprises: the data of the execution state of the batch jobs, the historical data of the batch jobs and the index data of the batch jobs.
7. The monitoring method according to any one of claims 1 to 6, wherein the type of the database is a time series database.
8. A monitoring device for batch operation of a bank system is characterized by comprising:
the storage unit is used for storing the log data of batch jobs of the bank system into a preset database after the log data are collected;
the statistical unit is used for respectively counting the operation indexes of the batch jobs according to a plurality of preset dimensions based on the log data;
the writing unit is used for writing the batch jobs into an abnormal statistical table if the index parameter average value of the operation index corresponding to each dimension is smaller than a preset average threshold value;
and the sending unit is used for sending the batch jobs with the abnormal indication of the abnormal statistical table to the target operation and maintenance terminal.
9. An electronic device, comprising:
a processor; and
a memory for storing executable instructions of the processor;
wherein the processor is configured to execute the method for monitoring a batch job of a banking system according to any one of claims 1 to 7 via execution of the executable instructions.
10. A computer-readable storage medium, comprising a stored computer program, wherein when the computer program runs, the computer-readable storage medium controls a device to execute the method for monitoring the batch job of the banking system according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111139057.6A CN113918413A (en) | 2021-09-27 | 2021-09-27 | Monitoring method and monitoring device for batch operation of bank system and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111139057.6A CN113918413A (en) | 2021-09-27 | 2021-09-27 | Monitoring method and monitoring device for batch operation of bank system and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113918413A true CN113918413A (en) | 2022-01-11 |
Family
ID=79236505
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111139057.6A Pending CN113918413A (en) | 2021-09-27 | 2021-09-27 | Monitoring method and monitoring device for batch operation of bank system and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113918413A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114418429A (en) * | 2022-01-26 | 2022-04-29 | 中国农业银行股份有限公司 | Monitoring method and device for batch operation, mobile terminal and medium |
| CN114626832A (en) * | 2022-04-08 | 2022-06-14 | 中国工商银行股份有限公司 | Business data processing method, apparatus, computer equipment and storage medium |
| CN115098480A (en) * | 2022-06-27 | 2022-09-23 | 中国银行股份有限公司 | A batch operation processing method and device, electronic device, and storage medium |
| CN115964245A (en) * | 2022-10-09 | 2023-04-14 | 中国工商银行股份有限公司 | Interest management method, apparatus, computer device, storage medium and program product |
| CN116342257A (en) * | 2023-03-30 | 2023-06-27 | 中国工商银行股份有限公司 | Monitoring method, device, storage medium and electronic equipment for credit batch operation |
| CN116644045A (en) * | 2023-05-29 | 2023-08-25 | 中国银行股份有限公司 | Batch job task processing method and device, server and storage medium |
-
2021
- 2021-09-27 CN CN202111139057.6A patent/CN113918413A/en active Pending
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114418429A (en) * | 2022-01-26 | 2022-04-29 | 中国农业银行股份有限公司 | Monitoring method and device for batch operation, mobile terminal and medium |
| CN114418429B (en) * | 2022-01-26 | 2025-07-25 | 中国农业银行股份有限公司 | Batch operation monitoring method and device, mobile terminal and medium |
| CN114626832A (en) * | 2022-04-08 | 2022-06-14 | 中国工商银行股份有限公司 | Business data processing method, apparatus, computer equipment and storage medium |
| CN115098480A (en) * | 2022-06-27 | 2022-09-23 | 中国银行股份有限公司 | A batch operation processing method and device, electronic device, and storage medium |
| CN115964245A (en) * | 2022-10-09 | 2023-04-14 | 中国工商银行股份有限公司 | Interest management method, apparatus, computer device, storage medium and program product |
| CN116342257A (en) * | 2023-03-30 | 2023-06-27 | 中国工商银行股份有限公司 | Monitoring method, device, storage medium and electronic equipment for credit batch operation |
| CN116644045A (en) * | 2023-05-29 | 2023-08-25 | 中国银行股份有限公司 | Batch job task processing method and device, server and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113918413A (en) | Monitoring method and monitoring device for batch operation of bank system and electronic equipment | |
| CN112801666B (en) | Monitoring management method, system, medium and equipment based on enterprise service bus | |
| CN114201201B (en) | A method, device and equipment for detecting abnormality in a business system | |
| CN113051147B (en) | A database cluster monitoring method, device, system, and equipment | |
| US20030065759A1 (en) | Event driven storage resource metering | |
| US20100122270A1 (en) | System And Method For Consolidating Events In A Real Time Monitoring System | |
| CN113472881B (en) | Statistical method and device for online terminal equipment | |
| CN105468492A (en) | SE(search engine)-based data monitoring method and system | |
| US7246043B2 (en) | Graphical display and correlation of severity scores of system metrics | |
| CN114116396A (en) | Full link tracking method, system, storage medium and equipment | |
| CN111131290B (en) | Flow data processing method and device | |
| CN112260858A (en) | Alarm method capable of automatic detection and terminal | |
| CN112463834A (en) | Method and device for automatically realizing root cause analysis in streaming processing and electronic equipment | |
| CN110363381B (en) | Information processing method and device | |
| CN116204393A (en) | Wind control management method and device of business system | |
| CN113362210A (en) | Window queuing service evaluation method, system and device | |
| CN110619308A (en) | Aisle sundry detection method, device, system and equipment | |
| CN111625437A (en) | Monitoring method and device of wind control model | |
| CN117539714A (en) | Application index monitoring method and device, computer equipment and computer readable storage medium | |
| CN119597596A (en) | A visual data early warning system and method | |
| CN119493682A (en) | A fault analysis and positioning method and system based on log data | |
| CN113421597A (en) | Monitoring method, monitoring system, electronic equipment and storage medium | |
| CN111738868A (en) | Anti-money laundering and anti-terrorist financing risk monitoring method, device, computer equipment and storage medium | |
| CN111061778B (en) | Data analysis method, system and electronic equipment | |
| CN115237886A (en) | A Redis security audit method, terminal and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |