CN113886471B - Data storage management method, system, storage medium and electronic device - Google Patents
Data storage management method, system, storage medium and electronic device Download PDFInfo
- Publication number
- CN113886471B CN113886471B CN202010664801.3A CN202010664801A CN113886471B CN 113886471 B CN113886471 B CN 113886471B CN 202010664801 A CN202010664801 A CN 202010664801A CN 113886471 B CN113886471 B CN 113886471B
- Authority
- CN
- China
- Prior art keywords
- data storage
- storage management
- configuration information
- path
- managed
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/252—Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/80—Information retrieval; Database structures therefor; File system structures therefor of semi-structured data, e.g. markup language structured data such as SGML, XML or HTML
- G06F16/81—Indexing, e.g. XML tags; Data structures therefor; Storage structures
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
本发明提供一种数据存储管理方法、系统、存储介质和电子设备，其中的方法包括：针对每一类数据存储管理需求，确定与其匹配的数据存储管理接口的配置信息；根据每一类数据存储管理需求所对应的配置信息中的触发条件和跳出条件设置逻辑分析流程；针对实际应用中的待管理路径，根据特定数据存储管理需求选定匹配的逻辑分析流程，并根据特定管理需求对逻辑分析流程中的配置信息进行调整，得到与待管理路径匹配的特定数据存储管理流程；将所有待管理路径所匹配的特定数据存储管理流程进行融合后得到数据存储管理策略集，数据存储管理策略集适用于各类数据存储管理需求。以上方案能够满足不同的数据存储管理需求以及实现多种平台特性的数据存储管理。
The present invention provides a data storage management method, system, storage medium and electronic device, wherein the method includes: for each type of data storage management requirement, determining the configuration information of the data storage management interface matching it; setting a logic analysis process according to the trigger conditions and exit conditions in the configuration information corresponding to each type of data storage management requirement; for the path to be managed in the actual application, selecting a matching logic analysis process according to the specific data storage management requirement, and adjusting the configuration information in the logic analysis process according to the specific management requirement to obtain a specific data storage management process matching the path to be managed; after fusing the specific data storage management processes matching all the paths to be managed, obtaining a data storage management strategy set, and the data storage management strategy set is applicable to various types of data storage management requirements. The above scheme can meet different data storage management requirements and realize data storage management of multiple platform characteristics.
Description
Technical Field
The present invention relates to the field of data storage management, and in particular, to a data storage management method, a data storage management system, a storage medium, and an electronic device.
Background
With the rapid development of economic society, more and more data are involved in learning, working and living of people, and data must be recorded in a certain format on a storage medium inside or outside a computer, so management of data on the storage medium is a precondition for data application.
In a continuously running service system, data can be gradually increased day by day, more and more data are stored in storage equipment (such as a hard disk and a flash memory), operations such as arrangement, removal and the like are required to be carried out on the data of the service system, otherwise, the service system can be overwhelmed. The traditional method may need to manually judge, manually process the data or develop multiple sets of management software to respectively manage different service data in the service system, the operation process is complex and time-consuming, the operation of the service system is seriously affected, and meanwhile, the waste phenomenon of human resources and software resources exists. For example, some service systems often need to perform operations such as manual analysis, judgment, cleaning and the like on the system storage condition, when a condition that manual handling is not performed in time occurs, overload often occurs on the storage system of the service system, external new data input cannot be received, new information data cannot be generated, and the service cannot be normally operated and is seriously affected. Or aiming at the condition that the data is gradually increased day by day, different data storage management software is respectively developed for different businesses, and in the storage management software, some processing steps are the same, so that direct and indirect waste is also caused.
Disclosure of Invention
The embodiment of the invention aims to provide a data storage management method, a data storage management system, a storage medium and electronic equipment, so as to solve the problems of the data storage management method in the prior art.
To this end, an embodiment of the present invention provides a data storage management method, including the following steps: determining configuration information of a data storage management interface matched with each type of data storage management requirement, wherein the configuration information comprises triggering conditions, jumping-out conditions and other related information;
Setting a logic analysis flow according to the trigger condition and the jump-out condition in the configuration information corresponding to each type of data storage management requirement, wherein the logic analysis flow is used for judging whether the data stored in the managed path meet the trigger condition or the jump-out condition in the configuration information and executing the corresponding operation;
Aiming at a path to be managed in actual application, selecting a matched logic analysis flow according to specific data storage management requirements, and adjusting configuration information in the logic analysis flow according to the specific management requirements to obtain a specific data storage management flow matched with the path to be managed;
And fusing the specific data storage management flows matched with all paths to be managed to obtain a data storage management policy set, wherein the data storage management policy set is applicable to various data storage management requirements.
Optionally, in the data storage management method, for each type of data storage management requirement, configuration information of a data storage management interface matched with the data storage management requirement is determined, where the configuration information includes a triggering condition, a jump-out condition and other relevant information in the steps of:
the data storage management requirements comprise data deletion, data backup, data migration, data record inquiry and update;
The triggering conditions include: a storage path waterline trigger condition, a data file lifetime trigger condition, a data file size trigger condition and a custom trigger condition.
Optionally, in the data storage management method, for each type of data storage management requirement, configuration information of a data storage management interface matched with the data storage management requirement is determined, where the configuration information includes a triggering condition, a jump-out condition and other relevant information in the steps of:
the data interface is recorded in an XML format file, and a trigger_policy item in the XML format file is used for representing a Trigger condition; wherein: the high_line and low_line items are used for representing the highest waterline and the lowest waterline of the managed path respectively; the high_life_cycle and low_life_cycle items are used for respectively representing the service life cycle days and the abnormal life cycle days of the data in the managed path; the Del_policy item indicates a policy to delete data, whether by day or by file; the monitor_proc term is used to Monitor whether the managed path runs the associated program.
Optionally, in the data storage management method, for each type of data storage management requirement, configuration information of a data storage management interface matched with the data storage management requirement is determined, and the step of configuring information including a trigger condition, a jump-out condition and other relevant information further includes:
And generating a visual interaction interface according to the XML format file of the matched data storage management interface aiming at each type of data storage management requirement, wherein the visual interaction interface displays configuration information of the data storage management requirement.
Optionally, in the above data storage management method, for a path to be managed in an actual application, a matched logic analysis flow is selected according to a specific data storage management requirement, and configuration information in the logic analysis flow is adjusted according to the specific management requirement, so as to obtain a step of the specific data storage management flow matched with the path to be managed, where:
And adjusting the configuration information in the logic analysis flow on the visual operation interface.
Optionally, the data storage management method further includes the following steps:
And generating a receiving port of the personalized data storage management requirement, wherein the receiving port of the personalized data storage management requirement is used for receiving the newly-increased data storage management requirement and configuration information of a data storage management interface matched with the newly-increased data storage management requirement.
Optionally, in the above data storage management method, for a path to be managed in an actual application, a matched logic analysis flow is selected according to a specific data storage management requirement, and configuration information in the logic analysis flow is adjusted according to the specific management requirement, so as to obtain a specific data storage management flow matched with the path to be managed, and the method further includes:
configuring a data storage management mode of specific data storage management requirements, wherein the data storage management mode comprises a full-automatic data storage management mode and a single data storage management mode; and in the full-automatic data storage management mode, automatically managing the data in the path to be managed in a fixed period.
The embodiment of the invention also provides a data storage management system, which comprises:
the data interface configuration unit is used for determining configuration information of the data storage management interface matched with each type of data storage management requirement, wherein the configuration information comprises triggering conditions, jumping-out conditions and other related information;
The logic analysis unit is used for setting a logic analysis flow according to the trigger condition and the jump-out condition in the configuration information corresponding to each type of data storage management requirement, and the logic analysis flow is used for judging whether the data stored under the managed path meet the trigger condition or the jump-out condition in the configuration information and executing the corresponding operation;
The specific path management setting unit is used for selecting a matched logic analysis flow according to specific data storage management requirements aiming at a path to be managed in actual application, and adjusting configuration information in the logic analysis flow according to the specific management requirements to obtain a specific data storage management flow matched with the path to be managed;
And the management flow fusion unit is used for fusing the specific data storage management flows matched with all paths to be managed to obtain a data storage management policy set, and the data storage management policy set is suitable for various data storage management requirements.
The embodiment of the invention also provides a storage medium, wherein the storage medium stores program instructions, and the computer executes the data storage management method according to any scheme after reading the program instructions.
The embodiment of the invention also provides electronic equipment, which comprises at least one processor and at least one memory, wherein the at least one memory stores program instructions, and the at least one processor executes the data storage management method according to any scheme after reading the program instructions.
Compared with the prior art, the technical scheme provided by the embodiment of the invention has at least the following technical effects: the system can meet different data storage management requirements and realize data storage management with various platform characteristics, has flexible reconfiguration characteristics and an extensible data storage management strategy, further has a uniform interaction interface, and can meet various increasingly-increasing requirements of users on data storage management.
Drawings
FIG. 1 is a flow chart of a method for managing data storage according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of an XML format file of a data interface according to another embodiment of the present invention;
FIG. 3 is a schematic diagram of a logic analysis flow for a certain data storage management requirement;
FIG. 4 is a sequence diagram illustrating an internal implementation of a data storage management method according to an embodiment of the present invention;
FIG. 5 is a block diagram illustrating a data storage management system according to one embodiment of the present invention;
Fig. 6 is a schematic diagram of a hardware connection relationship of an electronic device for performing a data storage management method according to an embodiment of the invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. The components of the embodiments of the present invention generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the invention, as presented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention. All other embodiments, which can be made by a person skilled in the art without making any inventive effort, are intended to be within the scope of the present invention.
In the description of the present invention, it should be noted that the directions or positional relationships indicated by the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc. are based on the directions or positional relationships shown in the drawings, are merely for convenience of description of the present invention, and are not to indicate or imply that the apparatus or component to be referred to must have a specific orientation, be constructed and operated in a specific orientation, and thus should not be construed as limiting the present invention. Furthermore, the terms "first," "second," and "third" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. Wherein the terms "first position" and "second position" are two different positions.
In the description of the present invention, it should be noted that, unless explicitly specified and limited otherwise, the terms "mounted," "connected," and "connected" are to be construed broadly, and may be either fixedly connected, detachably connected, or integrally connected, for example; can be mechanically or electrically connected; can be directly connected or indirectly connected through an intermediate medium, and can be communication between the two components. The specific meaning of the above terms in the present invention will be understood in specific cases by those of ordinary skill in the art.
An embodiment of the present invention provides a data storage management method, which can be used to construct a data storage management system, and is applied to the data storage management system, as shown in fig. 1, and includes the following steps:
S101: for each type of data storage management requirement, determining configuration information of a data storage management interface matched with the data storage management requirement, wherein the configuration information comprises trigger conditions, jump-out conditions and other related information, and the other related information can comprise file types of data, priority of data storage management and the like. Specifically, on the basis of fully researching the data storage management requirements of a plurality of service systems, the existing data storage management requirements are obtained, so that a data storage management interface suitable for various data storage management requirements is obtained and is used as the original input and basis of the data storage management system. The data storage management requirements comprise data deletion, data backup, data migration, data record inquiry and update; the triggering conditions include: a storage path waterline trigger condition, a data file lifetime trigger condition, a data file size trigger condition and a custom trigger condition.
In this scheme, as shown in fig. 2, the data storage management interface records in an XML format file, and the root node of XML is DataLife. The Storage item and the sub-items in the XML format file are used for representing the path information of the managed path; globalSetting items in the XML format file are used for representing configuration information of the managed path; root items in the XML format file represent Root paths of managed paths; trigger_policy items in the XML format file represent Trigger conditions corresponding to different management requirements; the high_line and low_line items are used for representing the highest waterline and the lowest waterline of the managed path respectively; the high_life_cycle and low_life_cycle items are used for respectively representing the service life cycle days and the abnormal life cycle days of the data in the managed path; the Del_policy item indicates a policy to delete data, whether it is to be deleted by day or by file; the monitor_proc item is used for indicating a monitoring program, and monitoring whether the managed path runs the associated program, if a plurality of managed paths exist, the monitor_proc item is used; "separate; the single_manager_soft and manager_soft items indicate whether the unified interface calls a single execution program or an automatic monitoring program, respectively; the start_time and intervals entries indicate the start time and interval time, respectively, at which the hypervisor automatically starts.
DIRSETTING specifies the parameter configuration of the sub-paths under the root path that need to be managed, which can be traversed recursively. When DIRSETTING is a non-leaf node, the related_path item indicates a sub-path under the root path of the path to be managed, which is indispensable; other configuration parameters may be inherited from the GlobalSetting node. When DIRSETTING is a leaf node, the related_path item is also indispensable, and object_type indicates whether the type of the management object is a file or a folder; object_filter indicates part of the filtering information of the management object, and when it is, indicates that it is for all files or folders; priority indicates priority when operations such as deletion and backup are performed; the high_life_cycle and the low_life_cycle can be inherited from the previous node and can be described again.
S102: and setting a logic analysis flow according to the trigger condition and the jump-out condition in the configuration information corresponding to each type of data storage management requirement, wherein the logic analysis flow is used for judging whether the data stored in the managed path meet the trigger condition or the jump-out condition in the configuration information and executing the corresponding operation.
In this step, the logic analysis flow may be set according to the trigger condition, the jump-out condition and other relevant configuration information configured by the designated data storage management interface. A logic analysis flow of portable data storage management for specific data storage management requirements inputs configuration information and actual state information specified for a designed data storage management interface. The logic analysis flow mainly reflects various logic judgment and analysis aiming at the data storage management requirement, and various modules for realizing the judgment and analysis are expandable. When the analysis result of the data stored under the managed path meets the triggering condition specified by the data interface, the specified operation corresponding to the data storage management requirement is immediately invoked. Of course, the designer can also develop the special judgment analysis module and operation module by himself, and can also add the self-developed judgment analysis module and operation module into the existing data interface and logic analysis flow to realize the expandable function of data storage management for different users of the whole platform. In this step, an extensible and portable python language is used to develop a corresponding logic analysis flow for specific data storage management requirements. Specifically, the flow shown with reference to fig. 3 and 4 may include the following flows:
step 1): and inputting a data storage management interface file in an XML format, and analyzing the XML file.
Step 2): and (3) carrying out logic judgment and analysis on the root path in the management requirement, judging whether the trigger condition is met, if so, entering the step (3), otherwise, directly ending the logic analysis flow.
Step 3): traversing the sub-paths and obtaining configuration information and state information corresponding to a certain sub-path.
Step 4): and analyzing a certain sub-path under the root path according to the management requirement, starting logic judgment and analysis when the logic analysis flow identifies the triggering condition in the data storage management interface file, and determining what operation is executed according to the judgment analysis result.
Step 5): after the operation is finished, logic judgment is carried out to judge whether the jump-out condition is met.
Step 6): and (5) terminating the loop judgment, and ending the data storage management process.
S103: and selecting a matched logic analysis flow according to specific data storage management requirements aiming at a path to be managed, and optimally adjusting configuration information in the logic analysis flow according to the specific management requirements to obtain the specific data storage management flow matched with the path to be managed.
In this step, according to different data storage management requirements of a specific management path, the trigger condition or the jump-out condition and other configuration information parameters in the logic analysis flow are optimized and adjusted. For example, a user can manage a path to be managed according to a disk waterline, can manage the path according to a single path size limit, can manage the path according to the life cycle of different data under the path, and the like. The user only needs to combine the self-management path requirement, select the corresponding logic analysis flow and optimize and adjust the parameters, and the configuration information is automatically stored in the XML file. For the same management path, users can perform optimization adjustment of logic analysis flow and configuration parameters at any time according to own needs.
S104: and fusing the specific data storage management flows matched with all paths to be managed to obtain a data storage management policy set, wherein the data storage management policy set is applicable to various data storage management requirements.
According to the data storage management method provided by the scheme, a designer can expand a new data storage management function only by configuring parameters of a designed logic analysis flow according to specific data storage management requirements. The general function can provide a data storage management strategy which is suitable for all data storage management requirements without developing a plurality of sets of data storage management systems, and the data storage management method can monitor or process management targets of different platforms.
Further, in the above scheme, before step S103, the method further includes the following steps: and generating a visual interaction interface according to the XML format file of the matched data storage management interface aiming at each type of data storage management requirement, wherein the visual interaction interface displays configuration information of the data storage management requirement. In step S103, the configuration information in the logic analysis flow may be optimally adjusted on the visual operation interface. Specifically, it may include:
(1) The information to be configured is input into the text box of the unified interactive interface, and the configured parameters are determined according to the specific management path and the corresponding storage management requirement, and the existing configuration information can be adjusted and optimized.
(2) After clicking and storing, the system can automatically judge the validity of the input parameters, and automatically store the change content in the configuration file in the corresponding XML format after determining that the change content is correct. In the scheme, a user develops a unified cross-platform self-adaptive interactive interface according to a data storage management interface file by combining Java language and cross-platform apache technology, and various configuration parameter information of a data interface in an XML format is displayed. The user may also select information of interest or view all information of a certain management path of interest according to the filtering condition. When the root node information of the XML interface file changes, the interactive interface can also be self-adaptively updated and displayed. In addition, the user also needs to develop a unified extensible framework, which comprises basic operations and functions required by different management policy programs, such as analysis of XML files, deletion, backup and migration of data, inquiry and update of databases, and the like. Through the scheme, a user does not need to develop a plurality of manual interaction interfaces, the unified interaction interface can display information of the XML management interface file in real time, and the user only needs to perform optimization confirmation on parameters on the manual interaction interface. The system has the functions of supporting various configuration parameter inquiry, adding, modifying, storing and deleting, triggering and stopping the starting of the logic analysis flow, checking the running state of the logic analysis flow and the like. In this step, the user may also develop a unified extensible framework containing the basic operations and functions required for different data storage management methods, including: XML files can be read, unified configuration parameter information of different data storage management methods is fed back, and the fed back information is stored in a data dictionary form; operations such as deletion, backup, migration and the like can be performed on files, folders and the like in the management path; when the data in the management path is operated, if the database information needs to be synchronously updated, corresponding data query and updating operations and the like are needed to be carried out; a unified log generator for all module calls in the management process is compiled, so that a user is ensured to quickly identify and better use key information in the log; the extensible framework also supports adding other new basic functions into the framework at any time for all users to call, thereby greatly saving various cost overheads.
Further, the method may further include the steps of:
And S105, generating a personalized data storage management demand receiving port, wherein the personalized data storage management demand receiving port is used for receiving newly-increased data storage management demands and configuration information of a data interface matched with the newly-increased data storage management demands.
With increasing demands of users for data storage management, there may be an additional data storage management demand, so in this step, by providing a personalized data storage management demand receiving port, the additional data storage management demand input by the user through the port and configuration information of a data interface matched with the additional data storage management demand can be received at any time, so that a logic analysis flow corresponding to the additional data storage management demand can be generated subsequently.
Preferably, the above method may further comprise the steps of:
S106: configuring a data storage management mode of specific data storage management requirements, wherein the data storage management mode comprises a full-automatic data storage management mode and a single data storage management mode; the full-automatic data storage management mode is used for automatically managing the data in the path to be managed in a fixed period.
Under normal conditions, after each item of configuration parameter information in a logic analysis flow is defined, all management paths with different platforms and different data storage management requirements can be selected to be used as paths to be managed for monitoring, and the logic analysis flow adopting the method can automatically trigger the data storage management method to monitor and operate all the management paths at regular time or within a specified interval time according to the configuration information; in the emergency situation, the user can select to execute the monitoring and processing operation once after specifying various configuration parameter information on the unified interactive interface, and the data storage management method can immediately execute the monitoring and processing operation once so as to meet the emergency requirement under the specific situation. All the monitoring and processing operation processes can write the judgment and analysis results and the operation of the key nodes into corresponding logs, so that the traceability purpose is achieved. Specifically:
the user only needs to select on the interface whether to use full automatic monitoring and processing in general or one monitoring and processing in emergency for different management paths. When multiple management paths need to be monitored and processed at the same time, a multi-process mode is adopted, and the management paths do not affect each other.
(1) The management flow in the normal case is as follows:
1) After the parameter configuration is performed, the user clicks an automatic monitoring and processing button on the unified interactive interface.
2) And analyzing the corresponding xml configuration parameter information of the management path.
3) Generating a monitoring queue according to the analyzed xml configuration parameter information, and triggering a timing device;
4) The timing device starts the management policy program at a specified time or within a specified interval to determine whether the trigger condition is satisfied, and starts recursively traversing all sub-paths when the trigger condition is satisfied, thereby completing the rest of the operations associated with step S102. When the condition is not met, the program jumps out, gives out prompt information of the condition not met, and records the prompt information into the log file.
(2) The flow of the function executed once by the storage management is as follows:
1) After each item of configuration is performed, the user clicks a button for executing immediately on the interface;
2) And analyzing the corresponding xml configuration parameter information of the management path.
3) And (3) according to the analyzed xml configuration parameter information, automatically calling a corresponding management strategy module, judging whether a triggering condition is met, starting recursively traversing all sub-paths when the triggering condition is met, completing the rest operation related to the step S102, and when the condition is not met, jumping out the program, giving prompt information which does not meet the condition, and recording the prompt information in a log file.
Therefore, the data storage management method provided by the embodiment of the invention is organically combined by a series of subtasks (different logic analysis paths, a general function implementation method, a unified interaction interface and the like).
According to the scheme in the embodiment of the invention, in order to meet the data storage management requirements of different business systems and realize the requirement that the data storage management system can be quickly expanded and constructed, the data interface file of the data storage management system is designed, and a workflow mechanism is introduced to maximize the flexibility and expandability of the data storage management flow of the system. The processing flow of data storage management is described by an XML format file, and is dynamically loaded when a task is run, so that the hot plug of the data storage management method program can be realized in the data storage management flow. Meanwhile, the same management strategy can be used for different management paths without mutual influence. The scheme of the embodiment also provides a unified cross-platform manual interaction interface, a user only needs to modify configuration parameters according to the designated interface file, and development of all functional modules, manual interaction interfaces and the like in the whole process is not needed, so that development time and difficulty are greatly saved. And the extended logic analysis flow does not need to modify any configuration parameter and any functional module in the execution process of other logic analysis flows, so that the stability and the reliability of the whole system are greatly improved.
Some embodiments of the present invention also provide a data storage management system, as shown in fig. 5, which may include:
A data interface configuration unit 101, configured to determine, for each type of data storage management requirement, configuration information of a data storage management interface matched with the data storage management requirement, where the configuration information includes a trigger condition, a jump-out condition, and other relevant information; the logic analysis unit 102 is configured to set a logic analysis flow according to a trigger condition and a jump-out condition in the configuration information corresponding to each type of data storage management requirement, where the logic analysis flow is configured to determine whether the data stored under the managed path meets the trigger condition or the jump-out condition in the configuration information and what corresponding operation is executed; a specific path management setting unit 103, configured to select a matched logic analysis flow according to a specific data storage management requirement for a path to be managed in an actual application, and adjust configuration information in the logic analysis flow according to the specific management requirement, so as to obtain a specific data storage management flow matched with the path to be managed; the management flow fusion unit 104 is configured to fuse specific data storage management flows matched by all paths to be managed to obtain a data storage management policy set, where the data storage management policy set is applicable to various data storage management requirements. The scheme is used for solving the problems that the management strategy in the current data storage management system is not easy to expand, cross-platform management is not possible, and the configuration parameters of the management strategy cannot be modified through a unified man-machine interaction interface.
Some embodiments of the present invention provide a storage medium, which may be a computer usable storage medium (including, but not limited to, a disk memory, a CD-ROM, an optical storage, etc.), where program instructions are stored in the storage medium, and after the program instructions are read by a computer, the computer performs a data storage management method according to any one of the above technical solutions.
Fig. 6 is a schematic hardware structure of an electronic device for executing a data storage management method according to the present embodiment, where the device includes: one or more processors 201, and a memory 202, one processor 201 being illustrated in fig. 6. The apparatus for performing the charge information processing method may further include: an input device 203 and an output device 204. The processor 201, memory 202, input devices 203, and output devices 204 may be connected by a bus or other means, for example in fig. 6. The memory 202 is used as a non-volatile computer-readable storage medium for storing non-volatile software programs, non-volatile computer-executable programs, and modules. The processor 201 executes various functional applications of the server and data processing, that is, implements the data storage management method of the above-described method embodiment, by running nonvolatile software programs, instructions, and modules stored in the memory 202.
The above embodiments are only for illustrating the technical solution of the present invention, and are not limiting; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims (6)
1. A data storage management method, comprising the steps of:
Determining configuration information of a data storage management interface matched with each type of data storage management requirement, wherein the configuration information comprises a triggering condition, a jump-out condition, a file type of data and a priority of data storage management;
Setting a logic analysis flow according to the trigger condition and the jump-out condition in the configuration information corresponding to each type of data storage management requirement, wherein the logic analysis flow is used for judging whether the data stored in the managed path meet the trigger condition or the jump-out condition in the configuration information and executing the corresponding operation;
Aiming at a path to be managed in actual application, selecting a matched logic analysis flow according to specific data storage management requirements, and adjusting configuration information in the logic analysis flow according to the specific data storage management requirements to obtain a specific data storage management flow matched with the path to be managed;
fusing the specific data storage management flows matched with all paths to be managed to obtain a data storage management policy set, wherein the data storage management policy set is applicable to various data storage management requirements;
Determining configuration information of a data storage management interface matched with each type of data storage management requirement according to each type of data storage management requirement, wherein the configuration information comprises triggering conditions, jumping-out conditions and other relevant information in the steps of:
The data storage management requirements comprise data deletion, data backup, data migration, data record inquiry and update; the triggering conditions include: storing path waterline triggering conditions, data file life triggering conditions, data file size triggering conditions and custom triggering conditions;
Determining configuration information of a data storage management interface matched with each type of data storage management requirement according to each type of data storage management requirement, wherein the configuration information comprises triggering conditions, jumping-out conditions, file types of data and priorities of data storage management:
The data storage management interface records in an XML format file, and a trigger_policy item in the XML format file is used for representing a Trigger condition; wherein: the high_line and low_line items are used for representing the highest waterline and the lowest waterline of the managed path respectively; the high_life_cycle and low_life_cycle items are used for respectively representing the service life cycle days and the abnormal life cycle days of the data in the managed path; the Del_policy item indicates a policy to delete data, whether it is to be deleted by day or by file; the monitor_proc item is used for monitoring whether the managed path runs the associated program;
The method further comprises the steps of:
Generating a receiving port of a personalized data storage management requirement, wherein the personalized data storage management requirement receiving port is used for receiving newly-increased data storage management requirement and configuration information of a data storage management interface matched with the newly-increased data storage management requirement;
The step of selecting a matched logic analysis flow according to a specific data storage management requirement aiming at a path to be managed in actual application, and adjusting configuration information in the logic analysis flow according to the specific data storage management requirement to obtain the specific data storage management flow matched with the path to be managed further comprises the steps of: configuring a data storage management mode of specific data storage management requirements, wherein the data storage management mode comprises a full-automatic data storage management mode and a single data storage management mode; and in the full-automatic data storage management mode, automatically managing the data in the path to be managed in a fixed period.
2. The data storage management method according to claim 1, wherein the step of determining, for each type of data storage management requirement, configuration information of the data storage management interface matched with the data storage management requirement, wherein the configuration information includes a trigger condition, a jump-out condition, a file type of the data, and a priority of the data storage management, further includes:
And generating a visual interaction interface according to the XML format file of the matched data storage management interface aiming at each type of data storage management requirement, wherein the visual interaction interface displays configuration information of the data storage management requirement.
3. The data storage management method according to claim 2, wherein, for a path to be managed in an actual application, a matched logic analysis flow is selected according to a specific data storage management requirement, and configuration information in the logic analysis flow is adjusted according to the specific data storage management requirement, so as to obtain a specific data storage management flow matched with the path to be managed, wherein the step of:
And adjusting the configuration information in the logic analysis flow on the visual operation interface.
4. A data storage management system for implementing the data storage management method of claim 1, comprising:
The data interface configuration unit is used for determining configuration information of a data storage management interface matched with each type of data storage management requirement, wherein the configuration information comprises a triggering condition, a jump-out condition, a file type of data and a priority of data storage management;
The logic analysis unit is used for setting a logic analysis flow according to the trigger condition and the jump-out condition in the configuration information corresponding to each type of data storage management requirement, and the logic analysis flow is used for judging whether the data stored under the managed path meet the trigger condition or the jump-out condition in the configuration information and executing the corresponding operation;
The specific path management setting unit is used for selecting a matched logic analysis flow according to specific data storage management requirements aiming at a path to be managed in actual application, and adjusting configuration information in the logic analysis flow according to the specific data storage management requirements to obtain a specific data storage management flow matched with the path to be managed;
And the management flow fusion unit is used for fusing the specific data storage management flows matched with all paths to be managed to obtain a data storage management policy set, and the data storage management policy set is suitable for various data storage management requirements.
5. A storage medium, characterized by:
the storage medium has stored therein program instructions, and a computer executes the data storage management method according to any one of claims 1 to 3 after reading the program instructions.
6. An electronic device comprising at least one processor and at least one memory, the at least one memory having program instructions stored therein, the at least one processor executing the data storage management method of any of claims 1-3 after reading the program instructions.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010664801.3A CN113886471B (en) | 2020-07-10 | 2020-07-10 | Data storage management method, system, storage medium and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010664801.3A CN113886471B (en) | 2020-07-10 | 2020-07-10 | Data storage management method, system, storage medium and electronic device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113886471A CN113886471A (en) | 2022-01-04 |
| CN113886471B true CN113886471B (en) | 2024-11-26 |
Family
ID=79012864
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010664801.3A Active CN113886471B (en) | 2020-07-10 | 2020-07-10 | Data storage management method, system, storage medium and electronic device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113886471B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103631931A (en) * | 2013-12-06 | 2014-03-12 | 浪潮(北京)电子信息产业有限公司 | Method and system for hierarchically storing data |
| CN104283960A (en) * | 2014-10-15 | 2015-01-14 | 福建亿榕信息技术有限公司 | System for achieving heterogeneous network storage virtualization integration and hierarchical management |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7269612B2 (en) * | 2002-05-31 | 2007-09-11 | International Business Machines Corporation | Method, system, and program for a policy based storage manager |
| CN110825716A (en) * | 2019-06-04 | 2020-02-21 | 中国人民解放军92493部队参谋部 | Data life cycle management system, method and medium |
| CN111124288B (en) * | 2019-12-06 | 2022-08-12 | 苏州浪潮智能科技有限公司 | A VPD storage management method, apparatus, device and readable storage medium |
-
2020
- 2020-07-10 CN CN202010664801.3A patent/CN113886471B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103631931A (en) * | 2013-12-06 | 2014-03-12 | 浪潮(北京)电子信息产业有限公司 | Method and system for hierarchically storing data |
| CN104283960A (en) * | 2014-10-15 | 2015-01-14 | 福建亿榕信息技术有限公司 | System for achieving heterogeneous network storage virtualization integration and hierarchical management |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113886471A (en) | 2022-01-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US12153512B2 (en) | System and method for automated intelligent mobile application testing | |
| US10565095B2 (en) | Hybrid testing automation engine | |
| US10430324B2 (en) | System and method for automated intelligent mobile application testing | |
| US20200034281A1 (en) | System and method for automated intelligent mobile application testing | |
| US8341590B1 (en) | System for relating workflow status to code component status in a software project | |
| CN111125444A (en) | Big data task scheduling management method, device, device and storage medium | |
| US20100083211A1 (en) | Integration of external software analysis processes with software configuration management applications | |
| CN109614157A (en) | A kind of configuration method of system, device and storage medium | |
| US9128724B2 (en) | Configuring assembly of a system using supplied architectural artifacts | |
| CN110427258B (en) | Resource scheduling control method and device based on cloud platform | |
| CN105915657A (en) | Data synchronization method and device, and client | |
| US10901984B2 (en) | Enhanced batch updates on records and related records system and method | |
| US10956407B2 (en) | Automatic detection of problems in a large-scale multi-record update system and method | |
| US7484203B2 (en) | Automated interaction diagram generation using source code breakpoints | |
| JP6336919B2 (en) | Source code review method and system | |
| CN114185583A (en) | Generation and processing method and device of approval process | |
| CN113886471B (en) | Data storage management method, system, storage medium and electronic device | |
| US12093686B2 (en) | Code maintenance system | |
| CN110908644A (en) | Configuration method and device of state node, computer equipment and storage medium | |
| CN109359093A (en) | A method and system for updating a rule file | |
| US12093587B1 (en) | System, method, and computer program for unified management of multiple master-agent job execution environments | |
| US12099973B2 (en) | Computer system and method to efficiently extend a workflow in software | |
| US20250130988A1 (en) | Management of hierarchical product parameters | |
| Fördős et al. | CRDTs for the configuration of distributed Erlang systems | |
| CN116560977A (en) | Version regression plan use case management method, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |