CN115380282A - Log data processing method and related products - Google Patents
Log data processing method and related products Download PDFInfo
- Publication number
- CN115380282A CN115380282A CN202080099562.XA CN202080099562A CN115380282A CN 115380282 A CN115380282 A CN 115380282A CN 202080099562 A CN202080099562 A CN 202080099562A CN 115380282 A CN115380282 A CN 115380282A
- Authority
- CN
- China
- Prior art keywords
- log
- log data
- target
- search
- search engine
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
一种日志数据处理方法及相关产品,应用于日志服务系统,所述日志服务系统包括日志搜索引擎和日志仓库服务,该方法包括:所述日志搜索引擎按照预设时序从所述日志仓库服务获取目标日志数据(101);所述日志搜索引擎通过预设日志搜索算法对所述目标日志数据进行关键字搜索和匹配,得到目标搜索结果(102);所述日志搜索引擎输出所述目标搜索结果(103)。采用上述方法,能够节省内存资源。
A log data processing method and related products, applied to a log service system, the log service system includes a log search engine and a log warehouse service, the method includes: the log search engine obtains from the log warehouse service according to a preset time sequence Target log data (101); said log search engine carries out keyword search and matching to said target log data by preset log search algorithm, obtains target search result (102); said log search engine outputs said target search result (103). By adopting the above method, memory resources can be saved.
Description
PCT国内申请,说明书已公开。PCT domestic application, specification has been published.
Claims (20)
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2020/091319 WO2021232292A1 (en) | 2020-05-20 | 2020-05-20 | Log data processing method and related product |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115380282A true CN115380282A (en) | 2022-11-22 |
Family
ID=78709078
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202080099562.XA Pending CN115380282A (en) | 2020-05-20 | 2020-05-20 | Log data processing method and related products |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN115380282A (en) |
| WO (1) | WO2021232292A1 (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114185971A (en) * | 2021-12-13 | 2022-03-15 | 平安壹账通云科技(深圳)有限公司 | Multi-node log analysis and processing method and system |
| CN114237645A (en) * | 2021-12-17 | 2022-03-25 | 深圳壹账通智能科技有限公司 | Deployment method, device, terminal and storage medium of application system |
| CN114297189B (en) * | 2022-01-10 | 2024-05-10 | 成都国铁电气设备有限公司 | Subway track geometry detection data cleaning method based on Flink stream processing |
| CN114661662A (en) * | 2022-03-03 | 2022-06-24 | 中银金融科技有限公司 | Log query method and device |
| CN114661777A (en) * | 2022-04-08 | 2022-06-24 | 深圳市捷顺科技实业股份有限公司 | Method, device and medium for extracting log records |
| CN115378803B (en) * | 2022-04-13 | 2023-12-12 | 网易(杭州)网络有限公司 | Log management method, device, blockchain node and storage medium |
| CN114860932A (en) * | 2022-04-24 | 2022-08-05 | 福建财通信息科技有限公司 | Log information acquisition and monitoring method |
| CN116156261A (en) * | 2023-01-18 | 2023-05-23 | 易视腾科技股份有限公司 | Method for processing terminal play log in real time based on Flink architecture |
| CN116566873A (en) * | 2023-05-18 | 2023-08-08 | 浪潮思科网络科技有限公司 | An ELK-based automated log analysis method, system, and storage medium |
| CN116678162B (en) * | 2023-08-02 | 2023-09-26 | 八爪鱼人工智能科技(常熟)有限公司 | Cold storage operation information management method, system and storage medium based on artificial intelligence |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101641674A (en) * | 2006-10-05 | 2010-02-03 | 斯普兰克公司 | Time series search engine |
| CN103309882A (en) * | 2012-03-13 | 2013-09-18 | 北京启明星辰信息技术股份有限公司 | Method and system for matching character strings under multiple modes |
| CN105630908A (en) * | 2015-12-21 | 2016-06-01 | 北京奇虎科技有限公司 | Method and device for displaying search results |
| WO2019140828A1 (en) * | 2018-01-17 | 2019-07-25 | 平安科技(深圳)有限公司 | Electronic apparatus, method for querying logs in distributed system, and storage medium |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103914485B (en) * | 2013-01-07 | 2017-05-03 | 上海宝信软件股份有限公司 | System and method for remotely collecting, retrieving and displaying application system logs |
| US10235417B1 (en) * | 2015-09-02 | 2019-03-19 | Amazon Technologies, Inc. | Partitioned search of log events |
| CN108572971B (en) * | 2017-03-09 | 2022-11-01 | 百度在线网络技术(北京)有限公司 | Method and device for mining keywords related to search terms |
| CN107332685A (en) * | 2017-05-22 | 2017-11-07 | 国网安徽省电力公司信息通信分公司 | A kind of method based on big data O&M daily record applied in state's net cloud |
-
2020
- 2020-05-20 WO PCT/CN2020/091319 patent/WO2021232292A1/en not_active Ceased
- 2020-05-20 CN CN202080099562.XA patent/CN115380282A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101641674A (en) * | 2006-10-05 | 2010-02-03 | 斯普兰克公司 | Time series search engine |
| CN103309882A (en) * | 2012-03-13 | 2013-09-18 | 北京启明星辰信息技术股份有限公司 | Method and system for matching character strings under multiple modes |
| CN105630908A (en) * | 2015-12-21 | 2016-06-01 | 北京奇虎科技有限公司 | Method and device for displaying search results |
| WO2019140828A1 (en) * | 2018-01-17 | 2019-07-25 | 平安科技(深圳)有限公司 | Electronic apparatus, method for querying logs in distributed system, and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2021232292A1 (en) | 2021-11-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN115380282A (en) | Log data processing method and related products | |
| CN109478144A (en) | Data processing device and method | |
| CN115244586A (en) | Microwave identification method and system | |
| CN112639828A (en) | Data processing method, method and equipment for training neural network model | |
| CN114930401A (en) | Point cloud-based three-dimensional reconstruction method and device and computer equipment | |
| CN109729734A (en) | Chip apparatus and Related product | |
| CN111713117A (en) | A method and device for processing service data in an optical transport network | |
| CN111886593A (en) | Data processing system and data processing method | |
| CN110121704A (en) | Execution method, device and system for stored procedure | |
| CN111567121A (en) | A resource selection method and device, and computer storage medium | |
| CN110520844A (en) | Cloud management platform, virtual machine management method and system thereof | |
| CN109923901A (en) | Method and terminal device for searching network | |
| CN111373804A (en) | Data processing method and device | |
| CN109952565A (en) | Internal storage access technology | |
| CN109416800A (en) | A kind of authentication method and mobile terminal of mobile terminal | |
| CN110786028A (en) | Application resource processing method and related products | |
| CN116034361A (en) | Cross-domain authorization processing method and cross-domain calling processing method | |
| CN110115075A (en) | The method and apparatus of Transmission system information | |
| CN111684462A (en) | A kind of image matching method and vision system | |
| CN110709824A (en) | A data query method and device | |
| CN111512293A (en) | Data processing method based on DMA and related product | |
| CN115989478A (en) | A data computing method and device | |
| Chen et al. | CS-BWAMEM: A fast and scalable read aligner at the cloud scale for whole genome sequencing | |
| CN111542837A (en) | Three-dimensional convolution neural network computing device and related product | |
| CN104239795A (en) | File scanning method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |