[go: up one dir, main page]

WO2018149479A1 - Calcul de méta-messagerie distribué - Google Patents

Calcul de méta-messagerie distribué Download PDF

Info

Publication number
WO2018149479A1
WO2018149479A1 PCT/EP2017/053260 EP2017053260W WO2018149479A1 WO 2018149479 A1 WO2018149479 A1 WO 2018149479A1 EP 2017053260 W EP2017053260 W EP 2017053260W WO 2018149479 A1 WO2018149479 A1 WO 2018149479A1
Authority
WO
WIPO (PCT)
Prior art keywords
metadata
messages
message
messaging
service
Prior art date
Application number
PCT/EP2017/053260
Other languages
English (en)
Inventor
Wen GUAN
Original Assignee
Guan Wen
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guan Wen filed Critical Guan Wen
Priority to PCT/EP2017/053260 priority Critical patent/WO2018149479A1/fr
Publication of WO2018149479A1 publication Critical patent/WO2018149479A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/07—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail characterised by the inclusion of specific contents
    • H04L51/08—Annexed information, e.g. attachments
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/02—Details
    • H04L12/16—Arrangements for providing special services to substations
    • H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/1859—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast adapted to provide push services, e.g. data channels
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/07—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail characterised by the inclusion of specific contents
    • H04L51/18—Commands or executable codes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/02—Details
    • H04L12/16—Arrangements for providing special services to substations
    • H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/1895—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for short real-time information, e.g. alarms, notifications, alerts, updates

Definitions

  • search engines and similar services users can find a lot of information about data or services. But in search engines, it is driven by search engines to collect information about data or services. The normal provider who provides data or services is passive. As a result, the service providers have no control when and whether their information will be crawled by search engines. In addition, for services which are more than content-based information, such as operation interface, it's not easy for search engines to crawl. Besides, search engines cannot dig out information about data or services which are security blocked by firewalls. So a lot of private information is still not well organized or indexed in organizations. Even the information or service is open to all over the world, search engines may take some time to crawl it. A common way to get real-time information is not available. At the same time, service providers always want to distribute their information or services to as many people as they can, not only in some central locations such as search engines, amazon and so on.
  • message broker or message bus have been used in many situations, they are only used in separate organized applications or software environment. They are not used to relay messages, especially in an open unorganized network environment with routing loops.
  • BigData' is one of the most important feature of current era.
  • the source of the data can from different organizations, groups or teams. How to obtain and organize BigData is a big issue. These examples different in many respects, but they also have much in common: they need to share or distribute their products or services to others. In fact, they only need to distribute an abstract of their product or service to others, where the abstract information about their product or service is metadata. It's also the main point we will discuss in the following, to distribute metadata to others.
  • a Distributed Messaging Network is adapted to distribute meta messages in the Distributed Meta Messaging Computing architecture.
  • the Distributed Messaging Network consists of one or many connected Messaging Stations which can be deployed by the same or different organizations.
  • a Messaging Station can receive messages by actively consuming, fetching or subscribing messages from other places, or passively accepting messages published by others. It's also open to publish received messages to other Messaging Stations and passively accept subscribes, fetchers or consumers from others.
  • the Messaging Station caches messages just like a news kiosk. An important part is that the Messaging Station discards duplicated messages, which avoids messaging explosion in connected Messaging Stations with routing loops.
  • a Distributed Messaging Network can distribute messages to many Messaging Stations over the network.
  • Topics and channels can be configured in a Messaging Station during deployment, such as private and public, normal and administration, education and commerce, and so on, to apply different connection and filter policies.
  • a Messaging Station can deploy a Messaging Station with a part of topics or channels restricted to be accessed only inside of the institute and a part of topics or channels open to the world.
  • the Distributed Meta Messaging Computing includes a publisher which formats input metadata information to a message and then publishes the message to a Distributed Messaging Network.
  • the publisher can be a script, an API function or a separate independent application, such as smart device applications.
  • the publisher can be a mobile application which can be used by hotels to publish their hotel's metadata information.
  • the Distributed Meta Messaging Computing also includes an agent repository. Users can register to the agent repository and publish metadata to the agent repository. The agent repository can filter and validate these received metadata, and then publish them to the Distributed Messaging Network. Security checks and other policies can be applied on the agent repository, which can protect the Distributed Messaging Network from some invalid messages or attackers. The agent repository can also periodically refresh metadata by fetching information from the data or service that the metadata describes, and then publish refreshed metadata to the Distributed Messaging Network.
  • Users who are not authorized to publish messages to a Distributed Messaging Network can register themselves in an agent repository 130. Users can publish their metadata to the agent repository 130. Then the agent repository can help convert the metadata to messages and publish the messages to a Distributed Messaging Network. Filters such as security filters can be applied in the agent repository 130 to avoid some security issues.
  • a gather can be provided by the Agent Repository.
  • Data or services can provide an interface where metadata can be fetched.
  • a web page can have its metadata in html header; a web service can provide a RESTful interface or a json file where metadata is nested in. Then users can register this interface to the gather in Agent Repository. The gather will automatically fetch metadata from these registered interfaces.
  • a collector cluster with more than one collector 210 can be deployed, where different collectors collect messages from different sources.
  • all of the subscriber 211, the fetcher 212 and receiver 213 can be configured to be enabled or disabled.
  • the scatter 240 is used to distribute messages. It contains a broker 241, a waiter 242 and a publisher 243.
  • the broker 241 can be subscribed by subscription clients.
  • the waiter 242 is a listening service where messages can be fetched.
  • the publisher 243 can actively publish messages.
  • topology processor 230 Inside the topology processor 230, the mathematics of epidemics is applied to build gossip-like dynamic connection list. The purpose is to collect as many messages as it can. Different from basic gossip protocol, the topology processor 230 constructs trees to select the dynamic source nodes to collect messages:
  • the topology processor 230 can also generate filter parameters for different message sources.
  • Level2 cache 303 When a new message comes at block 301, if the message version is not older than the oldest cache timestamp 310, it will be compared within memory cache 302. Otherwise it will be compared within Level2 cache 303. Duplicated messages will be discarded at block 304. The message id and message version of a new message which is not recorded in the cache will be send to cache manager 307.
  • the cache manager 307 will update the cache with new messages 308 and balance the space between memory cache 302 and Level2 cache 303. If memory cache 302 reaches its threshold such as memory limitation, cache manager 307 will move some information from memory cache 302 to Level 2 cache 303. The cache manager 307 will also clean too old information in Level2 cache 303.
  • a hash item can be added to the memory cache 302 and Ievel2 cache 303.
  • the value of the hash item can be a hash number of the message id.
  • the duplication checker 222 can compare the hash values before comparing the message ids. Only message ids with the same hash value will be compared for a new message. It will improve the performance of message id comparing.
  • the metadata validator 531 is designed to validate it. It uses a possibility selector to randomly select some metadata to validate. The validator 531 will use the namespace plugin to validate the metadata (The metadata id or other URLs are used to locate the service which the metadata describes). If a metadata fails to pass the validator 531 (The validator fails to validate a metadata, or the difference between the metadata and the real service is too big), the validator 531 will increase the possibility to validate metadata from the same source or the same IP address, and decrease the rank of the metadata (The rank will be used to order metadata returned from a user query.
  • an edge Messaging Station is provided. It can be a normal Messaging Station 141 with public and private channels/topics, or with filters to block private messages. It can also be a fat Messaging Station described in FIG.6, where metadata is first collected in the SQL/NoSQL database 520. Then a filter can be applied to distribute selected metadata out through scatter 240.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

L'invention concerne une nouvelle architecture de calcul de méta-messagerie distribué permettant de distribuer des métadonnées sous la forme de messages par l'intermédiaire d'un réseau qui comprend des métadonnées et une structure de message, un réseau de messagerie distribué, un référentiel de connaissances et un référentiel d'agents. En outre, l'invention concerne un procédé de diffusion de messages dans un environnement de réseau ouvert indépendant distribué, les stations de messagerie étant reliées en tant que réseau de messagerie ouverte distribuée afin de relayer des messages, le procédé comprenant le formatage d'un message avec un en-tête et un corps avec une interface d'éditeur, la publication de messages à une station de messagerie avec une interface d'éditeur, la collecte de messages avec un auditeur passif, un abonné actif ou un extracteur actif dans une station de messagerie, le relais ou la distribution de messages d'une station de messagerie à d'autres stations de messagerie, à des systèmes de messagerie ou à des applications, la consommation ou la récupération de messages à partir de stations de messagerie avec une interface de consommateur, et l'analyse de messages.
PCT/EP2017/053260 2017-02-14 2017-02-14 Calcul de méta-messagerie distribué WO2018149479A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/EP2017/053260 WO2018149479A1 (fr) 2017-02-14 2017-02-14 Calcul de méta-messagerie distribué

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/EP2017/053260 WO2018149479A1 (fr) 2017-02-14 2017-02-14 Calcul de méta-messagerie distribué

Publications (1)

Publication Number Publication Date
WO2018149479A1 true WO2018149479A1 (fr) 2018-08-23

Family

ID=58191390

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2017/053260 WO2018149479A1 (fr) 2017-02-14 2017-02-14 Calcul de méta-messagerie distribué

Country Status (1)

Country Link
WO (1) WO2018149479A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11507314B2 (en) 2020-06-24 2022-11-22 Samsung Electronics Co., Ltd. Systems and methods for message queue storage
CN115858203A (zh) * 2023-02-09 2023-03-28 中国电子科技集团公司第十研究所 异构功能交互信息翻译系统及方法
CN116455972A (zh) * 2023-06-16 2023-07-18 中国人民解放军国防科技大学 基于消息中心通信的仿真中间件的实现方法及系统

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6263362B1 (en) * 1998-09-01 2001-07-17 Bigfix, Inc. Inspector for computed relevance messaging
US20030158839A1 (en) * 2001-05-04 2003-08-21 Yaroslav Faybishenko System and method for determining relevancy of query responses in a distributed network search mechanism
US7783777B1 (en) * 2003-09-09 2010-08-24 Oracle America, Inc. Peer-to-peer content sharing/distribution networks
US20100299702A1 (en) * 2009-05-19 2010-11-25 Qualcomm Incorporated Delivery of selective content to client applications by mobile broadcast device with content filtering capability
US8977763B1 (en) * 2003-04-25 2015-03-10 Aol Inc. Systems and methods for distributing streams and stream metadata
US20160191296A1 (en) * 2014-12-31 2016-06-30 Vidscale, Inc. Methods and systems for an end-to-end solution to deliver content in a network

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6263362B1 (en) * 1998-09-01 2001-07-17 Bigfix, Inc. Inspector for computed relevance messaging
US20030158839A1 (en) * 2001-05-04 2003-08-21 Yaroslav Faybishenko System and method for determining relevancy of query responses in a distributed network search mechanism
US8977763B1 (en) * 2003-04-25 2015-03-10 Aol Inc. Systems and methods for distributing streams and stream metadata
US7783777B1 (en) * 2003-09-09 2010-08-24 Oracle America, Inc. Peer-to-peer content sharing/distribution networks
US20100299702A1 (en) * 2009-05-19 2010-11-25 Qualcomm Incorporated Delivery of selective content to client applications by mobile broadcast device with content filtering capability
US20160191296A1 (en) * 2014-12-31 2016-06-30 Vidscale, Inc. Methods and systems for an end-to-end solution to deliver content in a network

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11507314B2 (en) 2020-06-24 2022-11-22 Samsung Electronics Co., Ltd. Systems and methods for message queue storage
US12321636B2 (en) 2020-06-24 2025-06-03 Samsung Electronics Co., Ltd. Systems and methods for message queue storage
CN115858203A (zh) * 2023-02-09 2023-03-28 中国电子科技集团公司第十研究所 异构功能交互信息翻译系统及方法
CN115858203B (zh) * 2023-02-09 2023-06-20 中国电子科技集团公司第十研究所 异构功能交互信息翻译系统及方法
CN116455972A (zh) * 2023-06-16 2023-07-18 中国人民解放军国防科技大学 基于消息中心通信的仿真中间件的实现方法及系统
CN116455972B (zh) * 2023-06-16 2023-08-29 中国人民解放军国防科技大学 基于消息中心通信的仿真中间件的实现方法及系统

Similar Documents

Publication Publication Date Title
US20220035686A1 (en) Responding to incidents identified by an information technology and security operations application using a mobile application
US11327992B1 (en) Authenticating a user to access a data intake and query system
US11886455B1 (en) Networked cloud service monitoring
US11620288B2 (en) Dynamically assigning a search head to process a query
US11157497B1 (en) Dynamically assigning a search head and search nodes for a query
US10027564B2 (en) Unobtrusive methods and systems for collecting information transmitted over a network
US11922222B1 (en) Generating a modified component for a data intake and query system using an isolated execution environment image
US11799798B1 (en) Generating infrastructure templates for facilitating the transmission of user data into a data intake and query system
US11573971B1 (en) Search and data analysis collaboration system
US9870428B2 (en) Configuring an origin server content delivery using a pulled data list
JP6463768B2 (ja) Ｍ２ｍデバイスのクローリング
US6950821B2 (en) System and method for resolving distributed network search queries to information providers
US6961723B2 (en) System and method for determining relevancy of query responses in a distributed network search mechanism
US7099871B2 (en) System and method for distributed real-time search
EP2043011B1 (fr) Agrégateur de recherches initiées par un client dirigées vers un serveur
US9384208B2 (en) Configuring a cached website file removal using a pulled data list
US12164889B1 (en) Selecting a custom function from available custom functions to be added into a playbook
US20230161760A1 (en) Applying data-determinant query terms to data records with different formats
CN101046806B (zh) 搜索引擎系统和方法
US20180324064A1 (en) Unobtrusive methods and systems for collecting information transmitted over a network
US11892996B1 (en) Identifying an indexing node to process data using a resource catalog
CN102957571A (zh) 用于网络流量监控的方法和系统
US20110302272A1 (en) Unobtrusive methods and systems for collecting information transmitted over a network
US9055113B2 (en) Method and system for monitoring flows in network traffic
WO2018149479A1 (fr) Calcul de méta-messagerie distribué

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17707775

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17707775

Country of ref document: EP

Kind code of ref document: A1