[go: up one dir, main page]

WO1999067925A1 - Stockage de contenu et suppression de la redondance - Google Patents

Stockage de contenu et suppression de la redondance Download PDF

Info

Publication number
WO1999067925A1
WO1999067925A1 PCT/IL1999/000345 IL9900345W WO9967925A1 WO 1999067925 A1 WO1999067925 A1 WO 1999067925A1 IL 9900345 W IL9900345 W IL 9900345W WO 9967925 A1 WO9967925 A1 WO 9967925A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
packet
network
destination
maintained
Prior art date
Application number
PCT/IL1999/000345
Other languages
English (en)
Inventor
Marco Talmon
Ziv Haparnas
Original Assignee
Infit Communications Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Infit Communications Ltd. filed Critical Infit Communications Ltd.
Priority to AU43890/99A priority Critical patent/AU4389099A/en
Publication of WO1999067925A1 publication Critical patent/WO1999067925A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/16—Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/16—Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
    • H04L69/163—In-band adaptation of TCP data exchange; In-band control procedures
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/22—Parsing or analysis of headers

Definitions

  • the present invention relates to packet-based networks in general, and in particular to apparatus and methods for reducing data traffic associated with the transmission of packets in such networks.
  • BACKGROUND OF THE INVENTION In computer networks having a client-server architecture, data files are often sent multiple times from a server to the same destination or the same subnet in response to multiple requests. For example, on the Internet a server may transmit the same Graphics Interchange Format (GIF) file over and over again to different users at a single Internet Service Provider (ISP).
  • GIF Graphics Interchange Format
  • ISP Internet Service Provider
  • packet-switched networks such as the Internet, a data file is segmented prior to transmission into one or more "packets" that are transmitted in a "data stream" to the destination where they are then reassembled into the original data file. In order to facilitate the transmission of the packets over the network, they are "wrapped" by one or more protocols.
  • the Internet server in the previous example may use the HyperText Transfer Protocol (HTTP) in order to transmit the GIF file.
  • HTTP HyperText Transfer Protocol
  • the HTTP protocol adds a header that provides additional information about the GIF file (such as size, time and type of server etc.), and may also concatenate several files together (according to the HTTP/1.1 protocol).
  • TCP Transmission Control Protocol
  • IP Internet Protocol
  • the present invention seeks to provide apparatus and methods for reducing data traffic associated with the transmission of packets in a packet-based network, such as between two routers in the network.
  • a method for reducing data traffic associated with the transmission of packets in a packet-based network including a) maintaining data transmitted in a data stream at a network source and a network destination, the network source is in communication with the network destination via a network path, b) subsequently receiving a packet associated with the data stream at the network source, c) extracting the packet's data, d) comparing the data extracted in step c) with the data maintained in step a), and e) where the data extracted in step c) at least partially matches the data maintained in step a) f) sending a system packet to the network destination identifying the data extracted in step c) with the data maintained at the network destination, and g) recreating the packet at the network destination from the data maintained at the destination.
  • system packet includes a checksum of the data stream.
  • Fig. 1 is a simplified block diagram of a system for reducing data traffic associated with the transmission of packets in a network, the system constructed and operative in accordance with a preferred embodiment of the present invention;
  • Fig. 2 is a simplified flowchart illustration of a method of operation of the system of Fig. 1 in accordance with a preferred embodiment of the present invention.
  • Fig. 1 is a simplified block diagram of a system for reducing data traffic associated with the transmission of packets in a network, the system constructed and operative in accordance with a preferred embodiment of the present invention
  • Fig. 2 is a simplified flowchart illustration of a method of operation of the system of Fig. 1 in accordance with a preferred embodiment of the present invention.
  • a stream of packets is transmitted via a network path 8 from a server 10 to a client 12.
  • Client 12 may be any recipient of the data stream sent by server 10, such as an end-user computer or an ISP server.
  • Server 10 is connected to network path 8 via a router 14 and a source device 16.
  • Client 12 is connected to network path 8 via a router 20 and a destination device 18.
  • Source device 16 preferably receives each packet sent by server 10 for transmission via network path 8 (block 102), extracts the data contained in the packet, and notes the data stream or streams to which the packet belongs (blocks 104 and 106). Next, the data from each packet is then checked to determine whether some of it, or all of it, was already sent over the network path 8 to destination device 18 (block 108) which preferably stores data sent to it (block 110).
  • One method of determining whether data received at source device 16 from server 10 already exists at destination device 18 is by maintaining in both source device 16 and destination device 18 a copy of all data sent in all data streams or specific data streams, such as those containing GIF data, that previously traversed network path 8 (blocks 110 and 118). Thus if data in a data stream is present in source device 16, it is also present in destination device 18, assuming that a reliable connection exists between source device 16 and destination device 18. If a reliable connection does not exist destination device 18 may inform source device 16 that destination device 18 is missing certain data and request a retransmission of the original data.
  • source device 16 communicates to destination device 18 that the data is already available at destination device 18 (block 130).
  • destination device 18 retrieves the data from memory (block 132), regenerates the packet (block 134), and sends the regenerated packet to client 12 via router 20 (block 120).
  • Data not found at destination device 18 is sent by source device 16 via network path 8 (block 112).
  • the data may be sent using any conventional technique, compressed or "as is,” provided that the destination device 18 can recreate the original data packet.
  • data streams may be transmitted in the context of one or more network sessions.
  • a session might be composed of all packets related to a certain TCP connection.
  • a network session may also be defined as all the IP packets sent from one IP address to another IP address that share an additional element such as a certain identifier.
  • a session may also include one or more data streams.
  • source and destination devices 16 and 18 are installed at each end of an IP hop.
  • devices 16 and 18 may be installed between the routers at each end of the IP hop. The device at the sending end of the hop, i.e. source device 16.
  • the system packet typically includes a packet identifier combined with data.
  • the identifier indicates whether this is a "regular" (bypass) packet, for which no matching data is found at destination device 18, and hence it is sent in its entirely.
  • the packet may include both the unmatched data and indexing information that destination device 18 may use to identify the matched stream, such as a unique checksum of the original stream and information about the location of the data in the stream, such as an offset-length pair.
  • the destination device on the receiving end of the hop receives the system packet and checks the identifier.
  • the packet is analyzed, and the data found in the packet will be stored in destination device 18's memory.
  • the original IP packet is then sent to router 20.
  • destination device 18 analyzes the packet and recreates the original IP packet from its memory using the information found in the system packet.
  • source device 16 and destination device 18 may be incorporated into routers 14 and 20 respectfully in hardware and/or software using conventional techniques.
  • the routers may thus be configured to process packets as described above, with the data being stored in the routers' internal memory as necessary.
  • Source device 16 may use several methods for matching incoming packets to data stored at destination device 18. For example, source device 16 may perform matching on a packet-by-packet basis, than reassemble the data file (e.g., GIF file), and compare the received and stored files.
  • a system utilizing the teachings of the present invention may provide additional data throughput as compared with existing systems as it is typically more efficient to send indexing information as described above which is usually several bytes in length, instead of the entire packet which may contain hundreds of bytes of data.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

L'invention concerne un procédé permettant de réduire un trafic de données associé à la transmission de paquets dans un réseau de transmission par paquets. Le procédé consiste à: a) maintenir des données transmises dans un flux de données au niveau d'une source du réseau (16) et d'une destination du réseau (18) communiquant entre elles par l'intermédiaire d'un chemin du réseau (8); b) recevoir ensuite, à la source du réseau (16), un paquet associé au flux de données; c) extraire les données contenues dans le paquet; d) comparer les données extraites à l'étape c) avec les données maintenues à l'étape a); et e) lorsque les données extraites à l'étape c) correspondent au moins partiellement aux données maintenues à l'étape a); f) acheminer vers la destination du réseau (18) un paquet du système pour identifier les données extraites à l'étape c) au moyen des données maintenues à la destination du réseau (18); et g) reconstituer le paquet au niveau de la destination du réseau (18) à partir des données qui y sont maintenues.
PCT/IL1999/000345 1998-06-23 1999-06-23 Stockage de contenu et suppression de la redondance WO1999067925A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU43890/99A AU4389099A (en) 1998-06-23 1999-06-23 Content storage and redundancy elimination

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US9042598P 1998-06-23 1998-06-23
US60/090,425 1998-06-23

Publications (1)

Publication Number Publication Date
WO1999067925A1 true WO1999067925A1 (fr) 1999-12-29

Family

ID=22222714

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IL1999/000345 WO1999067925A1 (fr) 1998-06-23 1999-06-23 Stockage de contenu et suppression de la redondance

Country Status (2)

Country Link
AU (1) AU4389099A (fr)
WO (1) WO1999067925A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9083708B2 (en) 2010-05-17 2015-07-14 Microsoft Technology Licensing, Llc Asymmetric end host redundancy elimination for networks

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4899148A (en) * 1987-02-25 1990-02-06 Oki Electric Industry Co., Ltd. Data compression method
US5293379A (en) * 1991-04-22 1994-03-08 Gandalf Technologies, Inc. Packet-based data compression method

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4899148A (en) * 1987-02-25 1990-02-06 Oki Electric Industry Co., Ltd. Data compression method
US5293379A (en) * 1991-04-22 1994-03-08 Gandalf Technologies, Inc. Packet-based data compression method

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9083708B2 (en) 2010-05-17 2015-07-14 Microsoft Technology Licensing, Llc Asymmetric end host redundancy elimination for networks

Also Published As

Publication number Publication date
AU4389099A (en) 2000-01-10

Similar Documents

Publication Publication Date Title
EP1330720B1 (fr) Architecture de reseau et procedes de codage transparent de sessions croisees en ligne et de transport de donnees de communications reseau
US7143169B1 (en) Methods and apparatus for directing messages to computer systems based on inserted data
US6032193A (en) Computer system having virtual circuit address altered by local computer to switch to different physical data link to increase data transmission bandwidth
US7948921B1 (en) Automatic network optimization
US8009696B2 (en) System and method for achieving accelerated throughput
JP3225924B2 (ja) 通信品質制御装置
US7079501B2 (en) Method and system for efficiently delivering content to multiple requesters
US20030084185A1 (en) Apparatus and method for scaling TCP off load buffer requirements by segment size
US20030206549A1 (en) Method and apparatus for multicast delivery of information
US6321269B1 (en) Optimized performance for transaction-oriented communications using stream-based network protocols
US20030229809A1 (en) Transparent proxy server
WO2002035795A1 (fr) Serveur mandataire transparent
US20030149792A1 (en) System and method for transmission of data through multiple streams
EP2084860A2 (fr) Procédé d'interception de session sélective
US7283527B2 (en) Apparatus and method of maintaining two-byte IP identification fields in IP headers
US20090055919A1 (en) Unauthorized communication detection method
WO2006111605A2 (fr) Methode pour etablir des connexions dans un systeme de communication
US7876757B2 (en) Router-assisted fast processing of packet termination in host
US20030055915A1 (en) Method and apparatus for transmitting data over a network
WO2002051077A1 (fr) Procede et systeme pour distinguer les protocoles de trafic plus eleves du trafic internet
US6963568B2 (en) Method for transmitting data packets, method for receiving data packets, data packet transmitter device, data packet receiver device and network including such devices
US6542503B1 (en) Multicast echo removal
US7978598B1 (en) Connection replication
US20100208728A1 (en) Multi-Route Transmission of Packets Within a Network
US7756996B2 (en) Embedding management data within HTTP messages

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AL AM AT AU AZ BA BB BG BR BY CA CH CN CU CZ DE DK EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW SD SL SZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase