[go: up one dir, main page]

WO2002035799A3 - Method and apparatus for large payload distribution in a network - Google Patents

Method and apparatus for large payload distribution in a network Download PDF

Info

Publication number
WO2002035799A3
WO2002035799A3 PCT/US2001/032638 US0132638W WO0235799A3 WO 2002035799 A3 WO2002035799 A3 WO 2002035799A3 US 0132638 W US0132638 W US 0132638W WO 0235799 A3 WO0235799 A3 WO 0235799A3
Authority
WO
WIPO (PCT)
Prior art keywords
network
file
content
nodes
large payload
Prior art date
Application number
PCT/US2001/032638
Other languages
French (fr)
Other versions
WO2002035799A2 (en
Inventor
Siew Yong Sim
Desmond Cho-Hung Chan
Original Assignee
Prismedia Networks Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US09/681,644 external-priority patent/US6970939B2/en
Application filed by Prismedia Networks Inc filed Critical Prismedia Networks Inc
Priority to EP01989004A priority Critical patent/EP1368948A2/en
Priority to AU2002224448A priority patent/AU2002224448A1/en
Publication of WO2002035799A2 publication Critical patent/WO2002035799A2/en
Publication of WO2002035799A3 publication Critical patent/WO2002035799A3/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/18—File system types
    • G06F16/182—Distributed file systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/18—File system types
    • G06F16/188—Virtual file systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00—Traffic control in data switching networks
    • H04L47/10—Flow control; Congestion control
    • H04L47/12—Avoiding congestion; Recovering from congestion
    • H04L47/125—Avoiding congestion; Recovering from congestion by balancing the load, e.g. traffic engineering

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Transfer Between Computers (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

Large payload files are selectively partitioned in blocks and theblocks distributed to a plurality of distribution stations at theedge of the network qualified to have the data. Each qualified station decides how much and what portion of the content to save locally, based on information such as network location and environment, usage, popularity, and other distribution criteria defined by the content provider. Different pieces of a large payload file may be available from different nodes, however, when a user requests access to the large payload file, for example, through an application server, a virtual file control system creates an illusion that the entire file is present at the connected node. However, since only selective portions of the large payload file may actually be resident at that node's storage at the time of request, a cluster of distribution servers at the distribution station may download the non-resident portions of the file as the applicationserver is servicing the user. The download may be in parallel andusually from the least congested nodes. New nodes added to the network learn from other nodes in the network what content they should have and downlaod the required content, in a desired amount, onto their local storage devices from the nearest and least congested nodes without interrupting network operation. Each node manages its local storage and decides what content to prune based on information such as usage patterns.
PCT/US2001/032638 2000-10-26 2001-10-26 Method and apparatus for large payload distribution in a network WO2002035799A2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP01989004A EP1368948A2 (en) 2000-10-26 2001-10-26 Method and apparatus for large payload distribution in a network
AU2002224448A AU2002224448A1 (en) 2000-10-26 2001-10-26 Method and apparatus for large payload distribution in a network

Applications Claiming Priority (16)

Application Number Priority Date Filing Date Title
US26628600P 2000-10-26 2000-10-26
US60/266,286 2000-10-26
US09/681,644 2001-05-15
US09/681,644 US6970939B2 (en) 2000-10-26 2001-05-15 Method and apparatus for large payload distribution in a network
US09/681,665 US7165095B2 (en) 2000-10-26 2001-05-17 Method and apparatus for distributing large payload file to a plurality of storage devices in a network
US09/681,665 2001-05-17
US09/681,669 2001-05-18
US09/681,672 US7047287B2 (en) 2000-10-26 2001-05-18 Method and apparatus for automatically adapting a node in a network
US09/681,671 2001-05-18
US09/681,673 US7058014B2 (en) 2000-10-26 2001-05-18 Method and apparatus for generating a large payload file
US09/681,671 US6857012B2 (en) 2000-10-26 2001-05-18 Method and apparatus for initializing a new node in a network
US09/681,672 2001-05-18
US09/681,668 US7177270B2 (en) 2000-10-26 2001-05-18 Method and apparatus for minimizing network congestion during large payload delivery
US09/681,668 2001-05-18
US09/681,673 2001-05-18
US09/681,669 US7181523B2 (en) 2000-10-26 2001-05-18 Method and apparatus for managing a plurality of servers in a content delivery network

Publications (2)

Publication Number Publication Date
WO2002035799A2 WO2002035799A2 (en) 2002-05-02
WO2002035799A3 true WO2002035799A3 (en) 2003-09-25

Family

ID=27575312

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2001/032638 WO2002035799A2 (en) 2000-10-26 2001-10-26 Method and apparatus for large payload distribution in a network

Country Status (4)

Country Link
EP (1) EP1368948A2 (en)
CN (1) CN100525288C (en)
AU (1) AU2002224448A1 (en)
WO (1) WO2002035799A2 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9794295B2 (en) 2011-12-21 2017-10-17 Akamai Technologies, Inc. Security policy editor

Families Citing this family (43)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE60131900T2 (en) 2000-10-26 2008-12-04 Flood, James C. jun., Portland METHOD AND SYSTEM FOR MANAGING DISTRIBUTED CONTENT AND RELATED METADATA
US7171469B2 (en) 2002-09-16 2007-01-30 Network Appliance, Inc. Apparatus and method for storing data in a proxy cache in a network
US7284030B2 (en) * 2002-09-16 2007-10-16 Network Appliance, Inc. Apparatus and method for processing data in a network
US7552223B1 (en) 2002-09-16 2009-06-23 Netapp, Inc. Apparatus and method for data consistency in a proxy cache
KR100585668B1 (en) * 2004-03-22 2006-06-07 엘지전자 주식회사 Multimedia editing method, device and multimedia file structure using virtual media file system
CN100433619C (en) * 2004-07-23 2008-11-12 腾讯科技（深圳）有限公司 Data download method and system
CN100411341C (en) * 2005-08-10 2008-08-13 华为技术有限公司 A parallel download method and terminal
CN101300805B (en) * 2005-09-08 2011-12-14 北方电讯网络有限公司 Load Balancing for Air Interface Protocol Architectures with Multiple Heterogeneous Physical Layer Modes
US20070168405A1 (en) * 2006-01-17 2007-07-19 Ori Pomerantz Self-optimizing network attached storage for multiple geographic locations
CN101064729B (en) * 2006-04-27 2010-06-09 中国电信股份有限公司 System and method for realizing FTP download service through CDN network
CN101495973A (en) * 2006-06-09 2009-07-29 迅龙国际集团有限公司 N ^ N data management, access, storage, transmission, exchange and retrieval system (data centralized management)
US8082289B2 (en) 2006-06-13 2011-12-20 Advanced Cluster Systems, Inc. Cluster computing support for application programs
CN101184104B (en) * 2007-12-21 2010-12-15 腾讯科技（深圳）有限公司 Distributed memory system and method
JP4557028B2 (en) * 2008-03-19 2010-10-06 ソニー株式会社 Information processing apparatus, information processing method, client device, information processing system
CA2673554C (en) * 2009-07-21 2017-01-03 Ibm Canada Limited - Ibm Canada Limitee Web distributed storage system
WO2011023134A1 (en) 2009-08-28 2011-03-03 Beijing Innovation Works Technology Company Limited Method and system for managing distributed storage system through virtual file system
US8612622B2 (en) * 2009-10-02 2013-12-17 Limelight Networks, Inc. Real-time message queuing for a processing ring
CN102486739B (en) * 2009-11-30 2015-03-25 国际商业机器公司 Method and system for distributing data in high-performance computer cluster
US8982738B2 (en) * 2010-05-13 2015-03-17 Futurewei Technologies, Inc. System, apparatus for content delivery for internet traffic and methods thereof
US8463788B2 (en) * 2010-09-03 2013-06-11 Marvell World Trade Ltd. Balancing caching load in a peer-to-peer based network file system
JP5743469B2 (en) 2010-09-22 2015-07-01 キヤノン株式会社 Information processing apparatus, control method thereof, and control program
US8612550B2 (en) 2011-02-07 2013-12-17 Microsoft Corporation Proxy-based cache content distribution and affinity
ES2650595T3 (en) * 2011-04-15 2018-01-19 Deutsche Telekom Ag Network traffic engineering
JP5932987B2 (en) * 2011-06-08 2016-06-08 コニンクリーケ・ケイピーエヌ・ナムローゼ・フェンノートシャップ Location and extraction of segmented content
EP2833582A4 (en) * 2012-03-28 2015-12-02 Nec Corp Computer system and communication path modification means
EP2660723A1 (en) * 2012-05-03 2013-11-06 Thomson Licensing Method of data storing and maintenance in a distributed data storage system and corresponding device
EP3518115B1 (en) * 2012-10-08 2020-12-02 Patrick Soon-Shiong Distributed storage systems and methods
US9246998B2 (en) 2012-10-16 2016-01-26 Microsoft Technology Licensing, Llc Load balancer bypass
CN103036967B (en) * 2012-12-10 2017-03-15 北京奇虎科技有限公司 A download management device, method and data download system
CN103152396A (en) * 2013-02-05 2013-06-12 华南师范大学 Data placement method and device applied to content distribution network system
CN103778212B (en) * 2014-01-16 2017-04-05 国网山东省电力公司青岛供电公司 Parallel mass data processing method based on back end
CN103929491B (en) * 2014-04-28 2016-02-03 努比亚技术有限公司 Method of data synchronization and system and mobile terminal
CN105634992B (en) * 2015-12-29 2019-01-11 网宿科技股份有限公司 CDN platform adaptive band width control method and system
CN108683692B (en) * 2018-03-16 2021-05-11 创新先进技术有限公司 Service request processing method and device
CN109308239B (en) * 2018-09-26 2022-02-18 北京百度网讯科技有限公司 Method and apparatus for outputting information
CN109981780A (en) * 2019-03-27 2019-07-05 深圳市网心科技有限公司 A kind of dispatching method, node device, scheduling system and storage medium
CN110308917B (en) * 2019-06-26 2024-02-23 深圳前海微众银行股份有限公司 Applet issuing method, device, equipment and computer storage medium
US11677625B2 (en) 2019-07-02 2023-06-13 Northeastern University Network and method for servicing a computation request
US12360976B1 (en) * 2020-09-30 2025-07-15 Amazon Technologies, Inc. Low latency writes to local tables by event-triggered functions at the edge
CN113301379B (en) * 2021-05-26 2022-10-04 广州方硅信息技术有限公司 Live broadcast list updating method, device, system and storage medium
EP4427143A1 (en) * 2021-11-03 2024-09-11 NetApp, Inc. Distributed storage systems and methods to provide change tracking integrated with scalable databases
US11606249B1 (en) * 2022-01-19 2023-03-14 Dell Products L.P. System and method for communication management in distributed system
CN120639649B (en) * 2025-08-18 2025-10-03 中国人民解放军国防科技大学 Network traffic load searching method, device and equipment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5751968A (en) * 1995-09-12 1998-05-12 Vocaltec Ltd. System and method for distributing multi-media presentations in a computer network
EP0967559A1 (en) * 1998-06-24 1999-12-29 Lucent Technologies Inc. Push-pull services for the internet
US6038601A (en) * 1997-07-21 2000-03-14 Tibco, Inc. Method and apparatus for storing and delivering documents on the internet
US6081840A (en) * 1997-10-14 2000-06-27 Zhao; Yan Two-level content distribution system
US6105029A (en) * 1997-09-17 2000-08-15 International Business Machines Corporation Retrieving network files through parallel channels

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5751968A (en) * 1995-09-12 1998-05-12 Vocaltec Ltd. System and method for distributing multi-media presentations in a computer network
US6038601A (en) * 1997-07-21 2000-03-14 Tibco, Inc. Method and apparatus for storing and delivering documents on the internet
US6105029A (en) * 1997-09-17 2000-08-15 International Business Machines Corporation Retrieving network files through parallel channels
US6081840A (en) * 1997-10-14 2000-06-27 Zhao; Yan Two-level content distribution system
EP0967559A1 (en) * 1998-06-24 1999-12-29 Lucent Technologies Inc. Push-pull services for the internet

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
ALLEN MIU ET AL: "Performance Analysis of a Dynamic Parallel Downloading Scheme from Mirror Sites Throughout the Internet", 6892 TERM PAPER, XX, XX, December 1999 (1999-12-01), pages 1 - 13, XP002204897 *
BABAK S NOGHAMI ET AL: "A Novel Approach to Reduce Latency on the Internet: Component-Based Download", DEPT. OF ELECTRICAL AND COMPUTER ENGINEERING, UNIVERSITY OF MANITOBA, June 2000 (2000-06-01), XP002204898 *
GRUBER S ET AL: "Design Considerations for an RTSP-Based Prefix-Caching Proxy for Multimedia Streams", AT&T LABS RESEARCH, 7 September 1999 (1999-09-07), XP002194289 *
RODRIGUEZ P ET AL: "Parallel-access for mirror sites in the Internet", INFOCOM 2000. NINETEENTH ANNUAL JOINT CONFERENCE OF THE IEEE COMPUTER AND COMMUNICATIONS SOCIETIES. PROCEEDINGS. IEEE TEL AVIV, ISRAEL 26-30 MARCH 2000, PISCATAWAY, NJ, USA,IEEE, US, 26 March 2000 (2000-03-26), pages 864 - 873, XP010376176, ISBN: 0-7803-5880-5 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9794295B2 (en) 2011-12-21 2017-10-17 Akamai Technologies, Inc. Security policy editor

Also Published As

Publication number Publication date
CN100525288C (en) 2009-08-05
CN1481635A (en) 2004-03-10
WO2002035799A2 (en) 2002-05-02
EP1368948A2 (en) 2003-12-10
AU2002224448A1 (en) 2002-05-06

Similar Documents

Publication Publication Date Title
WO2002035799A3 (en) Method and apparatus for large payload distribution in a network
EP1988684A3 (en) Method and apparatus for large payload distribution in a network
Machen et al. Live service migration in mobile edge clouds
Bestavros et al. Server-Initated Document Dissemination for the WWW.
RU2002120910A (en) Application interface for developing multi-user applications running over communication networks
EP0957616A3 (en) A protocol for exchanging configuration data in a computer network
CA2182124A1 (en) Method and System for Licensing Program Management Within a Distributed Data Processing System
Baker et al. Distributed cooperative Web servers
MY123888A (en) Method and apparatus for precaching data at a server
CA2308280A1 (en) System and method for capacity shaping in an internet environment
EP1351141A3 (en) Method and system for managing data records on a computer network
WO2003094033A3 (en) Method and system for configuration and download in a restricted architecture network
IL134457A0 (en) Method and apparatus of a collaborative proxy system
CA2406821A1 (en) Switchable resource management in clustered computer system
WO2004051479A3 (en) Heartbeat mechanism for cluster systems
WO2002021236A3 (en) Client-side last-element cache network architecture
CN105337901A (en) Router intelligent bandwidth allocation method and device
WO2003030486A3 (en) Hierarchical caching in telecommunication networks
ATE438243T1 (en) LOAD BALANCING DEVICE AND METHOD THEREOF
DE60045327D1 (en) System and method for integrated load distribution and resource management in an Internet environment
GB9624419D0 (en) Communication system for delivery of content over electronic networks
CN101491055A (en) Dispatching request fragments from a response aggregating surrogate
CN1921479B (en) Method and system for partaking load of flow media system
CN105872856A (en) Method and system for distributing stream media files
CN108924203B (en) Data copy self-adaptive distribution method, distributed computing system and related equipment

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
WWE Wipo information: entry into national phase

Ref document number: 2001989004

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 018208142

Country of ref document: CN

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

WWP Wipo information: published in national office

Ref document number: 2001989004

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: JP