An Evaluation of a Parallel Downloading Scheme from Mirror ...

An Evaluation of a Parallel Downloading Scheme from Mirror ...

Performance Analysis of a Parallel Downloading Scheme from Mirror Sites Throughout the Internet Allen Miu, Eugene Shih 6.892 Class Project December 3, 1999 Overview

Problem Statement Advantages/Disadvantages Operation of Paraloading Goals of Experiment Setup of Experiment Current Results Summary Questions

Problem Statement: Is Paraloading Good? Paraloading is the downloading from multiple mirror sites in parallel. Mirror C Paraloader Mirror A

Mirror B Advantages of Paraloading Performance is proportional to the realized aggregate bandwidth of the parallel connections Less prone to complete download failures compared to the single connection

download Facilitates dynamic load balancing among parallel connections Facilitates reliable, out-of-order delivery (similar to Netscape) Disadvantages of Paraloading Can be overly aggressive Consumes more server resources

Overhead costs for scheduling, maintaining buffers, and sending block request messages Only effective when mirror servers are available Step 1: Obtain Mirror List Mirror List

Hard-coded DNS? Mirror C Paraloader Mirror A Mirror B

Step 2: Obtain File Length Mirror C Paraloader Mirror A Mirror B

Step 3: Send Block Requests Mirror C Paraloader Mirror A Mirror B

Step 4: Re-order Mirror C Paraloader Mirror A Mirror B

Step 5: Send Next Request Mirror C Paraloader Mirror A Mirror B

Goals of Experiment Main goal: To compare the performance of serial and parallel downloading To verify the results of Rodriguez et al. To examine whether varying the degree of parallelism, the number of mirror servers used, affects performance To gain experience with paraloading and to

find out what issues are involved in designing efficient paraloading systems Experiment Setup Implemented a paraloader application in Java, using HTTP1.1 (range-requests and persistent connections) Files are downloaded at MIT from 3 different sets (kernel, mars, tucows) of 7 mirror servers

Degree of parallelism examined: M = 1, 3, 5, 7 Downloaded a 1MB and a 300KB file (S = 1MB, 300KB) in 1 hour intervals for 7 days Block Size = 32KB Results Paraloading decreases download time over the average single connection case Speedup is far from optimal case (aggregate

bandwidth) Block request gaps result in wasted bandwidth Gaps are proportional to RTT Congestion at client? Possible but unlikely. S = 1MB

S = 1MB S = 763KB, S - 763K B = 30, M = 4 Acknowledgements Dave Anderson

Dorothy Curtis Wendi Heinzelmann WIND Group Questions Summary of Contributions Implemented a paraloader Verified that paraloading indeed provides

performance gain sometimes Increasing degree of parallelism improves overall performance Performance gains are not as good as those reported by Rodriguez et al. Future Work Examine how block size affects

performance gain Examine cost of paraloading Implement and test various optimization techniques Perform measurements at different client sites Paraloading Will Not Be Effective In All Situations

Clients should have enough slack bandwidth capacity to open more than one connection Parallel connections are bottleneck disjoint Target data on mirror servers is consistent and static Security and authentication services are installed where appropriate Data transport is reliable Mirror locations are quickly and easily obtained

Step-by-step Process of the Block Scheduling Paraloading Scheme 1. Obtain a list of mirror sites 2. Open a connection to a mirror server and obtain file length 3. Divide file length into blocks 4. Send a block request to each open connection 5. Wait for a response 6. Send a new block request to the first connection

that finished downloading a block 7. Loop back to 5 until all blocks are retrieved Paraloading is Not a Well-studied Concept Byers et al. proposed using Tornado codes to facilitate paraloading. Rodriguez et al. proposed the

block scheduling paraloading scheme that is used in our project

Recently Viewed Presentations

  • The Three Fundamental Chemical Laws Law of Conservation

    The Three Fundamental Chemical Laws Law of Conservation

    Big Idea #1: Know this well!!! aluminum oxide tetraphosphorous decoxide mercury(II) sulfide hydrogen chlorate chloric acid Al2O3 P4O10 HgS HClO3 HClO3(aq) Title Author
  • จิตสาธารณะ (Public Mind)

    จิตสาธารณะ (Public Mind)

    แอนดรูว์ เฮย์วูด (Andrew Heywood) กล่าวถึง . ความสำคัญของการมีรัฐธรรมนูญ ได้แก่. 1. การสถาปนาอำนาจรัฐ. 2.
  • Pay for delay agreements: an unworthy target?

    Pay for delay agreements: an unworthy target?

    Hillingdon PCF Disabled children, young people and families - the law in a day8 March 2018. Steve Broach. Barrister. Monckton Chambers. www.monckton.com +44 (0)20 7405 7211
  • LESIONS ELEMENTAIRES Dr M.SFIA, Dermatologue Hospices Civils de

    LESIONS ELEMENTAIRES Dr M.SFIA, Dermatologue Hospices Civils de

    LESIONS ELEMENTAIRES Dr M.SFIA, Dermatologue Hospices Civils de Colmar Analyse de la forme, la taille, la couleur, la surface des lésions Association d'une ou de plusieurs lésions élémentaires Permet la description des lésions: oriente la diagnostic LESIONS PRIMAIRES: Non palpables:...
  • Welcome A Level Physics Make a difference Contents

    Welcome A Level Physics Make a difference Contents

    Support and training Next steps Our commitment is to provide qualifications which engage learners of all ages whether at school, college, in work and part time training programmes so they achieve their full potential make a difference Practical Accessible Innovative...
  • How do I do a screenshot and put it in my slide?

    How do I do a screenshot and put it in my slide?

    USP of this trailer is and the impact it has on the audience. You will also write about why the producers of the trailer chose this USP for the film… be sure to follow proper paragraph format. Use the screenshot...
  • Management of Heart Failure

    Management of Heart Failure

    Rales Trial of Spironolactone for CCF (30% reduction in 1 mortality), Epleronone - EPHESUS for AMI related HF (17% reduction in 1 year mortality)and EMPHASIS for CCF (Class 2 patient with 35% reduction in mortality and hospital admission over 21...
  • Andrea Yates - Seneca Valley School District

    Andrea Yates - Seneca Valley School District

    Quotes " Mommy, what's wrong with Mary?" - 7 year old Noah on his sister before Yates drowned him ... 2008 film Baby Blues (AKA Cradle May Fall in UK) is based on the killings, although story is largely changed...