Shmoocon Rainbow Table Swapshop

[kerry.milestone at gmail.com (Kerry)]

Perhaps have a look at this, its how many CDN networks work (I know
certainly, some do this on their backbone) - by forcing most of the transfer
to the clients rather than the seed.


http://www.bittorrent.org/beps/bep_0016.html


"The super-seed feature in S-5.5 and on is a new seeding algorithm designed
to help a torrent initiator with limited bandwidth "pump up" a large
torrent, reducing the amount of data it needs to upload in order to spawn
new seeds in the torrent.

When a seeding client enters "super-seed mode", it will not act as a
standard seed, but masquerades as a normal client with no data. As clients
connect, it will then inform them that it received a piece -- a piece that
was never sent, or if all pieces were already sent, is very rare. This will
induce the client to attempt to download only that piece.

When the client has finished downloading the piece, the seed will not inform
it of any other pieces until it has seen the piece it had sent previously
present on at least one other client. Until then, the client will not have
access to any of the other pieces of the seed, and therefore will not waste
the seed's bandwidth.

This method has resulted in much higher seeding efficiencies, by both
inducing peers into taking only the rarest data, reducing the amount of
redundant data sent, and limiting the amount of data sent to peers which do
not contribute to the swarm. Prior to this, a seed might have to upload 150%
to 200% of the total size of a torrent before other clients became seeds.
However, a large torrent seeded with a single client running in super-seed
mode was able to do so after only uploading 105% of the data. This is
150-200% more efficient than when using a standard seed.

Super-seed mode is *NOT* recommended for general use. While it does assist
in the wider distribution of rare data, because it limits the selection of
pieces a client can downlad, it also limits the ability of those clients to
download data for pieces they have already partially retrieved. Therefore,
super-seed mode is only recommended for initial seeding servers."




Tim Krabec wrote:
> I've got 3 servers soon to be 4 online. I think there are enough of us
> with servers and good home bandwidth to handle the load after an
> initial seed
>
> On Feb 11, 2010, at 3:24 PM, Stephen Reese <rsreese at gmail.com> wrote:
>
> > I have several Linode hosts around the US but they don't have nearly
> > the storage nor bandwidth to host this data...
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mail.pauldotcom.com/pipermail/pauldotcom/attachments/20100212/c6f27e73/attachment.htm