Skip to content

True GigaChannels with 1 billion magnet links #3971

@synctext

Description

@synctext

Tribler aims to be a realistic alternative to Youtube. Goal: support an unbounded wealth of user-generated content. Solution: create a Bittorrent swarm of any magnet link collection.

1 channel may contain up to 1 billion magnet links

A Youtube-alternative requires seamless scalability of a server-free video platform; beyond anything scientists have been able to create so far. Fast growth needs to be accommodated, for instance, Netflix has a growth rate 200.000 new users per day.
image
Current Tribler channels do not support envisioned growth rate. For instance, Youtube channels obtains lot of new subscribers each day. Taking some stats of the Internets, we see that:

  • More than 300 channels are hitting the 10,000 subscriber mark every day.
  • More than 40 channels are hitting the 100,000 subscriber mark every day.
  • Around 4 channels are hitting the 1 million subscriber mark every day.

Youtube channels with a gigantic amount of videos:

  1. 1013672 videos
  2. 727931 videos
  3. 624745 videos

The 10 Biggest YouTube Channels Right Now

  1. PewDiePie. Subscribers: 66.1 million.
  2. Dude Perfect. Subscribers: 34.54 million.
  3. HolaSoyGerman. Subscribers: 34.48 million.
  4. whinderssonnunes. Subscribers: 31.4 million.
  5. elrubiusOMG. Subscribers: 30.83 million.
  6. Fernanfloo. Subscribers: 29.34 million.
  7. JuegaGerman. Subscribers: 28.95 million.
  8. VEGETTA777. Subscribers: 23.85 million.

Technical Details

Above statistics are about the number of users subscribed to 1 channel. We will create 1 bittorrent swarm for each channel. If we project above subscribed numbers to Gigachannels we can expect near instantaneous access to a random partial selection of magnet links. If changes are made to the channel, the Gigachannel swarm is updated automatically. Changes to the Gigachannel should be quick and never trigger hash re-checks. This issue does not cover the discovery of Gigachannels or spreading update of Gigachannels. Fast incremental and hierarchical traversal of Gigachannels is also very much left as future work. Keep it a huge dumb list for starters.

1 billion magnet links represents a significant storage size. For example, 1 billion times magnet:?xt=urn:btih:23ABBAA2A7D44A4EAFCBC907DB475376D1422629 equals 61 GByte at minimum.

Requirement: 1 computer generates 1 billion random magnet links, one valid magnet link, and creates a channel. The channel address is made available to another Tribler instance and download is started. We allow unlimited transfer time, but no errors are allowed to occur.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions