• Piece_Maker@feddit.uk
    link
    fedilink
    English
    arrow-up
    9
    ·
    3 hours ago

    Torrents manage this without any extra tech. Just grab the .torrent file, and only select the files you have space for. Download them then seed, and get your 150 friends to do different files. If I then go to download a file that’s in your batch, the download will happen from your server (and whoever else is seeding these files), and if I go to download a file that’s on one of your 150 others’ server it’ll download from there.

    • Knock_Knock_Lemmy_In@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      1
      ·
      edit-2
      56 minutes ago

      Yes, almost. But i want it to seem like i have all 400tb on my 3tb drive. I want the cache to handle downloads automatically and I want an even spread of files so that none get lost.

      Torrents give me:

      • Chunking
      • Redundancy via multiple seeders
      • Partial downloads

      But they do not give me:

      • A unified filesystem view
      • Automatic caching & eviction
      • Guarantees that every file stays available
      • Load balancing or placement control
      • A way to say “this file must exist on N peers”

      Maybe I should be typing this into a LLM.

      Edit: ChatGPT is suggesting an IPFS Cluster

      • Piece_Maker@feddit.uk
        link
        fedilink
        English
        arrow-up
        1
        ·
        2 minutes ago

        Ahh fair enough! Yeah, not sure about all that.

        A very long time ago I remember there being FUSE filesystems that allow you to mount a .torrent like a network drive. I have no idea if these are still kicking though. Still doesn’t provide all of your extra bullet points but might be a good start to the rabbit hole