:Anna's Archive scraped 86M songs from Spotify covering 99.6% of streams. The 300TB archive is already on torrents.
    • commander@lemmy.worldEnglish
      5 months

      Get to acquiring Seagate external HDDs and shucking them for your own 3.5" drive bays before the data centers get them

        • tehn00bi@lemmy.worldEnglish
          5 months

          Pc guys haven’t had a break in like 7 years. One component or another is the hottest item for one scam or another.

          • trolololol@lemmy.worldEnglish
            5 months

            Frankenstein all the way, you just have to continuously build from whatever part is cheap at the moment.

    • LaunchesKayaks@lemmy.worldEnglish
      5 months

      I’m building my first Linux setup and have a NAS planned out. I’m so stoked. I got a raspberry pi kit from my dad as an Xmas gift yesterday.

      • ramenshaman@lemmy.worldEnglish
        5 months

        I also used a raspberry pi (5). People here will advise against it but for me it’s been working fine so far. I can stream 4K with Jellyfin on my local network just fine. Read/write speeds aren’t great but good enough for me. I used a Pi hat with 5x SATA ports and I have 5x 8TB HDDs in a custom 3D printed enclosure and I’m using ZFS RAID z1. No complaints yet.

        • Destide@feddit.ukEnglish
          5 months

          You learn a lot more than if you were to just slap an epyc in a box. Pi will reach you about encoding and balancing resources. I still use everything I learnt and some of the gear like the terra master only reason I don’t use it anymore is because I got free server stuff from work.

    • Scotty_Trees@lemmy.worldEnglish
      5 months

      40TB LOL. Where we’re going, we’re gonna need more space! Back to the Space, Part IV!

    • da_cow (she/her)@feddit.orgEnglish
      5 months

      My soon to be homeserver will have an astonishing 4TB of space. The CPU can handle up to 15TB (according to official specifications), but I am lacking drives that are big enough.

      If I ever get the money to build a proper NAS I will 100% start going all in on Storage and start doing stupid shit like mirroring Wikipedia. I will probably not start mirroring the entirety of Spotify (which would be kinda sick NGL.), but I kind of have the problem that I Am kind of a data hoarder that likes to store excessive amounts of stuff I will never need. In the future I will also start seeding all the music I have, but I need a VPN with port forwarding for that beforehand (I’m currently kinda broke, so won’t happen that fast)

  • blitzen@lemmy.caEnglish
    5 months

    As far as I’ve read, the database is largely low bitrate files, and some AI. The value here is metadata and preservation of “rare” music.

    • hietsu@sopuli.xyzEnglish
      5 months

      Nope, I would not call 160kbps Vorbis low bitrate, it’s roughly quality of 192kbps MP3. Only the ”popularity=0” stuff (so stuff with so few listens that Spotify does not keep record of) were re-encoded to 75kbps Opus, which as a modern codec is much better than it sounds like but of course re-encode is not great for already lossy stuff.

      For purists there are those Tidal downloader sites available everywhere for free lossless music, even 24-bit hires FLAC.

      • blitzen@lemmy.caEnglish
        5 months

        Opus is what I’m encoding my working library to. I like ripping to flac (and archiving them as such), but the advantages to smaller file sizes for the working library are worth it for me. So far, I’m really liking the format.

        I keep the archive on spinning hard drives, but the opus library on ssd (which makes browsing much quicker, and no unnecessary spinning up the hard drives.)

    • selokichtli@lemmy.mlEnglish
      5 months

      It’s not lossless but current ogg vorbis at 160kbps is absolutely transparent for the vast majority of people. That’s actually what I chose to keep my own collection, I mean, outside of the lossless albums that I absolutely want to flawlessly preserve.

        • selokichtli@lemmy.mlEnglish
          5 months

          I’d say in general it’s the same, but way lighter than 320 kbps mp3. It’s better than 192 kpbs mp3 and as good or better than 256 kbps mp3.

          • Valmond@lemmy.dbzer0.comEnglish
            5 months

            Thanks.

            I hear the diff between 192 & 320 (probably 256 is enough but better safe than sorry I thought so that’s what I use) so 160 vorbis is very good but not totally perfect for me then.

  • sbv@sh.itjust.worksEnglish
    5 months

    Is this new? Aren’t most tracks already available in torrents?

    • borokov@lemmy.worldEnglish
      5 months

      Yep, most of tracks were already available on “various” sources, but this time they directly scraped the whole Spotify database.

      It’s really nice from them to backup Spotify database on a distributed system, and for free ! This ensure Spotify business won’t be endanger in case of critical hardware failure.

    • JASN_DE@feddit.orgEnglish
      5 months

      It’s new insofar as this is one big scrape. About 300TB iirc.

      • HeyJoe@lemmy.worldEnglish
        5 months

        300tb is a lot, but its kind of crazy to think this entire company only needs 300tb storage arrays to function. I wonder how they handle things internally. I would imagine at least 1 backup server ready to go in HA. I wonder if they have multiple regions across the country that also serves up the same setup.

          • mojofrododojo@lemmy.worldEnglish
            5 months

            “Are you an incel with few friends, no job, and a deep seated hate for melanin? COME JOIN ICE!”

              • mojofrododojo@lemmy.worldEnglish
                5 months

                have never understood the fanbase, and have never understood people who love music throwing $$$$ at spotify so they could pay brogan $$$ and give actual musicians a pittance.

        • rainwall@piefed.socialEnglish
          5 months

          Likely cloned Netflix’s “netflix in a box” design, where they drop a large 200TB+ NAS in thousands of different CDN datecenters with their most popular content cached so that total traffic is minimal across the internet at large.

          Spotify mainly being music with very little video likely makes this even easier.

        • JohnEdwa@sopuli.xyzEnglish
          5 months

          IIRC there’s still like 700TB of low popularity music missing, but it is only something like 0.4% of listens.
          And they need a more storage overall because they have to set up datecenters around the world - doesn’t make sense to stream tens of millions of connections across the ocean. But that also gives all the backups one would need for “free”.

        • 🦄🦄🦄@feddit.orgEnglish
          5 months

          Afaik 300 TB is just the most popular music and around a third of all tracks. The blog post on anna’s is quite entertaining tho.

        • da_cow (she/her)@feddit.orgEnglish
          5 months

          This isnt the entirety of Spotify. If they would have archived everything in 160kbps OGG Vorbis it would have been 700+TB. Theres A bucket load of songs that literally no one listens to.

          • HeyJoe@lemmy.worldEnglish
            5 months

            Oh I know, I work in the industry as well. Our company backups alone for workstations and servers is just under 1 petabyte. This is then replicated to an offsite location which is also out disaster recovery location, and also stored in long term storage in Azure. This is just backups, sooo much money for backups haha. Thats why I am shocked that this entire company can run off of 300tb which is a lot, but nothing when you think of it being the entire business model for them.

            I think the craziest thing ive seen is we have these instruments that do genome testing and sequencing and they would create like 10tb worth of data per month. Every month they got there own 10tb drive handed to them to backup their stuff on there own on top of the ones we did for them.

            • Valmond@lemmy.dbzer0.comEnglish
              5 months

              I worked with visualisation of scientific data, up to 1petabyte, multi channel 3D realtime visu without degradation. One client had 1.5TB ram. Interesting times.

    • navigator@piefed.zipEnglish
      5 months

      Not mine, because I’m not famous enough for people to pirate my music lol. It would be flattering for me to be included in this batch of scraped music.

  • morto@piefed.socialEnglish
    5 months

    It would be awesome if we had an app that allowed to stream directly from such torrents, and had a user-made recommendation system to replace the discovery algorithm :D

    • Bizzle@lemmy.worldEnglish
      5 months

      Stremio + Torrentio does this for TV but I haven’t found an equivalent for music. Hoping to be proven wrong 🤞

      • WhiteOakBayou@lemmy.worldEnglish
        5 months

        Something as easy as stremio but for music. Connect to listenbrainz instead of trakt. Then only serve from the spotify collection because of their extensive metadata. With multi device sign in and syncing like stremio. Then a Kodi add on for the libreelec people.

    • Valmond@lemmy.dbzer0.comEnglish
      5 months

      I wonder how they are splitting it up in different torrents and how many.

      They are splitting it up right? 😁

  • pptiny@lemmy.worldEnglish
    5 months

    Moved to Tidal. Reviews from some tech-site said “It’s like Spotify 10 years ago.” as if that’s a bad thing.

    Loving the FLAC quality and non-enshittification.

      • Waldelfe@feddit.orgEnglish
        5 months

        I love Qobus. I heard they also pay the artists more fairly. It’s just unfortunate that some big artists are still missing. And from what I can see subscriptions only work via the Google Play store.

      • sexhaver87@sh.itjust.worksEnglish
        5 months

        And there’s some great quality CLI applications that let you rip source quality FLACs!

    • anythingdull@infosec.pubEnglish
      5 months

      I tried Tidal but they have a glitch on their app where downloaded songs get stuck and playlists stop downloading. They’ve had a bug open about it for at least three years last I checked. It may sound niche, but I’m often traveling and use offline music regularly

  • Gsus4@mander.xyzEnglish
    5 months

    Well, at least the datahoarders can preserve some things when it all goes to shit…

    • UnderpantsWeevil@lemmy.worldEnglish
      5 months

      90% of Spotify is trash. Much like Audible, it’s just choking on AI generated content and similar worthless vanity projects

    • nutsack@lemmy.dbzer0.comEnglish
      5 months

      data hoarders already have everything in here and far more, and the web release versions are a lower priority. thinking of red.sh here

      • HereIAm@lemmy.worldEnglish
        5 months

        I don’t think many data hoarders are sitting on the AI generated stuff 😁

  • verdi@feddit.orgEnglish
    5 months

    Now do Netflix, Prime, Paramount, HBO, Disney, Hulu and Apple and we’re golden.

    Would be a magical day the day copyright dies.

    • hexonxonx@lemmy.dbzer0.comEnglish
      5 months

      Already done. It’s called Torrent Streaming and lets you stream-on-demand anything that exists as a torrent without having to torrent anything yourself.

      A client that can stream these Spotify torrents with an interface that works like Spotify (low bar, I know) will be awesome, but also including a database to match songs to artists so users can send money directly to the artists they listen to will make it revolutionary.

    • Fredthefishlord@lemmy.blahaj.zoneEnglish
      5 months

      When copyright dies so rich conglomerates can make money by monetizing out toys and collectibles and theme parks from smaller creators content without paying a dime back to them? Copyright is beneficial. Copyright is good. It needs reform, yes, but don’t mistake that with the concept being bad.

      • somerandomperson@lemmy.dbzer0.comdeleted by creatorEnglish
        5 months

        You should NOT actively do something, for money. You should EXPECT it.
        Otherwise you’ll eventually try to maximize profits and get rid of everything that made whatever you did good in the first place.

        • Fredthefishlord@lemmy.blahaj.zoneEnglish
          5 months

          Abolishing copyright exclusive and only works if you abolish money with it. Otherwise you’re only benefiting the largest corporations, despite what you think, it won’t be the small guy winning

      • SocialMediaRefugee@lemmy.worldEnglish
        5 months

        I’d just reduce copyright periods. Right now they are ridiculously long. No one should hold rights from 1930s works.

  • Zarajevo@feddit.orgEnglish
    5 months

    I buy music on Bandcamp to support artists and then stream music via my own Plex server

      • n1ckn4m3@lemmy.worldEnglish
        5 months

        Yeah it’s awesome, you get to spend all of your time chasing stupid issues like it picking the dumbest artist name possible and using it for 30 albums because one artist was on two of those albums, or deciding that 50% of your artists should be Lastname, Firstname but the other 50% should be Firstname Lastname. Then half the time it will use its own metadata for cover art and the other half it’ll use metadata in the files. Doesn’t matter how meticulous you are with your music tags an whether or not you have musicbrainz’d all of them to be consistent, it still finds a way to screw things up pretty much reliably.

        But it’s all worth it because PlexAmp is surprisingly good once you’ve done the legwork and fixed all the stupid shit and I would much rather buy music directly and self-host my own music streaming system than pay spotify monthly.