Civilizational intelligence infrastructure must remain free to study, build, deploy, and run, not rented from closed institutions.
  • Mearcfara@lemmy.mlEnglish
    7 hours

    I just wish we could invest the time/money/resources into compressing AI and making it smaller and more efficient. I’d so much rather have a somewhat capable AI that can be run locally and offline, to outsource menial tasks to like alphabetizing spreadsheets and so basic image modification, than to have to upgrade my hardware constantly or use cloud based SaaS and/or have newer models that are more accurate in their predictions.

    Of course that assumes a lot of things, like the intent to help people and not make money. Maybe someone in the Linux-sphere will make something.

    • petersr@lemmy.worldEnglish
      5 hours

      If I understand correctly, if we actually said “this model is great, let’s put a pin in it”, then it could be turned into a dedicated chip that would be much more efficient and perhaps even something that could get embedded in consumer hardware - but then you are just stuck with that model instead of “the next shiny new model” that they keep making.

    • BrightCandle@lemmy.worldEnglish
      5 hours

      I feel like there is a future of more targeted AI. At the moment something that does spreadsheets has to carry knowledge of programming and chemistry and lots of languages and this seems very heavy for what ultimately we need. A programming language focussed AT dedicated to Rust or Go or Java could potentially be quite a bit smaller especially if they focussed on algorithm snippet and auto complete smarts. There is definitely a market for smaller more targeted uses than these all encompassing chat bots where the goal is to move the state of the art on for existing algorithms.

    • ZephyrXero@lemmy.world
      English
      5 hours

      There are efforts there. The new Deepseek 4 compresses a lot of its knowledge using something they call engrams. But it’s unfortunately still too big for a consumer GPU.

      Gemma 4 is small enough to run on your cellphone.

      If your GPU has at least 8GB there are a lot of options for self hosting your own local models

  • XLE@piefed.socialEnglish
    9 hours

    Did anybody click the link to read the paragraph-long website text? Not only is it packed with assumptions about AI, it’s simply unhinged.

    The ability to… run intelligence systems without asking permission is of existential importance.

    Existential?! No it’s not.

    This mirrors the delusion Sam Altman demonstrated when he insisted nobody could raise a child without AI.

    • Nouvellalia@lemmy.worldEnglish
      6 hours

      It is now. If you want it not to be, go ahead and stop all this modern bullshit happening around me.

      You can’t yell at people on the ocean that they don’t really need boats, and then attack boats. I mean you can, but it’s foolish and unproductive.

  • brianpeiris@lemmy.caEnglish
    8 hours

    The word “intelligence” is doing a lot of heavy lifting here. LLMs lack any mechanism for true logical reasoning, and they always will by nature. This is why they fail at simple questions like “the car wash test”. It’s also why agents are expensive; They just flail around in token hungry “reasoning loops” until they happen to come across a correct solution. And it’s why Claude Opus 4.8 (High) only scores 1.5% on the ARC-AGI-3 benchmark at a cost of $10,000.

    This kind of panic is just part of the hype. Wake me up when real intelligence arrives.

  • Blaad@europe.pubEnglish
    10 hours

    The Chinese are doing a good job with open source ai models, especially Z. Ai, qwen and minimax, Google also got us something decent with gemma4, but yeah we need commercial AI to fail so we can get affordable access to vram…

  • PushButton@lemmy.worldEnglish
    15 hours

    It’s like people are starting to realize what the “luddites” were saying from the beginning.

    This tech is not from the people to the people like the web, it’s from big corpos to fuck you.

    You won’t have that tech, you will rent a highly modified one at best, built with the purpose to manipulate you.

    Remember: there is a club out there, and you are not part of it.

    • mabeledo@lemmy.worldEnglish
      10 hours

      So much this.

      If we take a look at how the current AI behemoths got there, there’s a trail that goes straight from stolen data to proprietary models. They are charging their users for the privilege of using better aggregated public data. I hope that, when they raise prices once again and more and more users are cut off their larger models, people would understand where their place is, according to corpos.

    • squaresinger@lemmy.worldEnglish
      14 hours

      Yeah, that’s what I really don’t get.

      Why would any serious company think it’s a great idea to outsource all your intelligence work to a handfull of US companies, making yourself wholely dependant on their goodwill and the goodwill of the US government?

      • WhatAmLemmy@lemmy.worldEnglish
        9 hours

        It’s the same delusion and corruption from a neoliberal corporate-whore political class that led to every country growing dependent on US tech companies, and Chinese manufacturing. They represent corporations; not their constituents.

        If they’d all committed to open source and domestic companies for support and infra, the compounding effect of tens of thousands of engineers across governments working on linux and other FLOSS products would have made everything significantly cheaper and more efficient for all of them in a matter of years, compared to paying a foreign tech company for everything in perpetuity… and that’s before you consider the multitude of other risks and vulnerabilities to national security.

        • teft@piefed.socialEnglish
          9 hours

          As a good example look at the national police in france. They ditched windows for a custom linux distro and are now saving like 10 million or more euros a year. That’s money that used to come from taxpayers to a foreign company and now that money can stay local and help improve the taxpayers lives instead of buying someone a 3rd yacht.

          • squaresinger@lemmy.worldEnglish
            8 hours

            I wish all these European Linux projects would pool resources and create one good solution instead of each little country or even city DIYing their own solution.

    • LesserAbe@lemmy.worldEnglish
      10 hours

      It’s not going to. Saying all AI should stop is like saying “all gunpowder should stop”. Would everyone be better off if no one was using it? Maybe. But that’s not going to happen at this point, and will give you a strategic disadvantage if you unilaterally disarm.

      And to be clear I’m not talking about using AI to write a screenplay or something creative, I mean like using it to write software, to optimize industrial processes etc.

      • XLE@piefed.socialEnglish
        9 hours

        “All AI should stop” is a far more reasonable opinion than the one presented by the website blog 9-sentence rant linked above.

        You have far more in common with the person you’re pushing back on than the author of the rant.

        AI is a civilizational infrastructure for work, education, science, software, creativity, public services, and national capacity.

        • LesserAbe@lemmy.worldEnglish
          6 hours

          I bet me and the person I’m responding to have a ton in common. Likewise me and the person who wrote that post. But I don’t relate to the position of “all AI should stop.”

          I think there should be democratically accountable AI development. I’m interested in open source but the problem with it is that private corporations take advantage of it until they get big enough to try to lock out competitors. (See Google with Android) I would love to see an “open source” license which allows use by individuals and democratic entities, but forbids use by private enterprise.

    • teft@piefed.socialEnglish
      9 hours

      game theory, my friend. You can’t stop if there’s a chance someone else is building it. The only way to prevent this would be some sort of AI proliferation treaty like we have for nukes but nukes you test by making large explosions which are easy to detect. How are you going to detect some state backed group in a bunker somewhere disconnected from the internet developing a super AI? I’m fully against ai but the cat is already out of the bag.

  • shortwavesurfer@lemmy.zipEnglish
    13 hours

    Ollama.com

    Install it and then “ollama run olmo-3:7b” gets you a local AI. If you want to run a smarter AI, then you’re going to need a bigger parameter model, which is going to take more hardware to run.

      • shortwavesurfer@lemmy.zipEnglish
        9 hours

        Not the big ones, no. But I think almost everybody can run one with seven billion parameters.

        • mabeledo@lemmy.worldEnglish
          9 hours

          Considering that the vast majority of PCs in the world have 8GB of RAM at most, I still doubt it.

              • ZephyrXero@lemmy.world
                English
                5 hours

                I got Qwen 3.5:9b running on my 8GB GPU the other day, and it still has some room left over

                • mabeledo@lemmy.worldEnglish
                  4 hours

                  I was talking about combined system RAM. People often overestimate what the average system specs are.

    • jerakor@startrek.websiteEnglish
      6 hours

      You can run AI without causing environmental problems just like you can drive cars without burning fossil fuels and you can have industrial production without creating pollutants.

      All of that just cuts into the profits though.

  • Miller@lemmy.worldEnglish
    14 hours

    It depends what the game is, and I don’t think the people that think they know what the game is know what the game is. They believe they are ushering in something that will set them apart from the general population but which in fact will probably not view them as anything of more value than the rest of us.