- Mearcfara@lemmy.mlEnglish4 hours
I just wish we could invest the time/money/resources into compressing AI and making it smaller and more efficient. I’d so much rather have a somewhat capable AI that can be run locally and offline, to outsource menial tasks to like alphabetizing spreadsheets and so basic image modification, than to have to upgrade my hardware constantly or use cloud based SaaS and/or have newer models that are more accurate in their predictions.
Of course that assumes a lot of things, like the intent to help people and not make money. Maybe someone in the Linux-sphere will make something.
- petersr@lemmy.worldEnglish1 hour
If I understand correctly, if we actually said “this model is great, let’s put a pin in it”, then it could be turned into a dedicated chip that would be much more efficient and perhaps even something that could get embedded in consumer hardware - but then you are just stuck with that model instead of “the next shiny new model” that they keep making.
- BrightCandle@lemmy.worldEnglish2 hours
I feel like there is a future of more targeted AI. At the moment something that does spreadsheets has to carry knowledge of programming and chemistry and lots of languages and this seems very heavy for what ultimately we need. A programming language focussed AT dedicated to Rust or Go or Java could potentially be quite a bit smaller especially if they focussed on algorithm snippet and auto complete smarts. There is definitely a market for smaller more targeted uses than these all encompassing chat bots where the goal is to move the state of the art on for existing algorithms.
- ZephyrXero@lemmy.worldEnglish2 hours
There are efforts there. The new Deepseek 4 compresses a lot of its knowledge using something they call engrams. But it’s unfortunately still too big for a consumer GPU.
Gemma 4 is small enough to run on your cellphone.
If your GPU has at least 8GB there are a lot of options for self hosting your own local models
- XLE@piefed.socialEnglish5 hours
Did anybody click the link to read the paragraph-long website text? Not only is it packed with assumptions about AI, it’s simply unhinged.
The ability to… run intelligence systems without asking permission is of existential importance.
Existential?! No it’s not.
This mirrors the delusion Sam Altman demonstrated when he insisted nobody could raise a child without AI.
- Nouvellalia@lemmy.worldEnglish2 hours
It is now. If you want it not to be, go ahead and stop all this modern bullshit happening around me.
You can’t yell at people on the ocean that they don’t really need boats, and then attack boats. I mean you can, but it’s foolish and unproductive.
- brianpeiris@lemmy.caEnglish4 hours
The word “intelligence” is doing a lot of heavy lifting here. LLMs lack any mechanism for true logical reasoning, and they always will by nature. This is why they fail at simple questions like “the car wash test”. It’s also why agents are expensive; They just flail around in token hungry “reasoning loops” until they happen to come across a correct solution. And it’s why Claude Opus 4.8 (High) only scores 1.5% on the ARC-AGI-3 benchmark at a cost of $10,000.
This kind of panic is just part of the hype. Wake me up when real intelligence arrives.
- Blaad@europe.pubEnglish6 hours
The Chinese are doing a good job with open source ai models, especially Z. Ai, qwen and minimax, Google also got us something decent with gemma4, but yeah we need commercial AI to fail so we can get affordable access to vram…
- jerakor@startrek.websiteEnglish3 hours
You can run AI without causing environmental problems just like you can drive cars without burning fossil fuels and you can have industrial production without creating pollutants.
All of that just cuts into the profits though.
- 2 hours
the way the technology is run and built is in itself despicable. It is an abomination.
- PushButton@lemmy.worldEnglish12 hours
It’s like people are starting to realize what the “luddites” were saying from the beginning.
This tech is not from the people to the people like the web, it’s from big corpos to fuck you.
You won’t have that tech, you will rent a highly modified one at best, built with the purpose to manipulate you.
Remember: there is a club out there, and you are not part of it.
- mabeledo@lemmy.worldEnglish6 hours
So much this.
If we take a look at how the current AI behemoths got there, there’s a trail that goes straight from stolen data to proprietary models. They are charging their users for the privilege of using better aggregated public data. I hope that, when they raise prices once again and more and more users are cut off their larger models, people would understand where their place is, according to corpos.
- squaresinger@lemmy.worldEnglish11 hours
Yeah, that’s what I really don’t get.
Why would any serious company think it’s a great idea to outsource all your intelligence work to a handfull of US companies, making yourself wholely dependant on their goodwill and the goodwill of the US government?
- WhatAmLemmy@lemmy.worldEnglish6 hours
It’s the same delusion and corruption from a neoliberal corporate-whore political class that led to every country growing dependent on US tech companies, and Chinese manufacturing. They represent corporations; not their constituents.
If they’d all committed to open source and domestic companies for support and infra, the compounding effect of tens of thousands of engineers across governments working on linux and other FLOSS products would have made everything significantly cheaper and more efficient for all of them in a matter of years, compared to paying a foreign tech company for everything in perpetuity… and that’s before you consider the multitude of other risks and vulnerabilities to national security.
6 hoursAs a good example look at the national police in france. They ditched windows for a custom linux distro and are now saving like 10 million or more euros a year. That’s money that used to come from taxpayers to a foreign company and now that money can stay local and help improve the taxpayers lives instead of buying someone a 3rd yacht.
- squaresinger@lemmy.worldEnglish5 hours
I wish all these European Linux projects would pool resources and create one good solution instead of each little country or even city DIYing their own solution.
- LesserAbe@lemmy.worldEnglish7 hours
It’s not going to. Saying all AI should stop is like saying “all gunpowder should stop”. Would everyone be better off if no one was using it? Maybe. But that’s not going to happen at this point, and will give you a strategic disadvantage if you unilaterally disarm.
And to be clear I’m not talking about using AI to write a screenplay or something creative, I mean like using it to write software, to optimize industrial processes etc.
- XLE@piefed.socialEnglish5 hours
“All AI should stop” is a far more reasonable opinion than the one presented by the
websiteblog9-sentence rant linked above.You have far more in common with the person you’re pushing back on than the author of the rant.
AI is a civilizational infrastructure for work, education, science, software, creativity, public services, and national capacity.
- LesserAbe@lemmy.worldEnglish3 hours
I bet me and the person I’m responding to have a ton in common. Likewise me and the person who wrote that post. But I don’t relate to the position of “all AI should stop.”
I think there should be democratically accountable AI development. I’m interested in open source but the problem with it is that private corporations take advantage of it until they get big enough to try to lock out competitors. (See Google with Android) I would love to see an “open source” license which allows use by individuals and democratic entities, but forbids use by private enterprise.
game theory, my friend. You can’t stop if there’s a chance someone else is building it. The only way to prevent this would be some sort of AI proliferation treaty like we have for nukes but nukes you test by making large explosions which are easy to detect. How are you going to detect some state backed group in a bunker somewhere disconnected from the internet developing a super AI? I’m fully against ai but the cat is already out of the bag.
Install it and then “ollama run olmo-3:7b” gets you a local AI. If you want to run a smarter AI, then you’re going to need a bigger parameter model, which is going to take more hardware to run.
Not the big ones, no. But I think almost everybody can run one with seven billion parameters.
- mabeledo@lemmy.worldEnglish5 hours
Considering that the vast majority of PCs in the world have 8GB of RAM at most, I still doubt it.
- ZephyrXero@lemmy.worldEnglish2 hours
I got Qwen 3.5:9b running on my 8GB GPU the other day, and it still has some room left over
- mabeledo@lemmy.worldEnglish1 hour
I was talking about combined system RAM. People often overestimate what the average system specs are.
It depends what the game is, and I don’t think the people that think they know what the game is know what the game is. They believe they are ushering in something that will set them apart from the general population but which in fact will probably not view them as anything of more value than the rest of us.
