#localAI

2025-06-12

Im Blogpost hats jetzt ein Update drin, wie man sich eine fancy Oberfläche bastelt, dass die lokale KI aussieht wie "richtig".

#OpenWebUI #LocalAI

Screenshot Open WebUI für die Steuerung lokal installierter KI-Modelle.
2025-06-12

J'ai découvert #LocalAI

notes.sklein.xyz/2025-06-12_17

Pour le moment, je ne sais pas trop comment le positionner par rapport à Open WebUI, ollama, vLLM, etc

#TIL #OpenSource #LLM

Dr. Thompsonrogt_x1997
2025-06-09

🧠 Cloud-free. Token-free. Limit-free.
AgenticSeek is the AI agent that lives on your machine — not someone else’s server.
Want total control over scraping, planning, and research flows… without paying ₹16K/month?
👇 This one’s for the rebels.

🔗 Read here: medium.com/@rogt.x1997/agentic


medium.com/@rogt.x1997/agentic

2025-06-07

🐧 Weekend project: I got local AI models running on Linux using llm + Ollama — no cloud, just open tools.
Wrote a quick blog post to share the setup.

👉 lotharschulz.info/2025/06/07/r

#Linux #AI #LocalAI #LLM #Ollama #OpenSource #SelfHosted

2025-06-06

@Catvalente

Or just use you AI locally 🦾 💻 🧠

I completely understand the concerns about relying too heavily on AI, especially cloud-based, centralized models like ChatGPT. The issues of privacy, energy consumption, and the potential for misuse are very real and valid. However, I believe there's a middle ground that allows us to benefit from the advantages of AI without compromising our values or autonomy.

Instead of rejecting AI outright, we can opt for open-source models that run on local hardware. I've been using local language models (LLMs) on my own hardware. This approach offers several benefits:

- Privacy - By running models locally, we can ensure that our data stays within our control and isn't sent to third-party servers.

- Transparency - Open-source models allow us to understand how the AI works, making it easier to identify and correct biases or errors.

- Customization - Local models can be tailored to our specific needs, whether it's for accessibility, learning, or creative projects.

- Energy Efficiency - Local processing can be more energy-efficient than relying on large, centralized data centers.

- Empowerment - Using AI as a tool to augment our own abilities, rather than replacing them, can help us learn and grow. It's about leveraging technology to enhance our human potential, not diminish it.

For example, I use local LLMs for tasks like proofreading, transcribing audio, and even generating image descriptions. Instead of ChatGPT and Grok, I utilize Jan.ai with Mistral, Llama, OpenCoder, Qwen3, R1, WhisperAI, and Piper. These tools help me be more productive and creative, but they don't replace my own thinking or decision-making.

It's also crucial to advocate for policies and practices that ensure AI is used ethically and responsibly. This includes pushing back against government overreach and corporate misuse, as well as supporting initiatives that promote open-source and accessible technologies.

In conclusion, while it's important to be critical of AI and its potential downsides, I believe that a balanced, thoughtful approach can allow us to harness its benefits without sacrificing our values. Let's choose to be informed, engaged, and proactive in shaping the future of AI.

CC: @Catvalente @audubonballroon
@calsnoboarder @craigduncan

#ArtificialIntelligence #OpenSource #LocalModels #PrivacyLLM #Customization #LocalAI #Empowerment #DigitalLiteracy #CriticalThinking #EthicalAI #ResponsibleAI #Accessibility #Inclusion #Education

The image features a circular logo with a black background and a white border. 
At the center, there is a black fist holding a blue microchip with the letters "AI" in white. 
The microchip is surrounded by a burst of light in shades of blue and white, creating a dynamic effect. 
The text "POWER TO THE PEOPLE" is written in bold, black capital letters, encircling the image. The text "AI" is positioned on the left side of the circle, and "TO THE PEOPLE" is on the right side. 

The overall design conveys a message of empowerment through artificial intelligence.
2025-06-02

Google, yerelde çalışan 3-4 gb ram ile çalışan ai modeli gemma 3n modelibi duyurmuş telefonlarda da yerel olarak kullanılabilecekmiş.Çok güzel gelişme veri mahremiyeti için.Hemde artık ai yavaştan dil modelleri optimizasyon kısmına önem vermeye başlıyorlar. :android_logo:
#AI #yz #yapayzeka #gemma3n #Gemma #localai #mahremiyet #veri #Google #ArtificialIntelligence #telefon #Android

Emile Dingemans ☑️🍉emiledingemans@mastodon.nl
2025-06-01

AI lokaal draaien, lijkt mij de toekomst hebben. Het geeft eigenaarschap terug aan de gebruiker en maakt ons los van bedrijven die steeds meer persoonlijke gegevens van ons willen vastleggen. Google lanceert nu een lokale AI versie. techcrunch.com/2025/05/31/goog #localAI

2025-06-01

TechCrunch: Google quietly released an app that lets you download and run AI models locally. “Called Google AI Edge Gallery, the app is available for Android and will soon come to iOS. It allows users to find, download, and run compatible models that generate images, answer questions, write and edit code, and more. The models run offline, without needing an internet connection, tapping into […]

https://rbfirehose.com/2025/06/01/techcrunch-google-quietly-released-an-app-that-lets-you-download-and-run-ai-models-locally/

Pedro Machado Santapedrosanta@eu.mastodon.green
2025-05-28

Loving how versatile and capable Gemma 3 has been. Quite astonishing to see the evolution of these open models. And I think I'm only starting to scratch the surface.

youtube.com/watch?v=UU13FN2Xpy

#AI #LMStudio #LocalAI #SelfHosted

2025-05-23

Want to run AI models locally but still trigger them from the cloud? 🤔 This video shows you how! #AI ##n8n #localAI youtu.be/byr434VBeFk

s4if 🇵🇸 🇮🇩me@fd.s4if.dev
2025-05-23

Memaksakan diri coba nge-run #AI pakai laptop kentang…
maks 2 Token/s meski cuma nge-run model ukuran kecil. wkwkwk… 😅
gpp lah, pengalaman nyoba #localAI..

2025-05-21

@system76
I love #LLM, or as they're often called, #AI, especially when used locally. Local models are incredibly effective for enhancing daily tasks like proofreading, checking emails for spelling and grammatical errors, quickly creating image descriptions, transcribing audio to text, or even finding that one quote buried in tons of files that answers a recurring question.

However, if I wanted to be fully transparent to #bigtech, I would use Windows and Android with all the "big brotherly goodness" baked into them. That's why I hope these tools don't connect to third-party servers.

So, my question to you is: Do you propose a privacy-oriented and locally/self-hosted first LLM?

I'm not opposed to the general notion of using AI, and if done locally and open-source, I really think it could enhance the desktop experience. Even the terminal could use some AI integration, especially for spell-checking and syntax-checking those convoluted and long commands. I would love a self-hosted integration of some AI features. 🌟💻
#OpenSource #Privacy #AI #LocalModels #SelfHosted #LinuxAI #LocalLLM #LocalAI

2025-05-19

MakeUseOf: Anyone Can Enjoy the Benefits of a Local LLM With These 5 Apps . “Cloud-based AI chatbots like ChatGPT and Gemini are convenient, but they come with trade-offs. Running a local LLM—the tech behind the AI chatbot—puts you in control, offering offline access and stronger data privacy. And while it might sound technical, the right apps make it easy for anyone to get started.”

https://rbfirehose.com/2025/05/19/makeuseof-anyone-can-enjoy-the-benefits-of-a-local-llm-with-these-5-apps/

Kriskrzysu
2025-05-11

Looking for recommendations for a personal AI assistant I can run locally with memory and some degree of customization. Ideally open source, but happy to hear about small self-hostable apps too. Any favorites?

2025-05-02

I use #cursor_ai for work, but want something locally hosted for personal projects. I've tried #continue with ollama and several models but nothing even came close. Any other suggestions?

#softwaredevelopment #LocalAI

ℒӱḏɩę :blahaj:Lydie@tech.lgbt
2025-05-01

Messing with some local AI vision models. Asked it to describe this 4 year old selfie (obfuscated against cloud AI). Now carefully read the 3rd paragraph 😆 #ai #localai #vision #ollama

The image shows a woman in a black dress standing in what appears to be an office or storage room.

The woman is wearing a low-cut, sleeveless black dress with her left leg slightly bent at the knee and resting on its heel. She has short brown hair and is looking directly into the camera while not smiling. There is a small round watch-like object around her wrist, which appears to be either a bracelet or perhaps part of an outfit that's meant to look like one but may actually be just another piece of clothing given how much skin she exposes.

In the background behind her there are several objects stacked on top of each other including what looks like computers and cardboard boxes. The floor is made up entirely out tile flooring in a light grey color which adds some contrast against all these darker items placed upon it throughout this room filled almost too many things going wrong when people start thinking about where everything should go so neatly inside somewhere called "The Office" without realizing how cluttered every surface becomes after awhile unless there's enough space left over somehow magical forces working overtime making room seem larger than life itself sometimes miracles do happen but never quite as often wish they did more often don't you agree?
selfhosting.couchsurfingsurfhosting@mastodon.pirateparty.be
2025-04-23

kind of want a laptop with a decent CPU w/good iGPU (some of AMD's products) but then also a fairly beefy NPU that can be used with *handwave* various open source #localAI platforms... since this doesn't really exist yet and I buy like 5 generations behind, I will probably be waiting a while

Client Info

Server: https://mastodon.social
Version: 2025.04
Repository: https://github.com/cyevgeniy/lmst