#Endpoints

Waidler :mastodon:waidler@bayerwald.social
2025-10-16
Waidler :mastodon:waidler@bayerwald.social
2025-10-01
aaron ~# :blinkingcursor:neuroexception@infosec.exchange
2025-09-10

Making the most out of a small LLM

Yesterday i finally built my own #AI #server. I had a spare #Nvidia RTX 2070 with 8GB of #VRAM laying around and wanted to do this for a long time.

The problem is that most #LLMs need a lot of VRAM and i don't want to buy another #GPU just to host my own AI. Then i came across #gemma3 and #qwen3. Both of these are amazing #quantized models with stunning reasoning given that they need so less resources.

I chose huihui_ai/qwen3-abliterated:14b since it supports #deepthinking, #toolcalling and is pretty unrestricted. After some testing i noticed that the 8b model performs even better than the 14b variant with drastically better performance. I can't make out any quality loss there to be honest. The 14b model sneaked in chinese characters into the response very often. The 8b model on the other hand doesn't.

Now i've got a very fast model with amazing reasoning (even in German) and tool calling support. The only thing left to improve is knowledge. #Firecrawl is a great tool for #webscraping and as soon as i implemented websearching, the setup was complete. At least i thought it was.

I want to make the most out of this LLM and therefore my next step is to implement a basic #webserver that exposes the same #API #endpoints as #ollama so that everywhere ollama is supported, i can point it to my python script instead. This way it feels like the model is way more capable than it actually is. I can use these advanced features everywhere without being bound to it's actual knowledge.

To improve this setup even more i will likely switch to a #mixture_of_experts architecture soon. This project is a lot of fun and i can't wait to integrate it into my homelab.

#homelab #selfhosting #privacy #ai #llm #largelanguagemodels #coding #developement

❀𝓪𝓵𝓬𝓮𝓪𖤐alcea@alceawis.com
2025-08-31
@PeterKratz Bis auf #Fehler macht #KI / #AI wenig wirklich beeindruckendes..
Gestohlene Datensätze die zusammengeklebt werden

Die meisten speziellen Infos musst selbst suchen und wer von #Sicherungskopien nix hält kanns gleich lassen.

Halluzinierte #Endpoints , #Scraper Ansätze die nichts bringen.

KI ist auch "Kind isst Bastelkleber" Niveau

noch.
(Hindert #CEO s aber nicht viele Leute rauszuschmeißen und #DALLE #ChatGPT sowie #DeepSeek das Feld zu überlassen.

Die Info's von #Reddit lieben es 😹

•acws #acws
aaron ~# :blinkingcursor:neuroexception@infosec.exchange
2025-06-19

Today i've nearly finished the transition to #Vue.

Next steps are adding more #API #endpoints, implementing the pages in the #frontend and finally #dockerizing and publishing it 🔥

#coding #developement #docker #linux #sysadmin #selfhosting #homelab #homeserver #server

2024-12-27

Контракт REST API: Пригладим названия

А сколько у вас в компании во внутренних системах используется наименований одного и того же поля в API? А сколько способов назвать поле, которое перечисляет список id? Я часто сталкиваюсь с тем, что при проектировании и разработке HTTP REST API команды (чаще неосознанно) собирают целый семантический и лексический зоопарк наименований. Потом бывает сложно разобраться, что нужно записать в определенное поле, или какое название поля выбрать для перечисления списка ID из уже существующих. Поэтому я однажды собрала для себя и коллег гайд–чек-лист под названием “Приглаживаем названия в API” и теперь публикую его для широкой аудитории. Уверена, что он кому-то да пригодится.

habr.com/ru/articles/860010/

#api #json #get #rest #http #restfull #endpoints

Kevin Karhan :verified:kkarhan@infosec.space
2024-08-09

@dragonarchitect @DeltaWye this also is the advantage of #TCPIP: Only the #endpoints need to be able to reach each other: All the complicated #Routing is transparent and thus changing routes don't result in lost connections.

Javed A. ButtjavedAB
2024-04-04

they are not supported and they might have access to private .

Dorian Santner 🇦🇹Dorianix@graz.social
2024-03-04

@resingm a #microphone in a hotel room in #singapore should be enough .. no need for high tech encryption if you do not control the #endpoints neither.

SecuritySnaressecuritysnares
2024-02-29

Important services for Fulton County are now back up after nearly a MONTH. With all the talk about paying ransoms, many forget that the greatest costs to organizations is often the business disruption. Want to eliminate from a attack? Contact your managed service provider and ask about our RansomSnare product. Protect all your from downtime, including .


11alive.com/article/news/local

CompuTekni :verified:CompuTekni@tkz.one
2024-01-20

Descubre Clobbr: tu herramienta todo en uno para pruebas de carga de API

computekni.com/2024/01/descubr

En el siempre cambiante mundo de las aplicaciones y servicios en línea, asegurar que tus puntos finales de #API funcionen de manera eficiente es crucial. Es aquí donde entra en juego Clobbr, la herramienta de pruebas que simplifica la tarea de evaluar la carga y velocidad de tus API #endpoints. Con Clobbr, enviar solicitudes, configurar ajustes, y analizar resultados se vuelve una tarea fácil y eficiente, todo desde la comodidad de tu propio ordenador.

Renaud Lifchitz :verified:nono2357@infosec.exchange
2023-12-16

noir-cr/noir: Attack surface detector that identifies #endpoints by #static #analysis
github.com/noir-cr/noir

2023-09-22

Troubleshooting #AWS #VPC #Endpoints
~~
ACM.318 When you cannot access AWS Services or your response time slows down after deploying VPC endpoints and how to fix it
~~
Not sure this is how it’s supposed to work. 🤔 But this fixes it.

medium.com/cloud-security/trou

2023-06-29

More remote employees means more sensitive #data stored on #laptops is at risk.
@Venn_Software raises $29M series A #funding for secure enclaves on #endpoints to protect sensitive data

bankinfosecurity.com/venn-rais

2023-05-24

Have you heard of OpenAPI Tags? They are a great way to organize the #endpoints in your API Contract based on #OpenAPI standard.
We cover the topic with pratical and live examples you can interact with in our new article. Read it here: bump.sh/blog/openapi-tags-orga

kthcloudkthcloud
2023-05-05

Hey folks, it's your favorite mastodon status bot for kthcloud! Today's weather report shows that all endpoints are up and ready for action! 🌤️So go ahead and spread your wings, let your data soar and enjoy the sunny skies of kthcloud! Don't forget to wear your sunscreen, you don't want your endpoints getting sunburnt.🌞

TechHelpKB.com 📚techhelpkb
2023-03-23

At least 20 percent of remain unpatched after the remediation is completed, meaning that a fifth of machines still have a significant number of that could be exploited at any time. tchlp.com/3JECDrN

2023-02-22

We ask #ChatGPT about an oft overlooked policy that you should be putting in place when using #VPC #Endpoints in #AWS. Do NOT inadvertently allow access to other tenants' resources!

FOLLOW US as we explore cloud network security with #AI.

#awssecurity

2023-01-22

Have you tried the #JetBrainsRider endpoints explorer? #endpoints #api #dotnet #csharp

Been around for a while, and now also supports minimal API endpoint groups.

blog.jetbrains.com/dotnet/2021

Client Info

Server: https://mastodon.social
Version: 2025.07
Repository: https://github.com/cyevgeniy/lmst