Эффективный инференс множества LoRA адаптеров

LoRA — популярный метод дообучения больших моделей на небольших датасетах, однако на этапе инференса низкоранговые адаптеры работают неэффективно, а их объединение с весами требует хранения отдельной полной копии модели для каждого адаптера. MultiLoRA решает эту проблему, позволяя одновременно выполнять инференс с несколькими адаптерами на основе одной базовой модели. В статье мы сравним производительность MultiLoRA-инференса в двух популярных фреймворках — vLLM и TensorRT-LLM . Тесты проведём на готовых релизных Docker-образах, оценивая, какой фреймворк эффективнее обрабатывает батчи запросов в сценариях, близких к офлайн и асинхронному инференсу.

https://habr.com/ru/articles/922290/

#multilora #offline_inference #async_inference #vllm #TensorRTLLM #tensorrt #peft #inference #benchmark #lora

Hmm, I wonder what kind of cable I need to connect this other #antenna to my #Heltec #LoRa board. I know a lot about computer cables and interfaces, but I know nothing about antennas. Yet!

#radio #hamradio #amateurradio

My evaluation of resilient and disturbed means of communication started today #meshnetworks. I received my #LoRa radio board and installed #meshcore. No contact to other nodes yet, but I’m also not sure what to expect. Let’s see how it goes…
The next step will be #reticulum, but it looks too advanced to be a good starting point for me.

#emergencypreparedness #disasterpreparedness #disasterrelief #solarpunk

≪ Eine kleine Rundtour mit Reichweitentest ≫

Nach der heutigen kleinen Rundtour konnte ich wieder einige Reichweiten-Markierungen hinzufügen. Die roten Markierungen auf dem Screenshot entsprechen den neu hinzugekommenen grün / schwarzen Reichweiten-Markierungen des 2. MeshCore Repeaters SN-R2 auf unserer Karte.

🔗 https://umap.openstreetmap.de/de/map/meshcore-in-schwerin-und-umgebung_88945#13/53.6069/11.4277

#Rad #Bike #Fahrrad #Radtour #Repeater #Messenger #Kommunikation #Notfallkommunikation #MeshCore #Mesh #LoRa #Schwerin #MV

@tomjennings @mhoye Grab a few #meshtastic nodes, find out what settings your local mesh is using, and have a play. In any major city you're likely to have a decent population of nodes within signal range.

I recently started dabbling. I got a pair of Heltec V3s for very cheap. I have one on my roof with a solar panel, and one inside the house connected to my wifi.

There are 100 active nodes in my city of 2.2 million people, FWIW.

#lora

🎙️ In the Network Ep. 2 is live!

We sat down with Eric Pan, founder and CEO of Seeed Studio, to dive into Seeed’s roots in the maker community, their early support of open source hardware, and how they became involved with Meshtastic. 

Watch now: https://youtu.be/S-8zRmyo1dY

#Meshtastic #SeeedStudio #LoRa #OpenHardware

Looking to see if anybody on Masterdong is using Reticulum at all? I've been using Meshtastic but wondering whether to keep going with that and perhpas just go all in with Reticulum. I use LoRa but I also use portable analog and digital radio. Would be interested in learning how I can use digital radio (DMR) with Reticulum. #Reticulum #Meshtastic #LoRa #DMR

The new, fast. and furious LoRa APRS Tracker firmware.
Tracker best features:
- Multi QRG transmit (ideal for ham baloons) EU/SP/GB/CUSTOM
- Telemetry
- TCP TNC server
- Classic and BLE bluetooth TNC
- On Air remote upgrade (download and install a new firmware from the dev. server)
- many more, it's a really speedy firmware.
- Simple Digi function (for a field digi)
Flash it online (chrome and edge support) https://flasher.sq2cpa.pl
#hamradio #lora #aprs #amateurradio

Vanavond bij @HSN de #lora @meshtastic node verder inrichten.

https://hackerspacenijmegen.nl/Projects:Meshtastic

Hoe mooi zou het zijn als alle #hackerspaces in Nederland via lora met elkaar verbonden zouden zijn? Is er al een NLHackerspace kanaal?

@revspace @hack42
@hackalot
@tkkrlab
@bitlair
@nurdspace
@pixelbar
@spaceleiden
@TDvenlo
@hackerhotel

#nijmegen #meshtastic

Falls jemand fragt: MeshCore auf SF11 kann 63 Hops in 2 Minuten und 3 Sekunden ausführen :mastorofl:

Quelle: https://discord.com/channels/826570251612323860/1330643963501351004/1386337622913323098

#Messenger #Kommunikation #Notfallkommunikation #MeshCore #Mesh #LoRa

Obwohl das Arbeiten (Löten) an diesen FakeTec Nodes für mich eine Herausforderung ist, habe ich noch 5 weitere Nrf52840 Boards und 5 HT-RA62 SX1262 LoRa Module bestellt.

Nach meinen gestrigen Tests (neu Flashen des Bootloaders etc.) bin ich zu dem Entschluss gekommen, dass diese sich gut zum Bau sehr kostengünstiger (Solar) Repeater eigenen würden.
Die Kleinteile (SMD Widerstände, Taster) sind hier ja ohnehin vorhanden, und auch das FakeTec PCB (die Leiterplatte) habe ich dank bereits vorhandenen Gerber-Datei gleich 10 Mal anfertigen lassen (Stück in etwa 0,80 EUR), und so kostet die oben genannte Kombination jeweils nur rund 10 EUR.

Natürlich kommen noch die Kosten für eine Antenne, einem Gehäuse, einem Akku und vielleicht auch einem Solarmodul und anderen Kleinteilen hinzu, aber alles in allem ist dies eine Lösung für den Aufbau eines MeshCore-Netzes hier in Schwerin und Umgebung, in einer durchaus akzeptablen Preiskategorie.

#Messenger #Kommunikation #Notfallkommunikation #MeshCore #Mesh #LoRa #FakeTec #ProMicro #SMD #photography #fotografie #foto #photo #postprocessed #myphoto #mywork #ownwork

New on Lectronz: MeshSenger - Meshtastic Keyboard for Heltec T114 https://lectronz.com/products/meshsenger-meshtastic-keyboard-for-heltec-t114
#Lora #NordicNrfxxxx

This is such a cool resource on utilizing #LoRa #meshtastic (would #meshcore work too?) based Internet Resilience Clubs.

https://bowshock.nl/irc/

Next to the illustrated use case of having a resilient channel between network experts, I’m thinking about establishing resilient communication in a #solarpunk way. So local IRCs, intra-connecting a local community as the foundation. But inter-connecting those communities with each other on top of that.
Would that work?

#emergencycomms

≪ Aus 10 mach 1 ≫

Für meine “poor old eyes” absolut grenzwertig 🔍 👓 🔎

🔗 https://meshcore-de.net/meshcore-handbuch/lora_hardware/promicro-sx1262/

#Messenger #Kommunikation #Notfallkommunikation #MeshCore #Mesh #LoRa #FakeTec #ProMicro #SMD #photography #fotografie #foto #photo #postprocessed #myphoto #mywork #ownwork

Annnd my lora dev box is deployed on the roof 📡

#devhack #meshcore #lora #radio

#Goals2025

Moving away from the constant upgrade cycle & moving closer to the ideals of #PermaComputing #MalleableSoftware

Design and setup a redundant system of old/used, cheap, low-power devices running ia: #Guix, #Linux, #FreeBSD, #macOS, #HaikuOS, #Plan9Front, #X11, #P9, #NFS, all working together

Become an expert on #MicroControllers #ESP32 #STM32 #RP2040 #MIPS #RiscV

DIY sensors which sing like birds to communicate their status

DIY robots "drones"

Move as much as possible of my computing needs to the #Terminal, #Emacs, #Rio #CLI #TUI #P9

Get an #3DPrinter and learn to use it

Design and build my own portable 8dot #braille terminal & try out if 3x3 or 3x4 dots is also workable.

Design and build my own low-power computers, their OS, and tools

Writing more of my own tools #DIY

#SmallTalk #ObjectPascal #Prolog #Scheme #Racket #CommonLisp #Haskell #Rust #Go #ObjectiveC #Swift

Deploy #LoRa #ReticullumNetwork #RNodes #MeshCore #Meshtastic

Start an #InternetResiliencyClub

Add #Tor, #I2P support by #WebProxy

#SolarPowered #SelfHost over #I2P, #OnionService #Blog #Wiki #Repositories #GopherHole #Darcs #Mercurial

#SelfHost my own #EmailServer, which will only accept email from #KnownServers #CommunityEmail #MutualEmailAcceptance

Share files via #BitTorrent over #I2P

DIY #HomeAutomation
DIY #GardeningAutomation
DIY #GreenHouse

Get a house cat, train the cat, use voice and gestures

Start asking money for advice & technology support

Build/program my own opportunistic and strange cryptocurrency miners #BTC, #XMR, #ZEC, etc #Art

#MakeMoreArt #LearnToDraw #Learn3DModeling #LearnGenerativeArt #LearnToComposeAmbientMusic

#ReCreateJottit #ReCreateInstikiWiki

#WriteMore #PublishMore #Letters, #Essays, #Missives, #Reports, #Treatise

…

#Incomplete #Ongoing #NotFinal

Will mal kund tun, dass ich jetzt stolzer Eigentümer eines Lilygo T-Deck Plus bin.
https://lilygo.cc/products/t-deck-plus-meshtastic?variant=45315795910837

#Meshtastic #Lora

≪ Eine kleine Rundtour mit Reichweitentest ≫

Nach der heutigen kleinen Rundtour konnte ich wieder einige Reichweiten-Markierungen hinzufügen. Die neuen roten Markierungen auf dem Screenshot entsprechen den grün / schwarzen Reichweiten-Markierungen des MeshCore Repeaters SN-R2 auf unserer Karte.

🔗 https://umap.openstreetmap.de/de/map/meshcore-in-schwerin-und-umgebung_88945#13/53.6069/11.4277

#Rad #Bike #Fahrrad #Radtour #Repeater #Messenger #Kommunikation #Notfallkommunikation #MeshCore #Mesh #LoRa #Schwerin #MV