Lmst

Designing type inference for high quality type errors

https://blog.polybdenum.com/2025/02/14/designing-type-inference-for-high-quality-type-errors.html

#HackerNews #Designing #type #inference #for #high #quality #type #errors #typeinference #typeerrors #programming #languages #softwaredevelopment #techblog

'On Consistent Bayesian Inference from Synthetic Data', by Ossi Räisä, Joonas Jälkö, Antti Honkela.

http://jmlr.org/papers/v26/23-1428.html

#bayesian #privacy #inference

“ #Inference is actually quite close to a #theoryofeverything – including #evolution, #consciousness, and #life itself. It is #abduction all the way down.” (The process of abduction may be much more pervasive than the relatively rare use of the word “abduction” would suggest) aeon.co/essays/consc...

Consciousness is not a thing, ...

LLM-D: Kubernetes-Native Distributed Inference at Scale

https://github.com/llm-d/llm-d

#HackerNews #LLM-D #Kubernetes #Distributed #Inference #Scale #MachineLearning

inference, not training, represents an increasing majority of #AI’s energy demands and will continue to do so in the near future. It’s now estimated that 80–90% of computing power for AI is used for #inference https://www.technologyreview.com/2025/05/20/1116327/ai-energy-usage-climate-footprint-big-tech/

🎉 Behold! The #llmd #community emerges from the depths of the #tech abyss, promising the holy grail of Kubernetes-native distributed #LLM #inference. 🤖 Because who doesn't want their #AI #deployments served with extra buzzwords and a side of "competitive performance per dollar"? 🍽️
https://llm-d.ai/blog/llm-d-announce #Kubernetes #news #HackerNews #ngated

#statstab #346 Jeffreys-Lindley paradox

Thoughts: I like this short explanation of the "paradox" of why frequentist and bayesian inference can differ.

#paradox #frequentist #bayesian #inference #bayesfactor #pvalue #explanation

https://michael-franke.github.io/intro-data-analysis/jeffreys-lindley-paradox.html

New DFloat11 Technique Offers 30% Lossless Compression for LLMs, Easing Hardware Demands

#AI #AIResearch #DFloat11 #LLMs #LLMcompression #MachineLearning #DeepLearning #BF16 #Inference #RiceUniversity #xMADai

https://winbuzzer.com/2025/04/27/new-dfloat11-technique-offers-30-lossless-compression-for-llms-easing-hardware-demands-xcxwbn/

Как запустить локально LLM, если ее веса не помещаются в [видео]память

Некоторые люди предпочитают пользоваться не только облачными сервисами, но и запускать LLM у себя дома. Например, так можно запустить дообученные модели без цензуры, или не посылать в облако свои личные документы. А то и запускать бесчеловечные эксперименты над LLM так, чтобы superintelligence/skynet потом это не припомнил. Есть много моделей, оптимизированых для быстрой работы на устройствах с небольшой памятью. Но к сожалению, веса самых продвинутых моделей, которые играют в одной лиге с лучшими онлайн моделями, занимают сотни гигабайт. Например, 8-битные веса Deepseek R1-671B занимают 700 гигабайт, квантованые q4 — 350 гигов. Можно квантовать и в 1 бит, размер тогда будет около 90 гигов, но такая модель почти бесполезна. Еще есть много качественных finetunes на основе Mistral-Large-instruct-130B, Qwen2.5-72B, llama3.3-70B, веса которых также не помещаются в память старших моделей видеокарт.

https://habr.com/ru/articles/904172/

#llm #inference #llamacpp #apple

'DAGs as Minimal I-maps for the Induced Models of Causal Bayesian Networks under Conditioning', by Xiangdong Xie, Jiahua Guo, Yi Sun.

http://jmlr.org/papers/v26/23-0002.html

#inference #causal #bayesian

🚀 Local LLM inference: where #ambition meets #reality in a glorious code spaghetti that no sane developer wants to untangle. 🎉 It's like building a rocket 🚀 only to realize you forgot the launchpad—works great in theory but crashes spectacularly in the real world. 🌎🔧
https://medium.com/@aazo11/local-llm-inference-897a06cc17a2 #LocalLLM #Inference #CodeSpaghetti #TechHumor #SoftwareDevelopment #HackerNews #ngated

Local LLM inference – impressive but too hard to work with

https://medium.com/@aazo11/local-llm-inference-897a06cc17a2

#HackerNews #LocalLLM #Inference #LLMChallenges #AIResearch #TechTrends

Day 19 cont 🙏⛪️🕍🕌⛩️🛕 💽🧑‍💻

“The #LiberalParty has accidentally left part of its email provider’s #subscriber details exposed, revealing the types of #data harvested by the party during the #election campaign.

This gives rare #insight into some of the specific kinds of data the party is keeping on voters, including whether they are “predicted Chinese”, “predicted Jewish”, a “strong Liberal” and other #PersonalInformation.”

#AusPol / #DataScience / #inference / #voters / #Liberal / #LNP / #Nationals <https://www.crikey.com.au/2025/04/17/victorian-liberals-data-exposed-email-mailchimp-federal-election-crikey/>

The Path to Open-Sourcing the DeepSeek Inference Engine

https://github.com/deepseek-ai/open-infra-index/tree/main/OpenSourcing_DeepSeek_Inference_Engine

#HackerNews #OpenSourcing #DeepSeek #Inference #Engine #AI #DeepLearning #OpenSource #TechInnovation

Ironwood: The first Google TPU for the age of inference

https://blog.google/products/google-cloud/ironwood-tpu-age-of-inference/

#HackerNews #Ironwood #Google #TPU #inference #AI #technology #cloud

Learn how to optimize LLMs for faster inference and better testing using powerful open source tools — boost performance without breaking the bank with Sho Akiyama & Andre Rusli at #FOSSASIASummit2025

🔗 Click here https://youtu.be/8BJLqJ7_xcc?si=eBL0trVWi6PoUpSm to watch on the FOSSASIA YouTube channel
#LLM #AI #Inference #OpenSourceTools #FOSSASIA

A quotation from Robert Bolt

CROMWELL: Yet is there a man in this court, is there a man in this country, who does not know Sir Thomas More’s opinion of this title? Of course not! But how can that be? Because this silence betokened — nay, this silence was — not silence at all, but most eloquent denial!

MORE: (with some of the academic’s impatience for a shoddy line of reasoning) Not so, Mr. Secretary, the maxim is “qui tacet consentire”: The maxim of the law is: (very carefully) “Silence Gives Consent .” If therefore you wish to construe what my silence “betokened,” you must construe that I consented, not that I denied.

CROMWELL: Is that in fact what the world construes from it? Do you pretend that is what you wish the world to construe from it?

MORE: The world must construe according to its wits. This court must construe according to the law.

Robert Bolt (1924-1995) English dramatist
A Man for All Seasons, play, Act 2 (1960)

Sourcing, notes: wist.info/bolt-robert/76003/

#quote #quotes #quotation #qotd #consent #thomasmore #denial #inference #interpretation #silence