Lmst

Shoutout to @nushell for providing no-hassle parallelisation. I had a simple script which formats my Latex files like this:
```
def main [] {
let files = ls latex/**/*.tex | get name;
$files | each { |file|
let abs_path = $file | path expand;
latexindent --silent $abs_path --output $abs_path;
} | ignore;
}
```
which takes ~2 minutes to go through all my files. I just changed the `each` to `par-each` and voila! It got under 20 seconds!

#scripting #parallelism

https://kitfucoda.medium.com/concurrency-vs-parallelism-achieving-scalability-with-processpoolexecutor-c366bfcc6207

Concurrency and parallelism are often confused in async programming discussions. Go's goroutines highlighted the difference: concurrency is doing many things at once, while parallelism is doing many things at the same time.

AsyncIO handles concurrency well for I/O, but CPU-bound tasks need parallelism. Python uses AsyncIO for concurrency, and ProcessPoolExecutor for parallelism, distributing work across CPU cores.

Process communication is harder than thread communication. AsyncIO's task cancellation differs from ProcessPoolExecutor's, requiring workarounds like event objects for reliable cancellation and shutdown.

Essentially, ProcessPoolExecutor enables parallelism for CPU-bound tasks, scaling them across multiple cores, while AsyncIO handles I/O concurrently.

#python #asyncio #concurrency #parallelism #multiprocessing #opentowork #getfedihired #fedihire #opentowork

C++Now 2025 SESSION ANNOUNCEMENT: Parallel Range Algorithms - The Evolution of Parallelism in C++ by Ruslan Arutyunyan

https://schedule.cppnow.org/session/2025/parallel-range-algorithms/

Register now at https://cppnow.org/registration/

#algorithms #cplusplus #cpp26 #parallelism

🏃‍♀️ High-performance computing, with much less code

(... back in my business development days I was interested in "rules and schemes" that would separate what is to be done with how it should be done)

https://news.mit.edu/2025/high-performance-computing-with-much-less-code-0313

#computing #software #programming #languages #hpc #parallelism

Recently, in our English Lang Club, we dived into Concurrency & Parallelism in Go.

We wrote a program to send concurrent HTTP requests, ensuring proper synchronization with WaitGroup.

Sharpen your tech skills & English—join us next time! 🚀

#golang #concurrency #parallelism #programming

C++Now 2025 SESSION ANNOUNCEMENT: Parallel Range Algorithms - The Evolution of Parallelism in C++ by Ruslan Arutyunyan

https://schedule.cppnow.org/session/2025/parallel-range-algorithms/

Register now at https://cppnow.org/registration/

#algorithms #cplusplus #cpp26 #parallelism

Speeding Up Computational Lithography with the Power and Parallelism of GPUs — https://semiengineering.com/speeding-up-computational-lithography-with-the-power-and-parallelism-of-gpus/
#HackerNews #ComputationalLithography #GPUs #Parallelism #TechInnovation #Semiconductor

DeepSeek Open Source Optimized Parallelism Strategies, 3 repos — https://github.com/deepseek-ai/profile-data
#HackerNews #DeepSeek #Open #Source #Optimized #Parallelism #Strategies #3 #repos #"DeepSeek" #"OpenSource" #"Parallelism" #"AI" #"GitHub"

DualPipe: An innovative bidirectional pipeline parallelism algorithm — https://github.com/deepseek-ai/DualPipe
#HackerNews #DualPipe #Bidirectional #Pipeline #Parallelism #Algorithm #Innovation #Technology #AI

Параллелизм в Go тестах: все, что нужно знать о -p, -parallel и t.Parallel()

В Go есть три способа управления параллельностью тестов: Короткий гайд о -p , -parallel и t.Parallel а также бонус для любителей параллельного программирования

https://habr.com/ru/articles/882222/

#go #golang #testing #concurrency #parallelism #neva #nevalang #programming_languages #visual_programming #compiler

How to scale your model: A systems view of LLMs on TPUs
https://jax-ml.github.io/scaling-book/
#ycombinator #scaling #jax #llms #transformers #tpus #google #deepmind #parallelism #pallas

How to Scale Your Model: A Systems View of LLMs on TPUs
https://jax-ml.github.io/scaling-book/
#ycombinator #scaling #jax #llms #transformers #tpus #google #deepmind #parallelism #pallas

Распределённое обучение нейронных сетей. Часть I

Многие из успехов в глубинном обучении достигнуты отчасти благодаря тому, что разработчики, говоря простым языком, взяли модели побольше и натренировали их на огромных объёмах данных. Однако, чтобы прогнать эти самые огромные объёмы данных через модель, нужно либо очень много времени, либо каким-то образом распределить работу на много вычислительных узлов - сделать обучение параллельным. Я видел на Хабре пару статей на эту тему, но дерзну попробовать написать ещё одну. Добавить кое-каких деталей, а что-то, что уже было, надеюсь, получится объяснить попроще. Поехали!

https://habr.com/ru/companies/itfb/articles/858794/

#глубинное_обучение #ии #искусственный_интеллект #параллелизм #parallelism #ai #deep_learning

#NikkiSiapno uses the incredible GIF image (https://lnkd.in/gT2Q9Wyq) to pertinently and vividly describe what's the potential and essential differences between CONCURRENCY and PARALLELISM … I've just decorated it to become a fabulous MP4 file, which has been integrated the special effects and melodious music … 😉

#Concept #SystemDesign #Concurrency #Parallelism #Difference

I used to love #Python, but dealing with the honestly kind of scary #multiprocessing library was a reminder of the #GIL #threading situation really hurts working with #parallelism. 😰🫠

I've started learning #Kotlin after honestly really enjoying the threading library it provides. It's so's easy to work with when you understand it! 😀 (I would prefer to stay away from some of the #Java conventions after working with them for so long. 👍) #JVM #programming
♲ f.kawa-kun.com/display/881761a…