#parallelization

Francesco Yoshi Gobbo :linux:frayoshi@qoto.org
2025-11-02

#fura-utils
added #parallelization to the #opus conversion #bash script, and created a #flac conversion one,
you can find them as `fura-2opus` and `fura-2flac`, have fun mass converting! 😉
github.com/FraYoshi/fura-utils

oh, don't forget to install `parallel`, it is now a requirement for this script to work!

2025-08-17

There was something interesting going on on one of my systems:

If a certain function in #Python was called as a separate process with the #multiprocessing library, then the sort_values function of #Pandas would just hang (and therefore the process would never produce the output I was waiting for). Called from the main process was OK.

The solution was to change the sorting algorithm by the `kind="stable"` parameter. Weird.

#ArchLinux #Linux #programming #parallelization

N-gated Hacker Newsngate
2025-07-03

Ah yes, because the world was desperately incomplete without a way to hash a 25-byte string in merely 68 clock cycles. 😴🔧 Meanwhile, the rest of us are still waiting for the riveting sequel where we parallelize the of parallelizing. 🚀💼
controlpaths.com/2025/06/29/pa

Rowan the Selfsamerosylf@c.im
2025-06-21

Link: mediatum.ub.tum.de/?id=601795 (It took digging to find this from the Wikipedia article [1] and the unsecured HTTP homepage for "BMDFM".)

```bibtex
@phdthesis{dissertation,
author = {Pochayevets, Oleksandr},
title = {BMDFM: A Hybrid Dataflow Runtime Parallelization Environment for Shared Memory Multiprocessors},
year = {2006},
school = {Technische Universität München},
pages = {170},
language = {en},
abstract = {To complement existing compiler-optimization methods we propose a programming model and a runtime system called BMDFM (Binary Modular DataFlow Machine), a novel hybrid parallel environment for SMP (Shared Memory Symmetric Multiprocessors), that creates a data-dependence graph and exploits parallelism of user application programs at run time. This thesis describes the design and provides a detailed analysis of BMDFM, which uses a dataflow runtime engine instead of a plain fork-join runtime library, thus providing transparent dataflow semantics on the top virtual machine level. Our hybrid approach eliminates disadvantages of the parallelization at compile-time, the directive based paradigm and the dataflow computational model. BMDFM is portable and is already implemented on a set of available SMP platforms. The transparent dataflow paradigm does not require parallelization and synchronization directives. The BMDFM runtime system shields the end-users from these details.},
keywords = {Parallel computing;Shared memory multiprocessors;Dataflow;Automatic Parallelization},
note = {},
url = {mediatum.ub.tum.de/601795},
}
```

[1]: en.wikipedia.org/wiki/Binary_M

#SMP #Parallelization #Multithreading #DependenceGraph #RunTime #DataFlow #VirtualMachine #VM #ParallelComputing #SharedMemoryMultiprocessors #AutomaticParallelization #CrossPlatform #Virtualization #Configware #Transputer

N-gated Hacker Newsngate
2025-05-28

Ah, yes, because nothing says "cutting-edge tech" like juggling Git worktrees and while your AI coding agent goes "brrr" 🙄. Truly groundbreaking stuff: discovering in 2024 like it's a rare species. 🚀🔧
skeptrune.com/posts/git-worktr

Hacker Newsh4ckernews
2025-05-28
N-gated Hacker Newsngate
2025-05-20

🐲 Oh, look! Someone spent their free time rendering 27,000 and 10,000 lights on a GPU—because that's the absolute pinnacle of , right? 🤖 Just what the world needed: another article about high-performance strategies that only 0.000001% of the population will pretend to understand! 😂
logdahl.net/p/gpu-driven

Paul Grizzaffipgrizzaffi
2024-06-14

I'm excited to be heading back to an in-person conference! QA or the Highway is a week from today. There's still time to join us. Come hear me talk about , , and with our and . If you attend, please come say hi!

qaorthehwy.com/paul-grizzaffi/

Pawel Kozieleckipawel_kozielecki
2024-06-10

👋 Have you considered making your 🛠? This approach has recently become very popular, offering various benefits like efficient work 🏎️, 🧩, superior of 🧠, and stricter adherence to principles 👮‍♂️. Although modularity is hardly a rocket science, it can be more complex to set up. Are there apps that shouldn't use a modular design? Let's find out! Strap in and let’s take a look 🚀 swiftandmemes.com/how-to-build

Christian Meestersrupdecat@fediscience.org
2024-03-08

We had a registration from Chicago, US-Il. After asking back, the student noticed that there are a few miles of water between Chicago and Mainz, Germany. He will probably be better off looking for a similar course in the US.

BTW, there are still some places available. #MPI #OpenMP #Parallelization for #C, #cpp, #Fortran and #Python for #HPC software.

Some Bits: Nelson's Linkblogsomebitslinks@tech.lgbt
2024-03-03

One billion rows in Go: Nice explication of optimization and profiling techniques
benhoyt.com/writings/go-1brc/
#parallelization #optimization #programming #hashtables #golang #go #+

2024-01-27

Ok, I'm a total `go` fan now. A hopeless groupie, after having seen how easy it is to write parallel code.

#golang #programming #concurrency #parallelization

kaushikghose.wordpress.com/202

Christos Argyropoulos MD, PhDChristosArgyrop@mstdn.science
2024-01-12

Words of wisdom:
1. In High Performance Computing #HPC , it is not how fast you write the code, it is how fast the code you write runs.
2. It is all about memory: how much you use and how often you load it
3. If you load one value, you get six or eight
4. If there are any flows in your code, #parallelization will expose them

2023-12-03

A Review of the Parallelization Strategies for Iterative Algorithms

#OpenCL #CUDA #Parallelization

hgpu.org/?p=28800

2023-11-28

Been having further discussion on #forth #parallelization and the challenges of #concatenative languages or #stack architecture in exploiting #ILP or #superscalar for #parallelcomputing , if you enjoy this kind of conversation and have or have something to share, please join us in discord.gg/Jq2FE3tg

2023-06-30

my technical projects (underway) or interests, with hashtags, so findable: 

book & blog series on software performance & scalability

#software #programming #performance #scalability #scaling #optimization #tuning #engineering #guides #HPC #BrendanGregg

my tech interests and favored tools:

#Go #Golang #Python #C #Linux #git #SQL #webdev #cloud #Internet #DistributedSystems #threading #concurrency #parallelization #EDA #queues #MessagePassing #CLI #TUI #curses #Terminals #consulting #Systems

2023-01-19

'Let's Make Block Coordinate Descent Converge Faster: Faster Greedy Rules, Message-Passing, Active-Set Complexity, and Superlinear Convergence', by Julie Nutini, Issam Laradji, Mark Schmidt.

jmlr.org/papers/v23/18-045.htm

#parallelization #sparse #optimization

2022-12-10

Good morning ☕️☕️

Can’t wait these build jobs to finish …
#Parallelization doesn’t always make everything faster

Photo of our coffee maker. Showing 2 cups getting filled the same time.
Johannes Hentscheljohentsch@hostux.social
2022-12-04

This year's programming revelation for me was the #multiprocessing library #ray. Now that I've discovered how easily you can adapt existing code to make it scale up to any number of nodes, I can never go back to Python's built-in multiprocessing, especially considering all the limitations that have suddenly evaporated in a ray :mind_blown: Also, the interface is so dead simple, I can't believe it. #python #programming #DataScience #bigdata #scalability #parallelization #interfaces #ux

Client Info

Server: https://mastodon.social
Version: 2025.07
Repository: https://github.com/cyevgeniy/lmst