AISatoshi (@AiXsatoshi)
RTX Pro 6000 x2와 RTX A6000 x2가 혼재된 머신에서 vLLM을 사용할 때 Tensor Parallel=2, Pipeline Parallel=2 설정이 제대로 동작하지 않는다는 경험 공유입니다. 최소한 메모리 용량을 맞추지 않으면 실행조차 되지 않는 문제를 지적합니다.
#Parallelism
Khóa học về đồng thời và song song: Concurrency và Parallelism là gì? Concurrency là xử lý nhiều việc một lúc, trong khi Parallelism là làm nhiều việc cùng một lúc. Hiểu được sự khác biệt này giúp cải thiện khả năng mở rộng của SAAS #Concurrency #Parallelism #SAAS #Scalability #LậpTrình #PhátTriểnngDụng #TăngNăngSuất #ĐồngThời #SongSong
https://www.reddit.com/r/SaaS/comments/1p4koom/the_same_same_but_different_trap_concurrency_vs/
AI Agents Boost Developer Speed - Amjad Masad and Adam DAngelo
#parallelagents #aiagents #collaboration #productivity #parallelism #fyp #explore #discover
Пул интерпретаторов в Python 3.14. Что, зачем и почему?
Как все знают, GIL (Global Interpreter Lock) не позволяет нескольким потокам CPython выполнять CPU-bound задачи параллельно. Глобальная блокировка интерпретатора предоставляет каждому потоку лишь небольшой интервал времени для работы. При этом планирование работы потоков (какому именно потоку из ожидающих предоставить разрешение на выполнение) осуществляется планировщиком операционной системы. Интерпретатор не является полноценным планировщиком работы потоков, он делегирует эту функцию операционной системе. GIL использует мьютексы ОС для блокировки работы потоков так, чтобы в один момент времени мог выполняться только один поток из нескольких.
- https://discuss.python.org/t/python-3-14-0-final-is-here/104210 (Python 3.14.0 (final) is here!)
- https://docs.python.org/3.14/whatsnew/3.14.html (What’s new in Python 3.14 by Adam Turner and Hugo van Kemenade)
- https://docs.python.org/3.14/whatsnew/changelog.html#changelog (Python 3.14 Changelog)
- https://astral.sh/blog/python-3.14 (Astral ready for Python 3.14)
```
uv self update
uv python upgrade 3.14
uvx python@3.14
uvx python@3.14t
```
- https://docs.python.org/3/whatsnew/3.14.html#pep-649-pep-749-deferred-evaluation-of-annotations
- https://discuss.python.org/t/python-3-14-0-final-is-here/104210#:~:text=the%20evaluation%20of%20annotations%20is%20now%20deferred
Instead, annotations are stored in special-purpose annotate functions and **evaluated
only when necessary** (except if from __future__ import annotations is used).
# PEP 768 Python 3.14 **Safe external debugger interface, a zero-overhead external debugger interface for CPython
- https://docs.python.org/3.14/whatsnew/3.14.html#pep-768-safe-external-debugger-interface
- https://discuss.python.org/t/python-3-14-0-final-is-here/104210#:~:text=A%20zero%2Doverhead%20external%20debugger%20interface%20for%20CPython
Python 3.14 introduces a zero-overhead debugging interface that allows debuggers and profilers to safely attach to running Python processes without stopping or restarting them.
# RFC9562 Python 3.14 **UUID versions 6-8 are now supported by the uuid module**
- https://docs.python.org/3/whatsnew/3.14.html#uuid
- https://discuss.python.org/t/python-3-14-0-final-is-here/104210#:~:text=UUID%20versions%206%2D8%20are%20now%20supported%20by%20the%20uuid%20module
# zstandard
- https://peps.python.org/pep-0784/ (Adding Zstandard to the standard library)
- https://docs.python.org/3/whatsnew/3.14.html#whatsnew314-zstandard
- https://discuss.python.org/t/python-3-14-0-final-is-here/104210#:~:text=compression.zstd%20providing%20support%20for%20the%20zstandard%20compression%20algorithm.
# A new command line interface with asyncio introspection capabilities: python -m asyncio ps PID
- https://docs.python.org/3/whatsnew/3.14.html#asyncio-introspection-capabilities
- https://discuss.python.org/t/python-3-14-0-final-is-here/104210#:~:text=inspect%20running%20Python%20processes
# Multiple interpreters in the standard library
- https://peps.python.org/pep-0734/ (Multiple Interpreters in the Stdlib)
- https://docs.python.org/3.14/whatsnew/3.14.html#pep-734-multiple-interpreters-in-the-standard-library
- https://discuss.python.org/t/python-3-14-0-final-is-here/104210#:~:text=Multiple%20interpreters%20in%20the%20stdlib
- https://gdevops.frama.io/python/versions/3.14.0/3.14.0.html
# Python #Python314 #TemplateString #ZStandard #RemoteDebugging #MultipleInterpreters #FreeThreaded #UUID7 #asyncio #parallelism #CSP #ActorModel
Introducing the most riveting tale of all time: the #love #story between a #GPU and its #graphics, sprinkled with just enough #Triton #jargon to make you nod off faster than a PyTorch Profiler. We've got #parallelism, pheromones, and more tangents than a high school geometry class 💤. Pack your bags, folks, because we're going on an #adventure through a sea of terrifying colors and kernels that nobody asked for! 🚀🌈
https://ut21.github.io/blog/triton.html #HackerNews #ngated
Higher Geometry by N. V. Efimov
This book gives a systematic presentation of the fundamentals of Euclidean geometry, non-Euclidean geometry of Lobachevsky and Riemann, projective geometry and the geometrical aspects of special relativity theory. It also gives a general idea about constant curvature geometries. The subject matter has been shaped by the needs of the students and by my own experience.
A few words on the use of the book as a textbook in a course of the foundations of geometry are in order. The subject matter is distributed over the first two parts. It is presented systematically throughout the book and practically does not omit any of the details of the arguments (except for the proofs of certain theorems of elementary geometry). It is evident that in lectures such a detailed presentation would be unprofitable (even if many hours were assigned to this course). The most difficult portion is Chapter 2 in the first part of the book; I feel that in lectures one should discuss from this chapter the formulations of the axioms and present examples of rigorous proofs of certain theorems; moreover, the most important aspects, for example, the measurement of length, the equivalence of Archimedes’ and Cantor’s axioms to Dedekind’s axiom and the significance of these axioms for the substantiation of analytic geometry, should be discussed in detail. The proof of the majority of the initial theorems of elementary geometry should be left for self-study.
Translated from the Russian by P. C. Sinha, Cand.Sc.
You can get the book here and here
Contents
Preface to the English Edition 9
Part 1. The Foundations of Geometry
A Short Review of Investigations into the Foundations of Geometry
1.1 Euclid’s definitions, postulates, and axioms
1.2 The fifth postulate 16
1.3 Lobachevsky and his geometry 33
1.4 The formation of the notion of geometrical space 36
The Axioms of Elementary Geometry
2.1 Geometrical elements 42
2.2 Group I: axioms of incidence 42
2.3 Group II: axioms of betweenness 45
2.4 Corollaries of the axioms of incidence and betweenness 45
2.5 Group III: axioms of congruence 53
2.6 Corollaries of Axioms I-III 57
2.7 Group IV: axioms of continuity 69
2.8 Group V: the axiom of parallelism. Absolute and divergent lines 96
Chapter 3. The Non-Euclidean Theory of Parallels
3.1 Lobachevsky’s definition of parallels 82
3.2 Peculiarities in the location of parallel lines 85
3.3 Lobachevsky’s function II(x) 100
3.4 Lines and planes in Lobachevskian space 104
3.5 Equidistants and oricycles 111
3.6 Equidistant surfaces and horospheres 121
3.7 Elementary geometry on surfaces in Lobachevskian space 126
3.8 Area of a triangle 136
3.9 Proof of logical consistency of Lobachevskian geometry 146
3.10 The basic metric relationships in Lobachevskian geometry 165
3.11 Riemannian geometry: a brief survey 178
Chapter 4. Investigation of the Axioms of Elementary Geometry
4.1 Three basic problems of axiomatic theory 188
4.2 Consistency of the axioms of Euclidean geometry 191
4.3 Proof of independence of some axioms of Euclidean geometry 205
4.4 Axiom of completeness 216
4.5 The completeness of axioms of Euclidean geometry 220
4.6 The axiomatic method in mathematics
Part 2. Projective Geometry
Chapter 5. The Foundations of Projective Geometry
5.1 The subject matter of projective geometry 223
5.2 Desargues’ theorem. Harmonic sets of elements 226
5.3 Order of points on the projective line 231
5.4 Division of harmonic pairs. Continuity of the harmonic correspondence 244
5.5 The axiom of continuity. Projective system of coordinates on a line 252
5.6 Projective coordinate systems on a plane and in space 258
5.7 Projective correspondence between elements of one-dimensional manifolds 270
5.8 Projective correspondences between two- and three-dimensional manifolds 283
5.9 Analytic representation for projectivities. Involution 292
5.10 Transformation formulas for projective coordinates. Cross ratio of four elements 300
5.11 The principle of duality 316
5.12 Algebraic curves and pencils. Algebraic surfaces and bundles. Complex projective plane and complex projective space 325
5.13 Images of second degree. The theory of polars 337
5.14 Constructive theorems and problems of projective geometry 346
Chapter 6. Group-Theoretic Principles in Geometry. Groups of Transformations
6.1 Geometry and the theory of groups 362
6.2 The projective group and its basic subgroups 391
6.3 Geometries of Lobachevsky, Riemann, and Euclid in the projective setting 408
Chapter 7. Minkowski Space
7.1 Multidimensional affine space 425
7.2 Euclidean spaces and Minkowski space 440
7.3 The space of events of the special relativity theory 455
Chapter 8. Differential Properties of Non-Euclidean Metric
8.1 Metric form of the Euclidean plane 474
8.2 The distance between two points on the Lobachevskian plane 478
8.3 Metric form of the Lobachevskian plane 489
8.4 Intrinsic geometry of a surface and the Beltrami problem 505
8.5 Geometry on a surface of constant curvature 511
8.6 Derivation of basic metric relations in Lobachevskian geometry 523
Part 3. Constant Curvature Geometry
Chapter 9. Spatial Forms in Constant Curvature Geometry
9.1 Two-dimensional manifolds with differential-geometric metric 529
9.2 Parabolic spatial forms 537
9.3 Elliptic spatial forms 544
9.4 Hyperbolic spatial forms 547
Name Index 553
Subject Index 554
#1980 #axioms #EuclideanGeometry #geometry #lobachevsky #mathematics #metricRelations #minkowskiSpace #nonEuclideanGeometry #parallelism #projectiveGeometry #riemannianGeometry #sovietLiterature
Arendt et al. discuss several metrics of phenotypic parallel evolution including one that does not actually measure parallelism. They suggest use of a partial Eta-squared of the interaction term between Habitat and Replicate as an appropriate metric.
Read now ahead of print!
https://www.journals.uchicago.edu/doi/10.1086/736845
#evolution #parallelism #habitat #phenotypes #parallelEvolution
Concurrency Concept: Say you have two threads trying to access the same bytes.
Instead of a lock, both threads can reserve a specific time interval, in which they are allowed to access the memory area. So the access timeline would look something like this (t1 and t2 being the timeframe's the respective threads can access it): t1 | t2 | t1 | t2 | ...
Shoutout to @nushell for providing no-hassle parallelisation. I had a simple script which formats my Latex files like this:
```
def main [] {
let files = ls latex/**/*.tex | get name;
$files | each { |file|
let abs_path = $file | path expand;
latexindent --silent $abs_path --output $abs_path;
} | ignore;
}
```
which takes ~2 minutes to go through all my files. I just changed the `each` to `par-each` and voila! It got under 20 seconds!
Concurrency and parallelism are often confused in async programming discussions. Go's goroutines highlighted the difference: concurrency is doing many things at once, while parallelism is doing many things at the same time.
AsyncIO handles concurrency well for I/O, but CPU-bound tasks need parallelism. Python uses AsyncIO for concurrency, and ProcessPoolExecutor for parallelism, distributing work across CPU cores.
Process communication is harder than thread communication. AsyncIO's task cancellation differs from ProcessPoolExecutor's, requiring workarounds like event objects for reliable cancellation and shutdown.
Essentially, ProcessPoolExecutor enables parallelism for CPU-bound tasks, scaling them across multiple cores, while AsyncIO handles I/O concurrently.
#python #asyncio #concurrency #parallelism #multiprocessing #opentowork #getfedihired #fedihire #opentowork
C++Now 2025 SESSION ANNOUNCEMENT: Parallel Range Algorithms - The Evolution of Parallelism in C++ by Ruslan Arutyunyan
https://schedule.cppnow.org/session/2025/parallel-range-algorithms/
Register now at https://cppnow.org/registration/
🏃♀️ High-performance computing, with much less code
(... back in my business development days I was interested in "rules and schemes" that would separate what is to be done with how it should be done)
https://news.mit.edu/2025/high-performance-computing-with-much-less-code-0313
#computing #software #programming #languages #hpc #parallelism
Recently, in our English Lang Club, we dived into Concurrency & Parallelism in Go.
We wrote a program to send concurrent HTTP requests, ensuring proper synchronization with WaitGroup.
Sharpen your tech skills & English—join us next time! 🚀
C++Now 2025 SESSION ANNOUNCEMENT: Parallel Range Algorithms - The Evolution of Parallelism in C++ by Ruslan Arutyunyan
https://schedule.cppnow.org/session/2025/parallel-range-algorithms/
Register now at https://cppnow.org/registration/
Speeding Up Computational Lithography with the Power and Parallelism of GPUs — https://semiengineering.com/speeding-up-computational-lithography-with-the-power-and-parallelism-of-gpus/
#HackerNews #ComputationalLithography #GPUs #Parallelism #TechInnovation #Semiconductor
DeepSeek Open Source Optimized Parallelism Strategies, 3 repos — https://github.com/deepseek-ai/profile-data
#HackerNews #DeepSeek #Open #Source #Optimized #Parallelism #Strategies #3 #repos #"DeepSeek" #"OpenSource" #"Parallelism" #"AI" #"GitHub"
DualPipe: An innovative bidirectional pipeline parallelism algorithm — https://github.com/deepseek-ai/DualPipe
#HackerNews #DualPipe #Bidirectional #Pipeline #Parallelism #Algorithm #Innovation #Technology #AI
Параллелизм в Go тестах: все, что нужно знать о -p, -parallel и t.Parallel()
В Go есть три способа управления параллельностью тестов: Короткий гайд о -p , -parallel и t.Parallel а также бонус для любителей параллельного программирования
https://habr.com/ru/articles/882222/
#go #golang #testing #concurrency #parallelism #neva #nevalang #programming_languages #visual_programming #compiler
How to scale your model: A systems view of LLMs on TPUs
https://jax-ml.github.io/scaling-book/
#ycombinator #scaling #jax #llms #transformers #tpus #google #deepmind #parallelism #pallas
Client Info
Server: https://mastodon.social
Version: 2025.07
Repository: https://github.com/cyevgeniy/lmst