Локальный DeepSeek-R1: Когда скорость улитки – не приговор, а точка старта
Локальный DeepSeek-R1-0528 на скромном железе? Реально. Со скоростью улитки? Первоначально – да. Но итог моего эксперимента: эту 'улитку' можно заставить работать вдвое быстрее.
https://habr.com/ru/articles/916966/
#deepseek #ai #llm #local_ai #epyc #deepseek_r1 #deepseek_v3 #llamacpp #huggingface #gguf
Локальный DeepSeek-R1: Когда скорость улитки – не приговор, а точка старта
Локальный DeepSeek-R1-0528 на скромном железе? Реально. Со скоростью улитки? Первоначально – да. Но итог моего эксперимента: эту 'улитку' можно заставить работать вдвое быстрее.
https://habr.com/ru/articles/916966/
#deepseek #ai #llm #local_ai #epyc #deepseek_r1 #deepseek_v3 #llamacpp #huggingface #gguf
A document describes techniques that are useful for debugging suspend and resume issues with modern #AMD processors was merged for #Linux 6.16: https://git.kernel.org/torvalds/c/cafb22242bfb7fad10fde6f9b99853fc924e691a
Rendered version: https://origin.kernel.org/doc/html/next/arch/x86/amd-debugging.html
#Linux 6.16 will report the cause to a reset/reboot of system if you have a #AMD #Zen based CPU like #Ryzen or #EPYC
This can be handy to see it in the #dmesg output, just hope this will be logged properly so it's easy to find if you have a lot of clutter reported.
Source: https://www.phoronix.com/news/AMD-Report-Previous-Reset-Cause
I'd like to hear your thoughts on a planned #homeserver upgrade. Current set up is a Dual Xeon E5-2470 v2, running a NAS and multiple VMs under #NetBSD 10.
A 2U rackmount case is available.
Two M.2 slots and ECC RAM are hard requirements, AMD is preferred.
My currently favoured options:
- Asrock Rack X570D4U + Ryzen 9 5950X
- Asrock Rack B650D4U + Ryzen 9 9950X or 9900X
- Asrock Rack B650D4U + EPYC 4564P or 4584PX
The 9950X and the 4564P seem to be almost identical performance-wise, so I'm not quite sure what the advantage of the EPYC is.
Cooling 170 W TDP (4564P and 9950X) in 2U may not be trivial. The 4584PX has more cache, but lower single-thread performance, and also lower TDP, but is slightly more expensive, though all are within my budget.
Single-core-Performance is nice for some of my applications, but multiple cores are useful for running up to 6 parallel VMs.
#homelab #selfhosting #unplugtrump #Ryzen #AMD #EPYC
#AMD #EPYC #4565P & #4585PX #Benchmarks Against #Xeon #6369P
For "conventional" #server workloads like web serving and databases, the EPYC 4005 series dominates.
With up to 16C/32TH, #AVX512, DDR5-5600 memory and other advantages, the EPYC 4005 series is the very easy answer for those that may be looking for affordable #HPC
The AMD #EPYC4005 series #CPU deliver excellent generational uplift over the EPYC 4004 series and outright obliterating the #Xeon6300 series
https://www.phoronix.com/review/amd-epyc-4585px-4565p-benchmarks
AMD Epyc 4005 alias Grado: Neue Server-CPUs für den Sockel AM5 https://www.computerbase.de/news/prozessoren/amd-epyc-4005-alias-grado-neue-server-cpus-fuer-den-sockel-am5.92621/ #AMD #Epyc
#Intel's #ClearLinux Demonstrates Software Optimization Benefits On #AMD #EPYC 9005 Series
Clear #Linux easily took top spot. Clear was 6% faster than Ubuntu 25.04, which was running with the "performance" governor like the rest. Or compared to Ubuntu 24.04 LTS, the in-house Intel distribution was 23% faster. Ubuntu and other Linux distributions continue moving performance in right direction but Intel's Clear continues to deliver the fastest out-of-the-box x86_64 Linux.
https://www.phoronix.com/review/amd-epyc-mid2025-linux
#BSI: #AMD #EPYC #Prozessoren: Schwachstelle ermöglicht Codeausführung
Es besteht eine Schwachstelle in mehreren AMD EPYC-Prozessoren, Ein Angreifer mit administrativen Rechten kann diese Schwachstelle nutzen, um schädlichen Mikrocode zu laden.
https://wid.cert-bund.de/portal/wid/buergercert/details?uuid=336d2eaa-951e-4fb7-ab99-a9057e94d27c
https://www.sunoltech.com/intel-xeon-srm7s-platinum-4th-gen-8468h-vs-amd-epyc-7002-2nd-gen-7742/
Comparing the these Intel Xeon Platinum (4th Gen) 8468H Octatetraconta-core (48 Core) VS AMD EPYC 7002 (2nd Gen) 7742 Tetrahexaconta-core (64 Core) @intel #xeon #Platinum #8468H @AMD #epyc #Tetrahexaconta @SunolTech
💾 4am AMD Xorg/Kernel Debugging 💾
Ongoing fun ongoes, so much so. This iteration receives triple output: tty video (Display Port), COM1 redirect via DB9 to laptop running minicom, COM2 to the usual BMC SoL terminal watched from ipmitool on adjacent laptop.
Coming up, rebooting into GENERIC-DEBUG kernel rebuilt with remote GDM (kgdb) access via the COM1 link to laptop.
AMD has achieved a 2nm silicon milestone with its EPYC 'Venice' CPU, built on TSMC's N2 process, marking a leap for high-performance computing
#AMD #EPYC #Venice #TSMC #N2 #2nm #HPC #Semiconductors #CPUs #Processors
🚀 TESTING: Our New EPYC BEAST!
💥 Specs that make nerds drool:
🧠 CPU: 2x AMD EPYC 9845 (160 cores, 640 threads)
💾 RAM: 1.5TB (all cache runs from RAM!)
⚡ Every proxy has dedicated CPU threads for smooth performance
📢 WGP traffic in CZ is now running on The Beast – new proxy & cache version coming soon!
AMD Epyc Embedded 9005: 8 bis 192 Zen-5(c)-Kerne für weitere Industriezweige https://www.computerbase.de/news/prozessoren/amd-epyc-embedded-9005-8-bis-192-zen-5-c-kerne-fuer-weitere-industriezweige.91730/ #AMD #Epyc #ew25
SMT Remains Very Advantageous For #Zen5 #AMD #EPYC Performance
#SMT typically was of measurable benefit to the 5th Gen AMD EPYC processor with the exception of some #HPC workloads that perform better with SMT disabled or otherwise limited by memory bandwidth. SMT also hurt the OpenVINO inference latency but by and large Simultaneous Multi-Threading remains an important and valuable feature for AMD processors.
https://www.phoronix.com/review/amd-epyc-zen5-smt
The Compelling #AVX512 Performance Advantage On #AMD #EPYC 9005 "Turin"
Workloads tested on this #EPYC9655 Supermicro server, with AVX-512 yielded 1.57x the performance of the same hardware/software but with AVX-512 forced off.
https://www.phoronix.com/review/amd-epyc-turin-avx512
Snipesearch toot is part way through an #EPYC upgrade doubling memory storage and CPU cores available while updating our instance,
