#dataprocessing

Begrepen.bebegrepen
2025-04-18

Check out our new begrepen-video in which we explain the different steps in the Data Processing Cycle: youtu.be/qaCoOINxNFk
Want to see this video in Dutch? Just head over to our channel!

2025-04-17

Ускорить Pandas в 60 раз: проверяем лайфхаки из интернета на реальном проекте и обкладываемся бенчмарками

Привет! Если после заголовка вы решили, что это очередная статья в стиле «Топ-10 способов ускорить Pandas», то не торопитесь с выводами. Вместо топов и подборок предлагаю взглянуть на бенчмарки скорости и потребления памяти в зависимости от характеристик датафрейма и убедиться, что часть советов из статей по ускорению могут оказаться даже вредными. Разберём, какой из способов ускорения нужно пробовать в разных ситуациях, как это зависит от размера датафрейма и как ведёт себя в реальном проекте.

habr.com/ru/companies/tochka/a

#pandasprofiling #pandas #pandas_multiindex #dataprocessing #data_pipelines

Fali Fuentesfalitroke
2025-03-29

Big news for space tech! 🚀 Axiom Space and @redhat are teaming up to launch AxDCU-1, a cutting-edge data processing unit, to the ISS this spring. This lightweight, edge-powered prototype is taking space computing to new heights. What possibilities will this unlock? 🌍💻 linux.slashdot.org/story/25/03

2025-03-28

Seismic Data Processing and Imaging Software for Accurate Subsurface Mapping

Seismic waves travel through the Earth’s subsurface and are recorded by geophones or hydrophones. Seismic Data Processing and Imaging Software is give raw data obtained is often noisy and requires extensive processing to extract useful information.

Seismic Data Processing and Imaging Software- articlescad.com/seismic-data-p

Wilda SoftwareWildaSoftware
2025-03-19

LinkedIn, jak to wielka platforma, przetwarza dużo danych. Musi to robić szybko i sprawnie, stąd tutaj zwykła baza danych nie wystarczy i infrastruktura jest "trochę" większa. Warto wiedzieć, jak to robią duże serwisy.

blog.bytebytego.com/p/how-link

Hacker Newsh4ckernews
2025-03-02

Smallpond – A lightweight data processing framework built on DuckDB and 3FS — github.com/deepseek-ai/smallpo

Doug Ortizdougortiz
2025-02-28

🚨 ML Engineers: Tired of manual model upkeep?

MLOps = Automation + Real-Time Insights + Team Synergy.

Watch our bite-sized guide ➡️ link.illustris.org/discoveryml

2025-02-24

Python File Handling: How to Process Files Efficiently
Master Python file handling for robust code! Learn efficient ways to read, write, and manipulate files. This guide covers opening, processing, and writing.

tech-champion.com/data-science
Learn how to handle files in Python effectively. This post covers input and output file paths and ef...

2025-02-20

Troubleshooting DB2 XMLCAST NULL Values: A Guide to Resolving XML Data Conversion Issues
Solve the DB2 XMLCAST NULL issue! Learn practical strategies for preventing and resolving unexpected NULL values during XML data conversion in DB2. Improve your XML data handling with robust conversion techniques and efficient error handling.
tech-champion.com/database/db2

2025-02-20

Easytrieve Plus and DB2: Efficiently Matching File Data with Database Records
Master Easytrieve Plus DB2 integration for efficient data processing! Learn optimized strategies, including stored procedures & bulk loading, to seamlessly match file & DB2 data. EasytrievePlus
tech-champion.com/database/db2

Client Info

Server: https://mastodon.social
Version: 2025.04
Repository: https://github.com/cyevgeniy/lmst