Next Tuesday, get ready to meet the mind behind #Pandas & #ApacheArrow !
Wes McKinney shares his origin story (Part 1) on #TheTestSet. From speedruns to shaping the data stack, this is one you won't want to miss.
Mark your calendar for Tuesday & subscribe at https://thetestset.co!
OpenTelemetry Protocol with Apache Arrow
https://opentelemetry.io/blog/2025/otel-arrow-phase-2/
#HackerNews #OpenTelemetry #ApacheArrow #DataInstrumentation #TechTrends
Currently taking a look at refreshing some of the #ApacheArrow and #PyArrow docs, so if you use Arrow in #rstats or Python and there's any areas you'd like to understand better, give me a shout, and we'll see what we can do!
@ChristosArgyrop While this has truth, there is still #DuckDB and #ApacheArrow that can help tons with large datasets before we need actual SQL! Don't know if that's counting as giggles though 😅
My browser WASM’t prepared for this. Using DuckDB, Apache Arrow and Web Workers in real life | by Motif Analytics | Feb, 2025 | Medium
My Browser WASM't Prepared for This. Using DuckDB, Apache Arrow and Web Workers
#HackerNews #MyBrowserWASM #PreparedForThis #DuckDB #ApacheArrow #WebWorkers
#apachearrow and #gdal both rely on aws-c-cmmon and related packages
Having no trust in anything #Amazon related (though there are certainly good people at AWS Labs, too), a question:
Isn't there a way to make arrow and gdal depend on some other packages?
Check out the latest on the #apachearrow blog focusing on Arrow's benefits as a wire format: https://arrow.apache.org/blog/2025/01/10/arrow-result-transfer. Databases that can transfer query results as Arrow are seeing massive speedups.
🏹 We’re happy to announce the release of {arrow} 18.1.0 to both CRAN and R-Universe (https://apache.r-universe.dev/arrow). #rstats #apachearrow
For all the #data nerds out there, check this Humble Bundle ebook offer: https://www.humblebundle.com/books/tools-for-data-engineers-packt-books
It has books on #DataEngineering #ApacheArrow #DataGovernance #duckdb and much more, and you can allocate your donation to the #CoralGuardin charity
I recently taught a tutorial on #DuckDB and #ApacheArrow with #Rstats at @latinr_conf The slides and content are available on GitHub https://github.com/fmichonneau/2024-latinr-duckdb-arrow/
The tutorial was recorded and I'll add the link to this thread when it becomes available.
👋 We are #opensource developers, maintainers and consultants working on scientific and data-heavy software!
We are in part, or fully responsible for critical tools used by millions for research and tech across industries, like #Jupyter, #condaforge, #Mamba, or #ApacheArrow. We help navigate the complex data stack, use these tools efficiently, or develop and upstream contributions.
🚀 Follow us for light tech posts, opinions, links to deeper content as well as company updates.
The Apache Arrow ecosystem is an amazing enabler for a whole new range of database systems. Tonbo is a K/V store that uses Arrow+Parquet on storage systems ranging from OPFS (browser filesystem) to S3. And of course you get SQL for free with Apache DataFusion! #ApacheArrow #DataFusion #RustLang
https://tonbo.io/blog/introducing-tonbo
Arrow 18.0.0 is out! See https://arrow.apache.org/blog/2024/10/28/18.0.0-release/ for highlights and links.
#apachearrow
Spent the day trying to get TLS to work for my #apachearrow FlightServer. TLS always drives me to distraction, but I thought I had it all figured out. It turned out that my script for creating the certs was creating the not_valid_before dates to the future (I have no idea why). Chat GPT saved me by teaching me how to use ```openssl s_client```
Otherwise, it would have mysteriously started working tomorrow, and I would have never figured out why.
New on our blog: #OpenTelemetry Protocol with #ApacheArrow in Production https://buff.ly/3XZE0IP
🏹 We’re excited to announce the release of {arrow} 17.0.0.1. Binary packages are now available for all platforms from both CRAN and R-Universe (https://apache.r-universe.dev/arrow). This release includes some nice quality of life improvements for folks writing dplyr pipelines with arrow. Have a look below to see what’s changed or see the full changelog https://arrow.apache.org/docs/r/news/index.html for all the info. #rstats #ApacheArrow
Speaking tomorrow about the importance of open standards in enabling data lakehouses. Hope to see you at the SNIA Developer conference!
#DataLake #DataLakehouses #ApacheIceberg #ApacheArrow #ApacheParquet
After a few years I feel like I need to find my way back to OSS contribution, but I can't find the next things. I usually contribute to things I use at work. Probably #apachearrow #datafusion is what I am interesting at those days. I need to figure out what to do. Probably I will write something about my last implementation of Apache Flight
If you're at all interested in nanoarrow or programming with #python and #apachearrow in general, Will Ayd just released a fantastic video showing how to get started building a Python package with #apachearrow using nanoarrow: https://www.youtube.com/watch?v=EhUnmXPjTy8.
