This is also an area where Clojure really shines. It’s not the easiest to get started with, but once you’re up and running it is miles easier to test, version, deploy, package, scale, and repeatedly run your pipelines or models reliably than anything else I’ve tried so far. Paying the startup cost is well worth it if your goal is a robust production system that works.

#pydatalondon2024 #datascience #engineering

First keynote was amazing. I love hearing from other successful women in my field. Also super validating to hear from a real industry veteran that the time has come to bring robust engineering best practices to data science. A lot of companies do this well but there is a long way to go.

In software we’ve been working on “best practices” and processes for a couple of decades. So much of it is generic enough to be useful for data science too. We can help!

#pydatalondon2024 #engineering

Next comes @njr workshop on Test-Driven Data Analysis! Check out https://github.com/tdda/tdda (reminds me a bit of pandera or great-expectations)

#python #pydata #PyDataLondon #PyDataLondon2024 #dataanalysis

Just delivered alongside my colleague Deepyaman a workshop on Ibis + Kedro 🔥

Materials here: https://github.com/ibis-project/kedro-ibis-tutorial

Also follow @kedro on Mastodon 🔶

#python #PyData #PyDataLondon #PyDataLondon2024 #kedro #ibis #duckdb

@marcogorelli "Came for the speed, stayed for the syntax"

#polars #python #PyDataLondon #PyDataLondon2024

And now attending @marcogorelli's workshop on creating Polars plugins cc @ritchie46

#python #pydata #PyDataLondon #PyDataLondon2024 #polars

Made it safely to #PyDataLondon tutorials! Now attending Adam Hill's one on #Prefect #python #pydata #PyDataLondon2024