Have you run into this annoyance? You're in your experimentation tool but you have to jump into Looker or Mode just to write some quick SQL to answer a simple data question.
All of that context switching adds up, which is why we built SQL Explorer right into GrowthBook (part of Launch Month, Week 3).
This lightweight SQL editor lets you:
- Query data
- Create visualizations
- Save results
How often will you be reaching for SQL Explorer? #abtesting #datascience #opensource
Celebrating Next-Level A/B Testing by Leemay Nassery, now in print!
🔗 Read more: https://medium.com/pragmatic-programmers/next-level-a-b-testing-bb70ea7dfc64
🏔️ Heading to Snowflake Summit next week!
Our team will be there to connect with data teams who are turning their Snowflake infrastructure into experimentation engines.
If you're attending and curious about how to safely roll out features using your existing data warehouse, let's chat! We'll be sharing insights on feature flags, A/B testing, and gradual rollouts.
Nobody really tells you how much goes into this. It’s not just infrastructure — it’s analytics, product design, collaboration tooling, and ongoing maintenance, all rolled into one.
If you’re thinking about building your own system, it’s worth hearing from teams who’ve been through it. It’s doable. But it’s a lot.
We learned these lessons firsthand at https://Education.com. Article linked below. #abtesting #webdev #featureflags #stats #datascience
💡 #UnityTips: Utilize A/B testing to improve player engagement! 📈 Use A/B testing to determine the most effective in-game features and UI elements to increase player engagement and retention. #unity #unity3d #gamedev #ABtesting #marketing #IndieDev
💡 #UnityTips: Utilize A/B testing to improve player engagement! 📈 Use A/B testing to determine the most effective in-game features and UI elements to increase player engagement and retention. #unity #unity3d #gamedev #ABtesting #marketing #IndieDev
We saw this firsthand when building Multi-Armed Bandits 🦝 in GrowthBook. Without correcting for imbalances in traffic over time, you can easily call the wrong winner. That’s why our bandits apply weighted adjustments to remove this bias.
See how we deal with Simpson's Paradox in Multi-Arm Bandits: https://blog.growthbook.io/introducing-multi-armed-bandits-in-growthbook/
To sum it up. Most tools stop at data. Our EDF goes further. It helps you make decisions.
Real-world experimentation isn't just stats. It's strategy, trade-offs, and context.
The Experiment Decision Framework makes this complexity actionable.
Learn more and start experimenting better:
https://docs.growthbook.io/app/experiment-decisions #datascience #abtesting
📈 New in GrowthBook 3.6: Time Series for Experiment Results
One of our most requested features is here! You can now visualize how each metric changes over the course of your experiment—day by day, cumulatively, and at no extra cost to your data warehouse.
✅ No extra SQL
✅ Supports Relative, Absolute, and Scaled Impact views
Now you can see your experiment’s story unfold over time
Google的A/B测试太恶心了，不是一两次遇到类似的恶心改动了，YouTube 硕大的屏幕只能显示几个视频，找了Reddit上的ublock规则，改成了一行6个视频，这下好多了
https://old.reddit.com/r/youtube/comments/1b40hra/youtube_fix_customizations_4_videos_per_row/
YouTube 首頁的 A/B testing 被幹剿到翻 – Gea-Suan Lin's BLOG
https://blog.gslin.org/archives/2025/05/01/12374/youtube-%E9%A6%96%E9%A0%81%E7%9A%84-a-b-testing-%E8%A2%AB%E5%B9%B9%E5%89%BF%E5%88%B0%E7%BF%BB/
GrowthBook offers a seamless self-hosted solution for feature flagging and A/B testing, allowing you to maintain control over your data without sacrificing functionality.
👉 Learn more: https://blog.growthbook.io/why-fintechs-should-shrink-their-attack-surface-not-just-get-certified/
Welch's test: он вам не замена Т-test'a
Привет! С вами команда аналитиков «Пятёрочки» X5 Tech. В данной статье мы расскажем про один из классических тестов в статистике — тест Уэлча (Welch's Test). Постараемся максимально раскрыть, когда и где стоит его применять и является ли он, на самом деле, тестом по умолчанию вместо Т‑test-a.
https://habr.com/ru/companies/X5Tech/articles/896182/
#abтестирование #abtest #abtesting #abtests #ttest #аналитика #аналитика_данных #аналитика_мобильных_приложений #статистика #статистика_в_it
#statstab #303 When Your Permutation Test is Doomed to Fail
Thoughts: Permutation tests are great, except for when they're not. Skewed data + unbalanced samples.
Steigere deinen Umsatz mit A/B-Testing in TYPO3! 📈
Erfahre, wie du mit unseren TYPO3-Extensions LUX und LUX Enterprise direkt im Backend Varianten testen und optimieren kannst. Mehr Conversions, bessere Performance! 🚀
Jetzt entdecken:
https://www.in2code.de/aktuelles/a-b-testing-in-typo3-wer-nicht-testet-verliert-umsatz/
Did you know that Joomla core has built-in A/B testing functionnality for Banners? You can company any version of your banners and know EXACTLY what drives the more conversions because it also compares the impressions (views) of each Banner. #joomlarocks #adtech #abtesting
University of British Columbia: Facebook is constantly experimenting on consumers — and even its creators don’t fully know how it works. “Users of social media platforms like Facebook, Instagram and TikTok might think they’re simply interacting with friends, family and followers, and seeing ads as they go. But according to research from the UBC Sauder School of Business, they’re part […]
High Performance PostgreSQL for Rails by Andrew Atkinson is part of a 16-ebook $18 bundle! Pragmatic Bookshelf and Humble Bundle have made it available along with Practical A/B Testing, Designing Data Governance from the Ground Up, SQL Antipatterns Vol. 1, and others. Pretty sweet deal!
https://www.humblebundle.com/books/data-engineering-and-management-pragmatic-books
#Ruby #Rails #PostgreSQL #ABTesting #Data #DataGovernance #Phoenix #LiveView #Elixir #Quanum #Prolog #MachineLearning #Python #DataScience #Math #eBooks #Deal #reading #programming
10. Analyze and A/B Test: Continuously analyze your email marketing efforts and A/B test different strategies, subject lines, or designs to refine your approach and improve conversion rates. #ABTesting #EmailMarketingStrategy
🚀 Big news! Nelio A/B Testing 7.4 is here! 🎉
✨ PHP tests for devs
✨ Popup Tests for conversions
✨ Advanced WooCommerce tracking
Ready to level up your optimization game? 🚀
#ABTesting #WordPress
https://neliosoftware.com/blog/nelio-ab-testing-7-4-php-tests-and-better-integrations/
#statstab #260 Effect size measures in a two-independent-samples case with nonnormal and nonhomogeneous data
Thoughts: "A_w and d_r were generally robust to these violations"
#robust #effectsize #ttest #2groups #metaanalysis #assumptions #ttest #cohend
