Daan Kolkman’s Post

View profile for Daan Kolkman, graphic

Partner Big Data Company | Assistant Professor Utrecht University

𝐂𝐚𝐧 𝐦𝐚𝐜𝐡𝐢𝐧𝐞 𝐥𝐞𝐚𝐫𝐧𝐢𝐧𝐠 𝐡𝐞𝐥𝐩 𝐮𝐬 𝐛𝐮𝐢𝐥𝐝 𝐛𝐞𝐭𝐭𝐞𝐫 𝐭𝐡𝐞𝐨𝐫𝐢𝐞𝐬? That’s the question we explore in our new PLOS ONE paper. 🔍 𝐓𝐡𝐞 𝐬𝐡𝐨𝐫𝐭 𝐚𝐧𝐬𝐰𝐞𝐫? Absolutely! Use machine learning for initial pattern discovery, then use those insights to shape the (causal) structure of your statistical model. A lot has been said about the superior predictive power of machine learning compared to traditional statistical methods. The common wisdom is that you have to choose: accuracy or explanatory insights — 𝘯𝘰𝘵 𝘣𝘰𝘵𝘩. This trade-off is false. In our latest PLOS ONE paper, we show that you can have both. We introduce “co-duction”—an approach that integrates machine learning within a structured five-step research process, combining the best of both worlds. 𝐖𝐡𝐚𝐭’𝐬 𝐍𝐞𝐰? While others have suggested using ML inductively, our approach is the first to integrate ML across a complete research process—incorporating inductive, deductive, and abductive steps. 𝐂𝐚𝐮𝐬𝐚𝐥 𝐀𝐈? 𝐒𝐨𝐫𝐭 𝐨𝐟! While most causal AI tries to identify cause-and-effect directly, our approach uses ML-driven pattern discovery to set the foundation for subsequent (causal) modelling. 𝐇𝐨𝐰 𝐭𝐨 𝐮𝐬𝐞 𝐭𝐡𝐢𝐬? We designed the paper to serve as a practical guide for scholars and data science practitioners alike. Skip to Table 1 (page 10) for the step-by-step! We’ve been using this approach successfully at The Big Data Company. By starting with ML-driven discovery, we capture potential patterns and validate them statistically—ensuring our models are theoretically sound and responsive to stakeholder needs. 𝐂𝐮𝐫𝐢𝐨𝐮𝐬 𝐭𝐨 𝐥𝐞𝐚𝐫𝐧 𝐦𝐨𝐫𝐞? Read it here: https://lnkd.in/gdtqGgfS Thanks to my co-authors Gwen Lee and Arjen van Witteloostuijn, and to all the colleagues and all (anonymous) reviewers who helped shape this work.

  • graphical user interface, text, application, Word

To view or add a comment, sign in

Explore topics