Data Processing Evolved: OpenLineage with Willy Lulciuc

Willy Lulciuc (@wslulciuc) is a pioneer in data engineering and one of the creators of OpenLineage, the open-source framework for data lineage collection and analysis. It enables consistent collection of lineage metadata, giving engineers a better perspective on how data is produced and used, so they can better solve complex problems. Join us to learn about the evolution of data processing, the role of AI, and the future of data engineering.Subscribe to Contributor on Substack for email notifications!In this episode we discuss:Willy’s journey from WeWork to oleanderThe role of AI in data engineeringChallenges in data processing and observabilityA vision for the future of data platformsLinks:OpenLineageoleanderPeople mentioned:Julien Le Dem (@J_)