For the primary time ever, the Data Engineering Summit will likely be held in person! This summit will run concurrently with the premier data science and AI training conference, ODSC East, and can bring together data engineering leaders on April 23-24 in Boston. We are currently working intensively on the setup. In the meantime, try these recordings from last 12 months's virtual Data Engineering Summit.
Succeed in the info tooling tornado
Adam Breindel | Independent consultant
In this talk, Adam Breindel, a number one Apache Spark lecturer and expert in fraud detection in neural networks, streaming analytics, and cluster management code, will make it easier to navigate the info tool landscape.
In the rapidly changing data tools landscape of 2023, corporations are struggling to fulfill existing commitments, and next-generation projects have an estimated failure rate of as much as 85%. This session will explore the origins of those challenges (spoiler: legacy anti-patterns from twentieth century industry) and the adjustments you may make to resolve these issues.
Streaming featureization with Ibis, Substrait and Apache Arrow
Wes Mckinney | CTO and co-founder | Voltron data
David Palaitis | Managing Director | Two sigma
In this talk, Wes McKinney, creator of the Python Pandas project and co-creator of Apache Arrow, and David Palaitis, technical manager at Two Sigma Investment, will reveal how their organizations work together to enhance featurization workflows.
Their approach leverages the Ibis, Substrait, and Arrow software stack and provides an entire solution for real-time streaming data processing, with Ibis providing high-level APIs for data processing and evaluation, Substrait providing a machine learning framework, and Apache Arrow providing a robust data representation for each. This stack enables processing of huge amounts of streaming data in real-time, providing fast and accurate insights for decision making.
From data planning to implementation
Balaji Raghunathan | Vice President of Digital Experience | ITC Infotech
Over his 20+ 12 months profession, Balaji Raghunatthan has worked with cloud-based architectures, microservices, DevOps, Java, .NET and AWS. In this talk, Balaji walks you thru the means of data planning through implementation, which is the means of using data to develop and implement a project or initiative. In short, data planning through implementation helps organizations make informed decisions and take actions based on insights gained from data.
Building a Data Network: Strategies and Best Practices
Hajar Khizou | Senior Data Engineer | SustainCERT
Join data mesh and AI expert Hajar Khizou to explore the concept of information mesh architecture, a decentralized approach to organizing data and data infrastructure. In this talk, she’s going to cover key advantages, strategies, and best practices for implementing a knowledge network, including designing data products, defining governance models, and ensuring data quality and consistency.
Getting began with data technology
Joe Rice | CEO | Ternary data
In this video, Joe Reis, CEO of Ternary Data, shares worthwhile insight into navigating the present economic climate and what it means for aspiring data engineers. Find out more about the several profession entry points that may make it easier to start.
Sign me up!
As every data engineering skilled knows, the most effective technique to stay ahead of the curve is to not sleep so far on the whole lot related to data and data engineering. The best technique to do that is to attend the ODSC Data Engineering Summit and ODSC East.
At the Data Engineering Summit on April 24, co-located with ODSC East 2024, you'll be on the forefront of all the large changes coming before they occur. Get your pass today and stay one step ahead.
