Upsolver

🚨 Hot off the press! The latest edition of the Community Newsletter has landed!

While Windows sysadmins overcome the shock of Windows Server 2025 installing itself, catch up on the latest industry news, articles, podcasts, and events, including:

💠 Windows Server 2025 installs itself when a mislabeled security patch surprises sysadmins.
💠 The 4-day work week is the new “must-have” benefit employers can’t ignore.
💠 Congratulations go to PuppyGraph for raising $5M in seed funding. 🎉
💠 The rivalry between Snowflake and Databricks continues as they both launch their data catalogs.
💠 Julien Le Dem explores the advent of the open data lake.
💠 Join Zach Wilson’s six-week data engineering boot camp - it’s free! 🔥
💠 Alex Merced chats all things Iceberg with Brian Gracely on The Cloudcast podcast.
💠 Learn publish-audit-merge in Iceberg with Soumil Shah.
💠 And loads more, including data events you won’t want to miss…

📨 Dive in and subscribe here 👉 https://chilldatasummit.substack.com/p/apache-iceberg-community-news-windows

Let’s keep building the future of data together!

Who’s ready to learn how to build a production-grade lakehouse? 🙋‍♂️🙋‍♀️

We’re excited to offer hands-on Iceberg training led by Roy Hasson, VP of Product for Upsolver, at our next week!

With Roy’s deep expertise in data and his approachable teaching style, this is a rare chance to learn from an industry pro who welcomes every question and shares his knowledge generously! 🙌

🎫 Chill Data Summit on Tour, London
📅 Tuesday 17th September 2024
🕘 9 AM - 3.30 PM (BST)
📍 Shoreditch Studios, 37 Bateman's Row, London EC2A 3HH

This is an amazing opportunity to level up your skills and get ahead of the game with — don't miss out 👉 https://chilldatasummit.com/ontour/london?utm_source=LinkedIn&utm_medium=post&utm_campaign=speaker_rh_20240912

We’re excited to announce that Hugo Lu, Founder of Orchestra, will be joining our panel of speakers at the in London next week! 🤩

With his extensive experience in and , Hugo will bring valuable insights into the future of and beyond that you won't want to miss!

🎫 Chill Data Summit on Tour, London
📅 Tuesday 17th September 2024
🕘 9 AM - 3.30 PM (BST)
📍 Shoreditch Studios, 37 Bateman's Row, London EC2A 3HH

This is an amazing opportunity to level up your skills and get ahead of the game with — don't miss out 👉 https://chilldatasummit.com/ontour/london?utm_source=LinkedIn&utm_medium=post&utm_campaign=speaker_hl_20240912

With a PhD. in mechanical engineering, Jan Kaul is a man who loves to understand how things work ⚙

Having discovered a passion for software engineering, Jan founded his company, Dashbook, around and so he's an ideal speaker for our .

Come and join us in London next week to hear Jan's talk on analytical data transformations with Iceberg materialized views and deepen your understanding of Iceberg.

🎫 Chill Data Summit on Tour, London
📅 Tuesday 17th September 2024
🕘 9 AM - 3.30 PM (BST)
📍 Shoreditch Studios, 37 Bateman's Row, London EC2A 3HH

This is an amazing opportunity to level up your skills and get ahead of the game with — don't miss out 👉 https://chilldatasummit.com/ontour/london?utm_source=LinkedIn&utm_medium=post&utm_campaign=speaker_jk_20240912

Most of us might struggle to chat with Santona Tuli about her PhD in nuclear physics, but when it comes to data, we’re all ears! 👌

We’re thrilled to have Santona speaking at our in London next week. She’ll show us that CDC to isn’t as complicated as colliding atoms—it's actually within reach! 💪

🎫 Chill Data Summit on Tour, London
📅 Tuesday 17th September 2024
🕘 9 AM - 3.30 PM (BST)
📍 Shoreditch Studios, 37 Bateman's Row, London EC2A 3HH

This is an amazing opportunity to level up your skills and get ahead of the game with — don't miss out 👉 https://chilldatasummit.com/ontour/london?utm_source=LinkedIn&utm_medium=post&utm_campaign=speaker_st_2024091

What does the future hold for ? We'll be asking Chris Tabb this question next week at our when our panel of data experts discuss what's on the horizon for Iceberg.

Chris is Co-Founder & CCO at LEIT DATA and has plenty of experience and insights to bring to the discussion.

Will the conversation get heated, or stay cool and chilled? Be there to find out!!

🎫 Chill Data Summit on Tour, London
📅 Tuesday 17th September 2024
🕘 9 AM - 3.30 PM (BST)
📍 Shoreditch Studios, 37 Bateman's Row, London EC2A 3HH

This is an amazing opportunity to level up your skills and get ahead of the game with — don't miss out 👉 https://chilldatasummit.com/ontour/london?utm_source=LinkedIn&utm_medium=post&utm_campaign=speaker_ct_20240912

What could be more fun than a group of geeks chewing the fat over the latest developments? 🤓 🤓 🤓

Our panelists at the next week will be discussing the future of Apache Iceberg, and we're excited that Yoni Eini, CTO & Co-Founder at Upsolver will be joining us.

Be part of the conversation at:

🎫 Chill Data Summit on Tour, London
📅 Tuesday 17th September 2024
🕘 9 AM - 3.30 PM (BST)
📍 Shoreditch Studios, 37 Bateman's Row, London EC2A 3HH

This is an amazing opportunity to level up your skills and get ahead of the game with — don't miss out 👉 https://chilldatasummit.com/ontour/london?utm_source=LinkedIn&utm_medium=post&utm_campaign=speaker_ye_20240911

✨ We're delighted to announce that Seda Kocak will be presenting The Importance of Data Modeling in Decision-Making and System Design at our next week.

As Lead Data Analyst and Principal Data Modeler at The Dot Collective, Seda has in-depth knowledge of data modeling that she will be sharing with our lucky attendees. Will you be one of them?

🎫 Chill Data Summit on Tour, London
📅 Tuesday 17th September 2024
🕘 9 AM - 3.30 PM (BST)
📍 Shoreditch Studios, 37 Bateman's Row, London EC2A 3HH

This is an amazing opportunity to level up your skills and get ahead of the game with — don't miss out 👉 https://chilldatasummit.com/ontour/london?utm_source=LinkedIn&utm_medium=post&utm_campaign=speaker_sk_20240911

💫 We're super excited to announce that JB Onofre will open our Chill Data Summit in London with his keynote talk on The Future of Apache Iceberg and Navigating it with Polaris.

JB, Principal Software Engineer at Dremio and a Member of the Board of Directors of The Apache Software Foundation, brings a wealth of knowledge and experience that you won't want to miss.

🎫 Chill Data Summit on Tour, London
📅 Tuesday 17th September 2024
🕘 9 AM - 3.30 PM (BST)
📍 Shoreditch Studios, 37 Bateman's Row, London EC2A 3HH

This is an amazing opportunity to level up your skills and get ahead of the game with — don't miss out 👉 https://chilldatasummit.com/ontour/london?utm_source=LinkedIn&utm_medium=post&utm_campaign=speaker_jb_20240911

📢 We're super excited to announce the speakers for our Chill Data Summit!

Don't miss this exclusive opportunity for a day of free hashtag learning from these industry experts:

⭐ JB Onofré opens the show with a keynote on the future of Apache Iceberg and navigating it with Polaris.
⭐ Jan Kaul will explore analytical data transformations with Iceberg Materialized Views.
⭐ Santona Tuli, Ph.D. will demonstrate that Production database replication with Change Data Capture to Iceberg is achievable with the right strategy.
⭐ Seda KOCAK will highlight the importance of data modeling in decision-making and system design.
⭐ Our panelists, Chris Tabb, Hugo Lu, Yoni Eini, Seda KOCAK, and JB Onofré, reveal the future of Apache Iceberg.
⭐ Roy Hasson leads the hands-on training to build a production-grade Iceberg lakehouse from scratch.

We almost have a full house, so if you want to join us, grab your ticket today: https://chilldatasummit.com/ontour/london?utm_source=facebook&utm_medium=post&utm_campaign=speakers_20240911

🎉 This is exactly what we aim for with our events! These non-commercial, vendor-free community learning days are all about providing free, high-quality hashtag training.

We're delighted to hear that the Iceberg training with Holden Karau was both valuable and enjoyable! A big thank you to Swapnil Kamble for sharing your positive experience 🙌

Wish you'd been there? Register for our next event here 👉 https://chilldatasummit.com/

Hey, Data Engineers 🤓 We made it! It’s the final day of our special series exploring how to migrate from to tables.

In Part 1, we looked at the reasons for migrating, including the limitations of Hive, and how Iceberg overcomes these with its feature-rich open-table format. In the second part, we prepared for migration, and in Part 3, we considered the strategies to migrate our data.

In this final part, we’re validating our data, and today, we finish with everyone’s favorite, testing!! The good news is that Iceberg makes testing cool with its Write Audit Publish (WAP) pattern 😎

Firstly, you’ll want to use the same engines and versions your users will, like Athena or Snowflake, to ensure the accuracy of your testing.

Next, to validate updates and deletes, enable WAP on your table, create a branch from any version, and perform changes like updates or deletions within that branch. This keeps the main branch untouched until you're ready to push the final commit 💪

Finally, promote the test branch to the main branch to make your changes visible. How awesome is that? 👌

Watch the final video here 👉 https://www.youtube.com/watch?v=uSUuJRSRBSg

Thanks for being on this journey with us, it’s been great to have your company. Let us know how you get on with your migration and reach out if you have any questions. See you again soon!