Back to Browse

Part 8 - Duplicate migration - Hive to Iceberg Tables Migration eLearning Module

191 views
Jul 1, 2024
3:13

🛠️ Considering Iceberg Lakehouse ? Book a free consultation with an expert here: https://www.upsolver.com/discover 🎓 Watch additional Iceberg eLearning modules here: https://www.upsolver.com/resources/iceberg-academy Description: In this video, we explore the process of migrating duplicate tables from Hive to Iceberg. Unlike a simple metadata-only operation, this method involves rewriting the data from the old Parquet files into new Iceberg tables. The original Hive tables remain intact, allowing for parallel operations without impacting downstream systems. The new Iceberg tables offer advanced features such as updates, deletions, transactions, and schema evolution. However, the process does involve temporary data duplication and requires additional compute resources. Once the migration is complete, the original Hive tables can be deleted to eliminate data redundancy.

Download

0 formats

No download links available.

Part 8 - Duplicate migration - Hive to Iceberg Tables Migration eLearning Module | NatokHD