CachingSpec: A dataset to CRUD + Unlike DeltaLake, Iceberg does not freeze data in time after a call to .cache() - should create the appropriate Iceberg files + Given data files Datum(0,label_0,0,2024-11-15,2024-11-15 16:48:19.792) Datum(1,label_1,1,2024-11-14,2024-11-15 16:48:19.992) Datum(2,label_2,2,2024-11-13,2024-11-15 16:48:20.192) ... + When we cache one Dataset and then append more data to the same table + Then reading via a new Dataset reference shows the appended data + And the old, cached reference still sees the old snapshot of data + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +