Code

WIP: [Feat] Iceberg writer#113

Code

Open

shubham19may wants to merge 23 commits intomasterdatazip-inc/olake:masterfrom feat/iceberg-writerdatazip-inc/olake:feat/iceberg-writerCopy head branch name to clipboard

+5,954-17

Commits

Commits on Feb 24, 2025

• Fixed merge conflict

  Show description for 1eaff9c
  shubham19may

  committed
  1eaff9c

  Copy full SHA for 1eaff9c

Commits on Feb 26, 2025

• Refactored code a bit to make it more clean

  shubham19may

  committed
  6300803

  Copy full SHA for 6300803

• Fixed merge conflict

  Show description for c175ebe
  shubham19may

  committed
  c175ebe

  Copy full SHA for c175ebe

• Refactored code a bit to make it more clean

  shubham19may

  committed
  32861cf

  Copy full SHA for 32861cf

• Made RPC server per stream and added batching logic to only push data files > 256mb to iceberg

  shubham19may

  committed
  d2f532a

  Copy full SHA for d2f532a

• Fixed merge conflicts

  shubham19may

  committed
  8f41dc5

  Copy full SHA for 8f41dc5

• Increased the RPC deadline window

  shubham19may

  committed
  00071bc

  Copy full SHA for 00071bc

Commits on Feb 27, 2025

• Added the normalisation

  shubham19may

  committed
  a414e5d

  Copy full SHA for a414e5d

Commits on Mar 3, 2025

• Iceberg-writer code integrated in Olake

  shubham19may

  committed
  f3b580e

  Copy full SHA for f3b580e

• Updated the target path

  shubham19may

  committed
  9e6f9d0

  Copy full SHA for 9e6f9d0

• Commiting legal notices

  shubham19may

  committed
  dd13ed9

  Copy full SHA for dd13ed9

• Merge conflict fix

  shubham19may

  committed
  8838a94

  Copy full SHA for 8838a94

• Fixed release file

  shubham19may

  committed
  fc1b595

  Copy full SHA for fc1b595

• Upgraded java version in github ci

  shubham19may

  committed
  cd19a86

  Copy full SHA for cd19a86

Commits on Mar 4, 2025

• Fixing java build by downgrading java version

  shubham19may

  committed
  1efd5a8

  Copy full SHA for 1efd5a8

• Temporary login for jar figuring out part

  shubham19may

  committed
  fdda0d9

  Copy full SHA for fdda0d9

Commits on Mar 5, 2025

• Setup the java process logs for getting the iceberg logs in golang logs

  shubham19may

  committed
  cbb1254

  Copy full SHA for cbb1254

Commits on Mar 6, 2025

• Added readme for the java-iceberg code

  shubham19may

  committed
  403202b

  Copy full SHA for 403202b

• Removed retry logic for Iceberg and added a lock based commit

  shubham19may

  committed
  b3e7fda

  Copy full SHA for b3e7fda

• Added Iceberg writer readme for glue configuration

  shubham19may

  committed
  1aba145

  Copy full SHA for 1aba145

• Removed debezium dependencies and classes/tests

  shubham19may

  committed
  20a231a

  Copy full SHA for 20a231a

Commits on Mar 7, 2025

• Merge branch 'master' into feat/iceberg-writer

  shubham19may

  committed
  eeb7794

  Copy full SHA for eeb7794

• Added faster ingestion for Iceberg java code

  shubham19may

  committed
  b9fa0b0

  Copy full SHA for b9fa0b0