Code

fix: Working on Writer#14

Code

Merged

piyushdatazip merged 63 commits intomasterdatazip-inc/olake:masterfrom fraugsterdatazip-inc/olake:fraugsterCopy head branch name to clipboardDec 8, 2024

+552-7,264

Commits

Commits on Nov 4, 2024

• adding mongodb skeleton

  piyushdatazip

  committed
  0421068

  Copy full SHA for 0421068

• Working on full load

  piyushdatazip

  committed
  4895cf0

  Copy full SHA for 4895cf0

Commits on Nov 5, 2024

• Working on Adapters

  piyushdatazip

  committed
  c2f6d5d

  Copy full SHA for c2f6d5d

Commits on Nov 7, 2024

• Local writer and rework

  piyushdatazip

  committed
  12861be

  Copy full SHA for 12861be

• Added logic to respawnWriter on schema evolution

  piyushdatazip

  committed
  e8d5350

  Copy full SHA for e8d5350

• minor rewrite

  piyushdatazip

  committed
  402b11b

  Copy full SHA for 402b11b

• mongo cdc and discover

  hash-data

  committed
  b24acba

  Copy full SHA for b24acba

• Merge branch 'feat/mongo_cdc' into adapters

  piyushdatazip

  committed
  52c46ac

  Copy full SHA for 52c46ac

• remove setup from mongo

  piyushdatazip

  committed
  6dfd39e

  Copy full SHA for 6dfd39e

• gomod resolved

  piyushdatazip

  committed
  7b3f35b

  Copy full SHA for 7b3f35b

• chore: wip for discover testing required

  hash-data

  committed
  096e323

  Copy full SHA for 096e323

Commits on Nov 8, 2024

• Minor renaming

  piyushdatazip

  committed
  428508a

  Copy full SHA for 428508a

• feat: Timestamp precision in DataTypes (#7)

  piyushdatazip

  authored
  489c9f9

  Copy full SHA for 489c9f9

• rename CMD and unexpose CLI commands

  Show description for 655f3cc
  piyushdatazip

  committed
  655f3cc

  Copy full SHA for 655f3cc

• Merge branch 'adapters' of https://github.com/datazip-inc/olake into feat/mongo-cdc

  hash-data

  committed
  6c18ced

  Copy full SHA for 6c18ced

Commits on Nov 13, 2024

• feat: MongoDB Full-Load (#5)

  Show description for 2c41cc7
  

  piyushdatazip

  and

  hash-data

  authored
  2c41cc7

  Copy full SHA for 2c41cc7

• feat: discover command running success

  hash-data

  committed
  5693351

  Copy full SHA for 5693351

• chore: remove unnecessary print

  hash-data

  committed
  946adc1

  Copy full SHA for 946adc1

• reworked state

  Show description for 796fcbe
  piyushdatazip

  committed
  796fcbe

  Copy full SHA for 796fcbe

Commits on Nov 14, 2024

• Merge branch 'mongodb' into feat/mongo-cdc

  Show description for b8de01a
  piyushdatazip

  committed
  b8de01a

  Copy full SHA for b8de01a

• TypeSchema changes

  Show description for c4c19db
  piyushdatazip

  committed
  c4c19db

  Copy full SHA for c4c19db

• rewrote discover for mongodb

  Show description for ea819eb
  piyushdatazip

  committed
  ea819eb

  Copy full SHA for ea819eb

• delete state keys function

  Show description for 5b227da
  piyushdatazip

  committed
  5b227da

  Copy full SHA for 5b227da

• adding Setup call in discover

  Show description for a788dc7
  piyushdatazip

  committed
  a788dc7

  Copy full SHA for a788dc7

• fix discover

  Show description for 0401da0
  piyushdatazip

  committed
  0401da0

  Copy full SHA for 0401da0

• minor change in TypeFromValue

  Show description for e334943
  piyushdatazip

  committed
  e334943

  Copy full SHA for e334943

Commits on Nov 18, 2024

• fixed loggin for catalog

  Show description for 41479d3
  piyushdatazip

  committed
  41479d3

  Copy full SHA for 41479d3

• Registering Local Writer

  Show description for 59e4b6d
  piyushdatazip

  committed
  59e4b6d

  Copy full SHA for 59e4b6d

Commits on Nov 19, 2024

• feat: cdc run success

  hash-data

  committed
  31cbf9b

  Copy full SHA for 31cbf9b

• readme update

  hash-data

  committed
  2102412

  Copy full SHA for 2102412

Commits on Nov 21, 2024

• chore: remove testing sleep time

  hash-data

  committed
  2dddb56

  Copy full SHA for 2dddb56

• chore: time package removal

  hash-data

  committed
  9dbcda5

  Copy full SHA for 9dbcda5

Commits on Nov 25, 2024

• [WIP] First working draft of local parquet writer added (#10)

  Show description for bf98368
  

  shubham19may

  and

  piyushdatazip

  authored
  bf98368

  Copy full SHA for bf98368

• fixing ULID issue

  Show description for 43c46df
  piyushdatazip

  committed
  43c46df

  Copy full SHA for 43c46df

• local writer is working

  Show description for a0e948d
  piyushdatazip

  committed
  a0e948d

  Copy full SHA for a0e948d

• Changes before testing new parquet library

  Show description for fc9652c
  piyushdatazip

  committed
  fc9652c

  Copy full SHA for fc9652c

• Working with fraugster

  piyushdatazip

  committed
  b4cb5e7

  Copy full SHA for b4cb5e7

• Facing Invalid mem address

  Show description for da6c6d4
  piyushdatazip

  committed
  da6c6d4

  Copy full SHA for da6c6d4

Commits on Nov 27, 2024

• Seems to be working but half-assed

  Show description for 7fc5605
  piyushdatazip

  committed
  7fc5605

  Copy full SHA for 7fc5605

• minor fixes and methods on Field

  Show description for 97d6cc0
  piyushdatazip

  committed
  97d6cc0

  Copy full SHA for 97d6cc0

• altering Writers middleware

  Show description for bb2348e
  piyushdatazip

  committed
  bb2348e

  Copy full SHA for bb2348e

Commits on Nov 28, 2024

• testin rn

  Show description for b67cb40
  piyushdatazip

  committed
  b67cb40

  Copy full SHA for b67cb40

• Working now

  Show description for 2287e32
  piyushdatazip

  committed
  2287e32

  Copy full SHA for 2287e32

• altering back to single records

  Show description for 398dce1
  piyushdatazip

  committed
  398dce1

  Copy full SHA for 398dce1

• resetting mongodb

  Show description for e0cf617
  piyushdatazip

  committed
  e0cf617

  Copy full SHA for e0cf617

• done with local writing

  Show description for 161d78e
  piyushdatazip

  committed
  161d78e

  Copy full SHA for 161d78e

Commits on Nov 29, 2024

• adding few logs

  Show description for ceaed28
  piyushdatazip

  committed
  ceaed28

  Copy full SHA for ceaed28

• Adding ThreadOptions

  Show description for 2e655c8
  piyushdatazip

  committed
  2e655c8

  Copy full SHA for 2e655c8

Commits on Nov 30, 2024

• adding memory locking

  Show description for 183c52a
  piyushdatazip

  committed
  183c52a

  Copy full SHA for 183c52a

• replace encoding/json with goccy

  Show description for f791ac4
  piyushdatazip

  committed
  f791ac4

  Copy full SHA for f791ac4

Commits on Dec 2, 2024

• memory locks

  Show description for bf6813d
  piyushdatazip

  committed
  bf6813d

  Copy full SHA for bf6813d

Commits on Dec 6, 2024

• handle blocking of middleware on backend because of writer.Writer exit

  Show description for 9d4500f
  piyushdatazip

  committed
  9d4500f

  Copy full SHA for 9d4500f

• removed errorf

  Show description for 459fcc5
  piyushdatazip

  committed
  459fcc5

  Copy full SHA for 459fcc5

• shift the comment to correct position

  Show description for 041d08c
  piyushdatazip

  committed
  041d08c

  Copy full SHA for 041d08c

Commits on Dec 7, 2024

• resetting writers configurations

  Show description for 71b1a0a
  piyushdatazip

  committed
  71b1a0a

  Copy full SHA for 71b1a0a

Commits on Dec 8, 2024

• Merge branch 'master' into fraugster

  Show description for 5a5a5b1
  piyushdatazip

  committed
  5a5a5b1

  Copy full SHA for 5a5a5b1

• deleting go.sum files

  Show description for 280564e
  piyushdatazip

  committed
  280564e

  Copy full SHA for 280564e

• ignore .sum files

  Show description for 3343f03
  piyushdatazip

  committed
  3343f03

  Copy full SHA for 3343f03

• Merge branch 'master' into fraugster

  Show description for 762cdb1
  piyushdatazip

  committed
  762cdb1

  Copy full SHA for 762cdb1

• deleting go.sum

  Show description for 1b1ac91
  piyushdatazip

  committed
  1b1ac91

  Copy full SHA for 1b1ac91

• Adding validation in olake

  Show description for 6efb0fa
  piyushdatazip

  committed
  6efb0fa

  Copy full SHA for 6efb0fa

• setting up validation checks in olake

  Show description for 93703dc
  piyushdatazip

  committed
  93703dc

  Copy full SHA for 93703dc

• interface fix

  Show description for b9af6a4
  piyushdatazip

  committed
  b9af6a4

  Copy full SHA for b9af6a4