Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: create manifest.wall #142

Merged
merged 88 commits into from
Sep 30, 2024
Merged

feat: create manifest.wall #142

merged 88 commits into from
Sep 30, 2024

Commits on Jul 1, 2024

  1. feat: create manifest.wall 

    This commit adds support for the creation of the manifest.wall file. The
manifest file(s) are generated at the specified paths, marked with the
"generate: manifest" keyword. The files are ZSTD compressed and have the
basename "chisel.db". The format of the Chisel DB follows the RK009
spec.

Co-authored-by: Rafid Bin Mostofa <[email protected]>
    @letFunny @rebornplusplus
    letFunny and rebornplusplus committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    5e21a18 View commit details
    Browse the repository at this point in the history

Commits on Jul 2, 2024

  1. address review comments

    @letFunny
    letFunny committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    07ca4d7 View commit details
    Browse the repository at this point in the history

  2. feat: parse generate property in sdf 

    Co-authored-by: Rafid Bin Mostofa <[email protected]>
    @letFunny @rebornplusplus
    letFunny and rebornplusplus committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    af60a6f View commit details
    Browse the repository at this point in the history

  3. redo manifest package to not unmarshall everything

    @letFunny
    letFunny committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    55bd81d View commit details
    Browse the repository at this point in the history

  4. feat: internal manifest package

    @letFunny
    letFunny committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    e96e87b View commit details
    Browse the repository at this point in the history

  5. fix slicer tests

    @letFunny
    letFunny committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    26022fd View commit details
    Browse the repository at this point in the history

  6. lint errors

    @letFunny
    letFunny committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    dfba7b3 View commit details
    Browse the repository at this point in the history

  7. remove unnecessary constants

    @letFunny
    letFunny committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    1ea56d1 View commit details
    Browse the repository at this point in the history

Commits on Jul 3, 2024

  1. do not aggregate manifest twice for tests

    @letFunny
    letFunny committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    1f1177a View commit details
    Browse the repository at this point in the history

Commits on Jul 5, 2024

  1. minor rename

    @letFunny
    letFunny committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    fe51371 View commit details
    Browse the repository at this point in the history

  2. add generate to README

    @letFunny
    letFunny committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    655b17a View commit details
    Browse the repository at this point in the history

Commits on Jul 9, 2024

  1. make validate optional and use structs for prefixes

    @letFunny
    letFunny committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    401c86e View commit details
    Browse the repository at this point in the history

  2. indent manifest jsonwall in tests

    @letFunny
    letFunny committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    8600db6 View commit details
    Browse the repository at this point in the history

Commits on Jul 10, 2024

  1. address review comments

    @letFunny
    letFunny committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    e2c2645 View commit details
    Browse the repository at this point in the history

  2. change maps for structs with omitempty, jsonwall iterator

    @letFunny
    letFunny committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    140ab91 View commit details
    Browse the repository at this point in the history

  3. move path specification to function

    @letFunny
    letFunny committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    3faa139 View commit details
    Browse the repository at this point in the history

  4. remove redundant comment

    @letFunny
    letFunny committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    94ff54a View commit details
    Browse the repository at this point in the history

  5. conflict resolution works properly with generate and solve bugfix

    @letFunny
    letFunny committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    131472b View commit details
    Browse the repository at this point in the history

  6. make GetGeneratePath private and change name

    @letFunny
    letFunny committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    b8f91bf View commit details
    Browse the repository at this point in the history

  7. remove incomplete error messages

    @letFunny
    letFunny committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    426ca94 View commit details
    Browse the repository at this point in the history

  8. performance optimization

    @letFunny
    letFunny committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    e16eb2e View commit details
    Browse the repository at this point in the history

  9. remove redundant check that could never occur

    @letFunny
    letFunny committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    eff44b1 View commit details
    Browse the repository at this point in the history

  10. avoid using slices.Concat which is not in Go 1.21

    @letFunny
    letFunny committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    01f01f2 View commit details
    Browse the repository at this point in the history

Commits on Jul 12, 2024

  1. refactor manifest iteration with generic helper

    @letFunny
    letFunny committed Jul 12, 2024
    Configuration menu
    Copy the full SHA
    2ee0286 View commit details
    Browse the repository at this point in the history

  2. restrict generic with interface union type

    @letFunny
    letFunny committed Jul 12, 2024
    Configuration menu
    Copy the full SHA
    a0200f1 View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2024

  1. feat: add IterateContents

    @letFunny
    letFunny committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    cdaf78d View commit details
    Browse the repository at this point in the history

  2. feat: use higher level API internally in manifest.Validate

    @letFunny
    letFunny committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    efa9b44 View commit details
    Browse the repository at this point in the history

  3. validate schema when reading manifest

    @letFunny
    letFunny committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    e6f38d9 View commit details
    Browse the repository at this point in the history

  4. reword comment per PR suggestion

    @letFunny
    letFunny committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    7e19d3f View commit details
    Browse the repository at this point in the history

Commits on Aug 5, 2024

  1. TODO

    @letFunny
    letFunny committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    f41c82b View commit details
    Browse the repository at this point in the history

  2. duplication is not an error

    @letFunny
    letFunny committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    48d58ee View commit details
    Browse the repository at this point in the history

Commits on Aug 6, 2024

  1. duplication is ub, not allowed

    @letFunny
    letFunny committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    101c3d4 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into chisel-db-manifest-package

    @letFunny
    letFunny committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    89174b4 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into chisel-db-parse-generate

    @letFunny
    letFunny committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    301f506 View commit details
    Browse the repository at this point in the history

Commits on Aug 8, 2024

  1. documentation and move code for better readability

    @letFunny
    letFunny committed Aug 8, 2024
    Configuration menu
    Copy the full SHA
    49950a0 View commit details
    Browse the repository at this point in the history

Commits on Aug 12, 2024

  1. Merge branch 'chisel-db-manifest-package' into chisel-db-create-manifest

    @letFunny
    letFunny committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    597e3ad View commit details
    Browse the repository at this point in the history

Commits on Aug 13, 2024

  1. validate manifest entry, TODO

    @letFunny
    letFunny committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    c4aa806 View commit details
    Browse the repository at this point in the history

Commits on Aug 19, 2024

  1. pass by pointer instead of value

    @letFunny
    letFunny committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    481f69f View commit details
    Browse the repository at this point in the history

  2. use double quotes

    @letFunny
    letFunny committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    56dd49c View commit details
    Browse the repository at this point in the history

  3. Read takes io.Reader

    @letFunny
    letFunny committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    8dfcd2b View commit details
    Browse the repository at this point in the history

  4. remove unnecessary zstd for manifest_test

    @letFunny
    letFunny committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    4e0e33b View commit details
    Browse the repository at this point in the history

  5. address other review comments

    @letFunny
    letFunny committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    58531e9 View commit details
    Browse the repository at this point in the history

  6. rework algorithm to avoid all the copying into slices

    @letFunny
    letFunny committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    8fa3b3d View commit details
    Browse the repository at this point in the history

Commits on Aug 20, 2024

  1. last version of the conflict resolution algorithm

    @letFunny
    letFunny committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    b06fdd1 View commit details
    Browse the repository at this point in the history

Commits on Aug 21, 2024

  1. make failure string order deterministic

    @letFunny
    letFunny committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    1cd1fe1 View commit details
    Browse the repository at this point in the history

Commits on Aug 27, 2024

  1. remove unnecessary comment and add note about transitiveness

    @letFunny
    letFunny committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    659218f View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2024

  1. address review comments

    @letFunny
    letFunny committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    53c0785 View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2024

  1. Merge branch 'chisel-db-parse-generate' into chisel-db-create-manifest

    @letFunny
    letFunny committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    e84a5d7 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'chisel-db-manifest-package' into chisel-db-create-manifest

    @letFunny
    letFunny committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    14850bf View commit details
    Browse the repository at this point in the history

  3. working

    @letFunny
    letFunny committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    391119e View commit details
    Browse the repository at this point in the history

  4. test mode of manifest

    @letFunny
    letFunny committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    154697b View commit details
    Browse the repository at this point in the history

  5. simplify removing extra type

    @letFunny
    letFunny committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    cc5b6de View commit details
    Browse the repository at this point in the history

  6. typo

    @letFunny
    letFunny committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    6ad27a1 View commit details
    Browse the repository at this point in the history

  7. simplify

    @letFunny
    letFunny committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    475a2c5 View commit details
    Browse the repository at this point in the history

  8. remove redundant comments

    @letFunny
    letFunny committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    c7e9693 View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2024

  1. Merge branch 'main' into chisel-db-create-manifest

    @letFunny
    letFunny committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    ac59f75 View commit details
    Browse the repository at this point in the history

  2. lint

    @letFunny
    letFunny committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    c6f925d View commit details
    Browse the repository at this point in the history

  3. simplify

    @letFunny
    letFunny committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    9e2ecfb View commit details
    Browse the repository at this point in the history

  4. bugfix: proper until calculation for content created outside packages

    @letFunny
    letFunny committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    ee83c93 View commit details
    Browse the repository at this point in the history

  5. remove redundant comments

    @letFunny
    letFunny committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    cb3db41 View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2024

  1. Merge branch 'main' into chisel-db-create-manifest

    @letFunny
    letFunny committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    93a2218 View commit details
    Browse the repository at this point in the history

  2. tidy up

    @letFunny
    letFunny committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    a9528bd View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2024

  1. move reading manifest to auxiliary function

    @letFunny
    letFunny committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    3fb0904 View commit details
    Browse the repository at this point in the history

  2. testutil.Archive pkgs -> packages

    @letFunny
    letFunny committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    f123d37 View commit details
    Browse the repository at this point in the history

Commits on Sep 23, 2024

  1. make manifest.{FileMode,FileName} private

    @letFunny
    letFunny committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    d6e048b View commit details
    Browse the repository at this point in the history

  2. archive.Fetch returns PackageInfo

    @letFunny
    letFunny committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    687b21e View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2024

  1. test for slicer not generating a manifest

    @letFunny
    letFunny committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    212eb46 View commit details
    Browse the repository at this point in the history

  2. rename Hash -> SHA256

    @letFunny
    letFunny committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    a662826 View commit details
    Browse the repository at this point in the history

  3. reword comment

    @letFunny
    letFunny committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    8a64032 View commit details
    Browse the repository at this point in the history

  4. move manifest creation to small functions

    @letFunny
    letFunny committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    293fd06 View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2024

  1. make LocateManifestSlices public and tested

    @letFunny
    letFunny committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    9b03b95 View commit details
    Browse the repository at this point in the history

  2. lint: remove unused variable

    @letFunny
    letFunny committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    962566a View commit details
    Browse the repository at this point in the history

  3. add comment to clarify conflict resolution

    @letFunny
    letFunny committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    aaf70b1 View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2024

  1. move info logic into helper function

    @letFunny
    letFunny committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    189a3bf View commit details
    Browse the repository at this point in the history

  2. move report and generateManifest to manifest package

    @letFunny
    letFunny committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    7fa6ee9 View commit details
    Browse the repository at this point in the history

  3. lint: check error of WalkDir function

    @letFunny
    letFunny committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    07a0549 View commit details
    Browse the repository at this point in the history

Commits on Sep 29, 2024

  1. manifest.Write interface accepts a Writer

    @letFunny
    letFunny committed Sep 29, 2024
    Configuration menu
    Copy the full SHA
    573427c View commit details
    Browse the repository at this point in the history

Commits on Sep 30, 2024

  1. lint: check error in tests

    @letFunny
    letFunny committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    f9d1aaf View commit details
    Browse the repository at this point in the history

  2. create report entries for the manifest files to unify logic

    @letFunny
    letFunny committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    dad0ed7 View commit details
    Browse the repository at this point in the history

  3. rename LocateManifestSlices to FindPaths

    @letFunny
    letFunny committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    087d09d View commit details
    Browse the repository at this point in the history

  4. manifestAddReport now takes Report

    @letFunny
    letFunny committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    a0920b5 View commit details
    Browse the repository at this point in the history

  5. better root handling report

    @letFunny
    letFunny committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    2a0371c View commit details
    Browse the repository at this point in the history

  6. Hash -> SHA256

    @letFunny
    letFunny committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    86c6e7b View commit details
    Browse the repository at this point in the history

  7. move manifest generation to auxiliary function

    @letFunny
    letFunny committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    e070332 View commit details
    Browse the repository at this point in the history

  8. better comment

    @letFunny
    letFunny committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    b39cfe7 View commit details
    Browse the repository at this point in the history

  9. default manifest filename for FindPaths

    @letFunny
    letFunny committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    8445042 View commit details
    Browse the repository at this point in the history

  10. remove unused ManifestSlices

    @letFunny
    letFunny committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    a9ee6ac View commit details
    Browse the repository at this point in the history

  11. report cannot be null when writing manifest

    @letFunny
    letFunny committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    88a11fa View commit details
    Browse the repository at this point in the history