Skip to content

Commit

Permalink
Zyp: Improve documentation
Browse files Browse the repository at this point in the history
  • Loading branch information
amotl committed Aug 11, 2024
1 parent d2f91b3 commit 0e9102c
Show file tree
Hide file tree
Showing 5 changed files with 22 additions and 8 deletions.
15 changes: 10 additions & 5 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,6 @@
[![License](https://img.shields.io/pypi/l/commons-codec.svg)](https://pypi.org/project/commons-codec/)

## About
Data decoding, encoding, conversion, and translation utilities.

> A codec is a device or computer program that encodes or decodes a data stream or signal.
> Codec is a portmanteau of coder/decoder.
Expand All @@ -21,13 +20,18 @@ Data decoding, encoding, conversion, and translation utilities.
> -- https://en.wikipedia.org/wiki/Codec
## What's Inside
- **Decoders:** A collection of reusable utilities with minimal dependencies for
transcoding purposes, mostly collected from other projects like
- [Zyp], a generic and compact **transformation engine** written in Python, for data
decoding, encoding, conversion, translation, transformation, and cleansing purposes,
to be used as a data processing pipeline element.

- **Transformer** components for converging [Change Data Capture (CDC)] messages to
SQL statements.

- A collection of reusable utilities with minimal dependencies for
**decoding and transcoding** purposes, mostly collected from other projects like
[Kotori](https://kotori.readthedocs.io/) and [LorryStream](https://lorrystream.readthedocs.io/),
in order to provide them per standalone package for broader use cases.

- Transformers for [Change Data Capture (CDC)] messages to SQL statements.

## Installation
The package is available from [PyPI] at [commons-codec].
To install the most recent version, run:
Expand Down Expand Up @@ -74,3 +78,4 @@ within the header sections of relevant files.
[managed on GitHub]: https://github.com/daq-tools/commons-codec
[prior art]: https://commons-codec.readthedocs.io/prior-art.html
[PyPI]: https://pypi.org/
[Zyp]: https://commons-codec.readthedocs.io/zyp/
3 changes: 2 additions & 1 deletion doc/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -23,7 +23,7 @@
| [LorryStream]

```{include} readme.md
:start-line: 12
:start-line: 11
```


Expand All @@ -32,6 +32,7 @@
:caption: Documentation
:hidden:
zyp/index
cdc/index
decode
```
Expand Down
File renamed without changes.
10 changes: 9 additions & 1 deletion docs/zyp/index.md → doc/zyp/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -165,10 +165,18 @@ post:
- [AWS DMS table selection and transformation rules]
- ... and many more. Thanks for the inspirations.
## Etymology
With kudos to [Kris Zyp] for conceiving [JSON Pointer].
## More
```{toctree}
:maxdepth: 1

research
backlog
```



[attrs]: https://www.attrs.org/
[AWS DMS source filter rules]: https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Tasks.CustomizingTasks.Filters.html
Expand Down
2 changes: 1 addition & 1 deletion docs/zyp/research.md → doc/zyp/research.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
# Transformer Ingredients Research
# Zyp Research

## Toolbox
- jq, jsonpointer, jmespath, funcy, morph, boltons, toolz
Expand Down

0 comments on commit 0e9102c

Please sign in to comment.